MLINFO COLLECTION

深層学習

記事一覧

32 / 45
arxiv

Reader--Writer Coupling in Transformer MLPs

A transformer MLP gives each hidden channel two roles: a reader that decides when the channel responds, and a writer that decides what it adds back to the residual stream. Read as a key--value…

deep-learning