arXiv - CSCL: "The Lazy Neuron Phenomenon: On Emergence of Activ…" - Qoto Mastodon

arXiv - CSCL @arxiv_cscl@qoto.org

The Lazy Neuron Phenomenon: On Emergence of Activation Sparsity in Transformers. (arXiv:2210.06313v2 [cs.LG] UPDATED)

http://arxiv.org/abs/2210.06313 #arXiv #NLProc

Jun 13, 2023, 03:19 · · arxiv-cscl · · ·

Sign in to participate in the conversation