arXiv - CSCL: "GQA: Training Generalized Multi-Query Transformer…" - Qoto Mastodon

arXiv - CSCL @arxiv_cscl@qoto.org

GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints. (arXiv:2305.13245v2 [cs.CL] UPDATED)

http://arxiv.org/abs/2305.13245 #arXiv #NLProc

Oct 25, 2023, 03:18 · · arxiv-cscl · · ·

Sign in to participate in the conversation