wild how researchers are like, “ya know, the problem is matrix multiplication, lets just not do that part”, and it works great

i imagine #nvidia is watching this with anticipation and anxiety and will probably manage to completely miss the development, because big companies aren’t that good at changing course

#LLMs #ai
https://arstechnica.com/information-technology/2024/06/researchers-upend-ai-status-quo-by-eliminating-matrix-multiplication-in-llms/