Follow

TIL: "attention" term was coined a few years before the "Attention is all you need" article.
It first appeared in a 2015 paper from Y. Bengio's group, and it (apparently) wasn't even supposed to become a name of this technique.

Sign in to participate in the conversation
Qoto Mastodon

QOTO: Question Others to Teach Ourselves
An inclusive, Academic Freedom, instance
All cultures welcome.
Hate speech and harassment strictly forbidden.