TIL: "attention" term was coined a few years before the "Attention is all you need" article. It first appeared in a 2015 paper from Y. Bengio's group, and it (apparently) wasn't even supposed to become a name of this technique.
QOTO: Question Others to Teach Ourselves An inclusive, Academic Freedom, instance All cultures welcome. Hate speech and harassment strictly forbidden.