The original comparison of Adam vs AdamW is quite memorable.

On a related note, I absolutely recommend reading through reviews of that publication
openreview.net/forum?id=rk6qdG

Try out your best approaches, and see you at the leaderboards!
BTW, just a reminder: @AI21Labs's models are legal in the challenge


---
RT @CAMDA_conf
Final call for abstracts. Present your best work at @ISMBinfo: Take the Camda Challenge – Literature AI, Anti-microbial Resistance, Disease Maps – or share late breaking method papers! Extended abstracts 20 May. 👉camda.info @IARAInews @e
twitter.com/CAMDA_conf/status/

Ahh, the bliss of finding a bug in the function that you've used to optimise hyperparams for the past week.
It's nearly as pleasant as stubbing your toe on a screwdriver's pointy end.

RT @pawel_labaj
Join us @MCB_UJ as postDoc to apply techniques to understand the microbial intra-community synergies! Work with @TomaszLabMCB @RafalMostowy @mason_lab @Daniela_Bezdan @chmoei @akkah21 @metasub More tinyurl.com/PaweLab Deadline Dec 17th @JagiellonskiUni @krakow_pl

Qoto Mastodon

QOTO: Question Others to Teach Ourselves
An inclusive, Academic Freedom, instance
All cultures welcome.
Hate speech and harassment strictly forbidden.