Elena Rivas @elenarivas@qoto.org

I found the papers "Scaling Laws for Neural Language Models" (OpenAI, 2020) and "Training Compute-Optimal Large Language Models" (DeepMind, 2022) interesting:
https://arxiv.org/pdf/2001.08361.pdf
https://arxiv.org/pdf/2203.15556.pdf
They do a LOT of experiments training large language models (causal transformers) with varying hyperparameters, in particular model size, shape, batch size, and training data set size over many orders of magnitude. 1/?

If you don't yet know about the beautiful work done by
@nervous_jessica and @nervous_jesse, today's New York Times has a lovely article about them: https://www.nytimes.com/2022/12/09/science/puzzles-jigsaw-math.html?unlocked_article_code=AAAAAAAAAAAAAAAACEIPuonUktbfqYhlSlUbCibOVtkqqBaLwuDS0q44i2S7LimaUj9diuEcH4jG-1vIYeArQeoP6AmhZY0LNq4zFrs1x_VDPkdpRk70qJbfxs0JfWBvpNPpGz5shsOIVOs2_XqyYzG1I-l1yOXm7xjMeCK9DvykpH4qJwtjpJRnfUj7miBbg_eYTZMmn4V2zvwjBZtlRTwfZSnsv_fgChp2PdTufQiLo0BtGLkfAWeP6Ibav7EQcwxSCkbFT2d_4ws_7tBeP9ARNcXvPm0w3V2AwCkf1F9ciNcGt5o&smid=nytcore-ios-share&referringSource=articleShare

(Also a nice shout out to an algorithm developed by my former PhD student Nick Sharp.)

For #women in #science, our work often gets framed in a way that focuses on gender. It’s not a bad thing, but there’s so much more to who we are.

Many of us didn’t set out trying to be “females in science” so much as simply “scientists” doing research we love.

Our contributions are frequently less about shattering glass ceilings, and more about succeeding at institutions that weren’t built by us or for us.

We're thrilled & grateful that our software GSVA has been funded by the Chan Zuckerberg Initiative. This grant will enable giving a much needed upgrade to GSVA that will improve its scalability, robustness and documentation thru this open position https://functionalgenomics.github.io/jobads Please RT!!

JOB ALERT (please reblog) -->

Molecular biologist for zebrafish at Janelia Research Campus, HHMI:

https://hhmi.wd1.myworkdayjobs.com/en-US/External/job/Janelia-Research-Campus/Research-Specialist---Ahrens-Lab--Molecular-Biology_R-1568

How to migrate from one Mastodon server to another without losing followers:

1. Sign up on new server
2. On NEW server: Go to Account -> Moving FROM another account
3. Enter old account's handle
4. On OLD server: Go to Account -> Moving TO another account
5. Enter new account's handle and submit

#YoMigroaMastodon

My first toot.

I'm eligible to apply for a diversity supplement for my NIH grant (https://grants.nih.gov/grants/guide/pa-files/PA-21-071.html). If you fall into an underrepresented group, are interested in building computational/ML methods for genomics, and are looking for a postdoc next year, get in touch! (note: in computing, women are underrepresented!) Please boost

I wrote a quick introduction to Mastodon, meant for beginners and with a particular emphasis on scientists. Feel free to share with your community outside of Mastodon!

https://giorgio.gilest.ro/2022/11/05/mastodon-an-introduction-for-beginners-and-for-scientists/

I'd better do another #introduction with the new influx of folx into #fediverse.

Hi, I'm Dave. I'm a staff #Scientist at a biomedical Research Institute in #London, #UK

I'm a #StructuralBiologist by training. I help run a group that studies #Kinase #signaling in human #health and #disease.

I do #Crystallography #CryoEM #Biophysics #DrugDesign and #Glycobiology. #Science

On theoretical neural circuits for counting, and their biological implementation in the #Drosophila brain:

"Our second model uses anti-Hebbian plasticity and only tracks frequencies within four count categories (“1-2-3-many”) ... we show that an implementation of the “1-2-3-many” count sketch exists in the insect mushroom body."

From: "A neural theory for counting memories" by Dasgupta et al. 2022 https://www.nature.com/articles/s41467-022-33577-2

HT @andrew_c_lin

We are looking for postdocs! (1) To study how brainwide neuronal activity supports diverse behaviors (w Kenneth Harris); (2) To relate the activity of a neuron to its pre- and postsynaptic neurons across cortex (w Alipasha Vaziri and Federico Rossi). https://tinyurl.com/CortexlabPostdoc