Andreas Madsen
@andreas_madsen
Ph.D. in NLP Interpretability from Mila. Previously, independent researcher + freelancer in ML and Node.js core developer.
Spotlight award at ICML 2024. Introducing a new direction for interpretability: Faithfulness Measurable Models. 2x-5x better explanations, more accurate faithfulness metrics, no cost, and optimal explanations. Paper: arxiv.org/abs/2401.07927. Hall C 4-9, 24 Jul (11:30 - 13:00).
In my lab, we have not one but four open postdoc positions! These positions cover developing foundation models for text, proteins, small molecules, genomic data, time series data, and astrophysics data! If you have strong research expertise and a PhD in LLMs and Foundation…
Check out the latest article in my newsletter: The Dragons Algorithm: I Saw the Future in China, and Its Already Happening linkedin.com/pulse/dragons-… via @LinkedIn
Python; calling it "t-string", is just troublesome when I need to lookup documentation at work.
Interpretable Lobsters at #ICLR2025 🦞 🦞 Come by poster #504!
Very special being back in Montreal ✨ Huge thank you to @hugo_larochelle @apsarathchandar Marc-Alexandre Cote for bringing us together for MILA techaide.
hearing “I’ve never really thought about signed language before but your talk made me want to work on it” is the biggest compliment!! maybe my talks are all recruitment pitches disguised as research talks
A new BERT baby! If you are still using the huge RoBERTa or DeBERTa for your NLP tasks, here's NeoBERT!
Congratuations to Lola (@lo_LB_La) and Sarath (@apsarathchandar) Read their blog post: mila.quebec/en/article/neo…
2025 BERT is NeoBERT! We have fully pre-trained a next-generation encoder for 2.1T tokens with the latest advances in data, training, and architecture. This is a heroic effort from my PhD student @lo_LB_La in collaboration with @qfournier2 and Mariam El Mezouar (1/n)
What's the foundational model for generative chemistry? Our work, BindGPT, is a good candidate, and it will be presented at #AAAI2025 today! We built a simple transformer language model that beats diffusion models by just generating 3D molecules as text! Led by @artemZholus 1/n
This is very sad news. @FelixHill84 reached out to me during my time as an independent researcher because he wanted to collaborate with me on some ideas. This was the first time anyone well-known had ever wanted to work with me, so I was deeply appreciative. Felix was always…
I’m really sad that my dear friend @FelixHill84 is no longer with us. He had many friends and colleagues all over the world - to try to ensure we reach them, his family have asked to share this webpage for the celebration of his life: pp.events/felix
I would highly recommend this lab! Consider joining if you are interested in NLP.
I have multiple vacancies for PhD and Masters students at @Mila_Quebec @McGill_NLP in NLP/ML focusing on representation learning, reasoning, multimodality and alignment. Deadline for applications is Dec 1st. More details: mila.quebec/en/prospective…