NDIF
@ndif_team
The National Deep Inference Fabric, an NSF-funded computational infrastructure to enable research on large-scale Artificial Intelligence. https://ndif.us/
Great to present what’s coming next for NDIF at the @actinterp workshop at #ICML2025! If you missed us, let’s chat after the conference. Reach out here: forms.gle/AhTSBNNttA11JV…
Excited to share our first paper replication tutorial, walking you through the main figures from "Do Language Models Use Their Depth Efficiently?" by @robert_csordas. 🔎 Demo on Colab: colab.research.google.com/github/ndif-te… 📖 Read the full manuscript: arxiv.org/abs/2505.13898
Your language model is wasting half of its layers to just refine probability distributions rather than doing interesting computations. In our paper, we found that the second half of the layers of the Llama 3 models have minimal effect on future computations. 1/6
Join us for the NEMI Workshop on August 22nd in Boston! Spaces are limited, so register soon. We can't wait to see you there!
🚨 Registration is live! 🚨 The New England Mechanistic Interpretability (NEMI) Workshop is happening August 22nd 2025 at Northeastern University! A chance for the mech interp community to nerd out on how models really work 🧠🤖 🌐 Info: nemiconf.github.io/summer25/ 📝 Register:…
Some great thoughts on the importance of emphasizing interpretability and transparency in future US AI policy and the role of initiatives like NDIF in supporting such efforts.
Why is interpretability the key to dominance in AI? Not winning the scaling race, or banning China. Our answer to OSTP/NSF, w/ Goodfire's @banburismus_ Transluce's @cogconfluence MIT's @dhadfieldmenell resilience.baulab.info/docs/AI_Action… Here's why:🧵 ↘️
ARBOR has launched! ARBOR is a research community focused on studying AI reasoning models, like DeepSeek R1. If you’d like to contribute, NDIF is hosting DeepSeek R1 8B and 70B for researchers to experiment on at no cost. Sign up for API access here: login.ndif.us
Today we launch a new open research community with @wattenberg @viegasf @jacobandreas Ellie Pavlick @Brown_NLP and many others It is called ARBOR. please join us. 🧵