BlackboxNLP
@BlackboxNLP
The leading workshop on analysing and interpreting neural networks for NLP Co-located with EMNLP 2025 in Suzhou, China
Just 10 days to go until the results submission deadline for the MIB Shared Task at #BlackboxNLP! If you're working on: ๐ง Circuit discovery ๐ Feature attribution ๐งช Causal variable localization nowโs the time to polish and submit! Join us on Discord: discord.gg/n5uwjQcxPR
Are you attending ICML? ๐ I'm sadly not, but if you are, you should check out the MIB ๐ถ๏ธposter at 11AM icml.cc/virtual/2025/pโฆ The benchmark is used as the shared task at this year's @BlackboxNLP (blackboxnlp.github.io/2025/task/) - there's still time to participate ๐
Lots of progress in mech interp (MI) lately! But how can we measure when new mech interp methods yield real improvements over prior work? We propose ๐ ๐ ๐๐: a Mechanistic Interpretability Benchmark!
โณ Three weeks left! Submit your work to the MIB Shared Task at #BlackboxNLP, co-located with @emnlpmeeting Whether you're working on circuit discovery or causal variable localization, this is your chance to benchmark your method in a rigorous setup!
Have you started working on your submission for the MIB shared task yet? Tell us what youโre exploring! New featurization methods? Circuit pruning? Better feature attribution? We'd love to hear about it ๐
New to mechanistic interpretability? The MIB shared task is a great opportunity to experiment: โ Clean setup โ Open baseline code โ Standard evaluation Join the discord server for ideas and discussions: discord.gg/n5uwjQcxPR
The wait is over! ๐ Our speakers for #BlackboxNLP 2025 are finally out!
๐จ Excited to announce two invited speakers at #BlackboxNLP 2025! Join us to hear from two leading voices in interpretability: ๐๏ธ Quanshi Zhang (Shanghai Jiao Tong University) ๐๏ธ Verna Dankers (McGill University) @vernadankers @QuanshiZhang
๐จ Excited to announce two invited speakers at #BlackboxNLP 2025! Join us to hear from two leading voices in interpretability: ๐๏ธ Quanshi Zhang (Shanghai Jiao Tong University) ๐๏ธ Verna Dankers (McGill University) @vernadankers @QuanshiZhang
Working on the MIB shared task? Join the discord server: discord.gg/n5uwjQcxPR ๐ Check out submission ideas ๐ Brainstorm possible directions ๐ Ask questions and get help with setup issues Full task description: blackboxnlp.github.io/2025/task/
