Alberto Testoni

Today, our team will share “From Tools to Teammates: Evaluating LLMs in Multi-Session Coding Interactions” at @aclmeeting! 🎉 Led by:  @carraznathanael @mhamdy_res @jaa_campos Lucas Weber @alberto_testoni @mziizm @sandropezzelle @marcodeltredici 📜arxiv.org/abs/2502.13791

Excited to present PLAYPEN, an environment for learning through dialogue game self-play. Are you interested in LLM post-training techniques and how to make them better "language users"? Read this thread! #GenAI #NLProc #HRI #AI #ML

Can LLMs collaborate effectively over long-term interactions, like a human teammate, especially in coding tasks? 🤔 We introduce MEMORYCODE, a new way to evaluate LLMs' ability to track & execute coding instructions across multiple sessions, even with irrelevant info thrown in.

Excited to share insights from our new paper on evaluating LLMs in multi-session coding interactions! 📚📚📚 We introduce MEMORYCODE, a novel dataset to assess how well LLMs track & execute coding instructions across multiple sessions, mimicking real-world collaboration.

🔍 Papers being presented: 1️⃣ Learning to Ask Informative Questions: Enhancing LLMs with Preference Optimization and Expected Information Gain @dmazzaccara, @alberto_testoni, @raffagbernardi 📰 arxiv.org/abs/2406.17453

Flying to Miami! I will present “Learning to Ask Informative Questions: Enhancing LLMs with Preference Optimization and Expected Information Gain” at #EMNLP2024 🌴 If you are interested in questions’ generation come to say hi! ⏱️ Wednesday 13th 16-17 📃 aclanthology.org/2024.findings-…

PhD opportunities in Munich 🥳 - consider applying to MCML and reach out if you are interested in @MaiNLPlab research themes: human-centric NLP, variation, uncertainty, dialects, multimodality & much more -- mainlp.github.io

I'm looking for a last-minute emergency reviewer for a COLM submission related to generation with LLMs. Reviews need to be in by end of Thursday, May 23. Please DM if you can help out! 🙏 (PhD students with some reviewing experience welcome)

22 researchers from 12 European institutions discussed future directions in open #LLMs and multimodal language technologies at the Oberwolfach Research Institute for Mathematics. The workshop was organised by @raquel_dmg & @sandropezzelle on behalf of the ELLIS #NLP program! #ML