Matteo Tiezzi

🧐Interested in the details of the latest SOTA architectures (#RWKV , #RetNet, #Mamba, #Griffin) for long sequences? 📢 "State-space Modeling in Long Sequence Processing: A Survey on Recurrence in the Transformer Era" arxiv.org/abs/2406.09062

🚨 Our #survey "Back to recurrent processing at the crossroad of #transformers and state-space models" is out in Nature Machine Intelligence! 🔗 nature.com/articles/s4225… Read it here: rdcu.be/el85K @StefanoMelacci @KleineBottleM (M. Gori)

In our DeltaProduct work we also add a bit of theory to DeltaNet, showing that it can solve Dihedral groups, which are the groups of symmetries of regular polygons, with only two layers. This includes S3 (symmetries of the equilateral triangle).

1/9 There is a fundamental tradeoff between parallelizability and expressivity of Large Language Models. We propose a new linear RNN architecture, DeltaProduct, that can effectively navigate this tradeoff. Here's how!

#LOT startup day with @Continual_IST (@v_lomonaco), Motus ML (@GiacomoZiffer ) and @FocoosAI (@fcdl94) @Cossu94 @StefanoMelacci @aleitteb

#LOT very interesting interactive lecture by @claudiogallicc1 "Reservoir Computing Methods for Time Series Classification" @Cossu94 @v_lomonaco @StefanoMelacci

#LOT Spring School @eliricci_ on "Beyond Zero-Shot Generalization: Strengthening Vision-Language Models with Adaptation & Personalization" cai.diism.unisi.it/school/ @StefanoMelacci @v_lomonaco @Cossu94

#LOT Spring school @biggiobattista presenting the lecture "Machine Learning Security: Lessons Learned and Future Challenges" @Cossu94 @v_lomonaco @StefanoMelacci @aleitteb

#LOT Spring school Extremely honoured to introduce the second talk of the day, by the great @orvieto_antonio, on "New Avenues in Long-Sequence Processing without Attention" cai.diism.unisi.it/school/ @StefanoMelacci @Cossu94 @v_lomonaco @aleitteb

#LOT spring school we continue our incredible lineup of speakers with Alexei Efros and the talk titled "Test-Time Training: Toward a Post-Dataset World", @StefanoMelacci @Cossu94 @v_lomonaco @aleitteb cai.diism.unisi.it/school/

Art, nature and Artificial Intelligence at LoT Spring school which just started. With 50+ students, we are fully booked and eager to learn (over time). @StefanoMelacci @v_lomonaco @TiezziMatteo Alessandro Betti, Marco Gori

The first edition of Learning Over Time (LOT) Spring School is starting! @StefanoMelacci kicking off the school at the wonderful Certosa di Pontignano, Italy Organized by @StefanoMelacci, @v_lomonaco , @Cossu94 , @aleitteb , and myself cai.diism.unisi.it/school/

Working in #Multimedia, #ComputerVision, #AI? The Deadline for #ACMMM2025 is approaching fast! Don't forget to follow the new official profile for updates! x.com/acmmm_social

If you want to achieve AGI, you need to solve continual learning! @CoLLAs_Conf is the premier venue for continual learning research! Check this blog post to read more about CoLLAs 2025!

🚀 Announcing ASAP: asap-seminar.github.io! A fully virtual seminar bridging theory, algorithms, and systems to tackle fundamental challenges in Transformers. Co-organized by @simran_s_arora @Xinyu2ML @HanGuo97 Our first speaker: @heyyalexwang on Test-time Regression

Attention has been the key component for most advances in LLMs, but it can’t scale to long context. Does this mean we need to find an alternative? Presenting Titans: a new architecture with attention and a meta in-context memory that learns how to memorize at test time. Titans…

PAVIS and former members celebrating the coming holidays and a year full of successes! Well done people, you are an amazing team! @IITalk

@SvitovDavid presenting our poster @ACCVConf 2024 in Hanoi! Check our work on monocular avatar generation with 3DGS for more details here: david-svitov.github.io/HAHA_project_p… @LourdesAgapito @pmorerio @alessiodelbue