Daniel Severo

Excited to announce our new work on compressing vector database indices! Highlights: 🗜️ 7x compression of FAISS indices with no impact on accuracy or search runtime 🗜️ 30% memory reduction on billion-scale datasets arxiv.org/abs/2501.10479 github.com/facebookresear…

The supervision signal in AI4Science is so crisp that we can solve very complicated problems almost without any data or RL! In this project, we train a model to solve the Schrödinger equation for different molecular conformations using Density Functional Theory (DFT) In the…

(1/n)🚨You can train a model solving DFT for any geometry almost without training data!🚨 Introducing Self-Refining Training for Amortized Density Functional Theory — a variational framework for learning a DFT solver that predicts the ground-state solutions for different…

We've open sourced Adjoint Sampling! It's part of a bundled release showcasing FAIR's research and open source commitment to AI for science. github.com/facebookresear… x.com/AIatMeta/statu…

Announcing the newest releases from Meta FAIR. We’re releasing new groundbreaking models, benchmarks, and datasets that will transform the way researchers approach molecular property prediction, language processing, and neuroscience. 1️⃣ Open Molecules 2025 (OMol25): A dataset…

Hard to describe how incredible Montreal is between May and November. Total vibe.

Against conventional wisdom, I will be giving a talk with particular focus on the "how" and the various intricacies of applying stochastic control for generative modeling. Mon 9:50am Hall 1 Apex #ICLR2025 Also check out the other talks at delta-workshop.github.io!

📣I'll be at the poster session with our follow-up on Discrete Flow Matching. We derive a closed-form solution to the kinetic optimal problem for conditional velocity on discrete spaces. Into flow models? come chat! 💬 🗓Poster: Sat 10am (#191), 🎤Oral: Sat 3:30pm (6E) #ICLR2025

Discrete Flow Matching extends the Flow Matching recipe to discrete data. But so far the focus of the community has been on the simple masking corruption process. We now enable general corruption processes. Imagination is the limit! Oral by @shaulneta Sat 3:30pm.

We are presenting 3 orals and 1 spotlight at #ICLR2025 on two primary topics: On generalizing the data-driven flow matching algorithm to jump processes, arbitrary discrete corruption processes, and beyond. And on highly scalable algorithms for reward-driven learning settings.

.@shenghao_yang's Ph.D Thesis "Perspectives of Graph Diffusion: Computation, Local Partitioning, Statistical Recovery, and Applications" is now available. Link: dspacemainprd01.lib.uwaterloo.ca/server/api/cor… Relevant papers: 1) p-Norm Flow Diffusion for Local Graph Clustering: proceedings.mlr.press/v119/fountoula……

BREAKING: Amii Chief Scientific Advisor, Richard S. Sutton, has been awarded the A.M. Turing Award, the highest honour in computer science, alongside Andrew Barto! Read the official @TheOfficialACM announcement: hubs.la/Q039nZXM0 #TuringAward #AI #ReinforcementLearning

Congratulations to the latest Turing award winners Barto and Sutton! At this point, all three Canadian national AI institutes have a pioneering Turing winner in leadership: Amii - Rich Sutton Vector - Geoff Hinton Mila - Yoshua Bengio Canada AI haters real quiet right now.

Our MIT class “6.S184: Introduction to Flow Matching and Diffusion Models” is now available on YouTube! We teach state-of-the-art generative AI algorithms for images, videos, proteins, etc. together with the mathematical tools to understand them. diffusion.csail.mit.edu (1/4)

Are you a Canadian citizen or PR? 3rd or 4th year in undergrad? Available June 2-13 for a fully funded summer school in statistics? Learn more and apply here: statistics.utoronto.ca/UTSSRP Yours truly will be teaching you some online learning theory.

Positional Attention: Expressivity and Learnability of Algorithmic Computation (v2) We study the effect of using only fixed positional encodings (referred to as positional attention) in the Transformer architecture for computational tasks. These positional encodings remain the…

We will be withdrawing our Waterloo interns from the bay in response to the unjustified unnecessary illegal tariffs

On monday in our reading group we discuss "Flow Matching with General Discrete Paths: A Kinetic-Optimal Perspective" arxiv.org/abs/2412.03487 With Neta Shaul. Join on zoom on Monday at 9am PT / 12pm ET / 6pm CET: portal.valencelabs.com/logg

I've been reading the PDF copy of this book and it is a nice fresh perspective on info theory (free and legal PDF copy (no really, i'm not being sarcastic)) After you finish Cover and Thomas, take a look: people.lids.mit.edu/yp/homepage/da…