Prof. Anima Anandkumar
@AnimaAnandkumar
Bren Professor @caltech, Time100, Fmr Sr Director of #AI research @nvidia Fmr Principal Scientist @awscloud
OrbitAll: A Unified Quantum Mechanical Representation Deep Learning Framework for All Molecular Systems Accurately modeling chemical systems across diverse charges, spin states, and environments remains a central challenge in molecular machine learning. No existing machine…
Translating the successful techniques, tricks, and developments in neural networks to neural operators to learn on any resolution. We carefully planned out a practical and easy way to translate what we know works in neural networks and bring them all to neural operators, even go…
Neural Operators – Deep learning at any resolution Extending neural networks to function spaces: While many phenomena are inherently described by functions, neural networks define vector-to-vector mappings that rely on fixed discretization of the input and output. Neural…
Neural Operators – Deep learning at any resolution Extending neural networks to function spaces: While many phenomena are inherently described by functions, neural networks define vector-to-vector mappings that rely on fixed discretization of the input and output. Neural…
Check out our new paper on using AI to make progress on the Millennium problem of fluid blowup!
Can AI help solve Millennium Math problem in Fluid dynamics? We take an important step in this direction in our recent paper with physics-informed learning: High-Precision PINNs in Unbounded Domains: Application to Singularity Formulation in PDEs We develop a modular and a…
Can AI help solve Millennium Math problem in Fluid dynamics? We take an important step in this direction in our recent paper with physics-informed learning: High-Precision PINNs in Unbounded Domains: Application to Singularity Formulation in PDEs We develop a modular and a…
.@shoyer We admire neuralGCM and all the contributions you are making for AI+climate modeling. Social media doesn't allow for too much nuance - what I meant to say was FourCastNet 3 is unprecedented in offering competitive skill at 6-hour resolution, with probabilistic estimates…
FourCastNet3 is very impressive, great work! It's certainly not unprecendented in terms of speed for probabilistic AI-weather prediction, though. E.g., NeuralGCM makes a 15 day probabilistic weather forecast in under 20 seconds.
I led the creation of the very first high-resolution AI-based weather model FourCastNet at @NVIDIA @Caltech in 2021. Instead of bottoms-up physics-based weather forecasting, for the first time, we were able to show that AI-based models are accurate and tens of thousands of times…
Tensors are all you need
Einsum is all you need I have said it before I will say it again, If you truly understand how einsum works, you will never need to worry about reshape, permute, transpose, matmul, dot product and so much more
I am giving a talk on "Neural Operators and Biologically-informed Latent Embeddings for Foundation Models in NeuroAI" at the Workshop on Multi-modal Foundation Models and Large Language Models for Life Sciences at ICML2025.
If you are at ICML2025, welcome to attend our workshop "Multi-modal Foundation Models and Large Language Models for Life Sciences" tomorrow (Jul 19 Saturday). The workshop features a stellar lineup of invited speakers, including Valentina Boeva @val_boeva, Manolis Kellis…
Check out his essay on @ScienceMagazine x.com/sciencemagazin… @ZhuoranQ @Caltech
Hearty congratulations to my former student @ZhuoranQ for a very well deserved recognition. @ZhuoranQ was my first cross disciplinary student from chemistry and someone who was willing to explore ai+chemistry back when it was considered risky. His work on Orbnet was the first…
Hearty congratulations to my former student @ZhuoranQ for a very well deserved recognition. @ZhuoranQ was my first cross disciplinary student from chemistry and someone who was willing to explore ai+chemistry back when it was considered risky. His work on Orbnet was the first…
Thrilled to be awarded the 2024 @ChenInstitute and @ScienceMagazine Prize for AI Accelerated Research! This is a huge recognition for our past work on structure prediction foundation models, and the path ahead to pursue further. Looking forward to presenting more this October!
To make things elegant (but later we will have intuition), let us talk about the SDE approximation of SGD and SignSGD (a good model for Adam). The SignSGD result is by @EneaMC (arxiv.org/abs/2411.15958), a must-read if you want to understand how adaptive methods react to noise.
I had a wonderful time discussing #AI in chemistry at Lindau Nobel Laureate Panel youtube.com/live/Iv5_CYjCT… I talked about how physics-informed learning is essential for AI to make new scientific discoveries. Since discovery is about extrapolation, a purely data driven method is…
I have been advocating tensor methods for almost decade and a half. Take a look at our tensor methods in deep learning from a few years ago arxiv.org/abs/2107.03436 Tensorly package allows defining tensor operations in Pytorch seamlessly tensorly.org @JeanKossaifi
what if attention operated in 3D? This paper introduces trilinear (2-simplicial) attention, and it might have just rewrite the current transformer scaling law by squeezing out the same accuracy with far fewer tokens.
Happening soon! Join the livestream for Lindau Nobel Laureate Meeting on "Artificial Intelligence in Chemistry: How Is AI Changing the Game?" We will discuss the transformative impact of AI technologies in chemistry including groundbreaking applications in drug discovery,…
I'm thrilled to be @lindaunobel In beautiful #Lindau with 606 young scientists, and quite a few older ones, too.
Great opening at Lindau Nobel laureate event by @francesarnold I will be speaking on the panel of AI in chemistry later in the week #LINO25
Indeed. It will be live-streamed and available online. mediatheque.lindau-nobel.org/meetings/2025/…
Great opening at Lindau Nobel laureate event by @francesarnold I will be speaking on the panel of AI in chemistry later in the week #LINO25
Thank you @ELLEmagazine for featuring me in women in AI elle.in/life-culture/w…
