Carlo Sferrazza

Ever wondered what robots 🤖 could achieve if they could not just see – but also feel and hear? Introducing FuSe: a recipe for finetuning large vision-language-action (VLA) models with heterogeneous sensory data, such as vision, touch, sound, and more. Details in the thread 👇

Join us on July 19th at @icmlconf, Vancouver, for the EXAIT Workshop— a full-day workshop on the role of exploration in AI today.

Looking forward to an exciting final day of RSS tomorrow with our WCBM workshop kicking off at 8:20 at USC! More details on the website: wcbm-workshop.github.io @RoboticsSciSys @YoungwoonLee @Xingyu2017 @ToruO_O @pabbeel

Congratulations to BAIR researchers @kevin_zakka @qiayuanliao @arthurallshire @carlo_sferrazza @KoushilSreenath @pabbeel and Google collaborators for winning the Outstanding Demo Paper Award at RSS 2025! playground.mujoco.org

Very honored to receive this award at @RoboticsSciSys! Huge kudos to @kevin_zakka and all co-authors 🎉

I'm giving a talk at "Workshop on Whole-body Control and Bimanual Manipulation: Applications in Humanoids and Beyond" @ RSS. wcbm-workshop.github.io What should I cover in my talk? What do folks want to know?

😂

Sim2real is getting so mature that with great hardware (thanks @clemens_chr @katzschmann), you can get things running in just days 🤖 We are also demoing @orcahand trained with MuJoCo Playground at #RSS2025. Come by Associates Park at 12:30pm-2pm and 6:30pm-8pm! @RoboticsSciSys

Driving down to #RSS2025 with @qiayuanliao, @carlo_sferrazza, and @arthurallshire to demo MuJoCo Playground! We’re excited to host a hands-on demo across 3 hardware platforms—quadruped, humanoid, and hand—and even train + deploy policies live!

Looking forward to giving a talk at the Real2Sim workshop at @CVPR today at 3:50pm CDT. I will be speaking about sim-to-real for robot learning -- and MuJoCo Playground! #CVPR2025

Very excited for this one. We took a cautiously experimental view on NN optimizers, aiming to find something that just works. SPlus matches Adam within ~44% of steps on a range of objectives. Please try it out in your setting, or read below for how it works.…

Join our #CVPR2025 Workshop on Real2Sim: Bridging the Gap between Neural Rendering and Robot Learning on 6/12! With amazing speakers: @drmapavone @shahdhruv_ @GordonWetzstein @LingjieLiu1 @sicheng_mo @RuohanZhang76 @carlo_sferrazza ⏲️ Thu, 6/12, 1:45-5:30 PM CDT 🏢 Davidson…

FastTD3: "Minimum innovation, maximum results" Not the paper we had planned to write, but one of the works I am most proud of. We wanted to make sure our baseline (TD3) was a very solid baseline, so we added a few things that are already known to help in RL (large,…

Amazing work! This could finally open the door for bringing all the cool research about off-policy RL algorithms from the last years to large scale robotics policy training where PPO was the only thing before that would scale

FastTD3 Simple, Fast, and Capable Reinforcement Learning for Humanoid Control

Over the past year, I've been compiling some "alchemist's notes" on deep learning. Right now it covers basic optimization, architectures, and generative models. Focus is on learnability -- each page has nice graphics and an end-to-end implementation. notes.kvfrans.com

We just extended the deadline until May 31st! Submit your work here: exait-workshop.github.io