Milan Kovac

Tesla is where real-world AI is happening. These runs are on mulched ground, where I’ve myself slipped before. What’s really crazy here is that for these, Optimus is actually blind! Keeping its balance without video (yet), only other on-board sensors consumed by a neural net…

One of our goals is to have Optimus learn straight from internet videos of humans doing tasks. Those are often 3rd person views captured by random cameras etc. We recently had a significant breakthrough along that journey, and can now transfer a big chunk of the learning…

Here's a little more, and no cables this time ;) It's all real-time speed, zero CGI, fully learned in Simulation & zero-shot transferred to real. Besides the fact that it's fun, we had to make significant improvements to our robot model in Sim, domain randomization and other…

More coming shortly! The team has been working very hard in the background. Entirely trained in simulation with RL. Many optimizations and fixes have been put in place in our sim-to-real training code. The cable is there in case of a fall (not actually holding the bot) since…

This weekend, I drove to Napa and back - close to 200 miles - on FSD. I think I had max a couple interventions and they were both comfort-related, meaning not necessary per se. My car took me through my neighborhood’s winding, hilly streets, got on the highway, navigated San…

Our latest walk! Straight knees, smoother heel-to-toe gait & arms sway, just chilling around. Entirely trained in simulation with RL.

I came to the US in 2014 on a H1-B, with several years of prior experience as a C/C++ programmer. A “skilled white European immigrant” as some seem to call it recently here. Over the years, I’ve had the chance to work alongside absolutely exceptional so-called “skilled Indian…

Merry Christmas everyone 🎅🤖🎄

🤖 💭

Our new hand/forearm with double the number of degrees of freedom now in action on the bot! There’s 22 DoFs on the hand, and 3 on the wrist/forearm. This little video was made last night in the lab (teleoperated) and is real-time. Gives us confidence that we’ll very soon be…

In a couple weeks, I’ll finally be pledging allegiance to the American flag 🇺🇸 — what better and prouder time to do so. As a European, this election cycle meant so much to me. Growing up in the beautiful Old World, full of so many people I love, I’ve seen it increasingly plagued…

While we were busy making its walk more robust for 10/10, we’ve also been working on additional pieces of autonomy for Optimus! The absence of (useful) GPS in most indoor environments makes visual navigation central for humanoids. Using its 2D cameras, Optimus can now navigate…