Vincent Liu
@vincentjliu
Cofounder https://mecha.company. Math, CS @Stanford
The future of robotics isn't in the lab – it's in your hands. Can we teach robots to act in the real world without a single robot demonstration? Introducing EgoZero. Train real-world robot policies from human-first egocentric data. No robots. No teleop. Just Aria glasses and…
Robotics needs an open-source humanoid solution. There are a couple commercially viable humanoids, which are still expensive, closed source, and susceptible to geopolitics. I’m hopeful @kscalelabs could become a PyTorch-like platform for the ecosystem
You’ve never heard of them. But next week, they’re shipping your first personal robot. It’s open-source. Garage-built. Costs $8,999. Here’s why they might change robotics forever 🧵
👀
Full episode dropping soon! Geeking out with @vincentjliu @AdemiAdeniji on EgoZero: Robot Learning from Smart Glasses egozero-robot.github.io Co-hosted by @chris_j_paxton @micoolcho
I think the most interesting insight from EgoZero is the tradeoff between 2D/3D representations in human-to-robot learning. 2D inputs (images, VLMs) scale and encode strong visual priors—but mapping these to 3D actions is hard and data-hungry, especially given the human-robot…
The future of robotics isn't in the lab – it's in your hands. Can we teach robots to act in the real world without a single robot demonstration? Introducing EgoZero. Train real-world robot policies from human-first egocentric data. No robots. No teleop. Just Aria glasses and…
I wrote a fun little article about all the ways to dodge the need for real-world robot data. I think it has a cute title. sergeylevine.substack.com/p/sporks-of-agi
Playing around with some designs
every museum should digitally recreate its art with @threejs and make it interactive
Everyone says the value is in selling automation, but will do anything except sell automation
The number of startups trying to sell data to general purpose + humanoid robots companies seems to exceeds the number of actual robot startups. This is ... concerning. Do the hard thing. Hard things filter out competition. Optimize for the world you want to see, not your IRR
GPT-4.5 didn't scale because its pretraining dataset didn't scale
there is no wall
Congrats to my friends @tonyduan_ @patrick_cho_1 who have been cooking! Tesla shows that we should engineer intelligent systems that scale over long horizons, and not compromise scalability to get short term wins.
we are launching our Robotaxi service in austin today they said it couldn’t be done. you need lidar. you need more sensors. you need HD maps of the city you operate in. turns out ….. you just need cameras + AI to make cars drive themselves. 10 years in the making. so proud…
When we think of human data collection, we usually think of recording accurate 3D proprioception, but this alone does not contain force information. On the other hand, teleoperation data collects the human's input as action labels, so robots trained this way can learn how much…
Everyday human data is robotics’ answer to internet-scale tokens. But how can robots learn to feel—just from videos?📹 Introducing FeelTheForce (FTF): force-sensitive manipulation policies learned from natural human interactions🖐️🤖 👉 feel-the-force-ftf.github.io 1/n
In AI, better models → higher productivity → higher margins → more output + capital deployment. In robotics, we often view outcomes as binary: solved or not. But if we instead frame partial success rates as boosting physical labor productivity, we can potentially increase…
Closed-loop robot policies directly from human interactions. No teleop, no robot data co-training, no RL, and no sim. Just Aria smart glasses. Everyday human data is passively scalable and a massively underutilized resource in robotics...More to come here in the coming weeks.
The future of robotics isn't in the lab – it's in your hands. Can we teach robots to act in the real world without a single robot demonstration? Introducing EgoZero. Train real-world robot policies from human-first egocentric data. No robots. No teleop. Just Aria glasses and…