Jesse Marshall
@jessedmarshall
Neuromotor Interfaces @RealityLabs, Neuroscience & Behavior @Harvard, @Stanford Physics PhD. Interested in real & simulated brains and behavior.
emg2pose: Hand pose estimation anywhere with neuromotor interfaces A Dataset and Benchmark @ Neurips 2024 arxiv.org/abs/2412.02725… See blog: ai.meta.com/blog/open-sour…
Cool research by @RealityLabs to allow touch typing on any surface using egocentric camera-based hand-tracking as input. Full paper here: dl.acm.org/doi/10.1145/36…
Emg2qwerty!!!
1/ We just open-sourced two large wrist electromyography (EMG) datasets - one towards typing without a keyboard and the other for predicting hand poses - with baselines. We believe these will help advance research into making high bandwidth non-invasive neuromotor interfaces a…
AI Scaling laws + Neuro = Breakthroughs in computer interfaces We are out today at Nature (open access) Also see the great NYT writeup: nytimes.com/2025/07/23/sci… The github is quite nice ⭐️⭐️⭐️
We’re thrilled to see our advanced ML models and EMG hardware — that transform neural signals controlling muscles at the wrist into commands that seamlessly drive computer interactions — appearing in the latest edition of @Nature. Read the story: nature.com/articles/s4158… Find…
emg2pose ❤️ tendons
We've expanded the emg2pose dataset to include 39-channel muscle-tendon control signals for @MyoSuite MyoHand model! 🚀 #AI #Robotics #RoboSoft25
Great overview of our sEMG work, esp comparisons w bci
Human-Computer Input via a Wrist-Based sEMG Wearable meta.com/blog/quest/sur…
🚀 We’re Hiring at Fauna Robotics! 🦾✨ We’re building safe, lightweight robots to power the next generation of embodied AI in human-centric spaces. 👉 Check out our open roles and apply here: faunarobotics.com/careers/
We just unveiled Orion, our full AR glasses prototype that we’ve been working on for nearly a decade. When we started on this journey, our teams predicted that we had a 10% chance (at best) of success. This was our project to see if our dream AR glasses—wide FOV display, less…
When virtual rodents run, they think like rats
Happy to see my thesis work out today in @Nature! nature.com/articles/s4158… Josh Merel @jessedmarshall @lhq20 @yuvaltassa Ugne Klibaite @amandajgellis Greg Wayne @mattbotvinick @BOlveczky @GoogleDeepMind Video credit to the talented @KJHerr23
Happy to see my thesis work out today in @Nature! nature.com/articles/s4158… Josh Merel @jessedmarshall @lhq20 @yuvaltassa Ugne Klibaite @amandajgellis Greg Wayne @mattbotvinick @BOlveczky @GoogleDeepMind Video credit to the talented @KJHerr23
The BRAIN initiative is about building neurotechnology not addressing scientific questions. It is literally the title of the program ( Brain Research Through Advancing Innovative Neurotechnologies)
Quick, what have we learned from the BRAIN Initiative? One sentence or less please.