Samuel Schmidgall
@SRSchmidgall
Research Scientist @GoogleDeepmind // PhD @JohnsHopkins
🚀🌐Introducing AgentRxiv: a framework where autonomous research agents can upload, retrieve, and build on each other’s research. AgentRxiv takes your research direction and progressively outputs research, building on its previous work with each new paper! 🧵

A new Science #Robotics study describes SRT-H, a language-guided framework for surgical systems that enables step-level #autonomy in the clipping-and-cutting phase of gall bladder removal #surgeries in pig models. scim.ag/44Dhska
A new Review examines ways in which #ArtificialIntelligence could enable autonomous robotic #surgery for improved patient outcomes. @SRSchmidgall @krieger_axel Learn more in Science #Robotics: scim.ag/3UqC5ve
An advanced version of Gemini with Deep Think has officially achieved gold medal-level performance at the International Mathematical Olympiad. 🥇 It solved 5️⃣ out of 6️⃣ exceptionally difficult problems, involving algebra, combinatorics, geometry and number theory. Here’s how 🧵
Official results are in - Gemini achieved gold-medal level in the International Mathematical Olympiad! 🏆 An advanced version was able to solve 5 out of 6 problems. Incredible progress - huge congrats to @lmthang and the team! deepmind.google/discover/blog/…
This is an incredibly interesting conference. Excited to see what scientific findings can be produced by AI systems!
📢New conference where AI is the primary author and reviewer! agents4science.stanford.edu Current venues don't allow AI-written papers, so it's hard to assess the +/- of such works🤔 #Agents4Science solicits papers where AI is the main author w/ human advisors. 💡Initial reviews by…
📢New conference where AI is the primary author and reviewer! agents4science.stanford.edu Current venues don't allow AI-written papers, so it's hard to assess the +/- of such works🤔 #Agents4Science solicits papers where AI is the main author w/ human advisors. 💡Initial reviews by…
The robot can autonomously perform a real gallbladder removal subroutine! - Successfully completed the procedure on all 8 of 8 held-out gallbladders - Uses same alg that we used to train robots to make trail mix, using language hierarchy Paper + videos: h-surgical-robot-transformer.github.io
Introducing Hierarchical Surgical Robot Transformer (SRT-H), a language-guided policy for autonomous surgery🤖🏥 On the da Vinci robot, we perform a real surgical procedure on animal tissue. Collaboration b/w @JohnsHopkins & @Stanford
Was able to make an SRT-H interface quickly using this great huggingface tool AnyCoder: huggingface.co/spaces/akhaliq… Shoutout to @_akhaliq for the great work

The robot may be able to take your gallbladder out soon ;-)
📢 LLMs can perform autonomous surgery! SRT-H is the first vision-language-action (VLA) model to perform procedure-level autonomous robotic surgery 🧵
SRT-H A Hierarchical Framework for Autonomous Surgery via Language Conditioned Imitation Learning
SRT-H has been published in Science Robotics (and featured on the cover). :) Turns out, when we apply YAY Robot to surgical settings, the robot can perform real surgical procedures like gallbladder removal autonomously.
Introducing Hierarchical Surgical Robot Transformer (SRT-H), a language-guided policy for autonomous surgery🤖🏥 On the da Vinci robot, we perform a real surgical procedure on animal tissue. Collaboration b/w @JohnsHopkins & @Stanford