Ruofei Du
@DuRuofei
Interactive Perception & Graphics Lead/Mgr @Google, inventing novel #interactive #AI in #XR. PhD '18 @umdcs #VR #AR #Graphics #HCI #VisualBlocks #UIST #CHI
Check out #InstructPipe - an initial step that turns your idea into an AI pipeline with visual programming! Come to @Zhongyi_Zhou_'s @acm_chi talk on 5/1 9:30am at G304 and my talk at 10:30-11:10am in North 1F. #VisualBlocks #WebAI #LLM #Agent
Visual programming frameworks like Visual Blocks can speed up ML pipeline building, but novice users can still struggle with setting them up. Read how InstructPipe, a research prototype for ML pipeline design, helps users build workflows more easily →goo.gle/4lB4pav
I converted one of my favorite talks I've given over the past year into a blog post. "On the Tradeoffs of SSMs and Transformers" (or: tokens are bullshit) In a few days, we'll release what I believe is the next major advance for architectures.
Embodied Web Agents Bridging Physical-Digital Realms for Integrated Agent Intelligence
This is indeed amazing work for web agent-world interaction! Respect!
Thank you AK! All data, codes and web environments are available at embodied-web-agent.github.io Paper link: arxiv.org/abs/2506.15677 Huggingface link: huggingface.co/papers/2506.15…
#CVPR2025 Recap: My first #HCI talk @CVPR. Future innovation shouldn’t put human as slaves of #AI, but help people live a better physical life — the next chapter of #XR and #AI innovation will soon open will #AndroidXR! Photo credits: Erroll and @seanfanello.




Welcome to my #CVPR talk in #XR, #HCI, and #Graphics for #AndroidXR 👻 June 12th - 4:30 PM CDT - Room 201B @CVPR


GT^2-GS: Geometry-aware Texture Transfer for Gaussian Splatting Contributions: • To the best of our knowledge, we are the first to incorporate geometric information into 3D texture transfer. The proposed framework enables direction-controllable and high-quality texture transfer…
Hope to show more #XR demos next #GoogleIO - keep challenging the miracles!!




Only one day until #GoogleIO! The energy here is electric. Can’t wait to show you the latest with Android XR tomorrow. Tune in for the keynote at 10am PT: io.google
#InstructPipe is featured at the #UTokyo official account! See moreover about this project at this 30-sec video! youtu.be/ktPmX_kHU9k
[トピックス] Zhongyi Zhou東京カレッジポスドクがCHI2025で受賞―東京カレッジ u-tokyo.ac.jp/focus/ja/artic…
Visual programming frameworks like Visual Blocks can speed up ML pipeline building, but novice users can still struggle with setting them up. Read how InstructPipe, a research prototype for ML pipeline design, helps users build workflows more easily →goo.gle/4lB4pav
Congrats to @Zhongyi_Zhou_ again on the amazing talk and Honorable Mention Award at #CHI2025!! Wish everyone a safe travel after CHI! #VisualBlocks #InstructPipe @sigchi




Day 2 of #CHI2025: co-presenting #VisualBlocks and #InstructPipe @GoogleAI booth and presenting my talk entitled “Interactive Perception & Graphics for a Universally Accessible #XR” @sigchi See u tomorrow at my session “XR and virtual characteristics”



First XR Labs alumni lunch #CHI2025 ヾノ≧∀≦)o Welcome to my sponsor talk tomorrow at 10:30am North 1F (reception hall) bottom left about #XR and #AI!



Welcome to my #XR talk at #CHI2025 on Tuesday morning! @Zhongyi_Zhou_ will present #InstructPipe on Thursday; @Zhongyi_Zhou_ Xun Qian will give #VisualBlocks demo on Tuesday afternoon. I’ll host #XR and #DigitalHuman on Wednesday morning. Let’s have some fun @sigchi !




It was an honor to talk about the convergence of XR and AI at @TEDTalks, including a sneak peek of Android XR headsets and glasses powered by Gemini. Big thanks to @Google @SamsungMobile @Qualcomm and partners for an incredible journey so far. More soon!
Misplace your things often? These AI glasses could help. In this live demo at #TED2025, computer scientist @izadi_shahram debuts Google’s prototype smart glasses, powered by the new @Android XR system. Watch the full demo here: t.ted.com/z4hCFIU
Happy to be back in the greater DC area at #GMU and meet my advisor, students, old friends, and new friends in #XR!



