Jason Ren
@RenZhongzheng
Researcher @Ai2Prior @uwcse, Incoming Assistant Professor @UNC | PhD @IllinoisCS
🥳 Excited to share that I’ll be joining the CS Department at UNC-Chapel Hill (@unccs @unc_ai_group) as an Assistant Professor starting Fall 2026! Before that, I’ll be working at Ai2 Prior (@allen_ai @Ai2Prior) and UW (@uwcse) on multimodal understanding and generation.
Today is my 1st day in Ai2 @allen_ai office, and it’s definitely one of the prettiest and coziest working environment I’ve ever been in. Cannot wait to meet the wonderful @Ai2Prior team in the next few days!😃😃😃
Love it; very cool😍
Research arc: ⏪ 2 yrs ago, we introduced VRB: learning from hours of human videos to cut down teleop (Gibson🙏) ▶️ Today, we explore a wilder path: robots deployed with no teleop, no human demos, no affordances. Just raw video generation magic 🙏 Day 1 of faculty life done! 😉…
Thanks so much Mohit! Can’t wait to join and work with you and the lab. Gonna have lots of fun😄
🎉 Yay, welcome to the @unc @unccs @unc_ai_group family and beautiful Research Triangle area, Jason! Looking forward to the many exciting collaborations on these topics! 🔥 PS. If you are applying for fall2026 PhD admissions, make sure to apply to new faculty member Jason 👇
Congrats!!!
Big news! 🎉 I’m joining UNC-Chapel Hill as an Assistant Professor in Computer Science starting next year! Before that, I’ll be spending time @OpenAI working on LLM privacy. @unccs @uncnlp
the time I saw weather in the title, I know it's your work @ZhiHaoLin16 ! Very cool work 👏👏👏
Our two recent works on post-training video diffusion model for inverse/forward rendering and controllable weather simulation were featured on @twominutepapers! youtu.be/ZE0JZYgiaGc DiffusionRenderer (research.nvidia.com/labs/toronto-a…) WeatherWeaver (research.nvidia.com/labs/toronto-a…)
Congrats! Cannot wait to see more great work from your group at JHU!
Sharing some personal updates 🥳: - I've completed my PhD at @unccs! 🎓 - Starting Fall 2026, I'll be joining the Computer Science dept. at Johns Hopkins University (@JHUCompSci) as an Assistant Professor 💙 - Currently exploring options + finalizing the plan for my gap year (Aug…
Ever wish YouTube had 3D labels? 🚀Introducing🎥DynPose-100K🎥, an Internet-scale collection of diverse videos annotated with camera pose! Applications include camera-controlled video generation🤩and learned dynamic pose estimation😯 Download: huggingface.co/datasets/nvidi…
Wow🤩🤩🤩 can we also have one for ⚽️, one for 🏈, one for 🎾 lol
For those of you who know me, I've always been very excited to combine my two passions for basketball and CV. Our #CVPR2025 paper does this by introducing a large-scale video dataset for fine-grained skill estimation in 🏀. Paper, code & data available: sites.google.com/cs.unc.edu/bas…
Check out our new work, PhysTwin! It converts videos of deformable objects into real-time interactive demos with realistic physics. Highly recommend trying the demo out — it’s quite fun! 🚀 Led by the amazing @jiang_hanxiao.
🚀 How can we create interactive Physical Digital Twins from videos? Thrilled to share our latest work: PhysTwin! 🌟 Using inverse physics optimization, we generate photo-realistic, physically accurate, and real-time interactive virtual replicas. 🔥 🔗jianghanxiao.github.io/phystwin-web/
Congrats Taesung! Please feed us more with such cool results!
Excited to come out of stealth at @reveimage! Today's text-to-image/video models, in contrast to LLMs, lack logic. Images seem plausible initially but fall apart under scrutiny: painting techniques don't match, props don't carry meaning, and compositions lack intention. (1/4)
I'm not a fan but can understand and live with this. Maybe next time don't make a decision for us but let the authors vote? It has a big impact on the many researchers' preparation process!
🆕 #ICCV2025: The submission deadlines for the main paper and supplementary materials is the SAME!
Huge congrats!! Potential students: this is a wonderful opportunity to work with the great Unnat in one of the nicest city in the states
Excited to share that I'll be joining University of California at Irvine as a CS faculty in '25!🌟 Faculty apps: @_krishna_murthy, @liuzhuang1234 & I share our tips: unnat.github.io/notes/Hidden_C… PhD apps: I'm looking for students in vision, robot learning, & AI4Science. Details👇
If Llama3 scaling law is followed, I should be expecting the MovieGen 405b variant soon😜
MovieGen is now on arXiv, with some interesting new tidbits! I’m particularly excited about this scaling analysis, where we find that the optimal FLOPs/params for MovieGen lie on the Llama3 scaling law, suggesting that LLM scaling laws might even work for media generation models!
There's three parts. 1. Fitting as large of a network and as large of a batch-size as possible onto the 10k/100k/1m H100s -- parallelizing and using memory-saving tricks. 2. Communicating state between these GPUs as quickly as possible 3. Recovering from failures (hardware,…
lmao
Stop by our poster #217 tmr 10:30 if you are at #ECCV2024, Prof @ShenlongWang and Prof @_saurabhg will present tmr. This is how Shenlong did toy experiments at home🤣