Trinity 🌸

😄 and Google once had Jeffrey Hinton Ilya Demis David Silver Whole Transformer Team ( Noam , Ashwin .......) Dario Amodei Karpathy ( as intern )

Back to working 7 days a week and sleeping in the office if my little kids are away

We have a very poor understanding of why deep neural networks like transformer models learn the parameters they learn. For example, in the paper below from 2013, the authors demonstrated that 5% of the weights of a trained deep neural network can be used to predict the values of…

New MrBeast Video: Last one to leave the circle wins a GB200 NVL72 Rack

x.com/i/article/1948…

for those struggling with deep learning math I resurface this tutorial I made last year in 27min I show my process by working through QHAdam optimizer which is this alphabet soup of letters

Google just discovered a powerful emergent capability in Veo 3 - visually annotate your instructions on the start frame, and Veo just does it for you! Instead of iterating endlessly on the perfect prompt, defining complex spatial relationships in words, you can just draw it out…

You know what's cool... a quadrillion tokens. We processed almost 1,000,000,000,000,000 tokens last month, more than double the amount from May. 📈

Andrej, my long lost brother, let us work together again!

Why I decided to do RL in 2016 after trying out MuProp on training a Neural Programmer and backprop failed me

Distributed systems is the most fun field of computer science because of the stories behind each concept. That's why I'm launching Distributed Systems Made Simple, a YouTube channel to tell these stories in a fun way while diving deep into the "why". youtube.com/@DSMadeSimple

Thanks @lexfridman for another super fun & wide-ranging conversation. We talked about the future of video games, the nature of reality, advancing science with AI, the path to AGI… and quite a bit more as usual! Always a blast, already looking forward to next time! 😀

"You're sheltering chinese AI researchers, are you not?"

Google is processing 980 trillion+ monthly tokens across our products and APIs (up from 480T in May) 🤯 No slowdown in sight, intelligence is everywhere.

Today we’re releasing GitHub Spark — a new tool in Copilot that turns your ideas into full-stack apps, entirely in natural language.

230k GPUs, including 30k GB200s, are operational for training Grok @xAI in a single supercluster called Colossus 1 (inference is done by our cloud providers). At Colossus 2, the first batch of 550k GB200s & GB300s, also for training, start going online in a few weeks. As Jensen…

Meet Varang in Avatar: Fire and Ash. Be among the first to watch the trailer, exclusively in theaters this weekend with The Fantastic Four: First Steps.

$OPEN $82

An advanced version of Gemini with Deep Think has officially achieved gold medal-level performance at the International Mathematical Olympiad. 🥇 It solved 5️⃣ out of 6️⃣ exceptionally difficult problems, involving algebra, combinatorics, geometry and number theory. Here’s how 🧵

Unity’s built-in animation system hit its limit at 100 animators, so I built my own • Job-based pipeline • uint3 clip positions (skip scales) • max 256-bone rigs • Vertex weights packed into uint3 • GPU renderer Next: IK, frustum culling, curve clips

Unitree is preparing for an IPO in China ⦿ Unitree Robotics has officially begun its IPO counseling process with the Chinese Securities Regulatory Bureau. ⦿ Unitree has completed 10 funding rounds to date, with its latest round pushing its valuation to 10 billion RMB (~$1.4B)…