Lydia Chilton
@LydiaChilton
Computer Science Professor at Columbia
Videos are created by warping between start and end generations to the frequency of music. Disco builds on @_nateraw's brilliant stable-diffusion-videos repo. 🎵 - One More Time - Daft Punk Arxiv: arxiv.org/abs/2304.08551 Youtube: youtu.be/q22I53jHbuU
These people are smiling way to much to have migraines, depression and schizophrenia. They can be in trials for curing happiness.

AI has the surprising ability to discover abstract structure from examples. We use this for schema induction, but it can do so much more: find themes in data, discover templates, and generate design patterns. If you're working on structure discovery, pls msg me your ideas/work!
🧩 How do we go from examples to structural insight? 🎭 Surface variation in real-world examples makes it hard to spot deeper patterns. ✨ Introducing Schemex: a system for discovering structure through interactive abstraction & contrastive refinement. 📄arxiv.org/pdf/2504.11795
🚨⚠️Recently reviewed a paper that copied my CHI '24 work, ReelFramer arxiv.org/pdf/2304.09653, almost word-for-word. And they even cited ReelFramer! 😱 A friend mentioned they came across a similar situation. Is this common? What should the community do to prevent such incidents?
Thanks, everyone. I'm very grateful to have gotten a Sloan Fellowship. But I also know how frequent and awful rejection is. Here is my rejected Sloan Research Statement (2023), and my awarded research statement (2025), and the difference between them: lydiachilton.substack.com/p/game-of-pivo…
✨ Excited to introduce our #CHI24 work - *ReelFramer*: a system that transforms traditional news articles into engaging, narrative-driven IG Reels/TikToks - both fun and informative! How does ReelFramer tackle this content retargeting challenge? 📰🔄🎥
Unlike typical SIGCHI workshops, UIST workshops will be open enrollment — limited spaces, first-come, first-served. There is no position paper. Just make sure to register early before it fills up. Co-organizers: @joon_s_pk @merrierm @SaleemaAmershi @LydiaChilton @mitchellgordon
Here’s @savvas_petridis presenting AngleKindling at #chi2023 — for an overview of the work see here generative-ai-newsroom.com/finding-story-…
📖✍️⏳🫠 A writer sits in front of the desk for hours and then opens an AI writing tool 💻👀🙋♂️Feeling related? Ever wondered WHY?? See our #CHI2023 paper on the Social Dynamics of AI Support! How do writers perceive these tools? What leads to their usage? tinyurl.com/sociody
After years of building writing support tools, I've always wondered why some people loved them (even when they're bad!) & others disliked them no matter what. That's why I ran this study which is out with #CHI2023: "Social Dynamics of AI Support in Creative Writing" 🧵
🪩 Generated Disco helped express meaning through transitions in color, subject, style, time. Video could hold around certain images to encourage consistency + visual emphasis. 🎵 - Empire State of NY - Alicia Keys Arxiv: arxiv.org/abs/2304.08551 Youtube: youtu.be/q22I53jHbu
📰🎥📈 Can AI help make news into TikTok videos? Introducing ReelFramer: co-creating “news reels” with GPT and DALL-E! Arxiv: arxiv.org/abs/2304.09653 Preview:
After years of building writing support tools, I've always wondered why some people loved them (even when they're bad!) & others disliked them no matter what. That's why I ran this study which is out with #CHI2023: "Social Dynamics of AI Support in Creative Writing" 🧵
🪩 Generative Disco is one of the first to explore human-computer interaction problems surrounding text-to-video systems and assist music visualization through generative AI. Here are examples: 🎵 - Clair de Lune Arxiv: arxiv.org/abs/2304.08551 Youtube: youtu.be/q22I53jHbuU
Wanna make a Star Wars-themed product ad, but don't know how? 🤔 Introducing *PopBlends*, an LLM-driven system that tackles this creative challenge and gives your ad an edge. But can LLMs be creative on their own, or do they need help? See what we found in our #CHI23 paper... 🧵
Are you a journalist that has lots of press releases in their inbox? (I know, all of you!). Here's some new research on how generative AI can help brainstorm reporting angles on them: generative-ai-newsroom.com/finding-story-…
💃 🪩 🕺🏻 introducing generative disco, a text-to-video system for music visualization. thank you to collaborators 🌷 @taolongg @_nateraw @LydiaChilton arxiv: arxiv.org/abs/2304.08551 youtube: youtu.be/q22I53jHbuU
Join the Grad Student Symposium at Creativity and Cognition 2023. Present your work, get feedback, meet like minded researchers, have fun! Submissions due April 13 AoE cc.acm.org/2023/graduate-…

Generative AI is a potentially powerful tool to help illustrate news articles and visually draw in readers. Check out @lydiachilton's new primer on how to get started: generative-ai-newsroom.com/news-illustrat…
Here's how to start using Dall-E and Midjourney to help with news illustration: generative-ai-newsroom.com/news-illustrat…