Keith Coleman π±ππ
@kcoleman
VP Product @X. Previously CEO at Yes Inc, @google π
One step closer to making it easy to see the ideas/thoughts/opinions that resonate with people from different perspectives. The world is not as polarized as it may seem, and we'll soon see the areas of agreement!
Update: Posts Liked by People with Different Perspectives A small, random group of @CommunityNotes contributors are in our new pilot test to help identify posts that are liked by people with different perspectives. Thank you for your contributions so far! Starting today, yourβ¦
Introducing Community Notes AI Note Writer API, designed to empower people with AI while keeping humans in control!
Introducing AI Note Writer API π€ AI helping humans. Humans still in charge. Starting today, the world can create AI Note Writers that can earn the ability to propose Community Notes. Their notes will show on X if found helpful by people from different perspectives β just likeβ¦
Rolling out an *Open API for AI Community Note Writers*!! Anyone can write their own AI note writer to propose notes, but they will be treated the same as any note proposal: notes need to be rated as helpful by (human) raters who typically disagree before they show publicly
Introducing AI Note Writer API π€ AI helping humans. Humans still in charge. Starting today, the world can create AI Note Writers that can earn the ability to propose Community Notes. Their notes will show on X if found helpful by people from different perspectives β just likeβ¦
π¨π¨ Excited to share a new paper led by @Li_Haiwen_ with the @CommunityNotes team! LLMs will reshape the information ecosystem. Community Notes offers a promising model for keeping human judgment central but it's an open question how to best integrate LLMs. Threadπ
Very excited about this launch and the coming benefits to the Community Notes ecosystem. I think the scalability of AI paired with the guidance of human oversight is going to bring a great experience to X users. π
Introducing AI Note Writer API π€ AI helping humans. Humans still in charge. Starting today, the world can create AI Note Writers that can earn the ability to propose Community Notes. Their notes will show on X if found helpful by people from different perspectives β just likeβ¦
π brought the world @CommunityNotes. Now, weβre advancing the frontier again. Introducing βAI Note Writers.β
Introducing AI Note Writer API π€ AI helping humans. Humans still in charge. Starting today, the world can create AI Note Writers that can earn the ability to propose Community Notes. Their notes will show on X if found helpful by people from different perspectives β just likeβ¦
For those of you building AI Note Writers: β’ You can now get scores back from the automated note evaluator (helps ensure a basic level of note quality before admission) β’ We aim to be ready to admit the first cohort of AI Note Writers later this month β’ Reach out w/ q's!
AI Note Writer API update: Welcome developers writing notes in test_mode! Like all contributors, AI Note Writers must earn the ability to write notes that are seen by other people. So, before being admitted, AI Note Writersβ notes are scored by an open-source, automated noteβ¦
X will let AI bots propose Community Notes. I talked with VP of Product @kcoleman about the thinking behind the move.
New feedback loop to make more accurate, less biased note writing agents:
This creates a powerful loop: LLMs generate β humans rate collectively β models learn whatβs actually helpful and aligned with the community. We call this: Reinforcement Learning from Community Feedback (RLCF)
It's been a minute since I've appeared as an author... but very excited for the research agenda proposed in this paper. Can't wait to see the results!
The new AI Note Writer API further advances the state of the art in improving information quality on the internet. Weβve just published a paper along with researchers at MIT, University of Washington and more outlining the potential of this approach, new risks and challenges, andβ¦
Hereβs our articulation of what the future of Community Notes in an LLM era could look like π : Very interested to hear your thoughts!
Brand new paper on Arxiv with @Li_Haiwen_ @actuallysoham Manon Revel @andreas_h0wpt @__bradmiller__ @kcoleman @msaveski: Scaling Human Judgment in Community Notes with LLMs Very bullish on the LLM-assisted future of Community Notes π
AI-written notes will still be reviewed by humans before they show up publicly
X will start to publish Community Notes written by artificial intelligence agents, a move to increase the speed of the social networkβs fact-checking product and expand it to reach more people. @KurtWagner8 bloomberg.com/news/articles/β¦
Fastest way to get started writing your AI Community Note Writer is to fork this template API note writer: should take 30mins or less for you to get set up! Can you write the best note writer?
Brand new paper on Arxiv with @Li_Haiwen_ @actuallysoham Manon Revel @andreas_h0wpt @__bradmiller__ @kcoleman @msaveski: Scaling Human Judgment in Community Notes with LLMs Very bullish on the LLM-assisted future of Community Notes π
Dense subgraph detection!
Robustness update: Community Notes already employs multiple techniques to address coordination, and today weβre adding a new one. If a would-be Helpful note receives a significantly lower score without ratings from correlated raters, the note will be shown as a preview to gatherβ¦
Continually strengthening @CommunityNotes against potential coordination
Robustness update: Community Notes already employs multiple techniques to address coordination, and today weβre adding a new one. If a would-be Helpful note receives a significantly lower score without ratings from correlated raters, the note will be shown as a preview to gatherβ¦
We are building some incredible things on the Community Notes team! π