Stephen Pfohl
@stephenpfohl
Research Scientist at Google Research. Researching #fairness #transparency #causality #healthcare #healthequity
Really great to see this published! So, what is this all about? 🧵 (1/
📢 @LancetDigitalH and @NEJM_AI have co-published the long-awaited STANDING Together recommendations aiming to promote transparency in health datasets, and tackle algorithmic bias. @jaldmn @dr_laws @Denniston_Ophth @DrXiaoLiu @diversedata_ST Read more: buff.ly/3P48GV4
Red teaming LLM’s w @TristanNaumann @MSFTResearch @stephenpfohl @GoogleResearch #SAIL2024 #AI detecting threats across the broad taxonomy of LLM vulnerabilities
As our attendees settle in the @hyattregencypr, we get ready for a deep dive into medical AI with @TristanNaumann and @stephenpfohl presenting “Red Teaming to Test Limitations of LLMs”. Welcome everyone to #SAIL24! We hope you enjoy the conference and beautiful Puerto Rico. 🏝️
Excited to share our newest work! 📝 Evaluation of LLMs is hard, especially for health equity. We provide a multifaceted human assessment framework, 7 newly-released adversarial datasets, and perform the largest human eval study on this topic to date. 🧵: arxiv.org/abs/2403.12025