Responsible AI in the Generative Era with Michael Kearns - 662

Today we’re joined by Michael Kearns, professor in the Department of Computer and Information Science at the University of Pennsylvania and an Amazon scholar. In our conversation with Michael, we discuss the new challenges to responsible AI brought about by the generative AI era. We explore Michael’s learnings and insights from the intersection of his real-world experience at AWS and his work in academia. We cover a diverse range of topics under this banner, including service card metrics, privacy, hallucinations, RLHF, and LLM evaluation benchmarks. We also touch on Clean Rooms ML, a secured environment that balances accessibility to private datasets through differential privacy techniques, offering a new approach for secure data handling in machine learning.
🔔 Subscribe to our channel for more great content just like this: czcams.com/users/twimlai?sub_confi...
🗣️ CONNECT WITH US!
===============================
Subscribe to the TWIML AI Podcast: twimlai.com/podcast/twimlai/
Join our Slack Community: twimlai.com/community/
Subscribe to our newsletter: twimlai.com/newsletter/
Want to get in touch? Send us a message: twimlai.com/contact/
📖 CHAPTERS
===============================
00:00 - Career research update
1:27 - Service cards
5:34 - LLM evaluation benchmarks and metrics
11:56 - Hallucination
15:56 - RAG in tackling hallucinations
17:14 - Guardrails
19:13 - Guardrails vs. RLHF
21:56 - Privacy
24:10 - Steering via RLHF
27:35 - Clean Room ML
34:25 - Responsible AI in the Wild
🔗 LINKS & RESOURCES
===============================
Responsible AI in the wild: Lessons learned at AWS - www.amazon.science/blog/respo...
AWS Responsible AI - aws.amazon.com/machine-learni...
For a COMPLETE LIST of links and references, head over to twimlai.com/go/662.
📸 Camera: amzn.to/3TQ3zsg
🎙️Microphone: amzn.to/3t5zXeV
🚦Lights: amzn.to/3TQlX49
🎛️ Audio Interface: amzn.to/3TVFAIq
🎚️ Stream Deck: amzn.to/3zzm7F5