How large language models work (and why that's why they don't)

We are at the precipice of widespread adoption of natural language processing: large language models will fundamentally change how we use and interact with devices. Through examples, we will discuss how language models can be adapted to be classifiers, summarizers, coders, writers, and conversational assistants, with little to no supervision. We will discuss the basics of neural networks, the text corpus, and the training pipeline that enables language models to behave as these general-purpose AI agents. However, we will show how this very paradigm of language modeling also introduces fundamental limitations in this technology. We will characterize these vulnerabilities in language models and discuss how they affect end-use applications. By the end of the talk, attendees will better understand the capabilities, workings, and limitations of language models.
Dr. Sameer Singh is an Associate Professor of Computer Science at the University of California, Irvine (UCI). He is working primarily on the robustness and interpretability of machine learning algorithms and models that reason with text and structure for natural language processing. Sameer was a postdoctoral researcher at the University of Washington and received his Ph.D. from the University of Massachusetts, Amherst. He received the NSF CAREER award, the UCI Distinguished Early Career Faculty award, and the Hellman Faculty Fellowship, and was selected as a DARPA Riser. His group has received funding from Allen Institute for AI, Amazon, NSF, DARPA, Adobe Research, Hasso Plattner Institute, NEC, Base 11, and FICO. Sameer has published extensively at machine learning and natural language processing venues and received conference paper awards at KDD 2016, ACL 2018, EMNLP 2019, AKBC 2020, ACL 2020, and NAACL 2022.
This event is co-sponsored by the IEEE Orange County Computer Society, SIGAI OC and the Los Angeles Chapter of the ACM.
Follow us on your favorite platforms: linktree.com/ocacm