Linking Scientific Instruments and Computation: Patterns, Technologies, Experiences - Ian Foster

"Linking Scientific Instruments and Computation: Patterns, Technologies, Experiences"
Ian Foster, Director, Data Science and Learning Division; Argonne Senior Scientist; Argonne National Lab. Distinguished Fellow and the Arthur Holly Compton Distinguished Service Professor, Computer Science, University of Chicago
Presentation abstract: Powerful detectors at modern experimental facilities routinely collect data at multiple GB/s. Online analysis methods are needed to enable the collection of only interesting subsets of such massive data streams, such as by explicitly discarding some data elements or by directing instruments to relevant areas of experimental space. Such online analyses require methods for configuring and running high-performance distributed computing pipelines-what we call flows-linking instruments, data center computers (e.g., for analysis, simulation, AI model training), edge computing (for analysis), data stores, metadata catalogs, and high-speed networks. This talk reviews common patterns associated with such flows, describe methods for instantiating those patterns, and present experiences with the application of these methods to the processing of data from a range of experimental facilities, each of which engages HPC resources for data inversion, machine learning model training, or other purposes. Also of discussion, implications of these new methods for operators and users of scientific facilities.
About this event: Significant advancements in Artificial Intelligence (AI), including Generative AI, and the hardware and software research environment are enabling researchers to develop AI-driven research workflows (ARWs): AI and Generative AI for hypothesis generation, experimental design and monitoring, as well as data acquisition, processing and analytics. Such ARWs will not only significantly accelerate research, but also enable new research possibilities.
This mini-symposium featured a keynote by Ian Foster (Argonne National Lab) and presentations from University of Michigan faculty members showcasing how they have developed and embedded AI-driven components in their research workflows.
For more information about the series and speakers, please visit the event page at: midas.umich.edu/ai-driven-res...
- Sign up for the MIDAS newsletter: myumi.ch/rrxW3
- Twitter: @um_midas
- LinkedIn: / michigan-institute-for...
#datascience #artificialintelligence #research #ai #generativeai