Keynote: Science of AI and AI for Science

Speaker: Noah A. Smith
Professor, Paul G. Allen School of Computer Science & Engineering, University of Washington
Vice Provost for Artificial Intelligence, University of Washington
Senior Director of NLP Research, Allen Institute for AI

Abstract

Neural language models with billions of parameters and trained on trillions of words are powering the fastest-growing computing applications in history and generating discussion and debate around the world. Yet most scientists cannot study or improve those state-of-the-art models because the organizations deploying them keep their data and machine learning processes secret. I believe that the path to models that are usable by all, at low cost, customizable for areas of critical need like the sciences, and whose capabilities and limitations are made transparent and understandable, is radically open development, with academic and not-for-profit researchers empowered to do reproducible science. In this talk, I’ll discuss some of the work our team is doing to radically open up the science of language modeling and make it possible to explore new scientific questions and democratize control of the future of this fascinating and important technology.

The work I’ll present was led by a large team at the Allen Institute for Artificial Intelligence in Seattle, with collaboration from the Paul G. Allen School at the University of Washington and various kinds of support and coordination from many organizations, including the Kempner Institute for the Study of Natural and Artificial Intelligence at Harvard University, AMD, CSC - IT Center for Science (Finland), Databricks, Together.ai, and the National AI Research Resource Pilot. In August, the team was awarded a $75M mid-scale research infrastructure grant from the National Science Foundation, with additional support from NVIDIA, enabling continued work for five years.

Bio

Noah A. Smith is a researcher in natural language processing and machine learning, serving as the University of Washington’s inaugural Vice Provost for Artificial Intelligence. He is a Professor in the Paul G. Allen School of Computer Science & Engineering at the University of Washington (also Adjunct in Linguistics, Affiliate of the Center for Statistics and the Social Sciences, Senior Data Science Fellow at the eScience Institute, and Associate Faculty of the Stroum Center for Jewish Studies) as well as Senior Director of NLP Research at the Allen Institute for AI. He co-directs the OLMo open language modeling initiative and is the PI of the NSF- and NVIDIA-supported project “Open Multimodal AI Infrastructure to Accelerate Science.” His current work spans language, music, and AI research methodology, with a strong emphasis on mentoring—his former mentees now hold faculty and leadership roles worldwide. Smith is a Fellow of the Association for Computational Linguistics and has received numerous awards for research and innovation.