Sébastien Bubeck is a French-American computer scientist and mathematician. He is currently Microsoft's Vice President of Applied Research and leads the Machine Learning Foundations group at Microsoft Research Redmond. Bubeck was formerly professor at Princeton University and a researcher at the University of California, Berkeley.[1] He is known for his contributions to online learning, optimization and more recently studying deep neural networks, and in particular transformer models.
Bubeck's work spans a wide variety of topics in machine learning, theoretical computer science and artificial intelligence. Some of his most notable contributions include developing minimax rate for multi-armed bandits, linear bandits, developing an optimal algorithm for bandit convex optimization, and solving long-standing problems in k-server and metrical task systems. In regards to the mathematical theory of neural networks, Bubeck has both introduced and proved the law of robustness which links the number of parameters of a neural network and its regularity properties.[2] [3] Bubeck has also made contributions to convex optimization, network analysis, and information theory. Bubeck's papers have over 15,000 citations to date.[4]
Prior to joining Microsoft Research, Bubeck was an assistant professor at Princeton University in the Department of Operations Research and Financial Engineering. He received his PhD from the Lille 1 University of Science and Technology, and also studied at the Ecole Normale Supérieure de Cachan.
Bubeck is the author of the book Convex optimization: Algorithms and complexity (2015).[5] He has also been on the editorial board of several scientific journals and conferences, including the Journal of the ACM[6] and Neural Information Processing Systems (NeurIPS) and was program committee chair for the 2018 Conference on Learning Theory (COLT)[7]
In 2023, Bubeck and his collaborators published a paper that claimed to observe "sparks of artificial general intelligence" in an early version of GPT-4, a large language model developed by OpenAI. The paper presented examples of GPT-4 performing tasks across various domains and modalities, such as mathematics, coding, vision, medicine, and law. The paper sparked wide interest and debate in the scientific community and the popular media, as it challenged the conventional understanding of learning and cognition in AI systems.[8] [9] [10] [11] [12] Bubeck also investigated the potential use of GPT-4 as an AI chatbot for medicine in a paper that evaluated the strengths, weaknesses, and ethical issues of relying on such a tool for medical purposes[13]
Bubeck has received numerous honors and awards for his work, including the Alfred P. Sloan Research Fellowship in Computer Science in 2015,[14] and Best Paper Awards at the Conference on Learning Theory (COLT) in 2016,[15] Neural Information Processing Systems (NeurIPS) in 2018 and 2021 and in the ACM Symposium on Theory of Computing (STOC) 2023.[16] [17] He has also received the Jacques Neveu prize for the best French PhD in Probability/Statistics,[18] the AI prize for a French PhD in Artificial Intelligence,[19] and the Gilles Kahn prize for a French PhD in Computer Science.[20]