| Bill Dally | |
| Birth Name: | William James Dally |
| Birth Date: | 17 August 1960 |
| Doctoral Advisor: | Charles Seitz |
| Thesis Title: | A VLSI Architecture for Concurrent Data Structures |
| Thesis Url: | https://thesis.library.caltech.edu/1122/3/Dally_wj_1986.pdf |
| Thesis Year: | 1986 |
William James Dally (born August 17, 1960) is an American computer scientist and educator.[1] He is the chief scientist and senior vice president at Nvidia and was previously a professor of Electrical Engineering and Computer Science at Stanford University and MIT. Since 2021, he has been a member of the President's Council of Advisors on Science and Technology (PCAST).[2] [3]
He developed a number of techniques used in modern interconnection networks including routing-based deadlock avoidance, wormhole routing, link-level retry, virtual channels, global adaptive routing, and high-radix routers. He has developed efficient mechanisms for communication, synchronization, and naming in parallel computers including message-driven computing and fast capability-based addressing. He has developed a number of stream processors starting in 1995 including Imagine, for graphics, signal, and image processing, and Merrimac, for scientific computing.
He has published over 200 papers as well as the textbooks Digital Systems Engineering with John Poulton, and Principles and Practices of Interconnection Networks with Brian Towles. He was inventor or co-inventor on over 70 granted patents.
An author quoted him saying: "Locality is efficiency, Efficiency is power, Power is performance, Performance is king".[4]
See also: Ma Bell. Dally has received a bachelor's degree in electrical engineering from Virginia Tech.[5] While working for Bell Telephone Laboratories he contributed to the design of the Bellmac 32, an early 32-bit microprocessor, and earned an master's degree in electrical engineering from Stanford University in 1981. He then went to the California Institute of Technology (Caltech) from 1983 to 1986, graduating with a Ph.D. degree in computer science in 1986. At Caltech he designed the MOSSIM simulation engine and an integrated circuit for routing. While at Caltech, he was part of the founding group of Stac Electronics in 1983.[6]
From 1986 to 1997 he taught at MIT where he and his group built the J–Machine and the M–Machine,[7] parallel machines emphasizing low overhead synchronization and communication. During his MIT times he claims to have collaborated on developing design of Cray T3D and Cray T3E supercomputers. He became the Willard R. and Inez Kerr Bell Professor in the Stanford University School of Engineering and chairman of the computer science department at Stanford. He served as chairman for twelve years before moving on to Nvidia.[8]
Dally's corporate involvements include various collaborations at Cray Research since 1989. He did Internet router work at Avici Systems starting in 1997, was chief technical officer at Velio Communications from 1999 until its 2003 acquisition by LSI Logic, founder and chairman of Stream Processors, Inc until it folded.
Dally was elected a Fellow of the Association for Computing Machinery in 2002, and a Fellow of the IEEE, also in 2002. In 2003 he became a consultant for NVIDIA for the first time and helped to develop GeForce 8800 GPUs series.[9] He received the ACM/SIGARCH Maurice Wilkes Award in 2000, the Seymour Cray Computer Science and Engineering Award in 2004, and the IEEE Computer Society Charles Babbage Award in 2006. In 2007 he was elected to the American Academy of Arts and Sciences.
In January 2009 he was appointed chief scientist of Nvidia.[10] He worked full-time at Nvidia, while supervising about 12 of his graduate students at Stanford.[11] He is currently chief scientist and SVP of Nvidia Research.[12]
Among many contributions to technology at Nvidia, Dally also kick-started optical interconnects for GPU[13] and computing systems using micro ring modulators utilizing multiple wavelengths.[14] [15] These systems can lead to the adoption of very high bandwidth, low energy per bit optical interconnects[16] in GPUs[17] and also lead to circuit switched GPU datacenters with significant boost to AI computing efficiency.
In 2009, he was elected to the National Academy of Engineering for contributions to the design of high-performance interconnect networks and parallel computer architectures.
He received the 2010 ACM/IEEE Eckert–Mauchly Award for "outstanding contributions to the architecture of interconnection networks and parallel computers."[18]
Dally is married and has two children. He had a flight mishap in 1992 when the Cessna 210 he was flying from Hanscom Field, Massachusetts to Farmingdale, New York in bad weather conditions experienced an oil leak. He was forced to make a crash landing in the Long Island Sound and was retrieved by a rescue sailboat.[19]