Peter Dayan Explained

Peter Dayan
Fields:Computational neuroscience
Reinforcement learning
Workplaces:Max Planck Institute for Biological Cybernetics
University College London
Massachusetts Institute of Technology
Uber[1]
University of Toronto
Salk Institute
Alma Mater:University of Cambridge (BA)
University of Edinburgh (PhD)
Thesis Title:Reinforcing connectionism : learning the statistical way
Thesis Url:http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.649240
Thesis Year:1991
Doctoral Advisor:David Willshaw
Known For:Q-learning
Awards:Rumelhart Prize (2012)
The Brain Prize (2017)
Spouse:Li Zhaoping
Partners:)-->

Peter Dayan is a British neuroscientist and computer scientist who is director at the Max Planck Institute for Biological Cybernetics in Tübingen, Germany, along with Ivan De Araujo. He is co-author of Theoretical Neuroscience,[2] an influential textbook on computational neuroscience. He is known for applying Bayesian methods from machine learning and artificial intelligence to understand neural function and is particularly recognized for relating neurotransmitter levels to prediction errors and Bayesian uncertainties.[3] He has pioneered the field of reinforcement learning (RL) where he helped develop the Q-learning algorithm, and made contributions to unsupervised learning, including the wake-sleep algorithm for neural networks and the Helmholtz machine.[4] [5] [6]

Education

Dayan studied mathematics at the University of Cambridge and then continued for a PhD in artificial intelligence at the University of Edinburgh School of Informatics on statistical learning[7] supervised by David Willshaw and David Wallace, focusing on associative memory and reinforcement learning.[7]

Career and research

After his PhD, Dayan held postdoctoral research positions with Terry Sejnowski at the Salk Institute and Geoffrey Hinton at the University of Toronto. He then took up an assistant professor position at the Massachusetts Institute of Technology (MIT), and moved to the Gatsby Charitable Foundation computational neuroscience unit at University College London (UCL) in 1998, becoming professor and director in 2002.[8] In September 2018, the Max Planck Society announced his appointment as a director at the Max Planck Institute for Biological Cybernetics in Tübingen.[9]

Awards and honours

Dayan was elected a Fellow of the Royal Society (FRS) in 2018.[10] He was awarded the Rumelhart Prize in 2012 and The Brain Prize in 2017.[10]

See also

Notes and References

  1. Web site: Welcoming Peter Dayan to Uber AI Labs. uber.com. 2017. Zoubin . Ghahramani. Zoubin Ghahramani. https://web.archive.org/web/20180315021626/https://eng.uber.com/peter-dayan/. 2018-03-15.
  2. Book: Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems. Dayan. Peter. Abbott. Laurence. 2014. MIT Press. 9780262541855. Cambridge. en. 952504127.
  3. Schultz. W.. Dayan. P.. Montague. P. R.. A Neural Substrate of Prediction and Reward. Science. 275. 5306. 1997. 1593–1599. 0036-8075. 10.1126/science.275.5306.1593. 9054347. 220093382 .
  4. Watkins. Christopher J. C. H.. Dayan. Peter. Q-learning. Machine Learning. 8. 3–4. 1992. 279–292. 0885-6125. 10.1007/BF00992698. free. 21.11116/0000-0002-D738-D. free.
  5. Dayan. Peter. Machine Learning. The convergence of TD (λ) for general λ. 8. 3/4. 1992. 341–362. 0885-6125. 10.1023/A:1022632907294. free. 21.11116/0000-0002-D743-0. free.
  6. The helmholtz machine.. Neural Computation. 1995. 889–904. 7. 5. Dayan. Peter. Peter Dayan. Geoffrey E.. Hinton. Geoffrey Hinton. Radford M.. Neal. Radford M. Neal. Richard S.. Zemel. Richard Zemel. 10.1162/neco.1995.7.5.889. 7584891. 21.11116/0000-0002-D6D3-E. 1890561 . free.
  7. Dayan. Peter Samuel. PhD. 1991. Reinforcing connectionism: learning the statistical way. 1842/14754. en. .
  8. Web site: Peter Dayan. gatsby.ucl.ac.uk. https://web.archive.org/web/20190325134010/http://www.gatsby.ucl.ac.uk/~dayan/. 2019-03-25.
  9. Web site: Peter Dayan and Li Zhaoping appointed to the Max Planck Institute for Biological Cybernetics . mpg.de . 2 October 2018. 2018. Anon. https://web.archive.org/web/20190403042224/https://www.mpg.de/12300126/appointment-dayan-li. 2019-04-03.
  10. Web site: Professor Peter Dayan FRS. Anon. 2018. royalsociety.org. London. Royal Society. 22 May 2018. One or more of the preceding sentences incorporates text from the royalsociety.org website where: