| Richard Ernest Bellman | |
| Birth Name: | Richard Ernest Bellman |
| Birth Date: | August 26, 1920 |
| Birth Place: | New York City, New York, U.S. |
| Death Place: | Los Angeles, California, U.S. |
| Work Institution: | University of Southern California Rand Corporation Stanford University |
| Thesis Title: | On the Boundedness of Solutions of Non-Linear Differential and Difference Equations |
| Doctoral Students: | Christine Shoemaker |
| Doctoral Advisor: | Solomon Lefschetz |
| Fields: | Mathematics and Control theory |
| Known For: | Dynamic programming Stochastic dynamic programming Curse of dimensionality Linear search problem Bellman equation Bellman–Ford algorithm Bellman's lost in a forest problem Bellman–Held–Karp algorithm Grönwall–Bellman inequality Hamilton–Jacobi–Bellman equation |
| Awards: | John von Neumann Theory Prize (1976) IEEE Medal of Honor Richard E. Bellman Control Heritage Award (1984) |
Richard Ernest Bellman[1] (August 26, 1920 – March 19, 1984) was an American applied mathematician, who introduced dynamic programming in 1953, and made important contributions in other fields of mathematics, such as biomathematics. He founded the leading biomathematical journal Mathematical Biosciences, as well as the Journal of Mathematical Analysis and Applications.
Bellman was born in 1920 in New York City to non-practising[2] Jewish parents of Polish and Russian descent, Pearl (née Saffian) and John James Bellman, who ran a small grocery store on Bergen Street near Prospect Park, Brooklyn.[3] On his religious views, he was an atheist.[4] He attended Abraham Lincoln High School, Brooklyn in 1937,[5] and studied mathematics at Brooklyn College where he earned a BA in 1941. He later earned an MA from the University of Wisconsin. During World War II, he worked for a Theoretical Physics Division group in Los Alamos. In 1946, he received his Ph.D. at Princeton University under the supervision of Solomon Lefschetz.[6] Beginning in 1949, Bellman worked for many years at RAND corporation, and it was during this time that he developed dynamic programming.[7]
Later in life, Richard Bellman's interests began to emphasize biology and medicine, which he identified as "the frontiers of contemporary science". In 1967, he became founding editor of the journal Mathematical Biosciences, which rapidly became (and remains) one of the most important journals in the field of Mathematical Biology. In 1985, the Bellman Prize in Mathematical Biosciences was created in his honor, being awarded biannually to the journal's best research paper.
Bellman was diagnosed with a brain tumor in 1973, which was removed but resulted in complications that left him severely disabled. He was a professor at the University of Southern California, a Fellow in the American Academy of Arts and Sciences (1975),[8] a member of the National Academy of Engineering (1977),[9] and a member of the National Academy of Sciences (1983).
He was awarded the IEEE Medal of Honor in 1979, "for contributions to decision processes and control system theory, particularly the creation and application of dynamic programming".[10] His key work is the Bellman equation.
A Bellman equation, also known as a dynamic programming equation, is a necessary condition for optimality associated with the mathematical optimization method known as dynamic programming. Almost any problem which can be solved using optimal control theory can also be solved by analyzing the appropriate Bellman equation. The Bellman equation was first applied to engineering control theory and to other topics in applied mathematics, and subsequently became an important tool in economic theory.[11]
The Hamilton–Jacobi–Bellman equation (HJB) is a partial differential equation which is central to optimal control theory. The solution of the HJB equation is the 'value function', which gives the optimal cost-to-go for a given dynamical system with an associated cost function. Classical variational problems, for example, the brachistochrone problem can be solved using this method as well. The equation is a result of the theory of dynamic programming which was pioneered in the 1950s by Richard Bellman and coworkers. The corresponding discrete-time equation is usually referred to as the Bellman equation. In continuous time, the result can be seen as an extension of earlier work in classical physics on the Hamilton–Jacobi equation by William Rowan Hamilton and Carl Gustav Jacob Jacobi.[12]
See main article: Curse of dimensionality. The curse of dimensionality is an expression coined by Bellman to describe the problem caused by the exponential increase in volume associated with adding extra dimensions to a (mathematical) space. One implication of the curse of dimensionality is that some methods for numerical solution of the Bellman equation require vastly more computer time when there are more state variables in the value function. For example, 100 evenly spaced sample points suffice to sample a unit interval with no more than 0.01 distance between points; an equivalent sampling of a 10-dimensional unit hypercube with a lattice with a spacing of 0.01 between adjacent points would require 1020 sample points: thus, in some sense, the 10-dimensional hypercube can be said to be a factor of 1018 "larger" than the unit interval. (Adapted from an example by R. E. Bellman, see below.) [13]
Though discovering the algorithm after Ford he is referred to in the Bellman–Ford algorithm, also sometimes referred to as the Label Correcting Algorithm, computes single-source shortest paths in a weighted digraph where some of the edge weights may be negative. Dijkstra's algorithm accomplishes the same problem with a lower running time, but requires edge weights to be non-negative.
Over the course of his career he published 619 papers and 39 books. During the last 11 years of his life he published over 100 papers despite suffering from crippling complications of brain surgery (Dreyfus, 2003). A selection:[5]