| Norbert Wiener | |
| Birth Date: | 26 November 1894 |
| Birth Place: | Columbia, Missouri, U.S. |
| Death Place: | Stockholm, Sweden |
| Field: | Mathematics Cybernetics Computer Science |
| Work Institutions: | Massachusetts Institute of Technology |
| Education: | Tufts College (BA) Cornell University (MA) Harvard University (PhD) |
| Doctoral Advisors: | Karl Schmidt |
| Academic Advisors: | Josiah Royce[1] |
| Doctoral Students: | |
| Prizes: | Bôcher Memorial Prize (1933) National Medal of Science (1963) |
| Thesis Title: | A Comparison Between the Treatment of the Algebra of Relatives by Schroeder and that by Whitehead and Russell |
| Thesis Url: | https://www.worldcat.org/oclc/874331086 |
| Thesis Year: | 1913 |
| Signature: | Sign of N. Wiener.png |
| Children: | 2 |
Norbert Wiener (November 26, 1894 – March 18, 1964) was an American computer scientist, mathematician and philosopher. He became a professor of mathematics at the Massachusetts Institute of Technology (MIT). A child prodigy, Wiener later became an early researcher in stochastic and mathematical noise processes, contributing work relevant to electronic engineering, electronic communication, and control systems.
Wiener is considered the originator[2] of cybernetics, the science of communication as it relates to living things and machines,[3] with implications for engineering, systems control, computer science, biology, neuroscience, philosophy, and the organization of society. His work heavily influenced computer pioneer John von Neumann, information theorist Claude Shannon, anthropologists Margaret Mead and Gregory Bateson, and others.
Wiener is credited as being one of the first to theorize that all intelligent behavior was the result of feedback mechanisms, that could possibly be simulated by machines and was an important early step towards the development of modern artificial intelligence.[4]
Wiener was born in Columbia, Missouri, the first child of Leo Wiener and Bertha Kahn, Jewish immigrants from Lithuania and Germany, respectively. Through his father, he was related to Maimonides, the famous rabbi, philosopher and physician from Al Andalus, as well as to Akiva Eger, chief rabbi of Posen from 1815 to 1837.[5]
Leo had educated Norbert at home until 1903, employing teaching methods of his own invention, except for a brief interlude when Norbert was 7 years of age. Earning his living teaching German and Slavic languages, Leo read widely and accumulated a personal library from which the young Norbert benefited greatly. Leo also had ample ability in mathematics and tutored his son in the subject until he left home. In his autobiography, Norbert described his father as calm and patient, unless he (Norbert) failed to give a correct answer, at which his father would lose his temper.
In “The Theory of Ignorance”, a paper he wrote at the age of 10, he disputed “man’s presumption in declaring that his knowledge has no limits”, arguing that all human knowledge “is based on an approximation”, and acknowledging “the impossibility of being certain of anything.”
He graduated from Ayer High School in 1906 at 11 years of age, and Wiener then entered Tufts College. He was awarded a BA in mathematics in 1909 at the age of 14, whereupon he began graduate studies of zoology at Harvard. In 1910 he transferred to Cornell to study philosophy. He graduated in 1911 at 17 years of age.[6]
The next year he returned to Harvard, while still continuing his philosophical studies. Back at Harvard, Wiener became influenced by Edward Vermilye Huntington, whose mathematical interests ranged from axiomatic foundations to engineering problems. Harvard awarded Wiener a PhD in June 1913, when he was only 19 years old, for a dissertation on mathematical logic (a comparison of the work of Ernst Schröder with that of Alfred North Whitehead and Bertrand Russell), supervised by Karl Schmidt, the essential results of which were published as Wiener (1914). He was one of the youngest to achieve such a feat. In that dissertation, he was the first to state publicly that ordered pairs can be defined in terms of elementary set theory. Hence relations can be defined by set theory, thus the theory of relations does not require any axioms or primitive notions distinct from those of set theory. In 1921, Kazimierz Kuratowski proposed a simplification of Wiener's definition of ordered pairs, and that simplification has been in common use ever since. It is (x, y) = .
In 1914, Wiener traveled to Europe, to be taught by Bertrand Russell and G. H. Hardy at Cambridge University, and by David Hilbert and Edmund Landau at the University of Göttingen. At Göttingen he also attended three courses with Edmund Husserl "one on Kant's ethical writings, one on the principles of Ethics, and the seminary on Phenomenology." (Letter to Russell, c. June or July, 1914). During 1915–16, he taught philosophy at Harvard, then was an engineer for General Electric and wrote for the Encyclopedia Americana. Wiener was briefly a journalist for the Boston Herald, where he wrote a feature story on the poor labor conditions for mill workers in Lawrence, Massachusetts, but he was fired soon afterwards for his reluctance to write favorable articles about a politician the newspaper's owners sought to promote.
Although Wiener eventually became a staunch pacifist, he eagerly contributed to the war effort in World War I. In 1916, with America's entry into the war drawing closer, Wiener attended a training camp for potential military officers but failed to earn a commission. One year later Wiener again tried to join the military, but the government again rejected him due to his poor eyesight. In the summer of 1918, Oswald Veblen invited Wiener to work on ballistics at the Aberdeen Proving Ground in Maryland. Living and working with other mathematicians strengthened his interest in mathematics. However, Wiener was still eager to serve in uniform and decided to make one more attempt to enlist, this time as a common soldier. Wiener wrote in a letter to his parents, "I should consider myself a pretty cheap kind of a swine if I were willing to be an officer but unwilling to be a soldier." This time the army accepted Wiener into its ranks and assigned him, by coincidence, to a unit stationed at Aberdeen, Maryland. World War I ended just days after Wiener's return to Aberdeen and Wiener was discharged from the military in February 1919.
Wiener was unable to secure a permanent position at Harvard, a situation he attributed largely to anti-Semitism at the university and in particular the antipathy of Harvard mathematician G. D. Birkhoff. He was also rejected for a position at the University of Melbourne. At W. F. Osgood's suggestion, Wiener was hired as an instructor of mathematics at MIT, where, after his promotion to professor, he spent the remainder of his career. For many years his photograph was prominently displayed in the Infinite Corridor and often used in giving directions, but by 2017 it had been removed.[7]
In 1926, Wiener returned to Europe as a Guggenheim scholar. He spent most of his time at Göttingen and with Hardy at Cambridge, working on Brownian motion, the Fourier integral, Dirichlet's problem, harmonic analysis, and the Tauberian theorems.
In 1926, Wiener's parents arranged his marriage to a German immigrant, Margaret Engemann; they had two daughters. His sister, Constance (1898–1973), married mathematician Philip Franklin. Their daughter, Janet, Wiener's niece, married mathematician Václav E. Beneš.[8] Norbert Wiener's sister, Bertha (1902–1995), married the botanist Carroll William Dodge.
Many tales, perhaps apocryphal, were told of Norbert Wiener at MIT, especially concerning his absent-mindedness. It was said that he returned home once to find his house empty. He inquired of a neighborhood girl the reason, and she said that the family had moved elsewhere that day. He thanked her for the information and she replied, "It's ok, Daddy, Mommy sent me to get you".[9] Asked about the story, Wiener's daughter reportedly asserted that "he never forgot who his children were! The rest of it, however, was pretty close to what actually happened…"[10]
In the run-up to World War II (1939–45) Wiener became a member of the China Aid Society and the Emergency Committee in Aid of Displaced German Scholars.He was interested in placing scholars such as Yuk-Wing Lee and Antoni Zygmund who had lost their positions.
During World War II, his work on the automatic aiming and firing of anti-aircraft guns caused Wiener to investigate information theory independently of Claude Shannon and to invent the Wiener filter. (The now-standard practice of modeling an information source as a random process—in other words, as a variety of noise—is due to Weiner.) Initially his anti-aircraft work led him to write, with Arturo Rosenblueth and Julian Bigelow, the 1943 article 'Behavior, Purpose and Teleology', which was published in Philosophy of Science. Subsequently his anti-aircraft work led him to formulate cybernetics.[11] After the war, his fame helped MIT to recruit a research team in cognitive science, composed of researchers in neuropsychology and the mathematics and biophysics of the nervous system, including Warren Sturgis McCulloch and Walter Pitts. These men later made pioneering contributions to computer science and artificial intelligence. Soon after the group was formed, Wiener suddenly ended all contact with its members, mystifying his colleagues. This emotionally traumatized Pitts, and led to his career decline. In their biography of Wiener, Conway and Siegelman suggest that Wiener's wife Margaret, who detested McCulloch's bohemian lifestyle, engineered the breach.
Wiener later helped develop the theories of cybernetics, robotics, computer control, and automation. He discussed the modeling of neurons with John von Neumann, and in a letter from November 1946 von Neumann presented his thoughts in advance of a meeting with Wiener.[12]
Wiener always shared his theories and findings with other researchers, and credited the contributions of others. These included Soviet researchers and their findings. Wiener's acquaintance with them caused him to be regarded with suspicion during the Cold War. He was a strong advocate of automation to improve the standard of living, and to end economic underdevelopment. His ideas became influential in India, whose government he advised during the 1950s.
After the war, Wiener became increasingly concerned with what he believed was political interference with scientific research, and the militarization of science. His article "A Scientist Rebels" from the January 1947 issue of The Atlantic Monthly[13] urged scientists to consider the ethical implications of their work. After the war, he refused to accept any government funding or to work on military projects. The way Wiener's beliefs concerning nuclear weapons and the Cold War contrasted with those of von Neumann is the major theme of the book John Von Neumann and Norbert Wiener.[14]
Wiener was a participant of the Macy conferences.
In 1926 Wiener married Margaret Engemann, an assistant professor of modern languages at Juniata College. They had two daughters. Opinions are not all positive on Margaret's impacts on Wiener's career.[15]
Wiener admitted in his autobiography I Am a Mathematician: The Later Life of a Prodigy to abusing benzadrine throughout his life without being fully aware of its dangers.[16]
Wiener died in March 1964, aged 69, in Stockholm, from a heart attack. Wiener and his wife are buried at the Vittum Hill Cemetery in Sandwich, New Hampshire.
Wiener was an early studier of stochastic and mathematical noise processes, contributing work relevant to electronic engineering, electronic communication, and control systems. It was Wiener's idea to model a signal as if it were an exotic type of noise, giving it a sound mathematical basis. The example often given to students is that English text could be modeled as a random string of letters and spaces, where each letter of the alphabet (and the space) has an assigned probability. But Wiener dealt with analog signals, where such a simple example doesn't exist. Wiener's early work on information theory and signal processing was limited to analog signals, and was largely forgotten with the development of the digital theory.[20]
Wiener is one of the key originators of cybernetics, a formalization of the notion of feedback, with many implications for engineering, systems control, computer science, biology, philosophy, and the organization of society. His work with cybernetics influenced Gregory Bateson and Margaret Mead, and through them, anthropology, sociology, and education.[21]
A simple mathematical representation of Brownian motion, the Wiener equation, named after Wiener, assumes the current velocity of a fluid particle fluctuates randomly.
For signal processing, the Wiener filter is a filter proposed by Wiener during the 1940s and published in 1942 as a classified document. Its purpose is to reduce the amount of noise present in a signal by comparison with an estimate of the desired noiseless signal. Wiener developed the filter at the Radiation Laboratory at MIT to predict the position of German bombers from radar reflections. What emerged was a mathematical theory of great generality - a theory for predicting the future as best one can on the basis of incomplete information about the past. It was a statistical theory that included applications that did not, strictly speaking, predict the future, but only tried to remove noise. It made use of Wiener's earlier work on integral equations and Fourier transforms.[22] [23]
Wiener studied polynomial chaos, a key piece of which is the Hermite-Laguerre expansion. This was developed in detail in Nonlinear Problems in Random Theory.
Wiener applied Hermite-Laguerre expansion to nonlinear system identification and control. Specifically, a nonlinear system can be identified by inputting a white noise process and computing the Hermite-Laguerre expansion of its output. The identified system can then be controlled.[24] [25]
Wiener took a great interest in the mathematical theory of Brownian motion (named after Robert Brown) proving many results now widely known, such as the non-differentiability of the paths. Consequently, the one-dimensional version of Brownian motion was named the Wiener process. It is the best known of the Lévy processes, càdlàg stochastic processes with stationary statistically independent increments, and occurs frequently in pure and applied mathematics, physics and economics (e.g. on the stock-market).
Wiener's tauberian theorem, a 1932 result of Wiener, developed Tauberian theorems in summability theory, on the face of it a chapter of real analysis, by showing that most of the known results could be encapsulated in a principle taken from harmonic analysis. In its present formulation, the theorem of Wiener does not have any obvious association with Tauberian theorems, which deal with infinite series; the translation from results formulated for integrals, or using the language of functional analysis and Banach algebras, is however a relatively routine process.
The Paley–Wiener theorem relates growth properties of entire functions on Cn and Fourier transformation of Schwartz distributions of compact support.
The Wiener–Khinchin theorem, (also known as the Wiener – Khintchine theorem and the Khinchin – Kolmogorov theorem), states that the power spectral density of a wide-sense-stationary random process is the Fourier transform of the corresponding autocorrelation function.
An abstract Wiener space is a mathematical object in measure theory, used to construct a "decent", strictly positive and locally finite measure on an infinite-dimensional vector space. Wiener's original construction only applied to the space of real-valued continuous paths on the unit interval, known as classical Wiener space. Leonard Gross provided the generalization to the case of a general separable Banach space.
The notion of a Banach space itself was discovered independently by both Wiener and Stefan Banach at around the same time.[26]
His work with Mary Brazier is referred to in Avis DeVoto's As Always, Julia.[27]
A flagship named after him appears briefly in Citizen of the Galaxy by Robert Heinlein.[28]
The song Dedicated to Norbert Wiener appears as the second track on the 1980 album Why? by G.G. Tonet (Luigi Tonet), released on the Italian It Why label.[29]
Wiener wrote many books and hundreds of articles:
Wiener's papers are collected in the following works:
Fiction:
Autobiography:
Under the name "W. Norbert":
Wiener's life and work has been examined in many works:
Books and theses:
Articles:
Archives: