Eric Horvitz Explained
Eric Horvitz |
Birth Name: | Eric Joel Horvitz |
Nationality: | American |
Employer: | Microsoft |
Education: | Ph.D and M.D. from Stanford University |
Occupation: | Computer scientist |
Chief Scientific Officer |
Eric Joel Horvitz is an American computer scientist, and Technical Fellow at Microsoft, where he serves as the company's first Chief Scientific Officer.[1] He was previously the director of Microsoft Research Labs, including research centers in Redmond, WA, Cambridge, MA, New York, NY, Montreal, Canada, Cambridge, UK, and Bangalore, India.
Horvitz was elected a member of the National Academy of Engineering in 2013 for computational mechanisms for decision making under uncertainty and with bounded resources.
Biography
Horvitz received his Ph.D and M.D. from Stanford University.[2] His doctoral dissertation, Computation and Action Under Bounded Resources, and follow-on research introduced models of bounded rationality founded in probability and decision theory. He did his doctoral work under advisors Ronald A. Howard, George B. Dantzig, Edward H. Shortliffe, and Patrick Suppes.
He is currently the Chief Scientific Officer of Microsoft. He has been elected Fellow of the Association for the Advancement of Artificial Intelligence (AAAI), the National Academy of Engineering (NAE), the American Academy of Arts and Sciences, and of the American Association for the Advancement of Science (AAAS).
He was elected as an ACM Fellow in 2014 for "contributions to artificial intelligence, and human-computer interaction."[3]
He was elected to the ACM CHI Academy in 2013 for “research at the intersection of human-computer interaction and artificial intelligence.”[4]
He was elected to the American Philosophical Society in 2018.[5]
In 2015, he was awarded the AAAI Feigenbaum Prize,[6] a biennial award for sustained and high-impact contributions to the field of artificial intelligence through the development of computational models of perception, reflection and action, and their application in time-critical decision making, and intelligent information, traffic, and healthcare systems.
In 2015, he was also awarded the ACM - AAAI Allen Newell Award,[7] for "contributions to artificial intelligence and human-computer interaction spanning the computing and decision sciences through developing principles and models of sensing, reflection, and rational action."
He serves on the President's Council of Advisors on Science and Technology[8] (PCAST), the Scientific Advisory Committee of the Allen Institute for Artificial Intelligence (AI2), and the Computer Science and Telecommunications Board[9] (CSTB) of the US National Academies.
He has served as president of the Association for the Advancement of AI (AAAI), on the NSF Computer & Information Science & Engineering (CISE) Advisory Board, on the council of the Computing Community Consortium (CCC), chair of the Section on Information, Computing, and Communications of the American Association for the Advancement of Science (AAAS), on the Board of Regents[10] of the US National Library of Medicine (NLM), and the U.S. National Security Commission on AI.
Work
Horvitz's research interests span theoretical and practical challenges with developing systems that perceive, learn, and reason. His contributions include advances in principles and applications of machine learning and inference, information retrieval, human-computer interaction, bioinformatics, and e-commerce.
Horvitz played a significant role in the use of probability and decision theory in artificial intelligence. His work raised the credibility of artificial intelligence in other areas of computer science and computer engineering, influencing fields ranging from human-computer interaction to operating systems. His research helped establish the link between artificial intelligence and decision science. As an example, he coined the concept of bounded optimality, a decision-theoretic approach to bounded rationality.[11] The influences of bounded optimality extend beyond computer science into cognitive science and psychology.[12] [13]
He studied the use of probability and utility to guide automated reasoning for decision making. The methods include consideration of the solving of streams of problems in environments over time. In related work, he applied probability and machine learning to solve combinatorial problems and to guide theorem proving. He introduced the anytime algorithm paradigm in AI,[14] [15] where partial results, probabilities, or utilities of outcomes are refined with computation under different availabilities or costs of time, guided by the expected value of computation.[16] [17]
He has issued long-term challenge problems for AI—and has espoused a vision of open-world AI, where machine intelligences have the ability to understand and perform well in the larger world where they encounter situations they have not seen before.
He has explored synergies between human and machine intelligence.[18] He introduced principles for using machine learning and decision theory to guide machine versus human initiative,[19] methods that provide AI systems with understandings of when to transfer problem solving to humans,[20] and the use of machine learning and planning techniques to identify and merge the complementary abilities of people and AI systems.[21] [22] In work on human-centered AI, he introduced measures and models of the expected value of displayed information to guide the display of information to human decision makers in time-critical settings[23] and methods for making statistical AI inferences more understandable.[24] He introduced models of human attention in computing systems,[25] [26] and studied the use of machine learning to infer the cost of interruptions to computer users.[27] [28] His use of machine learning to build models of human surprise was featured as a technology breakthrough by MIT Technology Review.[29]
He investigated the use of AI methods to provide assistance to users including help with software[30] [31] and in the daily life.[32]
He made contributions to multimodal interaction.[33] In 2015, he received the ACM ICMI Sustained Accomplishment Award[34] [35] for contributions to multimodal interaction. His work on multimodal interaction includes studies of situated interaction,[36] [37] where systems consider physical details of open-world settings and can perform dialog with multiple people.[38]
He co-authored probability-based methods to enhance privacy, including a model of altruistic sharing of data called community sensing and risk-sensitive approaches[39] including stochastic privacy.
He is Microsoft's top inventor.[40]
He led efforts in applying AI methods to computing systems, including machine learning for memory management in Windows,[41] web prefetching,[42] graphics rendering,[43] and web crawling.[44] He did early work on AI for debugging software.[45]
Horvitz speaks on the topic of artificial intelligence, including on NPR and the Charlie Rose show.[46] [47] [48] Online talks include both technical lectures and presentations for general audiences (TEDx Austin: Making Friends with Artificial Intelligence). His research has been featured in The New York Times and MIT Technology Review.[49] [50] [51] He has testified before the US Senate on progress, opportunities, and challenges with AI.[52]
AI and society
He has addressed technical and societal challenges and opportunities with the fielding of AI technologies in the open world, including beneficial uses of AI,[53] AI safety and robustness,[54] and where AI systems and capabilities can have inadvertent effects, pose dangers, or be misused.[55] [56] [57] [58] He has presented on caveats with applications of AI in military settings.[59] He and Thomas G. Dietterich called for work on AI alignment, saying that AI systems "must reason about what people intend rather than carrying out commands literally."
He has called for action on potential risks to civil liberties posed by government uses of data in AI systems.[60] He and privacy scholar Deirdre Mulligan stated that society must balance privacy concerns with benefits of data for social benefit.[61]
He has presented on the risks of AI-enabled deepfakes and contributed to media provenance technologies that cryptographically certify the source and history of edits of digital content.[62]
Asilomar AI study
He served as President of the AAAI from 2007–2009. As AAAI President, he called together and co-chaired the Asilomar AI study which culminated in a meeting of AI scientists at Asilomar in February 2009. The study considered the nature and timing of AI successes and reviewed concerns about directions with AI developments, including the potential loss of control over computer-based intelligences, and also efforts that could reduce concerns and enhance long-term societal outcomes. The study was the first meeting of AI scientists to address concerns about superintelligence and loss of control of AI and attracted interest by the public.[63]
In coverage of the Asilomar study, he said that scientists must study and respond to notions of superintelligent machines and concerns about artificial intelligence systems escaping from human control. In a later NPR interview, he said that investments in scientific studies of superintelligences would be valuable to guide proactive efforts even if people believed that the probability of losing of control of AI was low because of the cost of such outcomes.[64]
One Hundred Year Study on Artificial Intelligence
In 2014, Horvitz defined and funded with his wife the One Hundred Year Study of Artificial Intelligence (AI100) at Stanford University.[65] [66] In 2016, the AI Index was launched as a project of the One Hundred Year Study.
According to Horvitz, the AI100 gift, which may increase in the future, is sufficient to fund the study for a century. A Stanford press release stated that sets of committees over a century will "study and anticipate how the effects of artificial intelligence will ripple through every aspect of how people work, live and play." A framing memo for the study calls out 18 topics for consideration, including law, ethics, the economy, war, and crime.[67] Topics include abuses of AI that could pose threats to democracy and freedom and addressing possibilities of superintelligences and loss of control of AI.
The One Hundred Year Study is overseen by a Standing Committee. The Standing Committee formulates questions and themes and organizes a Study Panel every five years. The Study Panel issues a report that assesses the status and rate of progress of AI technologies, challenges, and opportunities with regard to AI's influences on people and society.
The 2015 study panel of the One Hundred Year Study, chaired by Peter Stone, released a report in September 2016, titled "Artificial Intelligence and Life in 2030 ."[68] The panel advocated for increased public and private spending on the industry, recommended increased AI expertise at all levels of government, and recommended against blanket government regulation.[69] [70] Panel chair Peter Stone argues that AI won't automatically replace human workers, but rather, will supplement the workforce and create new jobs in tech maintenance. While mainly focusing on the next 15 years, the report touched on concerns and expectations that had risen in prominence over the last decade about the risks of superintelligent robots, stating "Unlike in the movies, there's no race of superhuman robots on the horizon or probably even possible.[71] Stone stated that "it was a conscious decision not to give credence to this in the report."
The report of the second cycle of the AI100 study, chaired by Michael Littman, was published in 2021.[72] [73]
Founding of Partnership on AI
He co-founded and has served as board chair of the Partnership on AI, a non-profit organization bringing together Apple, Amazon, Facebook, Google, DeepMind, IBM, and Microsoft with representatives from civil society, academia, and non-profit R&D. The organization's website points at initiatives, including studies of risk scores in criminal justice,[74] facial recognition systems,[75] AI and economy,[76] AI safety,[77] AI and media integrity,[78] and documentation of AI systems.[79]
Microsoft Aether Committee
He founded and chairs the Aether Committee at Microsoft, Microsoft's internal committee on the responsible development and fielding of AI technologies.[80] [81] He reported that the Aether Committee had made recommendations on and guided decisions that have influenced Microsoft's commercial AI efforts.[82] [83] In April 2020, Microsoft published content on principles, guidelines, and tools developed by the Aether Committee and its working groups, including teams focused on AI reliability and safety, bias and fairness, intelligibility and explanation, and human-AI collaboration.[84]
Publications
Selected articles
- Book: Horvitz, E. Principles of mixed-initiative user interfaces. May 1999. http://erichorvitz.com/chi99horvitz.pdf. 159–166. New York, NY. ACM. 10.1145/302979.303030. 0-201-48559-1. Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99. 8943607.
Podcasts
External links
__FORCETOC__
Notes and References
- News: Bonifacic . Igor . Microsoft appoints its first-ever chief scientific officer . 27 March 2020 . Engadget . 11 March 2020.
- Web site: Eric Horvitz. IEEE Xplore Digital Library. 3 June 2019.
- http://awards.acm.org/award_winners/horvitz_4722252.cfm ERIC HORVITZ ACM Fellows 2014
- Web site: 2013 SIGCHI Awards – ACM SIGCHI . 2022-03-22 . en-US.
- Web site: Election of New Members at the 2018 Spring Meeting | American Philosophical Society.
- Web site: The AAAI Feigenbaum Prize. AAAI. 14 April 2016.
- Web site: ERIC HORVITZ - Award Winner. ACM. 3 June 2019.
- Web site: Eric Horvitz, MD PhD. 2022-01-05. The White House. en-US., the Scientific Advisory Committee of the Allen Institute for Artificial Intelligence (AI2), and the Computer Science and Telecommunications Board (CSTB) Web site: Membership of the Computer Science and Telecommunications Board. 3 June 2019. The National Academies of Sciences, Engineering and Medicine. 3 June 2019. https://web.archive.org/web/20190603173942/http://sites.nationalacademies.org/CSTB/CSTB_042202. dead.
- Web site: About the Computer Science and Telecommunications Board. 2022-01-14. National Academies.
- Web site: Board of Regents. 3 June 2019. U.S. National Library of Medicine.
- News: Mackworth. Alan. Introduction of Eric Horvitz. AAAI Presidential Address. July 2008.
- Gershman. Samuel J.. Horvitz. Eric J.. Tenenbaum. Joshua B.. 17 July 2015. Computational rationality: A converging paradigm for intelligence in brains, minds, and machines. Science. 349. 6245. 273–278. 10.1126/science.aac6076. 26185246. 2015Sci...349..273G. 14818619.
- Howes. Andrew. Duggan. Geoffrey B.. Kalidindi. Kiran. Tseng. Yuan-Chi. Lewis. Richard L.. 1 July 2016. Predicting Short-term Remembering as Boundedly Optimal Strategy Choice. Cognitive Science. 40. 5. 1192–1223. 10.1111/cogs.12271. 26294328. free.
- Horvitz. Eric. July 1987. Reasoning about beliefs and actions under computational resource constraints. UAI'87 Proceedings of the Third Conference on Uncertainty in Artificial Intelligence. AUAI Press. Arlington, VA. 429–447. 0-444-87417-8.
- Horvitz. Eric. August 1988. Reasoning under varying and uncertain resource constraints. AAAI'88 Proceedings of the Seventh AAAI National Conference on Artificial Intelligence. AAAI Press. 111–116.
- Horvitz. Eric J.. Cooper. Gregory F.. Heckerman. David E.. August 1989. Reflection and action under scarce resources: theoretical principles and empirical study. IJCAI'89 Proceedings of the 11th International Joint Conference on Artificial Intelligence - Volume 2. Morgan Kaufmann Publishers Inc.. San Francisco, CA. 1121–1127.
- PhD . Horvitz. Eric. December 1990. Computation and Action Under Bounded Resources. Stanford University.
- Web site: Horvitz . Eric . Jan 13, 2020 . 2019 Annual Meeting Plenary: People, Machines, and Intelligence . 2020-04-02 . YouTube.
- Book: Horvitz, Eric . Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 . Principles of mixed-initiative user interfaces . May 1999 . http://erichorvitz.com/chi99horvitz.pdf . New York, NY . ACM . 159–166 . 10.1.1.78.7280 . 10.1145/302979.303030 . 0-201-48559-1 . 8943607.
- Horvitz . Eric . Paek . Tim . 2007-03-01 . Complementary computing: policies for transferring callers from dialog systems to human receptionists . User Modeling and User-Adapted Interaction . en . 17 . 1 . 159–182 . 10.1007/s11257-006-9026-1 . 2819237 . 1573-1391.
- Kamar . Ece . Hacker . Severin . Horvitz . Eric . 8 June 2018 . Combining human and machine intelligence in large-scale crowdsourcing . Proceeding, AAMAS '12 Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems - Volume 1 . Richland, SC . International Foundation for Autonomous Agents and Multiagent Systems . 1 . 467–474 . 978-0-9817381-1-6.
- Book: Wilder . Bryan . Horvitz . Eric . Kamar . Ece . Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence . Learning to Complement Humans . 2020-07-09 . https://www.ijcai.org/proceedings/2020/212 . en . 2. 1526–1533 . 10.24963/ijcai.2020/212. 978-0-9992411-6-5 . 218486980 .
- Horvitz . Eric . Barry . Matthew . August 1995 . Display of information for time-critical decision making . Proceeding, UAI'95 Proceedings of the Eleventh Conference on Uncertainty in Artificial Intelligence . San Francisco, CA . Morgan Kaufmann Publishers Inc . 296–305 . 1-55860-385-9.
- Horvitz . Eric . Heckerman . David . Nathwani . Bharat . Fagan . Lawrence . October 1986 . The use of a heuristic problem-solving hierarchy to facilitate the explanation of hypothesis-directed reasoning . Proceedings of Medinfo . 27–31.
- Horvitz . Eric . Kadie . Carl . Peak . Tim . Hovel . David . March 2003 . Models of attention in computing and communication: from principles to applications . Communications of the ACM . New York, NY . ACM . 46 . 52–59 . 10.1145/636772.636798 . 2584780.
- News: Markhoff . John . 17 July 2000 . Microsoft Sees Software 'Agent' as Way to Avoid Distractions . The New York Times . 3 June 2019.
- Book: Horvitz . Eric . Apacible . Johnson . Proceedings of the 5th international conference on Multimodal interfaces . Learning and reasoning about interruption . 2003-11-05 . https://doi.org/10.1145/958432.958440 . ICMI '03 . New York, NY, USA . Association for Computing Machinery . 20–27 . 10.1145/958432.958440 . 978-1-58113-621-0. 1183716 .
- Book: Horvitz . Eric . Koch . Paul . Apacible . Johnson . Proceedings of the 2004 ACM conference on Computer supported cooperative work . BusyBody . 2004-11-06 . https://doi.org/10.1145/1031607.1031690 . CSCW '04 . New York, NY, USA . Association for Computing Machinery . 507–510 . 10.1145/1031607.1031690 . 978-1-58113-810-8. 11517148 .
- Web site: Waldrop . M. Mitchell . 19 February 2008 . TR10: Modeling Surprise . 2022-01-11 . MIT Technology Review . en-us.
- Horvitz. E. Breese. J. Heckerman. D. Hovel. D. Rommelse. K. July 1998. The Lumiere Project: Bayesian User Modeling for Inferring the Goals and Needs of Software Users. Proceedings of UAI, Conference on Uncertainty in Artificial Intelligence. 256–265.
- Web site: Lumiere - Intelligent User Interface. 2009-08-31. YouTube. 1995. 2020-04-02.
- Web site: 2017-02-09. How the forgetfulness of one of Microsoft's top scientists inspired a killer new feature for Windows 10. 2022-01-11. Business Insider Australia. en-AU.
- Web site: Information Agents: Directions and Futures (2001). 2020-02-21. YouTube. 2001. 2020-04-02.
- Web site: ICMI Sustained Accomplishment Award. International Conference on Multimodal Interaction. 2020-04-02.
- Bohus. D. Horvitz. E. November 2009. Dialog in the Open World: Platform and Applications. ACM International Conference on Multimodal Interaction.
- Book: Bohus. D. The Handbook of Multimodal-Multisensor Interfaces, Volume 3. Horvitz. E. Association for Computing Machinery and Morgan & Claypool. 2019. 978-1-970001-75-4. 105–143. Situated Interaction.
- Web site: Elevating human-computer interaction to a new level of sophistication. 2014-04-08. YouTube. 2020-04-02.
- Book: Bohus. D. Horvitz. E. Proceedings of the SIGDIAL 2009 Conference on the 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue - SIGDIAL '09. Models for multiparty engagement in open-world dialog. September 2009. http://erichorvitz.com/Bohus_Horvitz_Multiparty_Engagement.pdf. 225–234. 10.3115/1708376.1708409. 9781932432640. 2125746.
- Krause. Andreas. Horvitz. Eric. November 2010. A Utility-Theoretic Approach to Privacy in Online Services. Journal of Artificial Intelligence Research. 39. 633–662. 10.1613/jair.3089. 1582192.
- Web site: 2019-05-28. Swimming in Creative Waters: The Art of Invention. 2022-01-13. Microsoft Research. en-US.
- Web site: Keizer. Gregg. 2007-01-19. Microsoft Predicts The Future With Vista's SuperFetch. 2022-01-13. InformationWeek. en.
- Book: Horvitz, Eric. Proceedings of the seventh international conference on Information and knowledge management . Continual computation policies for utility-directed prefetching . 1998-11-01. https://doi.org/10.1145/288627.288655. CIKM '98. New York, NY, USA. Association for Computing Machinery. 175–184. 10.1145/288627.288655. 978-1-58113-061-4. 13518550.
- Horvitz. Eric J.. Lengyel. Jed. 2013-02-06. Perception, Attention, and Resources: A Decision-Theoretic Approach to Graphics Rendering. cs.AI. 1302.1547.
- Book: Kolobov. Andrey. Peres. Yuval. Lubetzky. Eyal. Horvitz. Eric. Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval . Optimal Freshness Crawl Under Politeness Constraints . 2019-07-18. https://doi.org/10.1145/3331184.3331241. SIGIR'19. New York, NY, USA. Association for Computing Machinery. 495–504. 10.1145/3331184.3331241. 978-1-4503-6172-9. 196203203.
- Burnell. Lisa. Horvitz. Eric. 1995-03-01. Structure and chance: melding logic and probability for software debugging. Communications of the ACM. 38. 3. 31–ff. 10.1145/203330.203338. 9644536. 0001-0782.
- News: Hansen. Liane. Meet Laura, Your Virtual Personal Assistant. 16 March 2011. NPR. 21 March 2009.
- Web site: The Singularity: Humanity's Last Invention? . Kaste . Martin . 11 Jan 2011 . 14 Feb 2011 . NPR.
- Web site: Rose. Charlie. A panel discussion about Artificial Intelligence. 2011-03-12. https://web.archive.org/web/20110213142757/http://www.charlierose.com/guest/view/1221. 2011-02-13.
- News: Markoff. John. Microsoft Introduces Tool for Avoiding Traffic Jams. 16 March 2011. The New York Times. 10 April 2008.
- News: Markoff. John. Microsoft Sees Software 'Agent' as Way to Avoid Distractions. 16 March 2011. The New York Times. 17 July 2000.
- News: Lohr. Steve, and Markoff, John. Smarter Than You Think: Computers Learn to Listen, and Some Talk Back. 12 March 2011. The New York Times. 24 June 2010.
- Web site: Reflections on the Status and Future of Artificial Intelligence. Horvitz. Eric. 30 November 2016. erichorvitz.com. 3 June 2019.
- Web site: AI for Social Good (2016): Keynote AI in Support of People and Society. 2016-06-13. YouTube. 2020-04-20.
- Web site: Reflections on Safety and Artificial Intelligence. Horvitz. Eric. 2016-06-27. Eric Horvitz . 2020-04-20.
- Horvitz. Eric. 7 July 2017. AI, people, and society. Science. 357. 6346. 7. 10.1126/science.aao2466. 28684472. free. 2017Sci...357....7H.
- Dietterich. Thomas G. Horvitz. Eric J.. October 2015. Rise of Concerns about AI: Reflections and Directions. Communications of the ACM. 58. 10. 38–40. 10.1145/2770869. free.
- Web site: Conference on Ethics & AI: Keynote Session. 2018-04-09. YouTube. 2020-04-20.
- Web site: The Long View: AI Directions, Challenges, and Futures. Horvitz. Eric. 2017-03-28. YouTube. 2020-04-20.
- Web site: Keynote Address, Eric Horvitz: AI Advances, Aspirations—and Concerns. 2019-11-15. YouTube. 2020-04-20.
- Web site: Horvitz. Eric. Clyburn. Mignon. Felten. Ed. LeBlanc. Travis. 2021-05-17. Caution ahead: Navigating risks to freedoms posed by AI. 2022-01-19. TheHill. en.
- News: Horvitz. Eric. Mulligan. Deirdre. 17 July 2015. Data, privacy, and the greater good. 349. 253–254. Science. 6245. 19 Jan 2022.
- Web site: Horvitz. Eric. 2021-02-22. A promising step forward on disinformation. 2022-01-19. Microsoft On the Issues. en-US.
- News: Markoff. John. Scientists Worry Machines May Outsmart Man. York Times. 26 July 2009.
- News: Siegel. Robert. The Singularity: Humanity's Last Invention?. NPR. 11 January 2011.
- News: You. Jia. A 100-year study of artificial intelligence? Microsoft Research's Eric Horvitz explains. Science. 9 January 2015.
- News: Study to Examine Effects of Artificial Intelligence. Markoff. John. 15 December 2014. The New York Times. 1 October 2016.
- Web site: One-Hundred Year Study of Artificial Intelligence: Reflections and Framing. 2014. Eric Horvitz. 1 October 2016.
- News: Report: Artificial intelligence to transform urban cities. 1 September 2016. Houston Chronicle. 1 October 2016.
- News: AI in the real world: Tech leaders consider practical issues.. Dussault. Joseph. 4 September 2016. The Christian Science Monitor. 1 October 2016.
- Peter Stone et al. "Artificial Intelligence and Life in 2030." One Hundred Year Study on Artificial Intelligence: Report of the 2015-2016 Study Panel, Stanford University, Stanford, CA, September 2016. Doc: http://ai100.stanford.edu/2016-report. Accessed: October 1, 2016.
- News: Knight. Will. Artificial intelligence wants to be your bro, not your foe. 1 October 2016. MIT Technology Review. 1 September 2016.
- Web site: Stacey. Kevin. 16 Sep 2021. New Report Assesses Progress and Risks of Artificial Intelligence. 2022-01-20. Stanford University HAI News and Announcements. en.
- Web site: McKendrick. Joe. 18 Sep 2021. Artificial intelligence success is tied to ability to augment, not just automate. 2022-01-20. ZDNet. en.
- Web site: Report on Algorithmic Risk Assessment Tools in the U.S. Criminal Justice System. 2019-04-23. The Partnership on AI. en-US. 2020-04-24.
- Web site: Bringing Facial Recognition Systems To Light. 2020-02-18. The Partnership on AI. en-US. 2020-04-24.
- Web site: AI, Labor, and the Economy Case Study Compendium. 2019-04-30. The Partnership on AI. en-US. 2020-04-24.
- Web site: Introducing SafeLife: Safety Benchmarks for Reinforcement Learning. 2019-12-04. The Partnership on AI. en-US. 2020-04-24.
- Web site: AI and Media Integrity Steering Committee. 2019-12-05. The Partnership on AI. en-US. 2020-04-24.
- Web site: About ML. The Partnership on AI. en-US. 2020-04-24.
- Web site: Satya Nadella email to employees: Embracing our future: Intelligent Cloud and Intelligent Edge. Nadella. Satya. 2018-03-29. Microsoft Stories. 3 June 2019.
- Web site: Microsoft #TechTalk: AI and Ethics. 2019-07-17. YouTube. 2020-04-15.
- News: Microsoft is turning down some sales over AI ethics, top researcher Eric Horvitz says. Boyle. Alan. 9 April 2018. GeekWire. 3 June 2019.
- Web site: Conference on Ethics & AI: Keynote Session. 9 April 2018. YouTube. Carnegie Mellon University. 3 June 2019.
- Web site: Responsible AI principles from Microsoft. Microsoft Artificial Intelligence. 2020-04-15.