Progress in artificial intelligence explained

See also: History of artificial intelligence and Timeline of artificial intelligence. Progress in artificial intelligence (AI) refers to the advances, milestones, and breakthroughs that have been achieved in the field of artificial intelligence over time. AI is a multidisciplinary branch of computer science that aims to create machines and systems capable of performing tasks that typically require human intelligence. Artificial intelligence applications have been used in a wide range of fields including medical diagnosis, economic-financial applications, robot control, law, scientific discovery, video games, and toys. However, many AI applications are not perceived as AI: "A lot of cutting edge AI has filtered into general applications, often without being called AI because once something becomes useful enough and common enough it's not labeled AI anymore."[1] [2] "Many thousands of AI applications are deeply embedded in the infrastructure of every industry." In the late 1990s and early 21st century, AI technology became widely used as elements of larger systems,[3] but the field was rarely credited for these successes at the time.

Kaplan and Haenlein structure artificial intelligence along three evolutionary stages: 1) artificial narrow intelligence – applying AI only to specific tasks; 2) artificial general intelligence – applying AI to several areas and able to autonomously solve problems they were never even designed for; and 3) artificial super intelligence – applying AI to any area capable of scientific creativity, social skills, and general wisdom.[2]

To allow comparison with human performance, artificial intelligence can be evaluated on constrained and well-defined problems. Such tests have been termed subject matter expert Turing tests. Also, smaller problems provide more achievable goals and there are an ever-increasing number of positive results.

Humans still substantially outperform both GPT-4 and models trained on the ConceptARC benchmark that scored 60% on most, and 77% on one category, while humans 91% on all and 97% on one category.[4]

Current performance in specific areas

width=70Gamewidth=30Champion year[5] align=center width=30Legal states (log10)[6] align=center width=30Game tree complexity (log10)width=40Game of perfect information?width=15Ref.
Draughts (checkers) 1994 21 31 Perfect [7]
Othello (reversi) 1997 28 58 Perfect [8]
Chess 1997 46 123 Perfect
Scrabble 2006
Shogi 2017 71 226 Perfect [9]
Go 2016 172 360 Perfect
2017 Imperfect
StarCraft style="background:#e5d1cb"-270+Imperfect [10]
StarCraft II 2019 Imperfect [11]

There are many useful abilities that can be described as showing some form of intelligence. This gives better insight into the comparative success of artificial intelligence in different areas.

AI, like electricity or the steam engine, is a general-purpose technology. There is no consensus on how to characterize which tasks AI tends to excel at.[12] Some versions of Moravec's paradox observe that humans are more likely to outperform machines in areas such as physical dexterity that have been the direct target of natural selection.[13] While projects such as AlphaZero have succeeded in generating their own knowledge from scratch, many other machine learning projects require large training datasets.[14] [15] Researcher Andrew Ng has suggested, as a "highly imperfect rule of thumb", that "almost anything a typical human can do with less than one second of mental thought, we can probably now or in the near future automate using AI."[16]

Games provide a high-profile benchmark for assessing rates of progress; many games have a large professional player base and a well-established competitive rating system. AlphaGo brought the era of classical board-game benchmarks to a close when Artificial Intelligence proved their competitive edge over humans in 2016. Deep Mind's AlphaGo AI software program defeated the world's best professional Go Player Lee Sedol.[17] Games of imperfect knowledge provide new challenges to AI in the area of game theory; the most prominent milestone in this area was brought to a close by Libratus' poker victory in 2017.[18] [19] E-sports continue to provide additional benchmarks; Facebook AI, Deepmind, and others have engaged with the popular StarCraft franchise of videogames.[20] [21]

Broad classes of outcome for an AI test may be given as:

Optimal

See also: Solved game.

Super-human

Question answering, although the machine did not use speech recognition (2011)[33] [34]

High-human

Par-human

Sub-human

Proposed tests of artificial intelligence

In his famous Turing test, Alan Turing picked language, the defining feature of human beings, for its basis. The Turing test is now considered too exploitable to be a meaningful benchmark.[65]

The Feigenbaum test, proposed by the inventor of expert systems, tests a machine's knowledge and expertise about a specific subject.[66] A paper by Jim Gray of Microsoft in 2003 suggested extending the Turing test to speech understanding, speaking and recognizing objects and behavior.[67]

Proposed "universal intelligence" tests aim to compare how well machines, humans, and even non-human animals perform on problem sets that are generic as possible. At an extreme, the test suite can contain every possible problem, weighted by Kolmogorov complexity; however, these problem sets tend to be dominated by impoverished pattern-matching exercises where a tuned AI can easily exceed human performance levels.[68] [69] [70] [71] [72]

Exams

According to OpenAI, in 2023 ChatGPT GPT-4 scored the 90th percentile on the Uniform Bar Exam. On the SATs, GPT-4 scored the 89th percentile on math, and the 93rd percentile in Reading & Writing. On the GREs, it scored on the 54th percentile on the writing test, 88th percentile on the quantitative section, and 99th percentile on the verbal section. It scored in the 99th to 100th percentile on the 2020 USA Biology Olympiad semifinal exam. It scored a perfect "5" on several AP exams.[73]

Independent researchers found in 2023 that ChatGPT GPT-3.5 "performed at or near the passing threshold" for the three parts of the United States Medical Licensing Examination. GPT-3.5 was also assessed to attain a low, but passing, grade from exams for four law school courses at the University of Minnesota.[73] GPT-4 passed a text-based radiology board–style examination.[74] [75]

Competitions

See main article: Competitions and prizes in artificial intelligence. Many competitions and prizes, such as the Imagenet Challenge, promote research in artificial intelligence. The most common areas of competition include general machine intelligence, conversational behavior, data-mining, robotic cars, and robot soccer as well as conventional games.[76]

Past and current predictions

An expert poll around 2016, conducted by Katja Grace of the Future of Humanity Institute and associates, gave median estimates of 3 years for championship Angry Birds, 4 years for the World Series of Poker, and 6 years for StarCraft. On more subjective tasks, the poll gave 6 years for folding laundry as well as an average human worker, 7–10 years for expertly answering 'easily Googleable' questions, 8 years for average speech transcription, 9 years for average telephone banking, and 11 years for expert songwriting, but over 30 years for writing a New York Times bestseller or winning the Putnam math competition.

Chess

An AI defeated a grandmaster in a regulation tournament game for the first time in 1988; rebranded as Deep Blue, it beat the reigning human world chess champion in 1997 (see Deep Blue versus Garry Kasparov).[77]

Estimates when computers would exceed humans at Chess
Year prediction made Predicted year Number of years Predictor Contemporaneous source
19571967 or sooner 10 or less Herbert A. Simon, economist[78]
19902000 or sooner 10 or less Ray Kurzweil, futurist Age of Intelligent Machines[79]

Go

AlphaGo defeated a European Go champion in October 2015, and Lee Sedol in March 2016, one of the world's top players (see AlphaGo versus Lee Sedol). According to Scientific American and other sources, most observers had expected superhuman Computer Go performance to be at least a decade away.[80] [81] [82]

Estimates when computers would exceed humans at Go
Year prediction made Predicted year Number of years Predictor Affiliation Contemporaneous source
19972100 or later 103 or more Piet Hutt, physicist and Go fan New York Times[83] [84]
20072017 or sooner 10 or less Feng-Hsiung Hsu, Deep Blue lead Microsoft Research Asia IEEE Spectrum[85]
20142024 10 Rémi Coulom, Computer Go programmer Wired[86] [87]

Human-level artificial general intelligence (AGI)

AI pioneer and economist Herbert A. Simon inaccurately predicted in 1965: "Machines will be capable, within twenty years, of doing any work a man can do". Similarly, in 1970 Marvin Minsky wrote that "Within a generation... the problem of creating artificial intelligence will substantially be solved."[88]

Four polls conducted in 2012 and 2013 suggested that the median estimate among experts for when AGI would arrive was 2040 to 2050, depending on the poll.[89] [90]

The Grace poll around 2016 found results varied depending on how the question was framed. Respondents asked to estimate "when unaided machines can accomplish every task better and more cheaply than human workers" gave an aggregated median answer of 45 years and a 10% chance of it occurring within 9 years. Other respondents asked to estimate "when all occupations are fully automatable. That is, when for any occupation, machines could be built to carry out the task better and more cheaply than human workers" estimated a median of 122 years and a 10% probability of 20 years. The median response for when "AI researcher" could be fully automated was around 90 years. No link was found between seniority and optimism, but Asian researchers were much more optimistic than North American researchers on average; Asians predicted 30 years on average for "accomplish every task", compared with the 74 years predicted by North Americans.[91] [92] [93]

Estimates of when AGI will arrive
Year prediction made Predicted year Number of years Predictor Contemporaneous source
19651985 or sooner 20 or less Herbert A. Simon The shape of automation for men and management[94]
19932023 or sooner 30 or less Vernor Vinge, science fiction writer "The Coming Technological Singularity"[95]
19952040 or sooner 45 or less Hans Moravec, robotics researcher Wired[96]
2008Never / Distant future[97] IEEE Spectrum[98]
20172029 12 Ray Kurzweil Interview[99]

See also

External links

Notes and References

  1. http://www.cnn.com/2006/TECH/science/07/24/ai.bostrom/ AI set to exceed human brain power
  2. 10.1016/j.bushor.2018.08.004. Siri, Siri, in my hand: Who's the fairest in the land? On the interpretations, illustrations, and implications of artificial intelligence. Business Horizons. 62. 15–25. 2019. Kaplan. Andreas. Haenlein. Michael. 158433736.
  3. under "Artificial Intelligence in the 90s"
  4. News: Biever . Celeste . ChatGPT broke the Turing test — the race is on for new ways to assess AI . 25 July 2023 . . 26 July 2023 .
  5. Approximate year AI started beating top human experts
  6. van den Herik. H.Jaap. Uiterwijk. Jos W.H.M.. van Rijswijck. Jack. Games solved: Now and in the future. Artificial Intelligence. January 2002. 134. 1–2. 277–311. 10.1016/S0004-3702(01)00152-7. free.
  7. News: Madrigal. Alexis C.. How Checkers Was Solved. 6 May 2018. The Atlantic. 2017. 6 May 2018. https://web.archive.org/web/20180506124806/https://www.theatlantic.com/technology/archive/2017/07/marion-tinsley-checkers/534111/. live.
  8. Web site: www.othello-club.de. berg.earthlingz.de. 2018-07-15. 2018-07-15. https://web.archive.org/web/20180715181721/http://berg.earthlingz.de/ocd/programs.php?lang=en. live.
  9. News: Shogi prodigy breathes new life into the game The Japan Times. The Japan Times. 2018-07-15. en-US. 2018-07-15. https://web.archive.org/web/20180715181446/https://www.japantimes.co.jp/opinion/2017/06/29/editorials/shogi-prodigy-breathes-new-life-game/#.W0svONUza01. live.
  10. Facebook Quietly Enters StarCraft War for AI Bots, and Loses. 6 May 2018. WIRED. 2017. 7 May 2018. https://web.archive.org/web/20180507091035/https://www.wired.com/story/facebook-quietly-enters-starcraft-war-for-ai-bots-and-loses/. live.
  11. News: Sample . Ian . AI becomes grandmaster in 'fiendishly complex' StarCraft II . 28 February 2020 . The Guardian . 30 October 2019 . 29 December 2020 . https://web.archive.org/web/20201229185547/https://www.theguardian.com/technology/2019/oct/30/ai-becomes-grandmaster-in-fiendishly-complex-starcraft-ii . live .
  12. Brynjolfsson. Erik. Mitchell. Tom. What can machine learning do? Workforce implications. 7 May 2018. Science. 22 December 2017. 358. 6370. 1530–1534. en. 10.1126/science.aap8062. 29269459 . 2017Sci...358.1530B. 4036151 . 29 September 2021. https://web.archive.org/web/20210929161800/https://www.science.org/doi/10.1126/science.aap8062. live.
  13. News: IKEA furniture and the limits of AI. 24 April 2018. The Economist. 2018. en. 24 April 2018. https://web.archive.org/web/20180424014106/https://economist.com/news/leaders/21740735-humans-have-had-good-run-most-recent-breakthrough-robotics-it-clear. live.
  14. News: Sample. Ian. 'It's able to create knowledge itself': Google unveils AI that learns on its own. 7 May 2018. the Guardian. 18 October 2017. en. 19 October 2017. https://web.archive.org/web/20171019213849/https://www.theguardian.com/science/2017/oct/18/its-able-to-create-knowledge-itself-google-unveils-ai-learns-all-on-its-own. live.
  15. News: The AI revolution in science. 7 May 2018. Science AAAS. 5 July 2017. en. 14 December 2021. https://web.archive.org/web/20211214221104/https://www.science.org/content/article/ai-revolution-science. live.
  16. News: Will your job still exist in 10 years when the robots arrive?. 7 May 2018. South China Morning Post. 2017. en. 7 May 2018. https://web.archive.org/web/20180507221346/http://www.scmp.com/tech/innovation/article/2098164/robots-are-coming-here-are-some-jobs-wont-exist-10-years. live.
  17. Mokyr. Joel. 2019-11-01. The Technology Trap: Capital Labor, and Power in the Age of Automation. By Carl Benedikt Frey. Princeton: Princeton University Press, 2019. Pp. 480. $29.95, hardcover.. The Journal of Economic History. 79. 4. 1183–1189. 10.1017/s0022050719000639. 211324400. 0022-0507. 2020-11-25. 2023-02-02. https://web.archive.org/web/20230202181321/https://www.cambridge.org/core/journals/journal-of-economic-history/article/abs/technology-trap-capital-labor-and-power-in-the-age-of-automation-by-carl-benedikt-frey-princeton-princeton-university-press-2019-pp-480-2995-hardcover/F86C8E992A0EE1018ED110607A353A0D. live.
  18. News: Borowiec. Tracey Lien, Steven. AlphaGo beats human Go champ in milestone for artificial intelligence. 7 May 2018. Los Angeles Times. 2016. 13 May 2018. https://web.archive.org/web/20180513234132/http://www.latimes.com/world/asia/la-fg-korea-alphago-20160312-story.html. live.
  19. Brown. Noam. Sandholm. Tuomas. Superhuman AI for heads-up no-limit poker: Libratus beats top professionals. Science. 26 January 2018. 359 . 6374 . 418–424. en. 10.1126/science.aao1733. 29249696 . 2018Sci...359..418B . 5003977 . free.
  20. Ontanon. Santiago. Synnaeve. Gabriel. Uriarte. Alberto. Richoux. Florian. Churchill. David. Preuss. Mike. A Survey of Real-Time Strategy Game AI Research and Competition in StarCraft. IEEE Transactions on Computational Intelligence and AI in Games. December 2013. 5. 4. 293–311. 10.1109/TCIAIG.2013.2286295. 10.1.1.406.2524. 5014732.
  21. Facebook Quietly Enters StarCraft War for AI Bots, and Loses. 7 May 2018. WIRED. 2017. 2 February 2023. https://web.archive.org/web/20230202181319/https://www.wired.com/story/facebook-quietly-enters-starcraft-war-for-ai-bots-and-loses/. live.
  22. Schaeffer . J.. Burch . N.. Bjornsson . Y.. Kishimoto . A.. Muller . M.. Lake . R.. Lu . P.. Sutphen . S.. Checkers is solved. Science. 317. 5844. 1518–1522. 2007. 17641166. 10.1126/science.1144079. 10.1.1.95.5393. 2007Sci...317.1518S. 10274228.
  23. Web site: God's Number is 20. 2011-08-07. 2013-07-21. https://web.archive.org/web/20130721182026/http://www.cube20.org/. live.
  24. 10.1126/science.1259433. Heads-up limit hold'em poker is solved. Science. 347. 6218. 145–9. 2015. Bowling. M.. Burch. N.. Johanson. M.. Tammelin. O.. 25574016. 2015Sci...347..145B. 10.1.1.697.72. 3796371.
  25. In Major AI Breakthrough, Google System Secretly Beats Top Player at the Ancient Game of Go. 28 December 2017. WIRED. 2 February 2017. https://web.archive.org/web/20170202211927/https://www.wired.com/2016/01/in-a-huge-breakthrough-googles-ai-beats-a-top-player-at-the-game-of-go/. live.
  26. Sheppard . B.. World-championship-caliber Scrabble. Artificial Intelligence. 134. 1–2. 241–275. 2002. 10.1016/S0004-3702(01)00166-7. free.
  27. Webley. Kayla. Top 10 Man-vs.-Machine Moments. 28 December 2017. Time. 15 February 2011. 26 December 2017. https://web.archive.org/web/20171226005745/http://content.time.com/time/specials/packages/article/0,28804,2049187_2049195_2049083,00.html. live.
  28. Tesauro . Gerald . Temporal difference learning and TD-Gammon . Communications of the ACM . 38 . 3 . March 1995 . 58–68 . 10.1145/203330.203343 . 8763243 . 2008-03-26 . 2013-01-11 . https://web.archive.org/web/20130111060444/http://www.research.ibm.com/massive/tdl.html . live . free .
  29. Tesauro. Gerald. Programming backgammon using self-teaching neural nets. Artificial Intelligence. January 2002. 134. 1–2. 181–199. 10.1016/S0004-3702(01)00110-2. ...at least two other neural net programs also appear to be capable of superhuman play.
  30. News: Kramnik vs Deep Fritz: Computer wins match by 4:2. 2006-12-05. Chess News. 2018-07-15. en-US. 2018-11-25. https://web.archive.org/web/20181125095823/https://en.chessbase.com/post/kramnik-vs-deep-fritz-computer-wins-match-by-4-2. live.
  31. Web site: The Week in Chess 771. theweekinchess.com. 2018-07-15. 2018-11-15. https://web.archive.org/web/20181115020103/http://theweekinchess.com/html/twic771.html#13. live.
  32. Web site: Zor Winner in an Exciting Photo Finish. Nickel. Arno. May 2017. www.infinitychess.com. Innovative Solutions. 2018-07-17. ... on third place the best centaur .... 2018-08-17. https://web.archive.org/web/20180817111551/http://infinitychess.com/Page/Public/Article/DefaultArticle.aspx?id=322. live.
  33. News: Markoff . John . 2011-02-16 . Computer Wins on 'Jeopardy!': Trivial, It's Not . en-US . The New York Times . 2023-02-22 . 0362-4331.
  34. News: IBM Watson Vanquishes Human Jeopardy Foes. Jackson. Joab. PC World. IDG News. 2011-02-17. 2011-02-20. https://web.archive.org/web/20110220020908/http://www.pcworld.com/article/219893/ibm_watson_vanquishes_human_jeopardy_foes.html. live.
  35. Web site: The Arimaa Challenge. arimaa.com. 2018-07-15. 2010-03-22. https://web.archive.org/web/20100322201944/http://arimaa.com/arimaa/challenge/. live.
  36. News: Roeder. Oliver. The Bots Beat Us. Now What?. 28 December 2017. FiveThirtyEight. 10 July 2017. 28 December 2017. https://web.archive.org/web/20171228171720/https://fivethirtyeight.com/features/the-bots-beat-us-now-what/. live.
  37. News: AlphaGo beats Ke Jie again to wrap up three-part match. The Verge. 2018-07-15. 2018-07-15. https://web.archive.org/web/20180715181631/https://www.theverge.com/2017/5/25/15689462/alphago-ke-jie-game-2-result-google-deepmind-china. live.
  38. Brown . Noam. Sandholm. Tuomas. Superhuman AI for heads-up no-limit poker: Libratus beats top professionals. Science. 359. 6374. 418–424. 2017. 10.1126/science.aao1733. 29249696. 2018Sci...359..418B. free.
  39. Blair . Alan . Saffidine . Abdallah . AI surpasses humans at six-player poker . Science . 30 August 2019 . 365 . 6456 . 864–865 . 10.1126/science.aay7774 . 31467208 . 2019Sci...365..864B . 201672421 . 30 June 2022 . 18 July 2022 . https://web.archive.org/web/20220718200144/https://www.science.org/doi/10.1126/science.aay7774 . live .
  40. News: Sony's new AI driver achieves 'reliably superhuman' race times in Gran Turismo. The Verge. 2022-07-19. 2022-07-20. https://web.archive.org/web/20220720023339/https://www.theverge.com/2022/2/9/22925420/sony-ai-gran-turismo-driving-gt-sophy-nature-paper. live.
  41. Proverb: The probabilistic cruciverbalist. By Greg A. Keim, Noam Shazeer, Michael L. Littman, Sushant Agarwal, Catherine M. Cheves, Joseph Fitzgerald, Jason Grosland, Fan Jiang, Shannon Pollard, and Karl Weinmeister. 1999. In Proceedings of the Sixteenth National Conference on Artificial Intelligence, 710-717. Menlo Park, Calif.: AAAI Press.
  42. News: 'Dr. Fill' vies for crossword solving supremacy, but still comes up short. Adam. Wernick. 24 Sep 2014. Public Radio International. Dec 27, 2017. The first year, Dr. Fill came in 141st out of about 600 competitors. It did a little better the second-year; last year it was 65th. 2017-12-28. https://web.archive.org/web/20171228175445/https://www.pri.org/stories/2014-09-24/dr-fill-vies-crossword-solving-supremacy-still-comes-short. live.
  43. News: Arago's AI can now beat some human players at complex civ strategy games.. 20 July 2022. TechCrunch. 6 December 2016. 5 June 2022. https://web.archive.org/web/20220605151457/https://techcrunch.com/2016/12/06/aragos-ai-can-now-beat-some-human-players-at-complex-civ-strategy-games/. live.
  44. News: AI bots trained for 180 years a day to beat humans at Dota 2.. 17 July 2018. The Verge. 25 June 2018. 25 June 2018. https://web.archive.org/web/20180625183203/https://www.theverge.com/2018/6/25/17492918/openai-dota-2-bot-ai-five-5v5-matches. live.
  45. Bethe, P. M. (2009). The state of automated bridge play.
  46. Web site: AlphaStar: Mastering the Real-Time Strategy Game StarCraft II. 24 January 2019 . 2022-07-19. 2022-07-22. https://web.archive.org/web/20220722140448/https://www.deepmind.com/blog/alphastar-mastering-the-real-time-strategy-game-starcraft-ii. live.
  47. Web site: Suphx: The World Best Mahjong AI. Microsoft. 2022-07-19. 2022-07-19. https://web.archive.org/web/20220719233921/https://www.microsoft.com/en-us/research/project/suphx-mastering-mahjong-with-deep-reinforcement-learning/. live.
  48. News: Deepmind AI Researchers Introduce 'DeepNash', An Autonomous Agent Trained With Model-Free Multiagent Reinforcement Learning That Learns To Play The Game Of Stratego At Expert Level.. 19 July 2022. MarkTechPost. 9 July 2022. 9 July 2022. https://web.archive.org/web/20220709215709/https://www.marktechpost.com/2022/07/09/deepmind-ai-researchers-introduce-deepnash-an-autonomous-agent-trained-with-model-free-multiagent-reinforcement-learning-that-learns-to-play-the-game-of-stratego-at-expert-level/. live.
  49. 2210.05492 . Mastering the Game of No-Press Diplomacy via Human-Regularized Reinforcement Learning and Planning . 11 October 2022 . cs.GT . Bakhtin . Anton . Wu . David . Lerer . Adam . Gray . Jonathan . Jacob . Athul . Farina . Gabriele . Miller . Alexander . Brown . Noam .
  50. 2210.05125 . Human-AI Coordination via Human-Regularized Search and Learning . 11 October 2022 . cs.AI . Hu . Hengyuan . Wu . David . Lerer . Adam . Foerster . Jakob . Brown . Noam .
  51. Web site: Microsoft researchers say their newest deep learning system beats humans -- and Google - VentureBeat - Big Data - by Jordan Novet. VentureBeat. 2015-02-10. 2017-09-08. 2017-08-09. https://web.archive.org/web/20170809060105/https://venturebeat.com/2015/02/09/microsoft-researchers-say-their-newest-deep-learning-system-beats-humans-and-google/. live.
  52. 1605.06065 . One-shot Learning with Memory-Augmented Neural Networks . p. 5, Table 1 . 19 May 2016 . 4.2. Omniglot Classification: "The network exhibited high classification accuracy on just the second presentation of a sample from a class within an episode (82.8%), reaching up to 94.9% accuracy by the fifth instance and 98.1% accuracy by the tenth. . Santoro . Adam . Bartunov . Sergey . Botvinick . Matthew . Wierstra . Daan . Lillicrap . Timothy . cs.LG .
  53. Web site: Man Versus Machine: Who Wins When It Comes to Facial Recognition?. Neuroscience News. 2018-12-03. 2022-07-20. 2022-07-20. https://web.archive.org/web/20220720033355/https://neurosciencenews.com/man-machine-facial-recognition-120191/. live.
  54. 2111.08896 . Achieving Human Parity on Visual Question Answering . 17 November 2021 . cs.CL . Yan . Ming . Xu . Haiyang . Li . Chenliang . Tian . Junfeng . Bi . Bin . Wang . Wei . Chen . Weihua . Xu . Xianzhe . Wang . Fan . Cao . Zheng . Zhang . Zhicheng . Zhang . Qiyu . Zhang . Ji . Huang . Songfang . Huang . Fei . Si . Luo . Jin . Rong .
  55. Zhang, D., Mishra, S., Brynjolfsson, E., Etchemendy, J., Ganguli, D., Grosz, B., ... & Perrault, R. (2021). The AI index 2021 annual report. AI Index (Stanford University). arXiv preprint arXiv:2103.06312.
  56. News: Metz . Cade . A Breakthrough for A.I. Technology: Passing an 8th-Grade Science Test . 5 January 2023 . The New York Times . 4 September 2019 . 5 January 2023 . https://web.archive.org/web/20230105051148/https://www.nytimes.com/2019/09/04/technology/artificial-intelligence-aristo-passed-test.html . live .
  57. McMillan . Robert . Google's AI Is Now Smart Enough to Play Atari Like the Pros . 5 January 2023 . Wired . 2015 . 5 January 2023 . https://web.archive.org/web/20230105053006/https://www.wired.com/2015/02/google-ai-plays-atari-like-pros/ . live .
  58. News: Robots with legs are getting ready to walk among us. 28 December 2017. The Verge. 28 December 2017. https://web.archive.org/web/20171228171515/https://www.theverge.com/2017/2/22/14635530/bipedal-legged-robots-mobility-advantages. live.
  59. News: Hurst. Nathan. Why Funny, Falling, Soccer-Playing Robots Matter. 28 December 2017. Smithsonian. en. 28 December 2017. https://web.archive.org/web/20171228171803/https://www.smithsonianmag.com/innovation/why-funny-falling-soccer-playing-robots-matter-180964260/. live.
  60. News: The Business of Artificial Intelligence. 28 December 2017. Harvard Business Review. 18 July 2017. en. 29 December 2017. https://web.archive.org/web/20171229064652/https://hbr.org/cover-story/2017/07/the-business-of-artificial-intelligence. live.
  61. Brynjolfsson, E., & Mitchell, T. (2017). What can machine learning do? Workforce implications. Science, 358(6370), 1530-1534.
  62. van der Maas . Han L.J. . Snoek . Lukas . Stevenson . Claire E. . How much intelligence is there in artificial intelligence? A 2020 update . Intelligence . July 2021 . 87 . 101548 . 10.1016/j.intell.2021.101548. 236236331 . free .
  63. Nie, W., Yu, Z., Mao, L., Patel, A. B., Zhu, Y., & Anandkumar, A. (2020). Bongard-logo: A new benchmark for human-level concept learning and reasoning. Advances in Neural Information Processing Systems, 33, 16468-16480.
  64. Stephenson . Matthew . Renz . Jochen . Ge . Xiaoyu . The computational complexity of Angry Birds . Artificial Intelligence . March 2020 . 280 . 103232 . 10.1016/j.artint.2019.103232 . 1812.07793 . 56475869 . Despite many different attempts over the past five years the problem is still largely unsolved, with AI approaches far from human-level performance..
  65. Schoenick. Carissa. Clark. Peter. Tafjord. Oyvind. Turney. Peter. Etzioni. Oren. 23 August 2017. Moving beyond the Turing Test with the Allen AI Science Challenge. Communications of the ACM. 60. 9. 60–64. 1604.04315. 10.1145/3122814. 6383047.
  66. Feigenbaum. Edward A.. 2003. Some challenges and grand challenges for computational intelligence. Journal of the ACM. 50. 1. 32–40. 10.1145/602382.602400. 15379263.
  67. Gray. Jim . 2003. What Next? A Dozen Information-Technology Research Goals. Journal of the ACM. 50. 1. 41–57. 1999cs.......11005G . cs/9911005 . 10.1145/602382.602401. 10336312 .
  68. Hernandez-Orallo. Jose. 2000. Beyond the Turing Test. Journal of Logic, Language and Information. 9. 4. 447–466. 10.1023/A:1008367325700. 14481982.
  69. Web site: Kuang-Cheng . Andy Wang . 2023 . International licensing under an endogenous tariff in vertically-related markets . 2023-04-23 . Journal of Economics . en.
  70. Dowe. D. L.. Hajek. A. R.. 1997. A computational extension to the Turing Test. dead. Proceedings of the 4th Conference of the Australasian Cognitive Science Society. https://web.archive.org/web/20110628194905/http://www.csse.monash.edu.au/publications/1997/tr-cs97-322-abs.html. 28 June 2011. dmy-all.
  71. Hernandez-Orallo. J.. Dowe. D. L.. 2010. Measuring Universal Intelligence: Towards an Anytime Intelligence Test. Artificial Intelligence. 174. 18. 1508–1539. 10.1.1.295.9079. 10.1016/j.artint.2010.09.006.
  72. Hernández-Orallo. José. Dowe. David L.. Hernández-Lloreda. M.Victoria. March 2014. Universal psychometrics: Measuring cognitive abilities in the machine kingdom. Cognitive Systems Research. 27. 50–74. 10.1016/j.cogsys.2013.06.001. free. 10251/50244. 26440282.
  73. News: Varanasi . Lakshmi . AI models like ChatGPT and GPT-4 are acing everything from the bar exam to AP Biology. Here's a list of difficult exams both AI versions have passed. . 22 June 2023 . Business Insider . March 2023.
  74. News: Rudy . Melissa . Latest version of ChatGPT passes radiology board-style exam, highlights AI's 'growing potential,' study finds . 22 June 2023 . Fox News . 24 May 2023.
  75. Bhayana . Rajesh . Bleakney . Robert R. . Krishna . Satheesh . GPT-4 in Radiology: Improvements in Advanced Reasoning . Radiology . 1 June 2023 . 307 . 5 . e230987 . 10.1148/radiol.230987 . 37191491 . 258716171 .
  76. Web site: ILSVRC2017. 2018-11-06. image-net.org. en. 2018-11-02. https://web.archive.org/web/20181102131747/http://www.image-net.org/challenges/LSVRC/2017/. live.
  77. News: McClain. Dylan Loeb. Bent Larsen, Chess Grandmaster, Dies at 75. 31 January 2018. The New York Times. 11 September 2010. 25 March 2014. https://archive.today/20140325101752/http://www.nytimes.com/2010/09/11/world/americas/11larsen.html. live.
  78. News: The Business of Artificial Intelligence. 31 January 2018. Harvard Business Review. 18 July 2017. en. 18 January 2018. https://web.archive.org/web/20180118021138/https://hbr.org/cover-story/2017/07/the-business-of-artificial-intelligence. live.
  79. News: 4 Crazy Predictions About the Future of Art. 31 January 2018. Inc.com. 2017. en. 12 September 2017. https://web.archive.org/web/20170912004046/https://www.inc.com/kevin-j-ryan/ray-kurzweil-future-of-storytelling-sxsw-2017.html. live.
  80. News: Koch. Christof. How the Computer Beat the Go Master. 31 January 2018. Scientific American. 2016. en. 6 September 2017. https://web.archive.org/web/20170906224946/https://www.scientificamerican.com/article/how-the-computer-beat-the-go-master/. live.
  81. News: 'I'm in shock!' How an AI beat the world's best human at Go. 31 January 2018. New Scientist. 2016. 13 May 2016. https://web.archive.org/web/20160513193612/https://www.newscientist.com/article/2079871-im-in-shock-how-an-ai-beat-the-worlds-best-human-at-go/. live.
  82. News: Moyer. Christopher. How Google's AlphaGo Beat a Go World Champion. 31 January 2018. The Atlantic. 2016. 31 January 2018. https://web.archive.org/web/20180131200838/https://www.theatlantic.com/technology/archive/2016/03/the-invisible-opponent/475611/. live.
  83. News: Johnson. George. To Test a Powerful Computer, Play an Ancient Game. 31 January 2018. The New York Times. 29 July 1997. 31 January 2018. https://web.archive.org/web/20180131140930/http://www.nytimes.com/1997/07/29/science/to-test-a-powerful-computer-play-an-ancient-game.html?pagewanted=all. live.
  84. News: Johnson. George. To Beat Go Champion, Google's Program Needed a Human Army. 31 January 2018. The New York Times. 4 April 2016. 31 January 2018. https://web.archive.org/web/20180131200740/https://www.nytimes.com/2016/04/05/science/google-alphago-artificial-intelligence.html. live.
  85. News: Cracking GO. 31 January 2018. IEEE Spectrum: Technology, Engineering, and Science News. 2007. en. 31 January 2018. https://web.archive.org/web/20180131202330/https://spectrum.ieee.org/computing/software/cracking-go. live.
  86. The Mystery of Go, the Ancient Game That Computers Still Can't Win. 31 January 2018. WIRED. 2014. 31 January 2016. https://web.archive.org/web/20160131132350/http://www.wired.com/2014/05/the-world-of-computer-go/. live.
  87. Gibney. Elizabeth. Google AI algorithm masters ancient game of Go. Nature. 28 January 2016. 529. 7587. 445–446. en. 10.1038/529445a. 26819021 . 2016Natur.529..445G. 4460235 . free.
  88. Book: Bostrom. Nick. Superintelligence. 2013. Oxford University Press. Oxford. 978-0199678112. en. Superintelligence (book).
  89. Khatchadourian. Raffi. The Doomsday Invention. 31 January 2018. The New Yorker. 16 November 2015. 29 April 2019. https://web.archive.org/web/20190429183807/https://www.newyorker.com/magazine/2015/11/23/doomsday-invention-artificial-intelligence-nick-bostrom. live.
  90. Müller, V. C., & Bostrom, N. (2016). Future progress in artificial intelligence: A survey of expert opinion. In Fundamental issues of artificial intelligence (pp. 555-572). Springer, Cham.
  91. News: Gray. Richard. How long will it take for your job to be automated?. 31 January 2018. BBC. 2018. en. 11 January 2018. https://web.archive.org/web/20180111134529/http://www.bbc.com/capital/story/20170619-how-long-will-it-take-for-your-job-to-be-automated. live.
  92. News: AI will be able to beat us at everything by 2060, say experts. 31 January 2018. New Scientist. 2018. 31 January 2018. https://web.archive.org/web/20180131202306/https://www.newscientist.com/article/2133188-ai-will-be-able-to-beat-us-at-everything-by-2060-say-experts/. live.
  93. Grace, K., Salvatier, J., Dafoe, A., Zhang, B., & Evans, O. (2017). When will AI exceed human performance? Evidence from AI experts. arXiv preprint arXiv:1705.08807.
  94. Muehlhauser, L., & Salamon, A. (2012). Intelligence explosion: Evidence and import. In Singularity Hypotheses (pp. 15-42). Springer, Berlin, Heidelberg.
  95. News: Tierney. John. Vernor Vinge's View of the Future - Is Technology That Outthinks Us a Partner or a Master ?. 31 January 2018. The New York Times. 25 August 2008. 24 December 2017. https://web.archive.org/web/20171224122936/http://www.nytimes.com/2008/08/26/science/26tier.html. live.
  96. Superhumanism. 31 January 2018. WIRED. 1995. 2 September 2017. https://web.archive.org/web/20170902005717/https://www.wired.com/1995/10/moravec/. live.
  97. IEEE Spectrum attributes to Moore both "Never" and "I don't believe this kind of thing is likely to happen, at least for a long time"
  98. News: Tech Luminaries Address Singularity. 31 January 2018. IEEE Spectrum: Technology, Engineering, and Science News. 2008. en. 30 April 2019. https://web.archive.org/web/20190430150019/https://spectrum.ieee.org/computing/hardware/tech-luminaries-address-singularity. live.
  99. News: Molloy. Mark. Expert predicts date when 'sexier and funnier' humans will merge with AI machines. 31 January 2018. The Telegraph. 17 March 2017. 31 January 2018. https://web.archive.org/web/20180131225240/http://www.telegraph.co.uk/technology/2017/03/17/expert-predicts-date-sexier-funnier-humans-will-merge-ai-machines/. live.