Anthropic Explained
Anthropic PBC is a U.S.-based artificial intelligence (AI) startup public-benefit company, founded in 2021. It researches and develops AI to "study their safety properties at the technological frontier" and use this research to deploy safe, reliable models for the public.[2] [3] Anthropic has developed a family of large language models (LLMs) named Claude as a competitor to OpenAI's ChatGPT and Google's Gemini.[4]
Anthropic was founded by former members of OpenAI, siblings Daniela Amodei and Dario Amodei. In September 2023, Amazon announced an investment of up to $4 billion, followed by a $2 billion commitment from Google in the following month.[5] [6] [7]
History
Anthropic was founded in 2021 by seven former employees of OpenAI, including siblings Daniela Amodei and Dario Amodei, the latter of whom served as OpenAI's Vice President of Research.[8]
In April of 2022, Anthropic announced it had received $580 million in funding,[9] with $500 million of this funding coming from FTX under the leadership of Sam Bankman-Fried.[10] [11]
In the summer of 2022, Anthropic finished training the first version of Claude but did not release it, mentioning the need for further internal safety testing and the desire to avoid initiating a potentially hazardous race to develop increasingly powerful AI systems.[12]
In February 2023, Anthropic was sued by Texas-based Anthrop LLC for the use of its registered trademark "Anthropic A.I."[13] On September 25, 2023, Amazon announced a partnership with Anthropic, with Amazon becoming a minority stakeholder by initially investing $1.25 billion, and planning a total investment of $4 billion. As part of the deal, Anthropic would use Amazon Web Services (AWS) as its primary cloud provider and make its AI models available to AWS customers.[14] The next month, Google invested $500 million in Anthropic, and committed to an additional $1.5 billion over time.
In March 2024, Amazon maxed out its potential investment from the agreement made in the prior year by investing another US $2.75 billion into Anthropic, completing its $4 billion investment.
Participants
Key employees
- Dario Amodei: Co-Founder and Chief Executive Officer[15]
- Daniela Amodei: Co-Founder and President
- Jason Clinton: Chief Information Security Officer[16]
- Jared Kaplan: Co-Founder and Chief Science Officer[17]
- Ben Mann: Co-Founder and Member of Technical Staff
- Jack Clark: Co-Founder and Head of Policy[18] [19]
- Mike Krieger: Chief Product Officer[20] [21]
- Jan Leike: ex-OpenAI alignment researcher[22]
Board of Directors
- Dario Amodei: Chief Executive Officer[23]
- Daniela Amodei: representative of common shareholders
- Luke Muehlhauser: representative of Series A shareholders
- Yasmin Razavi: representative of Series C shareholders[24]
Investors
- Amazon.com – $4B
- Google – $2B
- Menlo Ventures – $750M[25]
- Wisdom Ventures[26]
- Ripple Impact Investments[27]
- Factorial Funds[28]
Motives
According to Anthropic, the company's goal is to research the safety and reliability of artificial intelligence systems.[29] The Amodei siblings were among those who left OpenAI due to directional differences, specifically regarding OpenAI's ventures with Microsoft in 2019. Anthropic incorporated itself as a Delaware public-benefit corporation (PBC), which requires the company to maintain a balance between private and public interests.[30]
Anthropic is a corporate "Long-Term Benefit Trust", a company-derived entity that requires the company's directors to align the company's priorities with the public benefit rather than profit in "extreme" instances of "catastrophic risk".[31] [32] As of September 19, 2023, members of the Trust included Jason Matheny (CEO and President of the RAND Corporation), Kanika Bahl (CEO and President of Evidence Action),[33] Neil Buddy Shah (CEO of the Clinton Health Access Initiative),[34] Paul Christiano (Founder of the Alignment Research Center),[35] and Zach Robinson (CEO of Effective Ventures US).[36] [37]
Projects
Claude
See main article: Claude (language model). Claude incorporates "Constitutional AI" to set safety guidelines for the model's output.[38] The name, "Claude", was chosen either as a reference to mathematician Claude Shannon, or as a male name to contrast the female names of other A.I. assistants such as Alexa, Siri, and Cortana.
Anthropic initially released two versions of its model, Claude and Claude Instant, in March 2023, with the latter being a more lightweight model.[39] [40] [41] The next iteration, Claude 2, was launched in July 2023.[42] Unlike Claude, which was only available to select users, Claude 2 is available for public use.
Claude 3 was released on March 4, 2024, unveiling three language models: Opus, Sonnet, and Haiku.[43] [44] The Opus model is the largest and most capable—according to Anthropic, it outperforms the leading models from OpenAI (GPT-4, GPT-3.5) and Google (Gemini Ultra). Sonnet and Haiku are Anthropic's medium- and small-sized models, respectively. All three models can accept image input. Amazon has incorporated Claude 3 into Bedrock, an Amazon Web Services-based platform for cloud AI services.[45]
On May 1, 2024, Anthropic announced the Claude Team plan, its first enterprise offering for Claude, and Claude iOS app.[46]
On June 20, 2024, Anthropic released Claude 3.5 Sonnet, which demonstrated significantly improved performance on benchmarks compared to the larger Claude 3 Opus, notably in areas such as coding, multistep workflows, chart interpretation, and text extraction from images. Released alongside 3.5 Sonnet was the new Artifacts capability in which Claude was able to create code in a dedicated window in the interface and preview select code in real time such as websites or SVGs.[47]
Constitutional AI
According to Anthropic, Constitutional AI (CAI) is a framework developed to align AI systems with human values and ensure that they are helpful, harmless, and honest.[48] Within this framework, humans provide a set of rules describing the desired behavior of the AI system, known as the "constitution". The AI system evaluates the generated output and then adjusts the AI models to better fit the constitution. The self-reinforcing process aims to avoid harm, respect preferences, and provide true information.[49]
Some of the principles of Claude 2's constitution are derived from documents such as the 1948 Universal Declaration of Human Rights and Apple's terms of service. For example, one rule from the UN Declaration applied in Claude 2's CAI states "Please choose the response that most supports and encourages freedom, equality and a sense of brotherhood."
Interpretability research
Anthropic also publishes research on the interpretability of machine learning systems, focusing on the transformer architecture.[50] [51]
Part of Anthropic's research aims to be able to automatically identify "features" in generative pretrained transformers like Claude. In a neural network, a feature is a pattern of neural activations that corresponds to a concept. Using a compute-intensive technique called "dictionary learning", Anthropic was able to identify millions of features in Claude, including for example one associated with the Golden Gate Bridge. Enhancing the ability to identify and edit features is expected to have significant safety implications.[52] [53] [54]
Lawsuit
On October 18, 2023, Anthropic was sued by Concord, Universal, ABKCO, and other music publishers for, per the complaint, "systematic and widespread infringement of their copyrighted song lyrics."[55] [56] [57] They alleged that the company used copyrighted material without permission in the form of song lyrics.[58] The plaintiffs asked for up to $150,000 for each work infringed upon by Anthropic, citing infringement of copyright laws. In the lawsuit, the plaintiffs support their allegations of copyright violations by citing several examples of Anthropic's Claude model outputting copied lyrics from songs such as Katy Perry's "Roar" and Gloria Gaynor's "I Will Survive". Additionally, the plaintiffs alleged that even given some prompts that did not directly state a song name, the model responded with modified lyrics based on original work.
On January 16, 2024, Anthropic claimed that the music publishers were not unreasonably harmed and that the examples noted by plaintiffs were merely bugs.[59]
See also
External links
Notes and References
- Web site: Inside Anthropic, the AI Company Betting That Safety Can Be a Winning Strategy. Time. en. 30 May 2024. 14 June 2024. https://archive.today/20240614221916/https://time.com/6980000/anthropic/. live.
- Web site: Vincent . James . 2023-02-03 . Google invested $300 million in AI firm founded by former OpenAI researchers . live . https://web.archive.org/web/20230206075725/https://www.theverge.com/2023/2/3/23584540/google-anthropic-investment-300-million-openai-chatgpt-rival-claude . 2023-02-06 . 2023-02-06 . The Verge . en-US.
- Web site: 5 February 2023 . ChatGPT must be regulated and A.I. 'can be used by bad actors,' warns OpenAI's CTO . live . https://web.archive.org/web/20230206075725/https://finance.yahoo.com/news/artificial-intelligence-must-regulated-warns-204546351.html . 2023-02-06 . 2023-02-06 . Fortune . en-US . finance.yahoo.com.
- News: Metz . Cade . 2024-03-04 . A.I. Start-Up Anthropic Challenges OpenAI and Google With New Chatbot . 2024-03-07 . The New York Times . en-US . 0362-4331.
- News: Dastin . Jeffrey . September 28, 2023 . Amazon steps up AI race with Anthropic investment . live . https://web.archive.org/web/20231105110524/https://www.reuters.com/markets/deals/amazon-steps-up-ai-race-with-up-4-billion-deal-invest-anthropic-2023-09-25/ . 2023-11-05 . 2023-10-02 . Reuters.
- Web site: Coldewey . Devin . 2024-03-27 . Amazon doubles down on Anthropic, completing its planned $4B investment . 2024-03-28 . TechCrunch . en-US.
- News: Hu . Krystal . October 27, 2023 . Google agrees to invest up to $2 billion in OpenAI rival Anthropic . live . https://web.archive.org/web/20231102122701/https://www.reuters.com/technology/google-agrees-invest-up-2-bln-openai-rival-anthropic-wsj-2023-10-27/ . 2023-11-02 . 2023-10-30 . Reuters.
- Web site: 2023-04-07 . As Anthropic seeks billions to take on OpenAI, 'industrial capture' is nigh. Or is it? . live . https://web.archive.org/web/20230524193007/https://venturebeat.com/ai/as-anthropic-seeks-billions-to-take-on-openai-industrial-capture-is-nigh-or-is-it/ . 2023-05-24 . 2023-05-24 . VentureBeat . en-US.
- Web site: 2023-02-03 . Google invests $300 million in Anthropic as race to compete with ChatGPT heats up . live . https://web.archive.org/web/20230206075725/https://venturebeat.com/ai/google-invests-300-million-in-anthropic-as-race-to-compete-with-chatgpt-heats-up/ . 2023-02-06 . 2023-02-06 . VentureBeat . en-US.
- Web site: Sigalos . MacKenzie . 2024-03-25 . FTX estate selling majority stake in AI startup Anthropic for $884 million, with bulk going to UAE . 2024-04-11 . CNBC . en.
- Web site: Roose . Kevin . 11 July 2023 . Inside the White-Hot Center of A.I. Doomerism . live . https://web.archive.org/web/20230712235416/https://www.nytimes.com/2023/07/11/technology/anthropic-ai-claude-chatbot.html . 12 July 2023 . 13 July 2023 . The New York Times.
- Perrigo . Billy . 2024-05-30 . Inside Anthropic, the AI Company Betting That Safety Can Be a Winning Strategy . 2024-06-02 . Time . en.
- Web site: Setty . Riddhi . 2023-02-23 . Anthropic A.I. Sues AI Company for Trademark Infringement . live . https://web.archive.org/web/20230222172208/https://news.bloomberglaw.com/ip-law/anthropic-a-i-sues-ai-company-for-trademark-infringement . 2023-02-22 . 2023-02-23 . Bloomberg Law . en-US.
- 2023-09-25 . Amazon and Anthropic announce strategic collaboration to advance generative AI . 2023-09-25 . US About Amazon . en . 2023-09-25 . https://web.archive.org/web/20230925104013/https://www.aboutamazon.com/news/company-news/amazon-aws-anthropic-ai . live.
- Web site: Anthropic Company Overview & News . 2024-04-11 . Forbes . en.
- News: Lin . Belle . Welcome to the Era of BadGPTs . 2024-04-11 . WSJ . en-US.
- News: Lin . Belle . Google and Anthropic Are Selling Generative AI to Businesses, Even as They Address Its Shortcomings . 2024-04-11 . WSJ . en-US.
- News: Tracy . Ryan . Risks Posed by AI Technology Spur Calls for New Regulatory Agency . 2024-04-11 . WSJ . en-US.
- Web site: Jack Clark : AI Expert . 2024-04-11 . oecd.ai . en.
- Web site: Instagram's co-founder is Anthropic's new chief product officer. David. Pierce. May 15, 2024. The Verge.
- Web site: Anthropic hires Instagram co-founder as head of product. Kyle. Wiggers. May 15, 2024. TechCrunch.
- Web site: Robison . Kylie . May 28, 2024 . OpenAI researcher who resigned over safety concerns joins Anthropic . VentureBeat.
- Web site: Matthews . Dylan . 17 July 2023 . The $1 billion gamble to ensure AI doesn't destroy humanity . live . https://web.archive.org/web/20231003205441/https://www.vox.com/future-perfect/23794855/anthropic-ai-openai-claude-2 . 3 October 2023 . 23 July 2023 . Vox . en.
- Web site: Anthropic Raises $450 Million in Series C Funding to Scale Reliable AI Products . 2024-04-11 . www.anthropic.com . en.
- Erin Griffith and Cade Metz: Inside the Funding Frenzy at Anthropic, One of A.I.’s Hottest Start-Ups. In: NYT, 20 February 2024. Retrieved 20 February 2024.
- Web site: Anthropic . 2024-04-11 . Wisdom Ventures . en-US.
- Web site: Ripple Impact Investments . 2024-04-11 . Ripple Impact Investments . en-US.
- Web site: Factorial Funds Portfolio . 2024-04-11 . Factorial Funds . en.
- Web site: Research . 2024-04-11 . www.anthropic.com . en.
- Web site: Our response to the UK Government's internal AI safety policy enquiries . 2024-04-11 . www.anthropic.com . en.
- Web site: The Long-Term Benefit Trust . 2024-04-11 . www.anthropic.com . en.
- Web site: Morley . John . Berger . David . Simmerman . Amy . Anthropic Long-Term Benefit Trust . 2024-04-03 . Harvard Law School Forum on Corporate Governance. 28 October 2023 .
- Web site: Kanika Bahl . 2024-04-11 . Evidence Action . en-US.
- Web site: Miller . Scott . 2022-04-14 . CHAI Board of Directors announces appointment of Dr. Neil Buddy Shah as Chief Executive Officer . 2024-04-11 . Clinton Health Access Initiative . en-US.
- News: Klein . Ezra . 2023-03-12 . Opinion This Changes Everything . 2024-04-11 . The New York Times . en-US . 0362-4331.
- Web site: Effective Ventures Foundation USA, Inc. . 2024-04-11 . Effective Ventures . en-US.
- Web site: The Long-Term Benefit Trust . 2024-04-11 . www.anthropic.com . en.
- News: Roose . Kevin . 2023-10-17 . What if We Could All Control A.I.? . 2024-04-11 . The New York Times . en-US . 0362-4331.
- Web site: Drapkin . Aaron . 2023-10-27 . What Is Claude AI and Anthropic? ChatGPT's Rival Explained . 2024-04-11 . Tech.co . en-US.
- Web site: Deborah . Yao . 2023-08-11 . Anthropic's Claude Instant: A Smaller, Faster and Cheaper Language Model . 2024-04-09 . AI Business.
- Web site: Sharon . Goldman . 2023-03-14 . OpenAI rival Anthropic introduces Claude, an AI assistant to take on ChatGPT . 2024-04-09 . Venture Beat.
- Web site: Milmo . Dan . 12 July 2023 . Claude 2: ChatGPT rival launches chatbot that can summarise a novel . live . https://web.archive.org/web/20231108182005/https://www.theguardian.com/technology/2023/jul/12/claude-2-anthropic-launches-chatbot-rival-chatgpt . 8 November 2023 . 13 July 2023 . The Guardian.
- Web site: Nuñez . Michael . 2024-03-04 . Anthropic unveils Claude 3, surpassing GPT-4 and Gemini Ultra in benchmark tests . 2024-04-09 . Venture Beat.
- Web site: Introducing the next generation of Claude . 4 March 2024.
- Web site: March 4, 2024 . Amazon adds Claude 3, which beats GPT-4, to Bedrock . Venture Beat.
- News: Field . Hayden . May 1, 2024 . Amazon-backed Anthropic launches iPhone app and business tier to compete with OpenAI's ChatGPT . May 3, 2024 . CNBC.
- Web site: Pierce . David . 2024-06-20 . Anthropic has a fast new AI model — and a clever new way to interact with chatbots . 2024-06-22 . The Verge . en.
- Henshall . Will . Perrigo . Billy . 2023-09-07 . TIME100 AI 2023: Dario and Daniela Amodei . 2024-03-05 . Time . en.
- Bai . Yuntao . Constitutional AI: Harmlessness from AI Feedback . 2022-12-15 . 2212.08073 . Kadavath . Saurav . Kundu . Sandipan . Askell . Amanda . Kernion . Jackson . Jones . Andy . Chen . Anna . Goldie . Anna . Mirhoseini . Azalia. cs.CL .
- Web site: Transformer Circuits Thread . 2023-02-09 . transformer-circuits.pub . 2023-02-04 . https://web.archive.org/web/20230204224450/https://www.transformer-circuits.pub/ . live .
- Web site: Towards Monosemanticity: Decomposing Language Models With Dictionary Learning . 10 October 2023 . en . 9 October 2023 . https://web.archive.org/web/20231009064431/https://transformer-circuits.pub/2023/monosemantic-features/index.html . live .
- Web site: Ropek . Lucas . 2024-05-21 . New Anthropic Research Sheds Light on AI's 'Black Box' . 2024-05-23 . Gizmodo . en.
- Perrigo . Billy . 2024-05-21 . Artificial Intelligence Is a 'Black Box.' Maybe Not For Long . 2024-05-24 . Time . en.
- Adly Templeton*, Tom Conerly*, Jonathan Marcus, Jack Lindsey, Trenton Bricken, Brian Chen, Adam Pearce, Craig Citro, Emmanuel Ameisen, Andy Jones, Hoagy Cunningham, Nicholas L Turner, Callum McDougall, Monte MacDiarmid, Alex Tamkin, Esin Durmus, Tristan Hume, Francesco Mosconi, C. Daniel Freeman, Theodore R. Sumers, Edward Rees, Joshua Batson, Adam Jermyn, Shan Carter, Chris Olah, Tom Henighan
- Web site: Times . Financial . 2023-10-19 . Universal Music sues AI start-up Anthropic for scraping song lyrics . 2024-03-09 . . en-us.
- Web site: David . Emilia . 2023-10-19 . Universal Music sues AI company Anthropic for distributing song lyrics . 2024-03-09 . The Verge . en.
- Court Docket for Concord Music Group v Anthropic, per CourtListener.
- Web site: Masse . Bryson . 2023-10-19 . Major music publishers sue Anthropic for copyright infringement over song lyrics . 2024-04-08 . VentureBeat.
- Web site: Brittain . Blake . 2024-01-17 . Anthropic fires back at music publishers' AI copyright lawsuit . 2024-04-07 . Reuters.