Metaculus Explained

Metaculus Inc.
Company Type:Benefit corporation
Language:English
Headquarters:Santa Cruz, California, United States
Area Served:Worldwide
Ceo:Deger Turan
Registration:Optional
Current Status:Active

Metaculus is an American reputation-based, massive online prediction solicitation and aggregation engine.[1] One of the focuses of Metaculus is predicting the timing, nature and impact of scientific and technological advances and breakthroughs.[2] [3]

Reward system

Three types of predictions can be made: probability predictions to binary questions that resolve as either 'yes' or 'no', numerical-range predictions, and date-range predictions. Users can contribute to the community prediction for any given question, leave comments and discuss prediction strategies with other users.[4] Users can suggest new questions which, after moderation, will be opened to the community.

Users can earn points for successful predictions (or lose points for unsuccessful predictions), and track their own predictive progress. The scoring awards points both for being right and for being more right than the community.[5]

In January 2020, Metaculus introduced the Bentham Prize, which awards bi-weekly monetary prizes of $300, $200 and $100 to the first, second and third most valuable user contributions.[6] The following month, Metaculus introduced the Li Wenliang prize, which awards a number of different monetary prizes to questions, forecasts and analyses related to the COVID-19 outbreak.[7]

History

Data scientist Max Wainwright and physicists Greg Laughlin and Anthony Aguirre launched the site in 2015. In June 2017, the Metaculus Prediction was launched, which is a system for aggregating user predictions.[8] The Metaculus Prediction, on average, outperforms the median of the community's predictions when evaluated using the Brier or Log scoring rules.[9]

In 2021, Metaculus received an Effective altruism infrastructure fund grant worth $300k.[10] In 2022, Metaculus received a $5.5m grant from Open Philanthropy.[11] In October 2022, Metaculus received $20k funding from the FTX future fund, 3 weeks before the bankruptcy of FTX.[12]

In 2022 the organization announced it reached 1,000,000 individual predictions, and that it was restructured as a public-benefit corporation, it is committed to the following goals, its new charter compels it to rapport annually on its progress in achieving these goals:[13]

  1. Fostering the growth, learning, and development of the forecasting and forecasting research communities.
  2. Supporting stakeholders who are serving the public good by informing their decision making.
  3. Increasing public access to information regarding forecasts of public interest.

In 2024 Metaculus announced it would open source access to its platform, but it has not done so yet. [14]

See also

External links

Notes and References

  1. Web site: Predicting the Future (of Life) . . January 24, 2016 . March 16, 2019 . Anthony . Aguirre . live . https://web.archive.org/web/20190326200016/https://futureoflife.org/2016/01/24/predicting-the-future-of-life/ . Mar 26, 2019 .
  2. Web site: Mann . Adam . December 17, 2018 . The power of prediction markets . . March 16, 2019 .
  3. Web site: 2018-12-17 . This site keeps track of Elon Musk's predictions about the future . March 16, 2019 . Dan . Robitzski . Futurism.
  4. Web site: Shelton . Jim . 2016-11-02 . Metaculus: a prediction website with an eye on science and technology . March 16, 2019 . . en.
  5. https://www.metaculus.com/help/faq/#howscore Metaculus, "FAQ"
  6. Web site: Besiroglu . Tamay . The Bentham prize . Metaculus . January 15, 2020 . 22 January 2020.
  7. Web site: Besiroglu . Tamay . The Li Wenliang prize series for forecasting the COVID-19 outbreak . Metaculus . February 13, 2020 . 15 February 2020.
  8. Web site: What is the Metaculus Prediction? . live . 2022-11-13 . FAQ . Metaculus . en-us . https://web.archive.org/web/20221110204627/https://www.metaculus.com/help/faq/#metaculus-prediction . 2022-11-10 . ... the Metaculus Prediction uses a sophisticated model to calibrate and weight each user .
  9. https://futurism.com/forecasting-the-future-can-the-hive-mind-let-us-predict-the-future Forecasting the Future: Can The Hive Mind Let Us Predict the Future?
  10. Web site: May-August 2021: EA Infrastructure Fund Grants . 2023-05-14 . Effective Altruism Funds . en.
  11. Web site: Metaculus . 2022-07-28 . Metaculus Awarded $5.5M Grant to Advance Forecasting as a Public Good . 2023-05-14 . Medium . en.
  12. Web site: Metaculus . 2022-10-12 . Metaculus Launches the 'Forecasting Our World In Data' Project to Probe the Long-Term Future . 2023-05-14 . Medium . en.
  13. Web site: 2022-09-12 . Becoming a Public Benefit Corporation, Hitting 1 Million Predictions, and Three New AI Forecasting Roles . 2024-07-14 . www.metaculus.com . en-us.
  14. Web site: 2024-06-05 . Open Sourcing Metaculus . 2024-07-14 . www.metaculus.com . en-us.