John Ioannidis Explained

John P. A. Ioannidis
Birth Date:August 21, 1965
Birth Place:New York City, U.S.
Nationality:American, Greek
Fields:Medicine, metascience
Workplaces:Stanford School of Medicine
Alma Mater:University of Athens Medical School
Athens College
Doctoral Advisors:)-->
Known For:Metascience

John P. A. Ioannidis (; Greek, Modern (1453-);: Ιωάννης Ιωαννίδης, pronounced as /iɔˈanis iɔaˈniðis/;[1] [2] born August 21, 1965) is a Greek-American physician-scientist, writer and Stanford University professor who has made contributions to evidence-based medicine, epidemiology, and clinical research. Ioannidis studies scientific research itself, meta-research primarily in clinical medicine and the social sciences.

He has served on the editorial board of over twenty scientific journals including Journal of the American Medical Association (JAMA), Journal of the National Cancer Institute (JNCI) and The Lancet.

Ioannidis's 2005 essay "Why Most Published Research Findings Are False" was the most-accessed article in the history of Public Library of Science (PLOS) as of 2020, with more than three million views. Ioannidis was a prominent opponent of lockdowns during the COVID-19 pandemic, and he has been accused of promoting conspiracy theories concerning COVID-19 policies and public health and safety measures.

Early life and education

Born in New York City in 1965, Ioannidis was raised in Athens, Greece.[3] He was valedictorian of his class at Athens College, graduating in 1984, and won a number of awards, including the National Award of the Greek Mathematical Society. He graduated in the top rank of his class at the University of Athens Medical School (1990), then attended Harvard University for his medical residency in internal medicine. He did a fellowship at Tufts University for infectious disease[4] and received a PhD in biopathology at the University of Athens (1996).

Career

He is a very highly cited medical researcher, with an h-index of 239 on Google Scholar in January 2023.[5]

From 1998 to 2010, Ioannidis was chairman of the Department of Hygiene and Epidemiology, University of Ioannina School of Medicine. In 2002, he became an adjunct professor at Tufts University School of Medicine.[6] [7] He has also been president of the Society for Research Synthesis Methodology.

He holds four academic appointments at Stanford University: Professor of Medicine, Professor of Epidemiology and Population Health, Professor (by courtesy) of Statistics and Professor (by courtesy) of Biomedical Data Science.[8] [9] He is director of the Stanford Prevention Research Center, and co-director, along with Steven N. Goodman, of the Meta-Research Innovation Center at Stanford.[10] [11]

Research

Ioannidis's 2005 paper "Why Most Published Research Findings Are False" is the most downloaded paper in the Public Library of Science.[12] [13] [14] In the paper, Ioannidis says that most published research does not meet good scientific standards of evidence. Ioannidis has also described the replication crisis in diverse scientific fields including genetics,[15] clinical trials,[16] neuroscience,[17] and nutrition.[18] His work has aimed to identify solutions to problems in research, and on how to perform research more optimally.[19] [20] [21] In a series of five papers about research published in The Lancet and titled "Research: increasing value, reducing waste", Ioannidis co-authored papers discussing prioritization, transparency and the assessment of existing evidence when making decisions for the funding of research so that they meet the needs of users of research[22] and examining how to correct weaknesses in research design, methods, and analysis by involving experienced statisticians and methodologists and avoiding stakeholders with conflicts of interest.[23] [24]

Ioannidis's research at Stanford focuses on meta-analysis and meta-research – the study of studies. Thomas Trikalinos and Ioannidis coined the term Proteus phenomenon to describe tendency for early studies on a subject to find larger effect than later ones.

He was an early and influential public critic of Theranos, the now-fallen Silicon Valley blood test startup that at its height was valued at up to $9 billion. He criticized it for "stealth research" that it had not made available for other scientists to review.[25] [26] [27]

Meta-research

Ioannidis has defined meta-research to include "thematic areas of methods, reporting, reproducibility, evaluation, and incentives (how to do, report, verify, correct, and reward science)".[28] He has performed large-scale assessments of the presence of reproducible and transparent research indicators such as data sharing, code sharing, protocol registration, declaration of funding and conflicts of interest in biomedical sciences,[29] social sciences,[30] and psychology.[31] He has led or co-led efforts to define[32] and improve reproducibility in science,[33] e.g. computational reproducibility,[34] [35] and to reduce research waste in study design, conduct, and analysis.[36] Ioannidis has co-authored the Manifesto for Reproducible Science,[37] an eight-page document illuminating the need to fix the flaws in the current scientific process and mitigate the "reproducibility crisis" in science.[38]

In "Why Most Public Research Findings are False" (2005), Ioannidis focused on why most published research findings cannot be validated. In a later paper on PLOS Medicine (2014), he discusses what can be done to improve this situation and make more published research findings to be true[39] and in a third paper (2016) he showed why clinical research in particular is usually not useful and how this can be amended.[40] In the first of the three PLOS papers he stated that "a research finding is less likely to be true when the studies conducted in a field are smaller; when effect sizes are smaller; when there is a greater number and lesser preselection of tested relationships; where there is greater flexibility in designs, definitions, outcomes, and analytical modes; when there is greater financial and other interest and prejudice; and when more teams are involved in a scientific field in chase of statistical significance".[41] In the second paper, he discussed solutions: "adoption of large-scale collaborative research; replication culture; registration; sharing; reproducibility practices; better statistical methods; standardization of definitions and analyses; more appropriate (usually more stringent) statistical thresholds; and improvement in study design standards, peer review, reporting and dissemination of research, and training of the scientific workforce".[42] [43] [44] In the third paper, he proposed eight features that are important for useful clinical research: problem base, context placement, information gain, pragmatism, patient-centeredness, value for money, feasibility, and transparency.[45] Ioannidis was invited to present his findings as a keynote speaker at the "Evidence Live 2016" conference, hosted jointly by the Centre for Evidence-Based Medicine (CEBM) at the Nuffield Department of Primary Care Health Sciences, University of Oxford and the BMJ.[46]

Meta-analysis

Ioannidis has developed and popularized several methods for meta-analysis and has made several conceptual advances in this field. These include methods for assessing heterogeneity and its uncertainty,[47] methods for meta-analysis involving multiple treatments,[48] methods and processes for umbrella reviews,[49] [50] and several approaches to identifying bias and adjusting the results of meta-analyses for bias, such as publication bias and reporting bias resulting in funnel-plot asymmetry.[51] He has also alerted about the misuse and misinterpretation of bias tests.[52] Along with David Chavalarias, he catalogued 235 biases across the entire publication record of biomedical research.[53] Ioannidis has been critical of flawed, misleading and redundant meta-analyses, estimating that few meta-analyses in medicine are both bias-free and clinically useful.[54] He has performed empirical evaluations of the concordance of results between meta-analyses and large trials[55] and between randomized trials and non-randomized studies.[56] [57]

Evidence-based medicine

Ioannidis has been one of the strong proponents and earlier advocates of evidence-based medicine. However, he has alerted that, over the years, as evidence-based medicine acquired more prominence and influence, it was hijacked to serve other agendas that are often biased.[58] In an essay written to honor his late mentor David Sackett, he stated that "Influential randomized trials are largely done by and for the benefit of the industry. Meta-analyses and guidelines have become a factory, mostly also serving vested interests. National and federal research funds are funneled almost exclusively to research with little relevance to health outcomes. We have supported the growth of principal investigators who excel primarily as managers absorbing more money. Diagnosis and prognosis research and efforts to individualize treatment have fueled recurrent spurious promises. Risk factor epidemiology has excelled in salami-sliced, data-dredged articles with gift authorship and has become adept to dictating policy from spurious evidence. Under market pressure, clinical medicine has been transformed to finance-based medicine. In many places, medicine and health care are wasting societal resources and becoming a threat to human well-being. Science denialism and quacks are also flourishing and leading more people astray in their life choices, including health. Evidence-based medicine still remains an unmet goal, worthy to be attained."[59] [60] He has described four inter-related problems that create what he calls the Medical Misinformation Mess: "First, much published medical research is not reliable or is of uncertain reliability, offers no benefit to patients, or is not useful to decision makers. Second, most healthcare professionals are not aware of this problem. Third, they also lack the skills necessary to evaluate the reliability and usefulness of medical evidence. Finally, patients and families frequently lack relevant, accurate medical evidence and skilled guidance at the time of medical decision-making."[61] [62] He has supported these views by contributing to a meta-epidemiological study which found that only 1 in 20 interventions tested in Cochrane Reviews have benefits that are supported by high-quality evidence.,[63] and a related study showing that the quality of this evidence does not seem to improve over time.[64]

Statistical methods and inference

Ioannidis has made methodological and conceptual contributions to the debates surrounding the use and misuse of statistical methods and inference.[65] He has been an advocate of the approach to redefine statistical significance by requesting more stringent statistical significance thresholds;[66] [67] [68] he has proposed and empirically validated stringent thresholds for genome-wide significance in genetics;[69] and has been critical of the approach to entirely abandon statistical significance.[70] [71]

Reporting guidelines

Ioannidis has contributed to several influential guidelines for reporting different types of research, such as PRISMA for meta-analyses,[72] TRIPOD for multivariable prognostic and diagnostic models,[73] and others on clinical trials and observational research. He is the lead author of the CONSORT for harms, a guideline that provides guidance on how to properly report on harms in randomized trials[74] [75] and has contributed to PRISMA for harms, a guideline for reporting of harms in meta-analyses.[76] [77]

Genetic and molecular epidemiology

Ioannidis was one of the first to advocate the use of meta-analysis in genetic epidemiology to assess replication[78] and the incorporation of meta-analysis in large-scale consortia of multiple investigators performing genome-wide association studies.[79] [80] He led and contributed to many such efforts in diverse areas of genetic epidemiology and in other areas of molecular epidemiology.[81]

Nutrition

Ioannidis has been critical of nutritional epidemiology research practices and has recommended reforms to improve the credibility of research in the field.[82] [83] By means of empirical reviews, he has highlighted that there are studies suggesting that almost every nutrient is associated with cancer risk, which is an implausible situation[84] [85] He has also suggested that more attention is needed for proper disclosures of both financial and non-financial conflicts of interest in nutrition research. He also co-authored the DIETFITS randomized trial that showed no difference between a low-fat and a low-carb diet.[86] [87]

Association studies and big data

In an effort to improve the credibility of research on risk factors, Ioannidis has proposed that exposure-wide or environment-wide association studies should be performed and he has outlined the similarities and differences between such studies and genome-wide association studies in genetics.[88] [89] By assessing all risk factors together instead of one at a time, this practice aims to reduce selective reporting and publication bias. He has also advocated for the use of large national population databases with systematically collected data to minimize bias and improve yield of trustworthy discoveries.[90] He has worked on the potential uses of such approaches in big data[91] and artificial intelligence.[92] [93]

Psychiatry

Ioannidis has performed critical assessments of the evidence behind mental health interventions (pharmacotherapy and psychotherapy). He co-authored a network meta-analysis on more than 500 randomized trials of anti-depressants showing a modest benefit from these medications for major depression.[94] [95] [96] He has identified the potential for sponsorship bias in meta-analyses in mental health[97] [98] and has empirically assessed the totality of meta-analyses on mental health interventions, estimating that beneficial effects do exist, but they tend to be modest and thus a research agenda is needed to identify more effective interventions.[99]

Neuroscience

Along with colleagues, Ioannidis has performed empirical evaluations and meta-research assessments of large numbers of scientific studies in neuroscience and have found that lack of power is a very common problem, leading to both false-negatives (the inability to discover true signals) and false-positives (finding spurious signals).[100] [101]

Economics

In empirical assessments of all meta-analyses that have been conducted on economics topics, Ioannidis and colleagues have found that most of the studies in these fields are small and under-powered. Using bias detection and correction methods, they have concluded that nearly 80% of the reported effects in the empirical economics literature is exaggerated; typically by a factor of two, and with one-third inflated by a factor of four or more.[102] [103]

Editorial appointments

Ioannidis has served on the editorial board of a number of scientific journals, including the European Journal of Clinical Investigation (editor-in-chief, 2010–2019),[104] BMC Medicine,[105] International Journal of Epidemiology,[106] Journal of the American Medical Association,[107] Journal of Clinical Epidemiology,[108] Journal of Infectious Diseases,[109] International Journal of Molecular Epidemiology and Genetics,[110] International Journal of Epidemiology,[106] Journal of Translational Medicine,[111] Journal of Evaluation in Clinical Practice,[112] Clinical Chemistry,[113] Physiological Reviews,[114] Royal Society Open Science,[115] Research Integrity and Peer Review,[116] BioMed Central Infectious Diseases,[105] Biomarker Research,[117] Diagnostic and Prognostic Research,[118] PLoS Medicine,[119] PLoS Biology,[120] The Lancet, Annals of Internal Medicine, JNCI, and Science Translational Medicine.

COVID-19

In an editorial on STAT published March 17, 2020, Ioannidis wondered whether the global response to the COVID-19 pandemic may be a "once-in-a-century evidence fiasco" and asked for obtaining more reliable data to deal with the pandemic. He made a rough estimation that the coronavirus could cause 10,000 U.S. deaths if it infected 1% of the U.S. population, but argued that more data was needed to determine how widely the virus would spread. The virus in fact eventually became widely disseminated, and would cause more than one million deaths in the U.S. Ioannidis expressed doubt that vaccines or treatments would be developed and tested in time to affect how the pandemic would unfold.[121] Marc Lipsitch, Director of the Center for Communicable Disease Dynamics at the Harvard T.H. Chan School of Public Health, objected to Ioannidis's characterization of the global response in a reply that was published on STAT the next day after Ioannidis's.[122]

In March 2020, Ioannidis tried to organize a meeting at the White House where he and colleagues would caution President Donald Trump against "shutting down the country for [a] very long time and jeopardizing so many lives in doing this," according to a proposal he submitted. The meeting did not come to pass, but on March 28, after Trump said he wanted the country reopened by Easter, Ioannidis wrote to his colleagues, "I think our ideas have the White House regardless".[123]

Ioannidis widely promoted a study of which he had been co-author, "COVID-19 Antibody Seroprevalence in Santa Clara County, California", released as a preprint on April 17, 2020. It asserted that Santa Clara County's number of infections was between 50 and 85 times higher than the official count, putting the virus's fatality rate as low as 0.1% to 0.2%.[124] [125] Ioannidis concluded from the study that the coronavirus is "not the apocalyptic problem we thought".[126] The message found favor with right-wing media outlets, but the paper drew criticism from a number of epidemiologists who said its testing was inaccurate and its methods were sloppy.[127] [128] [129] Writing for Wired, David H. Freedman said that the Santa Clara study compromised Ioannidis's previously excellent reputation and meant that future generations of scientists may remember him as "the fringe scientist who pumped up a bad study that supported a crazy right-wing conspiracy theory in the middle of a massive health crisis."[130] Ioannidis has also promoted the idea that there were financial incentives to put COVID-19 on death certificates and as such, they were unreliable during the pandemic, as well as the idea that doctors killed COVID-19 patients through premature intubations. Both of these beliefs contradict the available evidence.[131]

It was later reported that the study received $5,000 in funding from the founder of the JetBlue airline, which led to criticism over a potential conflict of interest.[132] [133] In a guest opinion article in Scientific American, former colleagues of Ioannidis wrote that a legal firm had determined he had no financial conflict.[134] A review by the Stanford School of Medicine faulted the study for shortcomings including a public perception of a conflict of interest, but found "no evidence that any of the study funders influenced the design, execution, or reporting of the study".[135]

Amid controversy over his COVID-19 work and his frequent televised interviews, Ioannidis was harassed in memes and emails, including one falsely claiming his mother died of COVID-19. Some scientists and commentators voiced concerns over the backlash and the highly politicized scientific dispute in general.[136]

In March 2021 Ioannidis estimated the global infection fatality rate from COVID-19 at 0.15%, in an article in the European Journal of Clinical Investigation (EJCI).[137] In an article in Science-Based Medicine, David Gorski said that the EJCI article included ad hominem criticisms against a co-author of a higher estimate who had criticized his work on Twitter.

In February 2022 Ioannidis co-authored a paper examining the role of indoor and outdoor air quality in the spread of SARS-CoV-2, which concluded that environmental health may be a crucial component in the prevention of COVID-19 and suggested preventive measures such as indoor monitoring and mechanical ventilation.[138]

In 2022, Ioannidis authored a paper in BMJ Open arguing that signatories of the Great Barrington Declaration were shunned as a fringe minority by those in favor of the John Snow Memorandum. According to him, the latter used their large numbers of followers on Twitter and other social media and op-eds to shape a scientific groupthink against the former, who had less influence as measured by the Kardashian Index.[139] [140] The BMJ published responses to his paper, including a comment by Gavin Yamey, David Gorski, and Gideon Meyerowitz-Katz which argued that Ioannidis's paper featured "factual errors, statistical shortcomings, failure to protect the named research subjects from harm, and potentially undeclared conflicts of interest that entirely undermine the analysis presented."[141] In the same exchange of comments on The BMJ, Ioannidis addressed the concerns of Yamey, Gorski and Meyerovitz-Katz in his "Fourth set of replies", additionally stating that his "COVID-19 papers have been cited about 5 thousand times in the scientific literature by tens of thousands of scientists and were discussed by millions of people," and dismissed conflict of interest by asserting that he did not sign the Great Barrington Declaration or any other petition or signature collection on COVID-19, as he is against the notion that scientific matters and evidence could be decided by signature collections and prefers these matters be handled by heavily moderated public debates.[142]

Reception

In 2010, David H. Freedman in The Atlantic stated in a special edition about "Brave Thinkers" that Ioannidis "may be one of the most influential scientists alive."[143] [144]

In 2011, Sharon Begley's article "Why Almost Everything You Hear About Medicine Is Wrong" in Newsweek said Ioannidis was "cementing his role as one of medicine's top mythbusters".[145]

In 2013, Richard Smith's article "Time for science to be about truth rather than careers" likened listening to Ioannidis to "listening to a great opera or watching a gripping football match: you feel inspired, uplifted, and privileged."[146]

In 2014, The Economist featured Ioannidis and Steven Goodman in an article on the Meta-Research Innovation Center at Stanford,[147] and George Johnson of the New York Times wrote an article on the importance of reproducible research, profiling Ioannidis's two 2005 papers as playing a critical role in raising concern about the issue in the scientific community, as later expressed by the journal Nature.[148]

In 2015, Ioannidis was profiled in The BMJ and described as "the scourge of sloppy science".[149]

In 2016, Quartz ran a feature on Ioannidis titled "The man who made scientists question themselves has just exposed huge flaws in evidence used to give drug prescriptions".[150]

In 2017, Wired mentioned Ioannidis as "arguably the replication crisis' chief inquisitor."

In 2019, a STAT article on the healthcare replication crisis mentioned that Ioannidis had found that only a minority of widely cited health research studies carried out over the last decade could be replicated, with at least 1 in 6 actually being contradicted by later studies,[151] and Elsevier featured his analogy of reproducibility in research to "taming a complex beast".[152]

In 2021, David Gorski's article "What the heck happened to John Ioannidis?" described statements by Ioannidis about COVID-19 as inflammatory and politically charged, and said Ioannidis had made egregious ad hominem attacks. Gorski called Ioannidis "a cautionary tale of how even science watchdogs can fall prey to hubris."

In 2022, Jeffrey Lee Funk and Gary N. Smith writing at MarketWatch described how Ioannidis is “widely-known as the godfather of science reform” and narrated how he was the first to criticize Theranos"[153] and Graham Hilard at the Washington Examiner wrote that for the replication crisis in science, “the true clarion call was sounded in 2005 with the appearance of John P. A. Ioannidis’s Why Most Published Research Findings Are False,” describing the paper as a "shock treatise.”[154]

Awards and honors

Ioannidis has received elected membership to the National Academy of Medicine,[155] the European Academy of Sciences and Arts,[156] the European Academy of Cancer Sciences,[157] the American Epidemiological Society and the Association of American Physicians.[158] For the 2022-2023 term, he is vice-president and president-elect of the Association of American Physicians.[8]

See also

External links

Notes and References

  1. [wikt:el:Ιωάννης]
  2. [wikt:el:Ιωαννίδης]
  3. http://www.hsph.harvard.edu/john-ioannidis/ John Ioannidis
  4. Book: Freedman, David H.. Wrong: Why Experts Keep Failing Us. Little, Brown & Co. 2010. 978-0-316-02378-8 . Born in 1965 in the United States to parents who were both physicians, he was raised in Athens, where he showed unusual aptitude in mathematics and snagged Greece's top student math prize. . registration.
  5. Web site: Aguillo . Isidro F. . September 2020 . Highly Cited Researchers (h>100) according to their Google Scholar Citations public profiles . live . https://web.archive.org/web/20210129005033/http://www.webometrics.info/en/hlargerthan100 . January 29, 2021 . January 31, 2021 . webometrics.info .
  6. Web site: John P.A. Ioannidis. December 31, 2008. Department of Hygiene and Epidemiology, University of Ioannina School of Medicine. February 14, 2009. https://web.archive.org/web/20090214171831/http://users.uoi.gr/hyepilab/people.php. live.
  7. Web site: Ioannidis. John P.A. . Curriculum Vitae . UoI . November 4, 2010 . dead . https://web.archive.org/web/20110721083539/http://www.dhe.med.uoi.gr/data/cv/CV102010D.pdf . July 21, 2011.
  8. Web site: John P.A. Ioannidis . Stanford Profiles . April 24, 2020 . December 11, 2019 . https://web.archive.org/web/20191211202601/https://profiles.stanford.edu/john-ioannidis . live .
  9. Web site: March 17, 2020. A fiasco in the making? As the coronavirus pandemic takes hold, we are making decisions without reliable data. April 26, 2020. Stat. April 5, 2020. https://web.archive.org/web/20200405061513/https://www.statnews.com/2020/03/17/a-fiasco-in-the-making-as-the-coronavirus-pandemic-takes-hold-we-are-making-decisions-without-reliable-data/. live.
  10. Web site: John P. A. Ioannidis. Stanford School of Medicine. CAP Profiles. May 24, 2014. July 4, 2014. https://web.archive.org/web/20140704075828/https://med.stanford.edu/profiles/john-ioannidis. live.
  11. Web site: Prevention Research Center . . May 24, 2014 . June 29, 2014 . https://web.archive.org/web/20140629184726/http://prevention.stanford.edu/ . live .
  12. Web site: Highly Cited Researchers . September 17, 2015 . April 2, 2012 . https://web.archive.org/web/20120402232219/http://highlycited.com/ . live .
  13. News: Robert Lee Hotz. September 14, 2007. Most Science Studies Appear to Be Tainted By Sloppy Analysis. The Wall Street Journal. December 5, 2016. December 24, 2016. https://web.archive.org/web/20161224020018/http://www.wsj.com/articles/SB118972683557627104/. live.
  14. Web site: PLOS ONE: Search Results. February 18, 2022. journals.plos.org. February 18, 2022. https://web.archive.org/web/20220218234557/https://journals.plos.org/plosone/search?filterJournals=PLoSONE&filterJournals=PLoSMedicine&q=why+most%20public%20research%20findings%20are%20false&page=1. live.
  15. Replication validity of genetic association studies. Nature Genetics. November 1, 2001 . 1061-4036. 306–309. 29. 3. 10.1038/ng749. John P. A.. Ioannidis. Evangelia E.. Ntzani. Thomas A.. Trikalinos. Despina G.. Contopoulos-Ioannidis. 11600885. 6742347.
  16. REanalyses of randomized clinical trial data. JAMA. September 10, 2014. 0098-7484. 1024–1032. 312. 10. 10.1001/jama.2014.9646. 25203082. Ebrahim. Shanil. Sohani. Zahra N.. Montoya. Luis. Agarwal. Arnav. Thorlund. Kristian. Mills. Edward J.. Ioannidis. John P. A.. free.
  17. Power failure: why small sample size undermines the reliability of neuroscience. Nature Reviews Neuroscience. May 1, 2013. 1471-003X. 365–376. 14. 5. 10.1038/nrn3475. Katherine S.. Button. John P. A.. Ioannidis. Claire. Mokrysz. Brian A.. Nosek. Jonathan. Flint. Emma S. J.. Robinson. Marcus R.. Munafò. 23571845. free.
  18. Ioannidis. John P. A.. September 11, 2018. The Challenge of Reforming Nutritional Epidemiologic Research. JAMA. en. 320. 10. 969–970. 10.1001/jama.2018.11025. 30422271. 53293211. 0098-7484. August 8, 2020. January 22, 2021. https://web.archive.org/web/20210122090641/https://jamanetwork.com/journals/jama/fullarticle/2698337. live.
  19. Reproducibility in science: improving the standard for basic and preclinical research. Circulation Research. January 2, 2015. 1524-4571. 25552691. 116–126. 116. 1. 10.1161/CIRCRESAHA.114.303819. C. Glenn. Begley. John P. A.. Ioannidis. free.
  20. How to Make More Published Research True. PLOS Med. October 21, 2014. 4204808. 25334033. e1001747. 11. 10. 10.1371/journal.pmed.1001747. John P. A.. Ioannidis . free .
  21. Web site: Research: increasing value, reducing waste. February 12, 2022. www.thelancet.com. en. November 5, 2021. https://web.archive.org/web/20211105073108/https://www.thelancet.com/series/research. live.
  22. Chalmers. Iain. Bracken. Michael B.. Djulbegovic. Ben. Garattini. Silvio. Grant. Jonathan. Gülmezoglu. A. Metin. Howells. David W.. Ioannidis. John P. A.. Oliver. Sandy. January 11, 2014. How to increase value and reduce waste when research priorities are set. The Lancet. English. 383. 9912. 156–165. 10.1016/S0140-6736(13)62229-1. 0140-6736. 24411644. 26542330. February 12, 2022. May 18, 2022. https://web.archive.org/web/20220518010812/https://www.thelancet.com/journals/lancet/article/PIIS0140-6736(13)62229-1/fulltext. live.
  23. Ioannidis. John P. A.. Greenland. Sander. Hlatky. Mark A.. Khoury. Muin J.. Macleod. Malcolm R.. Moher. David. Schulz. Kenneth F.. Tibshirani. Robert. January 11, 2014. Increasing value and reducing waste in research design, conduct, and analysis. The Lancet. English. 383. 9912. 166–175. 10.1016/S0140-6736(13)62227-8. 0140-6736. 24411645. 4697939.
  24. Web site: 2014-01-27 . NIH to Researchers: Credibility Counts . 2022-05-13 . www.medpagetoday.com . en . December 6, 2021 . https://web.archive.org/web/20211206070043/https://www.medpagetoday.com/PublicHealthPolicy/ClinicalTrials/43995 . live .
  25. News: Cha. Ariana Eunjung. Theranos blood test: The insanely influential Stanford professor who called the company out for its 'stealth research'. en-US. Washington Post. November 19, 2021. 0190-8286. December 15, 2021. https://web.archive.org/web/20211215014540/https://www.washingtonpost.com/news/to-your-health/wp/2015/07/03/the-insanely-influential-stanford-professor-behind-biotech-firms-push-to-get-fda-approval-it-probably-doesnt-need/. live.
  26. Web site: Paul. Keri. August 30, 2021. 'Selling a promise': what Silicon Valley learned from the fall of Theranos. November 19, 2021. The Guardian. en. November 19, 2021. https://web.archive.org/web/20211119111309/https://www.theguardian.com/technology/2021/aug/30/elizabeth-holmes-trial-theranos-silicon-valley. live.
  27. Ioannidis. John P. A.. February 17, 2015. Stealth Research: Is Biomedical Innovation Happening Outside the Peer-Reviewed Literature?. JAMA. 313. 7. 663–664. 10.1001/jama.2014.17662. 25688775. 0098-7484. November 19, 2021. May 18, 2022. https://web.archive.org/web/20220518010828/https://jamanetwork.com/journals/jama/article-abstract/2110977. live.
  28. Ioannidis . John P. A. . Fanelli . Daniele . Dunne . Debbie Drake . Goodman . Steven N. . October 2, 2015 . Meta-research: Evaluation and Improvement of Research Methods and Practices . PLOS Biology . en . 13 . 10 . e1002264 . 10.1371/journal.pbio.1002264 . 1545-7885 . 4592065 . 26431313 . free .
  29. Iqbal . Shareen A. . Wallach . Joshua D. . Khoury . Muin J. . Schully . Sheri D. . Ioannidis . John P. A. . January 4, 2016 . Reproducible Research Practices and Transparency across the Biomedical Literature . PLOS Biology . en . 14 . 1 . e1002333 . 10.1371/journal.pbio.1002333 . 1545-7885 . 4699702 . 26726926 . free .
  30. Hardwicke . Tom E. . Wallach . Joshua D. . Kidwell . Mallory C. . Bendixen . Theiss . Crüwell . Sophia . Ioannidis . John P. A. . An empirical assessment of transparency and reproducibility-related research practices in the social sciences (2014–2017) . Royal Society Open Science . 2020 . 7 . 2 . 190806 . 10.1098/rsos.190806 . 7062098 . 32257301. 2020RSOS....790806H .
  31. Hardwicke . Tom E. . Thibault . Robert T. . Kosie . Jessica E. . Wallach . Joshua D. . Kidwell . Mallory C. . Ioannidis . John P. A. . March 8, 2021 . Estimating the Prevalence of Transparency and Reproducibility-Related Research Practices in Psychology (2014–2017) . Perspectives on Psychological Science . 17 . 1 . 239–251 . 10.1177/1745691620979806 . 1745-6916 . 8785283 . 33682488.
  32. Web site: June 3, 2016 . Define Your Terms . March 22, 2022 . Genomeweb . en . September 11, 2019 . https://web.archive.org/web/20190911161422/https://www.genomeweb.com/scan/define-your-terms . live .
  33. Begley . C. Glenn . Ioannidis . John P. A. . January 2, 2015 . Reproducibility in science: improving the standard for basic and preclinical research . Circulation Research . 116 . 1 . 116–126 . 10.1161/CIRCRESAHA.114.303819 . 1524-4571 . 25552691 . 3587510 . free .
  34. Web site: Urbana-Champaign . University of Illinois at . Report proposes standards for sharing data and code used in computational studies . March 22, 2022 . phys.org . en . March 22, 2022 . https://web.archive.org/web/20220322214500/https://phys.org/news/2016-12-standards-code.html . live .
  35. Stodden . Victoria . McNutt . Marcia . Bailey . David H. . Deelman . Ewa. Ewa Deelman . Gil . Yolanda . Hanson . Brooks . Heroux . Michael A. . Ioannidis . John P. A. . Taufer . Michela . December 9, 2016 . Enhancing reproducibility for computational methods . Science . 354 . 6317 . 1240–1241 . 10.1126/science.aah6168 . 1095-9203 . 27940837 . 2016Sci...354.1240S . 32551384 . March 22, 2022 . March 22, 2022 . https://web.archive.org/web/20220322214507/https://pubmed.ncbi.nlm.nih.gov/27940837/ . live .
  36. Ioannidis . John P. A. . Greenland . Sander . Hlatky . Mark A. . Khoury . Muin J. . Macleod . Malcolm R. . Moher . David . Schulz . Kenneth F. . Tibshirani . Robert . January 11, 2014 . Increasing value and reducing waste in research design, conduct, and analysis . The Lancet . English . 383 . 9912 . 166–175 . 10.1016/S0140-6736(13)62227-8 . 0140-6736 . 24411645. 4697939 .
  37. Munafò . Marcus R. . Nosek . Brian A. . Bishop . Dorothy V. M. . Button . Katherine S. . Chambers . Christopher D. . Percie du Sert . Nathalie . Simonsohn . Uri . Wagenmakers . Eric-Jan . Ware . Jennifer J. . Ioannidis . John P. A. . January 10, 2017 . A manifesto for reproducible science . Nature Human Behaviour . en . 1 . 1 . 0021 . 10.1038/s41562-016-0021 . 33954258 . 7610724 . 2397-3374.
  38. Web site: MacDonald . Fiona . Scientists Have Outlined an 8-Page Plan to Fix What's Wrong With Science . March 22, 2022 . ScienceAlert . January 11, 2017 . en-gb . December 14, 2021 . https://web.archive.org/web/20211214184057/https://www.sciencealert.com/scientists-have-written-an-8-page-plan-to-fix-bad-science . live .
  39. Ioannidis . John P. A. . October 21, 2014 . How to Make More Published Research True . PLOS Medicine . en . 11 . 10 . e1001747 . 10.1371/journal.pmed.1001747 . 1549-1676 . 4204808 . 25334033 . free .
  40. Ioannidis . John P. A. . June 21, 2016 . Why Most Clinical Research Is Not Useful . PLOS Medicine . en . 13 . 6 . e1002049 . 10.1371/journal.pmed.1002049 . 1549-1676 . 4915619 . 27328301 . free .
  41. Web site: Ioannidis 2005 PLoS Med - Bioblast . March 22, 2022 . www.bioblast.at . en . August 6, 2016 . https://web.archive.org/web/20160806051533/http://www.bioblast.at/index.php/Ioannidis_2005_PLoS_Med . live .
  42. Web site: Article: How to Make More Published Research True • Global Health Trials . March 22, 2022 . globalhealthtrials.tghn.org . April 13, 2022 . https://web.archive.org/web/20220413161300/https://globalhealthtrials.tghn.org/articles/how-make-more-published-research-true/ . live .
  43. Woolston . Chris . October 29, 2014 . A blueprint to boost reproducibility of results . Nature . en . 10.1038/nature.2014.16222 . 111524123 . 1476-4687 . March 25, 2022 . March 25, 2022 . https://web.archive.org/web/20220325011553/https://www.nature.com/articles/nature.2014.16222 . live .
  44. Web site: October 29, 2014 . How to improve our scientific practice? - Technology Org . March 25, 2022 . en-US . May 18, 2022 . https://web.archive.org/web/20220518010812/https://www.technology.org/2014/10/29/improve-scientific-practice/ . live .
  45. Web site: August 27, 2014 . Reforming Clinical Research To Reduce Waste Science 2.0 . March 25, 2022 . www.science20.com . en.
  46. Web site: Archived copy. https://web.archive.org/web/20220518010810/https://www.cebm.net/wp-content/uploads/sites/3/2016/07/FINAL_EvidenceLive16-programme-160623.pdf . May 18, 2022.
  47. Ioannidis . John P. A. . Patsopoulos . Nikolaos A. . Evangelou . Evangelos . November 3, 2007 . Uncertainty in heterogeneity estimates in meta-analyses . BMJ (Clinical Research Ed.) . 335 . 7626 . 914–916 . 10.1136/bmj.39343.408449.80 . 1756-1833 . 2048840 . 17974687.
  48. Salanti . Georgia . Ades . A. E. . Ioannidis . John P. A. . February 2011 . Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial . Journal of Clinical Epidemiology . 64 . 2 . 163–171 . 10.1016/j.jclinepi.2010.03.016 . 1878-5921 . 20688472 . March 24, 2022 . March 24, 2022 . https://web.archive.org/web/20220324001921/https://pubmed.ncbi.nlm.nih.gov/20688472/ . live .
  49. Ioannidis . John P. A. . October 13, 2009 . Integration of evidence from multiple meta-analyses: a primer on umbrella reviews, treatment networks and multiple treatments meta-analyses . Canadian Medical Association Journal . 181 . 8 . 488–493 . 10.1503/cmaj.081086 . 1488-2329 . 2761440 . 19654195.
  50. Bellou . Vanesa . Belbasis . Lazaros . Tzoulaki . Ioanna . Evangelou . Evangelos . Ioannidis . John P. A. . February 2016 . Environmental risk factors and Parkinson's disease: An umbrella review of meta-analyses . Parkinsonism & Related Disorders . 23 . 1–9 . 10.1016/j.parkreldis.2015.12.008 . 1873-5126 . 26739246 . 10044/1/31820 . March 24, 2022 . March 24, 2022 . https://web.archive.org/web/20220324002015/https://pubmed.ncbi.nlm.nih.gov/26739246/ . live . free .
  51. Sterne . Jonathan A. C. . Sutton . Alex J. . Ioannidis . John P. A. . Terrin . Norma . Jones . David R. . Lau . Joseph . Carpenter . James . Rücker . Gerta . Harbord . Roger M. . Schmid . Christopher H. . Tetzlaff . Jennifer . July 22, 2011 . Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials . BMJ (Clinical Research Ed.) . 343 . d4002 . 10.1136/bmj.d4002 . 1756-1833 . 21784880 . 18638787 . free .
  52. Ioannidis . John P. A. . October 2008 . Interpretation of tests of heterogeneity and bias in meta-analysis . Journal of Evaluation in Clinical Practice . 14 . 5 . 951–957 . 10.1111/j.1365-2753.2008.00986.x . 19018930 . 1356-1294 . March 24, 2022 . May 18, 2022 . https://web.archive.org/web/20220518010813/https://onlinelibrary.wiley.com/doi/10.1111/j.1365-2753.2008.00986.x . live .
  53. Chavalarias . David . Ioannidis . John P. A. . November 1, 2010 . Science mapping analysis characterizes 235 biases in biomedical research . Journal of Clinical Epidemiology . English . 63 . 11 . 1205–1215 . 10.1016/j.jclinepi.2009.12.011 . 0895-4356 . 20400265 . March 24, 2022 . May 18, 2022 . https://web.archive.org/web/20220518010823/https://www.jclinepi.com/article/S0895-4356%2810%2900022-3/fulltext . live .
  54. Ioannidis . John P. A. . September 2016 . The Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta-analyses . The Milbank Quarterly . 94 . 3 . 485–514 . 10.1111/1468-0009.12210 . 1468-0009 . 5020151 . 27620683.
  55. Cappelleri . J. C. . Ioannidis . J. P. . Schmid . C. H. . de Ferranti . S. D. . Aubert . M. . Chalmers . T. C. . Lau . J. . October 23–30, 1996 . Large trials vs meta-analysis of smaller trials: how do their results compare? . JAMA . 276 . 16 . 1332–1338 . 10.1001/jama.1996.03540160054033 . 0098-7484 . 8861993 . March 24, 2022 . March 24, 2022 . https://web.archive.org/web/20220324001919/https://pubmed.ncbi.nlm.nih.gov/8861993/ . live .
  56. Ioannidis . J. P. . Haidich . A. B. . Pappa . M. . Pantazis . N. . Kokori . S. I. . Tektonidou . M. G. . Contopoulos-Ioannidis . D. G. . Lau . J. . August 15, 2001 . Comparison of evidence of treatment effects in randomized and nonrandomized studies . JAMA . 286 . 7 . 821–830 . 10.1001/jama.286.7.821 . 0098-7484 . 11497536 . March 24, 2022 . March 24, 2022 . https://web.archive.org/web/20220324001918/https://pubmed.ncbi.nlm.nih.gov/11497536/ . live .
  57. Web site: Belluz . Julia . February 16, 2015 . John Ioannidis has dedicated his life to quantifying how science is broken . March 25, 2022 . Vox . en . March 25, 2022 . https://web.archive.org/web/20220325012509/https://www.vox.com/2015/2/16/8034143/john-ioannidis-interview . live .
  58. Harvey . Lisa A. . October 2017 . Is evidence-based practice a sinking ship? . Spinal Cord . en . 55 . 10 . 885 . 10.1038/sc.2017.106 . 28984316 . 4702224 . 1476-5624 . free .
  59. Ioannidis . John P. A. . May 1, 2016 . Evidence-based medicine has been hijacked: a report to David Sackett . Journal of Clinical Epidemiology . en . 73 . 82–86 . 10.1016/j.jclinepi.2016.02.012 . 26934549 . 0895-4356 . March 30, 2022 . July 5, 2017 . https://web.archive.org/web/20170705151808/http://www.sciencedirect.com/science/article/pii/S0895435616001475 . live .
  60. Web site: Oransky . Ivan . March 16, 2016 . "Evidence-based medicine has been hijacked:" A confession from John Ioannidis . March 30, 2022 . Retraction Watch . en-US . March 30, 2022 . https://web.archive.org/web/20220330065039/https://retractionwatch.com/2016/03/16/evidence-based-medicine-has-been-hijacked-a-confession-from-john-ioannidis/ . live .
  61. Ioannidis . John P. A. . Stuart . Michael E. . Brownlee . Shannon . Strite . Sheri A. . September 28, 2017 . How to survive the medical misinformation mess . European Journal of Clinical Investigation . 47 . 11 . 795–802 . 10.1111/eci.12834 . 28881000 . 5353059 . 0014-2972 . free .
  62. Web site: February 14, 2020 . How to solve the medical misinformation mess . April 1, 2022 . Lown Institute . en-US . April 17, 2021 . https://web.archive.org/web/20210417224832/https://lowninstitute.org/how-to-solve-the-medical-misinformation-mess/ . live .
  63. Howick. Jeremy. Koletsi. Despina. John P.A.. Ioannidis. Madigan. Claire. Pandis. Nikolaos. Loef. Martin. Walach. Harald. Sauer. Sebastian. Kleijnen. Jos. Seehra. Jadbinder. Johnson. Tess. Schmidt. Stefan. 2022. Most healthcare interventions tested in Cochrane Reviews are not effective according to high quality evidence: a systematic review and meta-analysis.. J Clin Epi . 148. 160–169. 10.1016/j.jclinepi.2022.04.017. 35447356. 248250137 .
  64. Howick. Jeremy. Koletsi. Despina. Pandis P.A.. Nikolaos. Fleming. Padhraig. Loef. Martin. Walach. Harald. Schmidt. Stefan. Ioanidis. John P.A.. 2020. The quality of evidence for medical interventions does not improve or worsen: a metaepidemiological study of Cochrane reviews. J Clin Epidemiol . 126. 154–159. 10.1016/j.jclinepi.2020.08.005. 32890636. 221512241 .
  65. Web site: Bruce . Peter . Are Scientists Doing Too Much Research? . April 9, 2022 . Scientific American Blog Network . en . January 5, 2022 . https://web.archive.org/web/20220105162720/https://blogs.scientificamerican.com/observations/are-scientists-doing-too-much-research/ . live .
  66. Ioannidis . John P. A. . April 10, 2018 . The Proposal to Lower P Value Thresholds to .005 . JAMA . 319 . 14 . 1429–1430 . 10.1001/jama.2018.1536 . 29566133 . 0098-7484 . April 1, 2022 . May 18, 2022 . https://web.archive.org/web/20220518010831/https://jamanetwork.com/abusenotice . live .
  67. Benjamin . Daniel J. . Berger . James O. . Johannesson . Magnus . Nosek . Brian A. . Wagenmakers . E.-J. . Berk . Richard . Bollen . Kenneth A. . Brembs . Björn . Brown . Lawrence . Camerer . Colin . Cesarini . David . January 2018 . Redefine statistical significance . Nature Human Behaviour . 2 . 1 . 6–10 . 10.1038/s41562-017-0189-z . 2397-3374 . 30980045 . 3291437 . April 1, 2022 . April 1, 2022 . https://web.archive.org/web/20220401210755/https://pubmed.ncbi.nlm.nih.gov/30980045/ . live . 10281/184094 . free .
  68. Web site: Rethinking Science's Magic Number . April 1, 2022 . www.pbs.org . February 28, 2018 . en-US . April 1, 2022 . https://web.archive.org/web/20220401210755/https://www.pbs.org/wgbh/nova/article/rethinking-sciences-magic-number/ . live .
  69. Panagiotou . Orestis A. . Ioannidis . John P. A. . Genome-Wide Significance Project . February 2012 . What should the genome-wide significance threshold be? Empirical replication of borderline genetic associations . International Journal of Epidemiology . 41 . 1 . 273–286 . 10.1093/ije/dyr178 . 1464-3685 . 22253303 . free .
  70. Ioannidis . John P. A. . June 4, 2019 . The Importance of Predefined Rules and Prespecified Statistical Analyses: Do Not Abandon Significance . JAMA . 321 . 21 . 2067–2068 . 10.1001/jama.2019.4582 . 30946431 . 93002033 . 0098-7484 . April 1, 2022 . May 18, 2022 . https://web.archive.org/web/20220518010835/https://jamanetwork.com/journals/jama/article-abstract/2730486 . live .
  71. Web site: Resnick . Brian . 2017-07-31 . What a nerdy debate about p-values shows about science — and how to fix it . 2022-05-12 . Vox . en . May 7, 2022 . https://web.archive.org/web/20220507063218/https://www.vox.com/science-and-health/2017/7/31/16021654/p-values-statistical-significance-redefine-0005 . live .
  72. Liberati . Alessandro . Altman . Douglas G. . Tetzlaff . Jennifer . Mulrow . Cynthia . Gøtzsche . Peter C. . Ioannidis . John P. A. . Clarke . Mike . Devereaux . P. J. . Kleijnen . Jos . Moher . David . July 21, 2009 . The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration . BMJ . en . 339 . b2700 . 10.1136/bmj.b2700 . 0959-8138 . 19622552 . 2714672 . April 3, 2022 . April 2, 2022 . https://web.archive.org/web/20220402191312/https://www.bmj.com/content/339/bmj.b2700 . live .
  73. Moons . Karel G. M. . Altman . Douglas G. . Reitsma . Johannes B. . Ioannidis . John P. A. . Macaskill . Petra . Steyerberg . Ewout W. . Vickers . Andrew J. . Ransohoff . David F. . Collins . Gary S. . January 6, 2015 . Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): explanation and elaboration . Annals of Internal Medicine . 162 . 1 . W1–73 . 10.7326/M14-0698 . 1539-3704 . 25560730 . 1874/333472 . 24729487 . April 3, 2022 . April 3, 2022 . https://web.archive.org/web/20220403224644/https://pubmed.ncbi.nlm.nih.gov/25560730/ . live . free .
  74. Ioannidis . John P. A. . Evans . Stephen J. W. . Gøtzsche . Peter C. . O'Neill . Robert T. . Altman . Douglas G. . Schulz . Kenneth . Moher . David . CONSORT Group . November 16, 2004 . Better reporting of harms in randomized trials: an extension of the CONSORT statement . Annals of Internal Medicine . 141 . 10 . 781–788 . 10.7326/0003-4819-141-10-200411160-00009 . 1539-3704 . 15545678 . 17032571 . April 3, 2022 . April 3, 2022 . https://web.archive.org/web/20220403224638/https://pubmed.ncbi.nlm.nih.gov/15545678/ . live .
  75. Bandholm . Thomas . Thorborg . Kristian . Ardern . Clare L. . Christensen . Robin . Henriksen . Marius . 2022-02-21 . Writing up your clinical trial report for a scientific journal: the REPORT trial guide for effective and transparent research reporting without spin . British Journal of Sports Medicine . 56 . 12 . 683–691 . en . 10.1136/bjsports-2021-105058 . 0306-3674 . 35193854 . 9163716 . 247056557 . May 12, 2022 . May 12, 2022 . https://web.archive.org/web/20220512221313/https://bjsm.bmj.com/content/early/2022/02/21/bjsports-2021-105058 . live .
  76. Zorzela . Liliane . Loke . Yoon K. . Ioannidis . John P. . Golder . Su . Santaguida . Pasqualina . Altman . Douglas G. . Moher . David . Vohra . Sunita . PRISMAHarms Group . February 1, 2016 . PRISMA harms checklist: improving harms reporting in systematic reviews . BMJ (Clinical Research Ed.) . 352 . i157 . 10.1136/bmj.i157 . 1756-1833 . 26830668 . 6726816 . free .
  77. Web site: PRISMA . 2022-05-12 . prisma-statement.org . March 19, 2022 . https://web.archive.org/web/20220319013753/http://www.prisma-statement.org/Extensions/Harms . live .
  78. Ioannidis . J. P. . Ntzani . E. E. . Trikalinos . T. A. . Contopoulos-Ioannidis . D. G. . November 2001 . Replication validity of genetic association studies . Nature Genetics . 29 . 3 . 306–309 . 10.1038/ng749 . 1061-4036 . 11600885 . 6742347 . April 4, 2022 . April 13, 2022 . https://web.archive.org/web/20220413161259/https://pubmed.ncbi.nlm.nih.gov/11600885/ . live .
  79. McCarthy . Mark I. . Abecasis . Gonçalo R. . Cardon . Lon R. . Goldstein . David B. . Little . Julian . Ioannidis . John P. A. . Hirschhorn . Joel N. . May 2008 . Genome-wide association studies for complex traits: consensus, uncertainty and challenges . Nature Reviews Genetics . en . 9 . 5 . 356–369 . 10.1038/nrg2344 . 18398418 . 15032294 . 1471-0064 . April 4, 2022 . April 8, 2022 . https://web.archive.org/web/20220408060638/https://www.nature.com/articles/nrg2344 . live .
  80. Web site: Holden . 2013-06-06 . Meta-research update . 2022-05-12 . The GiveWell Blog . en-US . May 17, 2021 . https://web.archive.org/web/20210517102533/https://blog.givewell.org/2013/06/06/meta-research-update/ . live .
  81. Ioannidis . John P. A. . Gwinn . Marta . Little . Julian . Higgins . Julian P. T. . Bernstein . Jonine L. . Boffetta . Paolo . Bondy . Melissa . Bray . Molly S. . Brenchley . Paul E. . Buffler . Patricia A. . Casas . Juan Pablo . January 2006 . A road map for efficient and reliable human genome epidemiology . Nature Genetics . 38 . 1 . 3–5 . 10.1038/ng0106-3 . 1061-4036 . 16468121 . 23985692 . April 4, 2022 . May 25, 2021 . https://web.archive.org/web/20210525181729/https://pubmed.ncbi.nlm.nih.gov/16468121/ . live .
  82. Web site: Armitage . Hanae . July 16, 2018 . 5 Questions: John Ioannidis calls for more rigorous nutrition research . live . https://web.archive.org/web/20220411181139/https://med.stanford.edu/news/all-news/2018/07/john-ioannidis-calls-for-more-rigorous-nutrition-research.html . April 11, 2022 . 2022-05-12 . Stanford Medicine News Center .
  83. Web site: 2019-12-15 . Diet: Is nutrition science a more reliable source of advice than your grandmother? . 2022-05-12 . To infinity, and beyond! . en . April 20, 2021 . https://web.archive.org/web/20210420041711/https://dirnagl.com/2019/12/15/diet-is-nutrition-science-a-more-reliable-source-of-advice-than-your-grandmother/ . live .
  84. Schoenfeld . Jonathan D . Ioannidis . John PA . Is everything we eat associated with cancer? A systematic cookbook review . The American Journal of Clinical Nutrition . 97 . 1 . 2013 . 10.3945/ajcn.112.047142 . 127–134.
  85. News: O'Connor . Anahad . September 29, 2018 . More Evidence That Nutrition Studies Don't Always Add Up . en-US . The New York Times . April 6, 2022 . 0362-4331 . April 7, 2022 . https://web.archive.org/web/20220407084848/https://www.nytimes.com/2018/09/29/sunday-review/cornell-food-scientist-wansink-misconduct.html . live .
  86. Gardner . Christopher D. . Trepanowski . John F. . Del Gobbo . Liana C. . Hauser . Michelle E. . Rigdon . Joseph . Ioannidis . John P. A. . Desai . Manisha . King . Abby C. . February 20, 2018 . Effect of Low-Fat vs Low-Carbohydrate Diet on 12-Month Weight Loss in Overweight Adults and the Association With Genotype Pattern or Insulin Secretion: The DIETFITS Randomized Clinical Trial . JAMA . 319 . 7 . 667–679 . 10.1001/jama.2018.0245 . 29466592 . 5839290 . 0098-7484 . April 6, 2022 . May 18, 2022 . https://web.archive.org/web/20220518010830/https://jamanetwork.com/journals/jama/fullarticle/2673150 . live .
  87. Web site: Low-fat or low-carb? It's a draw, study finds . 2022-05-12 . ScienceDaily . en . May 12, 2022 . https://web.archive.org/web/20220512221311/https://www.sciencedaily.com/releases/2018/02/180220123124.htm . live .
  88. Ioannidis . John P. A. . Loy . En Yun . Poulton . Richie . Chia . Kee Seng . November 18, 2009 . Researching Genetic Versus Nongenetic Determinants of Disease: A Comparison and Proposed Unification . Science Translational Medicine . en . 1 . 7 . 7ps8 . 10.1126/scitranslmed.3000247 . 20368180 . 366302 . 1946-6234 . April 7, 2022 . April 7, 2022 . https://web.archive.org/web/20220407224042/https://www.science.org/doi/10.1126/scitranslmed.3000247 . live .
  89. von Stumm . Sophie . d’Apice . Katrina . January 2022 . From Genome-Wide to Environment-Wide: Capturing the Environome . Perspectives on Psychological Science . en . 17 . 1 . 30–40 . 10.1177/1745691620979803 . 1745-6916 . 8785306 . 33645332 .
  90. Hsing . Ann W. . Ioannidis . John P. A. . September 2015 . Nationwide Population Science: Lessons From the Taiwan National Health Insurance Research Database . JAMA Internal Medicine . 175 . 9 . 1527–1529 . 10.1001/jamainternmed.2015.3540 . 2168-6114 . 26192815 . April 7, 2022 . April 7, 2022 . https://web.archive.org/web/20220407223850/https://pubmed.ncbi.nlm.nih.gov/26192815/ . live .
  91. Khoury . Muin J. . Ioannidis . John P. A. . November 28, 2014 . Big data meets public health . Science . 346 . 6213 . 1054–1055 . 10.1126/science.aaa2709 . 0036-8075 . 4684636 . 25430753. 2014Sci...346.1054K .
  92. Nagendran . Myura . Chen . Yang . Lovejoy . Christopher A. . Gordon . Anthony C. . Komorowski . Matthieu . Harvey . Hugh . Topol . Eric J. . Ioannidis . John P. A. . Collins . Gary S. . Maruthappu . Mahiben . March 25, 2020 . Artificial intelligence versus clinicians: systematic review of design, reporting standards, and claims of deep learning studies . BMJ . en . 368 . m689 . 10.1136/bmj.m689 . 1756-1833 . 32213531 . 7190037 . April 7, 2022 . April 7, 2022 . https://web.archive.org/web/20220407224040/https://www.bmj.com/content/368/bmj.m689 . live .
  93. Web site: Journal . British Medical . Concerns over 'exaggerated' study claims of AI outperforming doctors . 2022-05-12 . medicalxpress.com . en . November 28, 2020 . https://web.archive.org/web/20201128024912/https://medicalxpress.com/news/2020-03-exaggerated-ai-outperforming-doctors.html . live .
  94. Cipriani . Andrea . Furukawa . Toshi A. . Salanti . Georgia . Chaimani . Anna . Atkinson . Lauren Z. . Ogawa . Yusuke . Leucht . Stefan . Ruhe . Henricus G. . Turner . Erick H. . Higgins . Julian P. T. . Egger . Matthias . April 7, 2018 . Comparative efficacy and acceptability of 21 antidepressant drugs for the acute treatment of adults with major depressive disorder: a systematic review and network meta-analysis . Lancet . 391 . 10128 . 1357–1366 . 10.1016/S0140-6736(17)32802-7 . 1474-547X . 5889788 . 29477251.
  95. News: February 22, 2018 . Anti-depressants: Major study finds they work . en-GB . BBC News . April 8, 2022 . April 8, 2022 . https://web.archive.org/web/20220408221148/https://www.bbc.com/news/health-43143889 . live .
  96. These Antidepressants Are Most Effective, Study Says . April 8, 2022 . Time . en . April 8, 2022 . https://web.archive.org/web/20220408221148/https://time.com/5169013/antidepressants-more-effective-placebo-treating-depression/ . live .
  97. Ebrahim . Shanil . Bance . Sheena . Athale . Abha . Malachowski . Cindy . Ioannidis . John P. A. . February 1, 2016 . Meta-analyses with industry involvement are massively published and report no caveats for antidepressants . Journal of Clinical Epidemiology . English . 70 . 155–163 . 10.1016/j.jclinepi.2015.08.021 . 0895-4356 . 26399904 . April 8, 2022 . September 14, 2018 . https://web.archive.org/web/20180914141407/https://www.jclinepi.com/article/S0895-4356(15)00429-1/abstract . live .
  98. News: Reviews Of Medical Studies May Be Tainted By Funders' Influence . en . NPR.org . April 8, 2022 . April 8, 2022 . https://web.archive.org/web/20220408221112/https://www.npr.org/sections/health-shots/2016/10/12/497550681/reviews-of-medical-studies-may-be-tainted-by-funders-influence?f=&ft=nprml&t=1649455233426 . live .
  99. Leichsenring . Falk . Steinert . Christiane . Rabung . Sven . Ioannidis . John P.A. . February 2022 . The efficacy of psychotherapies and pharmacotherapies for mental disorders in adults: an umbrella review and meta-analytic evaluation of recent meta-analyses . World Psychiatry . en . 21 . 1 . 133–145 . 10.1002/wps.20941 . 1723-8617 . 8751557 . 35015359.
  100. Button . Katherine S. . Ioannidis . John P. A. . Mokrysz . Claire . Nosek . Brian A. . Flint . Jonathan . Robinson . Emma S. J. . Munafò . Marcus R. . May 2013 . Power failure: why small sample size undermines the reliability of neuroscience . Nature Reviews Neuroscience . en . 14 . 5 . 365–376 . 10.1038/nrn3475 . 23571845 . 455476 . 1471-0048 . free .
  101. Web site: Bad Stats Plague Neuroscience . April 9, 2022 . The Scientist Magazine® . en . April 4, 2022 . https://web.archive.org/web/20220404145853/https://www.the-scientist.com/the-nutshell/bad-stats-plague-neuroscience-39458 . live .
  102. Ioannidis . John P. A. . Stanley . T. D. . Doucouliagos . Hristos . October 1, 2017 . The Power of Bias in Economics Research . The Economic Journal . 127 . 605 . F236–F265 . 10.1111/ecoj.12461 . 158829482 . 0013-0133 . free .
  103. Rogers . Adam . A New Study of Economics as a Science Says It's Still Dismal . en-US . Wired . April 9, 2022 . 1059-1028 . March 20, 2022 . https://web.archive.org/web/20220320024329/https://www.wired.com/story/econ-statbias-study/ . live .
  104. Web site: European Journal of Clinical Investigation. February 13, 2022. www.wolterskluwer.com. en. February 13, 2022. https://web.archive.org/web/20220213003907/https://www.wolterskluwer.com/en/solutions/ovid/european-journal-of-clinical-investigation-658. live.
  105. Web site: BMC Infectious Diseases. February 13, 2022. BioMed Central. en. February 13, 2022. https://web.archive.org/web/20220213003907/https://bmcinfectdis.biomedcentral.com/about/editorial-board. live.
  106. Web site: Editorial_Board. February 13, 2022. Oxford Academic. en. February 13, 2022. https://web.archive.org/web/20220213003905/https://academic.oup.com/ije/pages/Editorial_Board. live.
  107. May 23, 2012. About This Journal. JAMA. 307. 20. 2127. 10.1001/jama.307.20.2127. 0098-7484. free.
  108. Web site: Editorial Board - Journal of Clinical Epidemiology - Journal - Elsevier. February 13, 2022. www.journals.elsevier.com. May 18, 2022. https://web.archive.org/web/20220518010823/https://www.journals.elsevier.com/journal-of-clinical-epidemiology/journals.elsevier.com/journal-of-clinical-epidemiology/editorial-board. live.
  109. December 15, 2003. Reviewers. The Journal of Infectious Diseases. 188. 12. 1962–1965. 10.1086/380619. 0022-1899. free.
  110. Kehoe. Patrick. Cerhan. James R. Pedersen. Nancy. Wei. Qingyi. Ambrosone. Christine B. Arnett. Donna K. March 31, 2010. Editorial Board of International Journal of Molecular Epidemiology and Genetics (As of March 31, 2010). International Journal of Molecular Epidemiology and Genetics. 1. 1. 83. 1948-1756. 3076753. 21537455.
  111. Web site: Journal of Translational Medicine. February 13, 2022. BioMed Central. en. May 18, 2022. https://web.archive.org/web/20220518010816/https://translational-medicine.biomedcentral.com/about/editorial-board. live.
  112. Web site: Journal of Evaluation in Clinical Practice. February 13, 2022. Wiley Online Library. 10.1111/(ISSN)1365-2753. en. May 18, 2022. https://web.archive.org/web/20220518010816/https://onlinelibrary.wiley.com/page/journal/13652753/homepage/editorialboard.html. live.
  113. Web site: Editorial Board. February 13, 2022. Oxford Academic. en. October 30, 2021. https://web.archive.org/web/20211030114117/https://academic.oup.com/clinchem/pages/editorial_board. live.
  114. Web site: Physiological Reviews. February 13, 2022. Physiological Reviews. . en.
  115. Royal Society Open Science. Royal Society Open Science. 2014. 10.1098/rsos. en. free.
  116. Web site: Research Integrity and Peer Review. February 13, 2022. BioMed Central. en. February 13, 2022. https://web.archive.org/web/20220213222846/https://researchintegrityjournal.biomedcentral.com/about/editorial-board. live.
  117. Web site: Biomarker Research. February 13, 2022. BioMed Central. en. February 13, 2022. https://web.archive.org/web/20220213222846/https://biomarkerres.biomedcentral.com/about/editorial-board. live.
  118. Web site: Diagnostic and Prognostic Research. February 14, 2022. BioMed Central. en. February 14, 2022. https://web.archive.org/web/20220214223850/https://diagnprognres.biomedcentral.com/about/editorial-board. live.
  119. Web site: Ioannidis. February 14, 2022. MIDAS. en-US. February 14, 2022. https://web.archive.org/web/20220214223851/https://midas.umich.edu/ioannidis/. live.
  120. Ioannidis. John P. A.. Boyack. Kevin W.. Baas. Jeroen. October 16, 2020. Updated science-wide author databases of standardized citation indicators. PLOS Biology. en. 18. 10. e3000918. 10.1371/journal.pbio.3000918. 1545-7885. 7567353. 33064726 . free .
  121. News: Sridhar . Devi . Devi Sridhar . March 24, 2022 . Why can't some scientists just admit they were wrong about Covid? . The Guardian . live . March 24, 2022 . https://web.archive.org/web/20220324133929/https://www.theguardian.com/commentisfree/2022/mar/24/scientists-wrong-covid-virus-experts . March 24, 2022.
  122. Web site: Lipsitch. Marc. March 18, 2020. We know enough now to act decisively against Covid-19. Social distancing is a good place to start. October 20, 2020. October 19, 2020. https://web.archive.org/web/20201019213714/https://www.statnews.com/2020/03/18/we-know-enough-now-to-act-decisively-against-covid-19/. live.
  123. Web site: Lee. Stephanie M.. An Elite Group of Scientists Tried to Warn Trump Against Lockdowns in March. July 26, 2020. BuzzFeed News. July 24, 2020. July 26, 2020. https://web.archive.org/web/20200726032618/https://www.buzzfeednews.com/article/stephaniemlee/ioannidis-trump-white-house-coronavirus-lockdowns. live.
  124. Mallapaty. Smriti. April 17, 2020. Antibody tests suggest that coronavirus infections vastly exceed official counts. Nature. en. 10.1038/d41586-020-01095-0. 32303734. 215810316. November 25, 2020. November 21, 2020. https://web.archive.org/web/20201121102747/https://www.nature.com/articles/d41586-020-01095-0. live.
  125. Web site: March 29, 2021. What the heck happened to John Ioannidis? . March 31, 2021. Science-Based Medicine. en-US. March 31, 2021. https://web.archive.org/web/20210331045131/https://sciencebasedmedicine.org/what-the-heck-happened-to-john-ioannidis/. live.
  126. Web site: McCormick. Erin. April 23, 2020. Why experts are questioning two hyped antibody studies in coronavirus hotspots. November 21, 2020. The Guardian. June 1, 2020. https://web.archive.org/web/20200601111627/https://www.theguardian.com/world/2020/apr/23/coronavirus-antibody-studies-california-stanford. live.
  127. Vogel . Gretchen . Antibody surveys suggesting vast undercount of coronavirus infections may be unreliable . Science . April 21, 2020 . 10.1126/science.abc3831 . free.
  128. Web site: Schulson . Michael . A Respected Science Watchdog Raises Eyebrows . Undark Magazine . April 24, 2020 . November 22, 2020 . December 4, 2020 . https://web.archive.org/web/20201204005715/https://undark.org/2020/04/24/john-ioannidis-covid-19-death-rate-critics/ . live .
  129. Web site: May 6, 2020. Why unreliable tests are flooding the coronavirus conversation. November 25, 2020. National Geographic. en. November 19, 2020. https://web.archive.org/web/20201119164613/https://www.nationalgeographic.com/science/2020/05/why-unreliable-tests-are-flooding-the-coronavirus-conversation-cvd/. dead.
  130. Wired . David H. Freedman . A Prophet of Scientific Rigor—and a Covid Contrarian . May 1, 2020 . May 24, 2020 . May 24, 2020 . https://web.archive.org/web/20200524110110/https://www.wired.com/story/prophet-of-scientific-rigor-and-a-covid-contrarian/ . live .
  131. Web site: September 19, 2021. Intubations and Accusations: Doctors were "just going crazy, and intubating people who did not have to be intubated". November 30, 2021. Science-Based Medicine. en-US. November 30, 2021. https://web.archive.org/web/20211130235536/https://sciencebasedmedicine.org/intubations/. live.
  132. Web site: Lee. Stephanie. JetBlue's Founder Helped Fund A Stanford Study That Said The Coronavirus Wasn't That Deadly. May 30, 2020. Buzzfeed. May 15, 2020 . May 29, 2020. https://web.archive.org/web/20200529144350/https://www.buzzfeednews.com/article/stephaniemlee/stanford-coronavirus-neeleman-ioannidis-whistleblower. live.
  133. Web site: Landsverk. Gabby. A controversial study on coronavirus was partly funded by an airline founder who's criticized lockdowns, according to a new investigation from BuzzFeed News. May 30, 2020. Business Insider. May 30, 2020. https://web.archive.org/web/20200530205724/https://www.businessinsider.com/buzzfeed-stanford-coronavirus-study-funded-by-jetblue-founder-2020-5. live.
  134. Web site: Brownlee. Jeanne Lenzer, Shannon. The COVID Science Wars. December 1, 2020. Scientific American. en. December 1, 2020. https://web.archive.org/web/20201201011651/https://www.scientificamerican.com/article/the-covid-science-wars1/. live.
  135. News: Jamison. Peter. December 16, 2020. A top scientist questioned virus lockdowns on Fox News. The backlash was fierce.. The Washington Post. live. March 25, 2021. February 23, 2021. https://web.archive.org/web/20210223135844/https://www.washingtonpost.com/dc-md-va/2020/12/16/john-ioannidis-coronavirus-lockdowns-fox-news/.
  136. Web site: May 20, 2020. The Herd Immunity Taboo. March 29, 2021. Tablet Magazine. en. April 6, 2021. https://web.archive.org/web/20210406031003/https://www.tabletmag.com/sections/science/articles/plague-journal-herd-immunity-doidge. live.
  137. Ioannidis. John P. A.. Reconciling estimates of global spread and infection fatality rates of COVID-19: an overview of systematic evaluations. European Journal of Clinical Investigation. 2021. 51. 5. en. e13554. 10.1111/eci.13554. 8250317. 33768536. 1365-2362. free.
  138. Piscitelli . Prisco . Miani . Alessandro . Setti . Leonardo . De Gennaro . Gianluigi . Rodo . Xavier . Artinano . Begona . Vara . Elena . Rancan . Lisa . Arias . Javier . Passarini . Fabrizio . Barbieri . Pierluigi . February 26, 2022 . The role of outdoor and indoor air quality in the spread of SARS-CoV-2: Overview and recommendations by the research group on COVID-19 and particulate matter (RESCOP commission) . Environmental Research . 211 . en . 113038 . 10.1016/j.envres.2022.113038 . 35231456 . 8881809 . 2022ER....211k3038P . 0013-9351.
  139. News: Knapton . Sarah . February 15, 2022 . Lockdown debate skewed because sceptical scientists were shunned on social media . en-GB . The Telegraph . March 3, 2022 . 0307-1235 . February 27, 2022 . https://web.archive.org/web/20220227215329/https://www.telegraph.co.uk/news/2022/02/15/lockdown-debate-skewed-sceptical-scientists-shunned-social-media/ . live .
  140. Ioannidis . John . February 1, 2022 . Citation impact and social media visibility of Great Barrington and John Snow signatories for COVID-19 strategy . BMJ Open . en . 12 . 2 . e052891 . 10.1136/bmjopen-2021-052891 . 2044-6055 . 35140152 . 8829837 . April 10, 2022 . April 5, 2022 . https://web.archive.org/web/20220405031208/https://bmjopen.bmj.com/content/12/2/e052891 . live .
  141. Yarney . Gavin M. . et al. . 3 March 2022 . A Simple Request to Professor Ioannidis: Please Address Our Concerns . live . BMJ Open . 12 . 2 . e052891 . 10.1136/bmjopen-2021-052891 . 35140152 . 8829837 . https://web.archive.org/web/20220513021239/https://bmjopen.bmj.com/content/12/2/e052891.responses#a-simple-request-to-professor-ioannidis-please-address-our-concerns . 13 May 2022 . 12 May 2022.
  142. Ioannidis . John P. . 2022-02-01 . Citation impact and social media visibility of Great Barrington and John Snow signatories for COVID-19 strategy . BMJ Open . en . 12 . 2 . e052891 . 10.1136/bmjopen-2021-052891 . 2044-6055 . 35140152. 8829837 .
  143. Web site: Freedman. David H.. October 4, 2010. Lies, Damned Lies, and Medical Science. August 26, 2020. The Atlantic. en-US. August 24, 2020. https://web.archive.org/web/20200824031551/https://www.theatlantic.com/magazine/archive/2010/11/lies-damned-lies-and-medical-science/308269/. live.
  144. Web site: November 2010 Issue. March 31, 2021. The Atlantic. en-US. March 23, 2021. https://web.archive.org/web/20210323172225/https://www.theatlantic.com/magazine/toc/2010/11/. live.
  145. Web site: Begley. Sharon. January 23, 2011. Why Almost Everything You Hear About Medicine Is Wrong. February 15, 2022. Newsweek. en. February 15, 2022. https://web.archive.org/web/20220215233417/https://www.newsweek.com/why-almost-everything-you-hear-about-medicine-wrong-66947. live.
  146. Web site: September 9, 2013. Richard Smith: Time for science to be about truth rather than careers. February 15, 2022. The BMJ. en-US. February 15, 2022. https://web.archive.org/web/20220215233419/https://blogs.bmj.com/bmj/2013/09/09/richard-smith-time-for-science-to-be-about-truth-rather-than-careers/. live.
  147. News: Combating bad science: Metaphysicians. The Economist. September 1, 2017. September 18, 2017. https://web.archive.org/web/20170918031301/https://www.economist.com/news/science-and-technology/21598944-sloppy-researchers-beware-new-institute-has-you-its-sights-metaphysicians. live.
  148. News: Johnson. George. January 20, 2014. New Truths That Only One Can See. en-US. The New York Times. February 15, 2022. 0362-4331. February 3, 2022. https://web.archive.org/web/20220203131144/https://www.nytimes.com/2014/01/21/science/new-truths-that-only-one-can-see.html. live.
  149. Ioannidis. J.. 2015. John Ioannidis: Uncompromising gentle maniac. BMJ. 351. h4992. 10.1136/bmj.h4992. 1756-1833. 26404555. 10953475.
  150. Web site: Rathi . Akshat . A Stanford medical professor just exposed huge flaws in evidence used to give drug prescriptions . March 24, 2022 . Quartz . September 20, 2016 . en . March 24, 2022 . https://web.archive.org/web/20220324002611/https://qz.com/784615/the-man-who-made-scientists-question-themselves-has-just-exposed-huge-flaws-in-evidence-used-to-give-drug-prescriptions/ . live .
  151. Web site: says. Johnny Johnson. July 16, 2019. Fixing health care's replication crisis is important for researchers and patients. February 18, 2022. STAT. en-US. February 18, 2022. https://web.archive.org/web/20220218231724/https://www.statnews.com/2019/07/16/fixing-health-care-replication-crisis/. live.
  152. Web site: Elsevier . Reproducibility in research: taming a "complex beast" . March 22, 2022 . Elsevier Connect . en . March 22, 2022 . https://web.archive.org/web/20220322232619/https://www.elsevier.com/connect/reproducibility-in-research-taming-a-complex-beast . live .
  153. Web site: Smith . Jeffrey Lee Funk and Gary N. . 'Fake it till you make it' is an old trick Silicon Valley startups use to get money. Starry-eyed stock investors keep falling for it. . 2023-02-08 . MarketWatch . EN-US.
  154. Web site: 2022-04-29 . The science crisis . 2023-02-08 . Washington Examiner . en.
  155. Web site: Newsroom . Stanford professor John Ioannidis elected member of National Academy of Medicine eKathimerini.com . 2022-06-07 . www.ekathimerini.com . English.
  156. Web site: ΙΩΑΝΝΗΣ Π.Α. ΙΩΑΝΝΙΔΗΣ Εταιρεία Συγγραφέων . 2022-06-07 . www.authors.gr.
  157. Web site: EBHC International Conference 2019 - John Ioannidis . 2022-06-07 . www.ebhcconference.org.
  158. Web site: Association of American Physicians . 2022-06-07 . aap-online.org.
  159. Program at a glance. European Journal of Clinical Investigation. 2021. 1365-2362. e13566. 51. S1. 10.1111/eci.13566. 235382244. en. February 3, 2022. February 4, 2022. https://web.archive.org/web/20220204043235/https://onlinelibrary.wiley.com/doi/abs/10.1111/eci.13566. live. 10174/31004. free.
  160. Web site: Max-Delbrück-Centrum. Berliner Institut für Gesundheitsforschung-Charité und. Visiting Fellows - BIH at Charité. www.bihealth.org. en-EN. February 2, 2022. February 3, 2022. https://web.archive.org/web/20220203001535/https://www.bihealth.org/en/translation/innovation-enabler/quest-center/teams/visiting-fellows. live.
  161. News: Novim 2018 Awards. May 7, 2018. February 3, 2022. February 3, 2022. https://web.archive.org/web/20220203001534/https://novim.org/wp-content/uploads/2021/04/Novim2018AJNAwards.pdf. live.
  162. Web site: Chanchlani Award Recognizes One of the Most Influential Scientists Alive. February 7, 2017. Global Health Graduate Programs. en-US. February 3, 2022. February 3, 2022. https://web.archive.org/web/20220203001537/https://globalhealth.mcmaster.ca/chanchlani-award-recognizes-one-of-the-most-influential-scientists-alive/. live.
  163. Web site: David-Sackett-Preis. EbM-Netzwerk. de. February 3, 2022. January 20, 2022. https://web.archive.org/web/20220120110722/https://www.ebm-netzwerk.de/de/veroeffentlichungen/david-sackett-preis. live.
  164. Web site: Η Ελληνική Φαρμακευτική Εταιρεία βραβεύει τον ερευνητή των... ερευνών. Σπαγαδώρου. Νατάσσα Ν. November 12, 2016. Onmed.gr. el. February 3, 2022. February 3, 2022. https://web.archive.org/web/20220203213152/https://www.onmed.gr/ygeia-eidhseis/story/349203/h-elliniki-farmakeytiki-etaireia-vraveyei-ton-ereyniti-ton-ereynon. live.
  165. Web site: John Ioannidis to TC Doctoral Students: Saving Science and Humanity Begins with Teachers College, Columbia University. Teachers College - Columbia University. en. February 3, 2022. February 3, 2022. https://web.archive.org/web/20220203004356/https://www.tc.columbia.edu/articles/2015/may/john-ioannidis-to-tc-doctoral-students-saving-science-and-humanity-begins-with-/. live.
  166. The Esci Award for Excellence in Clinical Science. European Journal of Clinical Investigation. 2007. 1365-2362. 528. 37. 6. 10.1111/j.1365-2362.2007.01831.x. 221679709. en. free.