Research question explained

A research question is "a question that a research project sets out to answer".[1] Choosing a research question is an essential element of both quantitative and qualitative research. Investigation will require data collection and analysis, and the methodology for this will vary widely. Good research questions seek to improve knowledge on an important topic, and are usually narrow and specific.

To form a research question, one must determine what type of study will be conducted such as a qualitative, quantitative, or mixed study. Additional factors, such as project funding, may not only affect the research question itself but also when and how it is formed during the research process. Literature suggests several variations on criteria selection for constructing a research question, such as the FINER or PICOT methods.[2] [3] [4]

Definition

The answer to a research question will help address a research problem or question.[5] Specifying a research question, "the central issue to be resolved by a formal dissertation, thesis, or research project," is typically one of the first steps an investigator takes when undertaking research. Considerations, such as project funding or methodological approaches may influence the research process, including when and how the research question is developed.[6] Clearly and accurately defining the research question can become an iterative process. How the question is constructed can depend on the type of research or discipline.

Constructing a research question

Specifying the research question is one of the first methodological steps the investigator has to take when undertaking research. Having an interest in or knowledge of a particular subject can be useful in the construction of a research question.[7] Formation of the research question is largely determined by, and likewise influences, where and what kind of information will be sought.[8] The research question must be accurately and clearly defined. Choosing a research question is the central element of both quantitative and qualitative research and in some cases it may precede construction of the conceptual framework of study; in all cases, it makes the theoretical assumptions in the framework more explicit and indicates what the researcher wants to know most and first. Therefore, the investigator must first identify the type of study (qualitative, quantitative, or mixed) before the research question is developed. Forming the research question may become an iterative process when parameters of the research process, such as field of study or methodology, do not fit the original question. Literature suggests several methods for selecting criteria in the development of a research question, two of which are the FINER and PICO methods.

Construction method examples

FINER criteria

The FINER[9] method can be a useful tool for outlining research criteria used in the construction of a research question. Due to the flexibility of the criteria, this method may be used for a variety of research scenarios. The FINER method prompts researchers to determine whether one has the means and interest to conduct the study. It also asks one to consider the ethical ramifications, as well as the relevancy of the research.

According to Farrugia et al., the FINER criteria "highlight useful points that may increase the chances of developing a successful research project". These criteria were first suggested in the book Designing Clinical Research by Hulley et al., detailed below.

F – Feasible

I – Interesting

N – Novel

E – Ethical

R – Relevant

PICOT criteria

PICOT criteria tend to be used to frame questions used in evidence-based studies, such as medical studies. Such research may focus on assessment or evaluation of patients or problems, as well as what may be the causal factor(s) with control and experimental groups.

P – Patient (or Problem)

I – Intervention (or Indicator)

C – Comparison group

O – Outcomes

T – Time

Continuing the research process, the investigator then carries out the research necessary to answer the research question, whether this involves reading secondary sources over a few days for an undergraduate term paper or carrying out primary research over years for a major project. When the research is complete and the researcher knows the (probable) answer to the research question, writing up can begin (as distinct from writing notes, which is a process that goes on through a research project). In term papers, the answer to the question is normally given in summary in the introduction in the form of a thesis statement.

Aggregated research questions and coordination

See also: Open problem and Further research is needed. Scientists often communicate open research questions. Sometimes such questions are crowdsourced and/or aggregated, sometimes supplemented with priorities or other details. A common way open research questions are identified, communicated, established/confirmed and prioritized are their inclusion in scientific reviews of a sub-field or specific research question, including in systematic reviews and meta-analyses. Other channels include reports by science journalists and dedicated (sub-)websites such as 80000hours.org's "research questions by discipline"[10] or the Wikipedia articles of the lists of unsolved problems,[11] [12] [13] aggregative/integrative studies,[11] as well as unsolved online posts on Q&A websites and forums, sometimes categorized/marked as unsolved.[14] There have been online surveys used to generate priority research topics which were then classified into broader themes.[15] Such may improve research relevance and value[16] or strengthen rationale for societal dedication of limited resources or expansions of the limited resources or for funding a specific study.

Prioritization and evaluations

See also: Science policy, Philosophy of science, List of causes of death by rate, Quality-adjusted life year, Intergenerational equity, Sustainability and Risk. In terms of priorities and related concepts, the proposed strategy of differential technological development suggests research to focus primarily on questions and tools that are thought to increase safety and mitigate issues rather than risky technologies which are instead best to delay.[17] [18] Concerning control strategies for gene drives, researchers have however cautioned that such may lead to a counterproductive false sense of security.[19] Not all technological progress may be beneficial in general or in contemporary contexts (environments or systems) and various research may for example result in engineered pandemics.[20]

Many studies "ask uninteresting research questions, [and] make only marginal contributions".[21] One study suggests that while research on climate change "is valuable, it does not tackle head-on the most urgent question: how to change society to mitigate climate change right now".[22] In the ethical framework of effective altruism, research questions with the greatest potential benefits from investments (not necessarily of financial nature) are identified to maximize research benefits.[23] 80,000 Hours has compiled a small list of "Research questions that could have a big social impact, organised by discipline".[10] In public health research, "it is vital that research questions posed are important and that funded research meets a research need or a gap in evidence".[24]

ICTs, participation and routine procedures

See also: List of environmental issues and Technology and society. Platforms, e.g. citizen science ones, can "support identification of problems, formulation of research questions, and study design".[25] Participatory research can "improve study outcomes and foster greater data accessibility and utility as well as increase public transparency".[26] Participants can have continued discussions and iterations regarding new questions.[27] Research questions can be or are positioned at varying levels of detail – from broad to very specific questions – which are semantically or can be displayed as nested – for instance via category trees. In one platform, about invasion science and based on Wikidata, users "can zoom into the major research questions and hypotheses" of the field, "which are connected to the relevant studies published in the field and, if available, the underlying raw data" with tools like the Wikimedia project Scholia.[28] Individuals "who can ask novel, field-altering questions" may vary from "those who can answer them" or vary per question.[29] Translation of a (societal) problem "from its meaning in an everyday context into a scientifically valid research question means defining the goals of research in such a way that their contribution to practical solutions of a societal problem is narrow enough to be useful".[30] Both everyday practical knowledge and scientific knowledge play a role in this process.[30] In interdisciplinary research, integration "takes place at the level of the posing of research questions in the overlapping areas between various disciplines".[30] There is research into enabling presenting scholarly knowledge "flexibly enriched with contextual information" for specific research questions.[31]

Identification of open research questions may be useful for the adoption and application of science in society and accelerating specific research and development. There has been a suggestion for establishing a public non-profit organization that would identify "gaps in the science that need addressing", referring to the field of sustainable food system.[32]

Examples and breadth of "research questions"

Similar to outlining open research questions, there have also been proposals to e.g. combine specific fields or sources of data and knowledge as the subject or method of new research[33] or to engage more and more scientifically in specific research topics along with the establishment of new high-quality data gathering systems.[34] [35] One approach for the generation of research questions is [identifying, highlighting, and] challenging assumptions of existing theories and studies.[36]

Sometimes research questions overlap with or also refer to challenges of a specific theory or field such as how to solve known problems with the Standard Model. Research issues and knowledge gaps can also overlap or be synonymous.

Examples of lists of open significant research questions in reviews include a list of "major outstanding questions" for (applied) human life extension,[33] "fundamental" research questions in subterranean biology,[37] open research questions for digital twins (across fields),[38] open questions in performance measurement of sustainable supply chains,[39] knowledge gaps in antimicrobial resistance,[40] and unaddressed or neglected questions in the literature about 100% renewable energy systems.[41]

Types and purpose

The research question serves two purposes

  1. It determines where and what kind of research the writer will be looking for.[42]
  2. It identifies the specific objectives the study or paper will address.

Therefore, the writer must first identify the type of study (qualitative, quantitative, or mixed) before the research question is developed.

Qualitative study

A qualitative study seeks to learn why or how, so the writer's research must be directed at determining the what, why and how of the research topic. Therefore, when crafting a research question for a qualitative study, the writer will need to ask a why or how question about the topic. For example: How did the company successfully market its new product? The sources needed for qualitative research typically include print and internet texts (written words), audio and visual media.

Here is Creswell's (2009) example of a script for a qualitative research central question:

Quantitative study

A quantitative study seeks to learn where, or when, so the writer's research must be directed at determining the where, or when of the research topic. Therefore, when crafting a research question for a quantitative study, the writer will need to ask a where, or when question about the topic. For example: Where should the company market its new product? Unlike a qualitative study, a quantitative study is mathematical analysis of the research topic, so the writer's research will consist of numbers and statistics.

Here is Creswell's (2009) example of a script for a quantitative research question:

Alternatively, a script for a quantitative null hypothesis might be as follows:

Quantitative studies also fall into two categories:

  1. Correlational studies: A correlational study is non-experimental, requiring the writer to research relationships without manipulating or randomly selecting the subjects of the research. The research question for a correlational study may look like this: What is the relationship between long-distance commuters and eating disorders?
  2. Experimental studies: An experimental study is experimental in that it requires the writer to manipulate and randomly select the subjects of the research. The research question for an experimental study may look like this: Does the consumption of fast food lead to eating disorders?

Mixed study

A mixed study integrates both qualitative and quantitative studies, so the writer's research must be directed at determining the why or how and the what, where, or when of the research topic. Therefore, the writer will need to craft a research question for each study required for the assignment. A typical study may be expected to have between 1 and 6 research questions.

Once the writer has determined the type of study to be used and the specific objectives the paper will address, the writer must also consider whether the research question passes the "so what" test. The "so what" test means that the writer must construct evidence to convince the audience why the research is expected to add new or useful knowledge to the literature.

Related terms

Problematique

is a term that functions analogously to the research problem or question used typically when addressing global systemic problems. The term achieved prominence in 1970 when Hasan Özbekhan, Erich Jantsch and Alexander Christakis conceptualized the original prospectus of the Club of Rome titled "The Predicament of Mankind".[43] In this prospectus the authors designated 49 Continuous Critical Problems facing humankind, saying "We find it virtually impossible to view them as problems that exist in isolation – or as problems capable of being solved in their own terms... It is this generalized meta system of problems, which we call the 'problematique' that inheres in our situation."

Situations similar to the global problematique in their complexity are also called problematiques. These situations receive different designations from other authors. In organizational theory and related fields, researchers C. West Churchman, Horst Rittel and Melvin Webber, and Chris Argyris[44] called these situations wicked problems; Russell Ackoff called them "messes".

See also

Further reading

External links

Notes and References

  1. Mattick. Karen. Johnston. Jenny. de la Croix. Anne. 2018. How to…write a good research question. The Clinical Teacher. en. 15. 2. 104–108. 10.1111/tct.12776. 29575667. 4360924. free.
  2. Santos CM da C, Pimenta CA de M, Nobre MRC. The PICO strategy for the research question construction and evidence search. Revista latino-americana de enfermagem. 2007;15(3):508–511.
  3. Boudin F, Nie J-Y, Dawes M. Clinical information retrieval using document and PICO structure. In: Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Association for Computational Linguistics; 2010. p. 822–830.
  4. Bhattacharya S. Journal club and post-graduate medical education. Indian J Plast Surg. 2017 Dec;50(3):302–5.
  5. Book: The Craft of Research. Booth, Wayne C.. Gregory G. Colomb. Colomb, Gregory G.. Joseph M. Williams. Williams, Joseph M.. Bizup, Joseph. William T. Fitzgerald. Fitzgerald, William T.. The University of Chicago Press. 1995. 0-226-06565-0. Chicago, IL. Wayne C. Booth. The Craft of Research.
  6. Haynes. R. Brian. 2006-09-01. Forming research questions. Journal of Clinical Epidemiology. English. 59. 9. 881–886. 10.1016/j.jclinepi.2006.06.006. 0895-4356. 16895808. 7125967.
  7. Farrugia. Patricia. 2010. Practical tips for surgical research: Research questions, hypotheses and objectives. Canadian Journal of Surgery. 53. 4. 278–81. 2912019. 20646403.
  8. Book: Creswell, John W.. Research design : qualitative, quantitative, and mixed methods approaches. 2014. SAGE Publications. 978-1-4522-2609-5. 4th. Thousand Oaks, California. 815758208.
  9. Book: Designing clinical research. 2007. Lippincott Williams & Wilkins. Hulley, Stephen B.. 978-0-7817-8210-4. 3rd. Philadelphia, PA. 71223173.
  10. Web site: Research questions that could have a big social impact, organised by discipline . 80,000 Hours . 31 August 2022 . 31 August 2022 . https://web.archive.org/web/20220831213325/https://80000hours.org/articles/research-questions-by-discipline/ . live .
  11. Coley . Alan A . Open problems in mathematical physics . Physica Scripta . 30 August 2017 . 92 . 9 . 093003 . 10.1088/1402-4896/aa83c1 . 1710.02105 . 2017PhyS...92i3003C . 3892374 . en . 0031-8949.
  12. Adolphs . Ralph . The unsolved problems of neuroscience . Trends in Cognitive Sciences . 1 April 2015 . 19 . 4 . 173–175 . 10.1016/j.tics.2015.01.007 . 25703689 . 4574630 . en . 1364-6613. As for Hilbert’s problems, there is a Wikipedia entry for ‘unsolved problems in neuroscience’; there are more popular writings; and there are books. In trying to brainstorm a list of my own, I read the above sources and asked around. This yields a predictable list ranging from ‘how can we cure psychiatric illness?’ to ‘what is consciousness?’ (Box 1). Asking Caltech faculty added entries about how networks function and what neural computation is. Caltech students had things figured out and got straight to the point (‘how can I sleep less?’, ‘how can we save our species?’, ‘can we become immortal?’)..
  13. Dev . Sukhendu B. . Unsolved problems in biology—The state of current thinking . Progress in Biophysics and Molecular Biology . 1 March 2015 . 117 . 2 . 232–239 . 10.1016/j.pbiomolbio.2015.02.001 . 25687284 . en . 0079-6107 . Among many of the responses I received, a large majority mentioned several aspects of neuroscience. This is not surprising since the brain remains the most uncharted area in humans. A list of unsolved problems in neuroscience can be found in http://en.wikipedia.org/wiki/List_of_unsolved_problems_in_neuroscience (Accessed January 12, 2015).. free .
  14. Book: Cartaxo . Bruno . Pinto . Gustavo . Ribeiro . Danilo . Kamei . Fernando . Santos . Ronnie E.S. . da Silva . Fábio Q.B. . Soares . Sérgio . 2017 IEEE/ACM 14th International Conference on Mining Software Repositories (MSR) . Using Q&A Websites as a Method for Assessing Systematic Reviews . May 2017 . 238–242 . 10.1109/MSR.2017.5. 978-1-5386-1544-7 . 5853766 .
  15. Synnot . Anneliese . Bragge . Peter . Lowe . Dianne . Nunn . Jack S . O’Sullivan . Molly . Horvat . Lidia . Tong . Allison . Kay . Debra . Ghersi . Davina . McDonald . Steve . Poole . Naomi . Bourke . Noni . Lannin . Natasha . Vadasz . Danny . Oliver . Sandy . Carey . Karen . Hill . Sophie J . Research priorities in health communication and participation: international survey of consumers and other stakeholders . BMJ Open . May 2018 . 8 . 5 . e019481 . 10.1136/bmjopen-2017-019481. 29739780 . 5942413 .
  16. Synnot . Anneliese J. . Tong . Allison . Bragge . Peter . Lowe . Dianne . Nunn . Jack S. . O’Sullivan . Molly . Horvat . Lidia . Kay . Debra . Ghersi . Davina . McDonald . Steve . Poole . Naomi . Bourke . Noni . Lannin . Natasha A. . Vadasz . Danny . Oliver . Sandy . Carey . Karen . Hill . Sophie J. . Selecting, refining and identifying priority Cochrane Reviews in health communication and participation in partnership with consumers and other stakeholders . Health Research Policy and Systems . 29 April 2019 . 17 . 1 . 45 . 10.1186/s12961-019-0444-z. 31036016 . 6489310 . free .
  17. Bostrom, Nick. Nick Bostrom. 2002. Existential Risks: Analyzing Human Extinction Scenarios. 31 August 2022. 27 April 2011. https://web.archive.org/web/20110427030852/http://www.nickbostrom.com/existential/risks.html. live. 9 Journal of Evolution and Technology Jetpress Oxford Research Archive
  18. Book: Ord, Toby. The Precipice: Existential Risk and the Future of Humanity. Bloomsbury Publishing. 2020. 978-1526600219. United Kingdom. 200.
  19. News: Biologists create new genetic systems to neutralize gene drives . 8 October 2020 . phys.org . en . 9 October 2020 . https://web.archive.org/web/20201009044319/https://phys.org/news/2020-09-biologists-genetic-neutralize-gene.html . live .
  20. Bostrom . Nick . The Vulnerable World Hypothesis . Global Policy . November 2019 . 10 . 4 . 455–476 . 10.1111/1758-5899.12718 . 203169705 . en . 1758-5880. free .
  21. Sovacool . Benjamin K. . Axsen . Jonn . Sorrell . Steve . Promoting novelty, rigor, and style in energy social science: Towards codes of practice for appropriate methods and research design . Energy Research & Social Science . 1 November 2018 . 45 . 12–42 . 10.1016/j.erss.2018.07.007 . 53571042 . en . 2214-6296. free .
  22. Overland . Indra . Sovacool . Benjamin K. . The misallocation of climate research funding . Energy Research & Social Science . 1 April 2020 . 62 . 101349 . 10.1016/j.erss.2019.101349 . 212789228 . en . 2214-6296. free . 11250/2647605 . free .
  23. Garrett . K. A. . Alcalá-Briseño . R. I. . Andersen . K. F. . Brawner . J. . Choudhury . R. A. . Delaquis . E. . Fayette . J. . Poudel . R. . Purves . D. . Rothschild . J. . Small . I. M. . Thomas-Sharma . S. . Xing . Y. . Effective Altruism as an Ethical Lens on Research Priorities . Phytopathology . April 2020 . 110 . 4 . 708–722 . 10.1094/PHYTO-05-19-0168-RVW . 31821114 . 209313233 . 0031-949X. free . 10568/106260 . free .
  24. Turner . S. . Ollerhead . E. . Cook . A. . Identifying research priorities for public health research to address health inequalities: use of Delphi-like survey methods . Health Research Policy and Systems . 9 October 2017 . 15 . 1 . 87 . 10.1186/s12961-017-0252-2 . 28992810 . 5632826 . 1478-4505 . free .
  25. Web site: Kloppenborg . Katharina . Ball . Mad Price . Tzovaras . Bastian Greshake . Peer Production Practices: Design Strategies in Online Citizen Science Platforms . 31 August 2022 . 31 August 2022 . https://web.archive.org/web/20220831214827/https://osf.io/preprints/socarxiv/rw58y/ . live .
  26. English . P.B. . Richardson . M.J. . Garzón-Galvis . C. . From Crowdsourcing to Extreme Citizen Science: Participatory Research for Environmental Health . Annual Review of Public Health . 1 April 2018 . 39 . 1 . 335–350 . 10.1146/annurev-publhealth-040617-013702 . 29608871 . en . 0163-7525. free .
  27. Book: Senabre Hidalgo . Enric . Perelló . Josep . Becker . Frank . Bonhoure . Isabelle . Legris . Martine . Cigarini . Anna . Participation and Co-creation in Citizen Science . The Science of Citizen Science . 2021 . 199–218 . 10.1007/978-3-030-58278-4_11 . Springer International Publishing . 978-3-030-58277-7 . 234115472 . en. free . 2445/173432 . free .
  28. Jeschke . Jonathan M. . Heger . Tina . Kraker . Peter . Schramm . Maxi . Kittel . Christopher . Mietchen . Daniel . Towards an open, zoomable atlas for invasion science and beyond . NeoBiota . 18 August 2021 . 68 . 5–18 . 10.3897/neobiota.68.66685. 237952788 . free .
  29. Fortunato . Santo . Bergstrom . Carl T. . Börner . Katy . Evans . James A. . Helbing . Dirk . Milojević . Staša . Petersen . Alexander M. . Radicchi . Filippo . Sinatra . Roberta . Uzzi . Brian . Vespignani . Alessandro . Waltman . Ludo . Wang . Dashun . Barabási . Albert-László . Science of science . Science . 2 March 2018 . 359 . 6379 . eaao0185 . 10.1126/science.aao0185 . 29496846 . 5949209 . en . 0036-8075.
  30. Web site: Jahn . Thomas . Transdisciplinarity in the Practice of Research . 2008 . 31 August 2022 . 3 September 2023 . https://web.archive.org/web/20230903201728/http://www.isoe-publikationen.de/uploads/media/jahn-transdisciplinarity-2008.pdf . live .
  31. Haris . Muhammad . Stocker . Markus . Auer . Sören . Enriching Scholarly Knowledge with Context . 28 March 2022. cs.DL . 2203.14617 .
  32. The war in Ukraine is exposing gaps in the world's food-systems research . Nature . 12 April 2022 . 604 . 7905 . 217–218 . en . 10.1038/d41586-022-00994-8. 35414667 . 2022Natur.604..217. . 248129049 . free .
  33. Dönertaş . Handan Melike . Fuentealba . Matías . Partridge . Linda . Thornton . Janet M. . Identifying Potential Ageing-Modulating Drugs In Silico . Trends in Endocrinology & Metabolism . February 2019 . 30 . 2 . 118–131 . 10.1016/j.tem.2018.11.005. 30581056 . 6362144 .
  34. News: Opinion We're asking the wrong questions about UFOs . Washington Post . 31 August 2022 . 16 April 2022 . https://web.archive.org/web/20220416230308/https://www.washingtonpost.com/opinions/2021/05/26/we-need-put-science-center-ufo-question/ . live .
  35. News: Why some scientists want serious research into UFOs . 31 August 2022 . Science News . 19 May 2022 . 6 July 2022 . https://web.archive.org/web/20220706235654/https://www.sciencenews.org/article/ufo-science-research-uap-congress-pentagon . live .
  36. Alvesson . Mats . Sandberg . Jörgen . Generating Research Questions Through Problematization . Academy of Management Review . 1 April 2011 . 36 . 2 . 247–271 . 10.5465/amr.2009.0188 . 0363-7425.
  37. Mammola . Stefano . Amorim . Isabel R. . Bichuette . Maria E. . Borges . Paulo A. V. . Cheeptham . Naowarat . Cooper . Steven J. B. . Culver . David C. . Deharveng . Louis . Eme . David . Ferreira . Rodrigo Lopes . Fišer . Cene . Fišer . Žiga . Fong . Daniel W. . Griebler . Christian . Jeffery . William R. . Jugovic . Jure . Kowalko . Johanna E. . Lilley . Thomas M. . Malard . Florian . Manenti . Raoul . Martínez . Alejandro . Meierhofer . Melissa B. . Niemiller . Matthew L. . Northup . Diana E. . Pellegrini . Thais G. . Pipan . Tanja . Protas . Meredith . Reboleira . Ana Sofia P. S. . Venarsky . Michael P. . Wynne . J. Judson . Zagmajster . Maja . Cardoso . Pedro . Fundamental research questions in subterranean biology . Biological Reviews . December 2020 . 95 . 6 . 1855–1872 . 10.1111/brv.12642 . 32841483 . 10138/333518 . 221327219 . en . 1464-7931. free .
  38. Sharma . Angira . Kosasih . Edward . Zhang . Jie . Brintrup . Alexandra . Calinescu . Anisoara . Digital Twins: State of the art theory and practice, challenges, and open research questions . Journal of Industrial Information Integration . 8 August 2022 . 30 . 100383 . 10.1016/j.jii.2022.100383 . 226254582 . en . 2452-414X. free . 2011.02833 .
  39. Tajbakhsh . Alireza . Hassini . Elkafi . Performance measurement of sustainable supply chains: a review and research questions . International Journal of Productivity and Performance Management . 1 January 2015 . 64 . 6 . 744–783 . 10.1108/IJPPM-03-2013-0056 . 1741-0401.
  40. Hamers . Raph L. . Cassini . Alessandro . Asadinia . Koe Stella . Bertagnolio . Silvia . Developing a priority global research agenda for antimicrobial resistance in the human health sector: protocol for a scoping review . BMJ Open . 1 June 2022 . 12 . 6 . e060553 . 10.1136/bmjopen-2021-060553 . 35654465 . 9163534 . en . 2044-6055.
  41. Breyer . Christian . Khalili . Siavash . Bogdanov . Dmitrii . Ram . Manish . Oyewo . Ayobami Solomon . Aghahosseini . Arman . Gulagi . Ashish . Solomon . A. A. . Keiner . Dominik . Lopez . Gabriel . Østergaard . Poul Alberg . Lund . Henrik . Mathiesen . Brian V. . Jacobson . Mark Z. . Victoria . Marta . Teske . Sven . Pregger . Thomas . Fthenakis . Vasilis . Raugei . Marco . Holttinen . Hannele . Bardi . Ugo . Hoekstra . Auke . Sovacool . Benjamin K. . On the History and Future of 100% Renewable Energy Systems Research . IEEE Access . 2022 . 10 . 78176–78218 . 10.1109/ACCESS.2022.3193402 . 2169-3536. free.
  42. Book: Creswell, John W. . John W. Creswell . Research design : qualitative, quantitative, and mixed methods approaches . 2014 . . . 978-1-4522-2609-5 . 4th . 12 December 2018 . 16 November 2023 . https://web.archive.org/web/20231116101007/https://books.google.com/books?id=PViMtOnJ1LcC . live .
  43. Web site: The Predicament of Mankind . sunsite.utk.edu . en . 24 August 2023 . 1970 . unfit . https://web.archive.org/web/20140203125912/http://sunsite.utk.edu/FINS/loversofdemocracy/Predicament.PTI.pdf . 3 February 2014.
  44. Argyris, C. (1968) "Some Unintended Consequences of Rigorous Research". Psychological Bulletin, pp. 185–197.