Biocuration Explained
Biocuration is the field of life sciences dedicated to organizing biomedical data, information and knowledge into structured formats, such as spreadsheets, tables and knowledge graphs.[1] [2] The biocuration of biomedical knowledge is made possible by the cooperative work of biocurators, software developers and bioinformaticians and is at the base of the work of biological databases.
Biocuration as a profession
A biocurator is a professional scientist who curates, collects, annotates, and validates information that is disseminated by biological and model organism databases.[3] [4] It is a new profession, with the first mentions in the scientific literature dating of 2006 in the context of the work in databases like the Immune Epitope Database and Analysis Resource.[5] [6] Biocurators usually are PhD-level with a mix of experiences in wet lab and computational representations of knowledge (e.g. via ontologies).[7]
The role of a biocurator encompasses quality control of primary biological research data intended for publication, extracting and organizing data from original scientific literature, and describing the data with standard annotation protocols and vocabularies that enable powerful queries and biological database interoperability. Biocurators communicate with researchers to ensure the accuracy of curated information and to foster data exchanges with research laboratories.
Biocurators are present in diverse research environments, but may not self-identify as biocurators. Projects such as ELIXIR (the European life-sciences Infrastructure for biological Information) and GOBLET (Global Organization for Bioinformatics Learning, Education and Training)[8] promote training and support biocuration as a career path.[9] [10]
In 2011, biocuration was already recognized as a profession, but there were no formal degree courses to prepare curators for biological data in a targeted fashion.[11] With the growth of the field, the University of Cambridge and the EMBL-EBI started to jointly offer a Postgraduate Certificate in Biocuration,[12] considered as a step towards recognising biocuration as a discipline on its own.[13] There is a perceived increase in demand of biocuration, and a need for additional biocuration training by graduate programs.[14]
Organizations that employ biocurators, like Clinical Genome Resource (ClinGen), often provide specialized materials and training for biocuration.[15]
Biological knowledgebases
See main article: Biological database and Model organism database. The role of biocurators is best known among the field of biological knowledgebases. Such databases, like UniProt[16] and PDB[17] rely on professional biocurators to organize information. Among other things, biocurators work to improve the data quality, for example, by merging duplicated entries.[18]
An important part of those knowledgebases are model organisms databases, which rely on biocurators to curate information regarding organisms of particular kinds. Some notable examples of model organism databases are FlyBase,[19] PomBase,[20] and ZFIN,[21] dedicated to curate information about Drosophila, Schizosaccharomyces pombe and zebrafish respectively.
Curation and annotation
Biocuration is the integration of biological information into on-line databases in a semantically standardized way, using appropriate unique traceable identifiers, and providing necessary metadata including source and provenance.
Ontologies, controlled vocabularies and standard names
See main article: OBO Foundry. Biocurators commonly employ and take part in the creation and development of shared biomedical ontologies: structured, controlled vocabularies that encompass many biological and medical knowledge domains, such as the Open Biomedical Ontologies. These domains include genomics and proteomics, anatomy, animal and plant development, biochemistry, metabolic pathways, taxonomic classification, and mutant phenotypes. Given the variety of existing ontologies, there are guidelines that orient researchers on how to choose a suitable one.[22]
The Unified Medical Language System is one such systems that integrates and distributes millions of terms used in the life sciences domain.[23]
Biocurators enforce the consistent use of gene nomenclature guidelines and participate in the genetic nomenclature committees of various model organisms, often in collaboration with the HUGO Gene Nomenclature Committee (HGNC). They also enforce other nomenclature guidelines like those provided by the Nomenclature Committee of the International Union of Biochemistry and Molecular Biology (IUBMB), one example of which is the Enzyme Commission EC number.
More generally, the use of persistent identifiers is praised by the community, so to improve clarity and facilitate knowledge [24]
DNA annotation
See main article: DNA annotation.
In genome annotation for example, the identifiers defined by the ontologists and consortia are used to describe parts of the genome. For example, the gene ontology (GO) curates terms for biological processes, which are used to describe what we know about specific genes.
Text annotation
As of 2021, life sciences communication is still done primarily via free natural languages, like English or German, which hold a degree of ambiguity and make it hard to connect knowledge. So, besides annotating biological sequences, biocurators also annotate texts, linking words to unique identifiers. This aids in disambiguation, clarifying the meaning intended, and making the texts processable by computers. One application of text annotation is to specify the exact gene a scientist is referring to.[25]
Publicly available text annotations make it possible to biologists to take further advantage of biomedical text. The Europe PMC has an Application Programming Interface which centralizes text annotations from a variety of sources and make them available in a Graphic User Interface called SciLite.[26] The PubTator Central also provides annotations, but is fully based on computerized text-mining and does not provide a user interface.[27] There are also programs that allow users to manually annotate the biomedical texts they are interested, such as the ezTag system.[28]
Variant Curation
A type of biocuration within the field of medical genetics, variant curation is a process for assessment of genetic changes according to the likelihood that they may cause disease.[29] This is an evidence-based process that uses data from a multitude of sources. These sources can include population data, computational data, functional data, segregation data, de novo data, allelic data, among others.[30] It is a collaborative process that can be automated, however manual curation is considered to be the gold standard.[31]
There is no single standardised process of variant curation; different researchers and organisations use different variant curation processes. However, a set of internationally accepted[32] standards and guidelines for the interpretation of genetic variants have been jointly developed by the American College of Medical Genetics and the Association for Molecular Pathology. These are known as the ACMG/AMP guidelines. These guidelines provide a framework for classifying genetic variants as “pathogenic”, “likely pathogenic”, “uncertain significance”, “likely benign” or “benign”, in order from most likely to cause disease to least likely to cause disease. The guidelines also list various levels of evidence ranging from very strong, strong, moderate or supporting.[33] The combination of types of evidence found, and the levels in which those pieces of evidence exist, allows for each variant to be classified along the scale from "pathogenic" to "benign".
International Society for Biocuration (ISB)
See main article: International Society for Biocuration.
The International Society for Biocuration (ISB) is a non-profit organisation "promotes the field of biocuration and provides a forum for information exchange through meetings and workshops." It has grown from the International Biocuration Conferences and founded in early 2009.
The ISB offers the Biocuration Career Award to biocurators in the community: the Biocurator Career Award (given annually) and the ISB Award for Exceptional Contributions to Biocuration (given biannually).
The official journal of the ISB, Database, is a venue specialized in articles about databases and biocuration.[34]
Community curation
Traditionally, biocuration has been done by dedicated experts, which integrate data into databases. Community curation has emerged as a promising approach to improve the dissemination of knowledge from published data and provide a cost-effective way to improve the scalability of biocuration. In some cases, community help is leveraged in jamborees that introduce domain experts to curation tasks, carried during the event,[35] while others rely on asynchronous contributions of experts and non-experts.
Biological databases
Several biological databases include author contributions in their functional curation strategy to some extent, which may range from associating gene identifiers with publications or free-text, to more structured and detailed annotation of sequences and functional data, outputting curation to the same standards as professional biocurators. Most community curation at Model Organism Databases involves annotation by original authors of published research (first-pass annotation) to effectively obtain accurate identifiers for objects to be curated, or identify data-types for detailed curation. For example:
- WormBase successfully solicits first-pass annotation from users and has integrated author curation with the micropublication process.[36] WormBase also integrates text-mining to its platform, providing suggestions to community curators.
- FlyBase sends email requests to authors of new publications,[37] inviting them to list the genes and data types described via an online tool and has also mobilized the community to write gene summary paragraphs.[38]
Other databases, such as PomBase, rely on publication authors to submit highly detailed, ontology-based annotations for their publications, and meta-data associated with genome-wide data-sets using controlled vocabularies. A web-based tool Canto;[39] was developed to facilitate community submissions. Since Canto is freely available, generic and highly configurable, it has been adopted by other projects.[40] Curation is subjected to review by professional curators resulting in high quality in-depth curation of all molecular data-types.[41]
The widely used UniProt knowledgebase has also a community curation mechanism that allows researchers to add information about proteins.[42]
Wiki-style resources
Bio-wikis rely on their communities to provide content and a series of wiki-style resources are available for biocuration.[43] AuthorReward,[44] for example, is an extension to MediaWiki that quantifies researchers' contributions to biology wikis. RiceWiki was an example of a wiki-based database for community curation of rice genes equipped with AuthorReward.[45] [46] CAZypedia is another such wiki for community biocuration of information on carbohydrate-active enzymes (CAZys).[47]
The WikiProteins/WikiProfessional was a project to semantically organize biological data led by Barend Mons.[48] The 2007 project had direct contributions of Jimmy Wales, Wikipedia co-founder, and took Wikidata as an inspiration.[49] A currently active project that runs on an adaptation of mediawiki software is WikiPathways, which crowdsources information about biological pathways.[50]
Wikipedia
There is some overlap between the work of biocurators and Wikipedia, with boundaries between scientific databases and Wikipedia becoming increasingly blurred.[51] [52] [53] Databases like Rfam[54] [55] and the Protein Data Bank[56] for example make heavy use of Wikipedia and its editors to curate information.[57] [58] However, most databases offer highly structured data that is searchable in complex combinations, which is usually not possible on Wikipedia, although Wikidata aims at solving this problem to some extent.
The Gene Wiki project used Wikipedia for collaborative curation of thousands of genes and gene products, such as titin and insulin.[59] Several projects also employ Wikipedia as a platform for curation of medical information.[60]
One other way that Wikipedia is used for biocuration is via its list articles. For example, the Comprehensive Antibiotic Resistance Database integrates its assessment of databases about antibiotic resistance to a particular Wikipedia list.[61]
Wikidata
The Wikimedia knowledge base Wikidata is increasingly being used by the biocuration community as an integrative repository across life sciences.[62] Wikidata is being seen by some as an alternative with better prospects of maintenance and interoperability than smaller independent biological knowledge bases.[63] [64]
Wikidata has been used to curate information on SARS-CoV-2 and the COVID-19 pandemic[65] [66] and by the Gene Wiki project to curate information about genes.[67] Data from biocuration on Wikidata is reused on external resources via SPARQL queries. Some projects use curation via Wikidata as a path to improve life-sciences information on Wikipedia.[68]
Gamified resources
An approach to involve the crowd in biocuration is via gamified platforms that use game design principles to boost engagement. A few examples are:
- Mark2Cure, a gamified platform for community curation of biomedical abstracts[69] [70] [71]
- Cochrane Crowd,[72] a platform by Cochrane for curation of clinical trials and to categorize and summarize biomedical literature.[73]
- CIViC, a portal for annotation of genomic variants related to cancer[74] which tracks scores and keeps leaderboards.[75]
- APICURON, a database to credit and acknowledge the work of biocurators, that collects and aggregates biocuration events from third party resources and generates achievements and leaderboards.[76]
Computational text mining for curation
Natural-language processing and text mining technologies can help biocurators to extract of information for manual curation.[77] Text mining can scale curation efforts, supporting the identification of gene names, for example, as well as for partially inferring ontologies.[78] [79] The conversion of unstructured assertions to structured information makes use of techniques like named entity recognition and parsing of dependencies.[80] Text-mining of biomedical concepts faces challenges regarding variations in reporting, and the community is working to increase the machine-readability of articles.[81]
During the COVID-19 pandemic, biomedical text mining was heavily used to cope with the large amount of published scientific research about the topic (over 50.000 articles).[82]
The popular NLP python package SpaCy has a modification for biomedical texts, SciSpaCy, which is maintained by the Allen Institute for AI.[83]
Among the challenges for text-mining applied to biocuration is the difficulty of accessing full texts of biomedical articles due to pay wall, linking the challenges of biocuration to those of the open-access movement.[84]
A complementary approach to biocuration via text mining involves applying optical character recognition to biomedical figures, coupled to automatic annotation algorithms. This has been used to extract gene information from pathway figures, for example.[85]
Suggestions to improve the written text to facilitate annotations range from using controlled natural languages[86] to providing clear association of concepts (such as genes and proteins) with the particular species of interest.[86]
While challenges remain, text-mining is already an integral part of the workflow of biocuration in several biological knowledgebases.[87]
Biocreative challenges
See main article: BioCreative. The BioCreAtivE (Critical Assessment of Information Extraction systems in Biology) Challenge is a community-wide effort to develop and evaluate text mining and information extraction systems for the life sciences. The challenge was first launched in 2004 and has since become an important event in the biocuration and bioinformatics communities.[88] The main goal of the challenge is to foster the development of advanced computational tools that can effectively extract information from the vast amount of biological data available.The BioCreative Challenge is organized into several subtasks that cover various aspects of text mining and information extraction in the life sciences. These subtasks include gene normalization, relation extraction, entity recognition, and document classification. Participants in the challenge are provided with a set of annotated data to develop and test their systems, and their performance is evaluated based on various metrics, such as precision, recall, and F-score.
The BioCreative Challenge has led to the development of many innovative text mining and information extraction systems that have greatly improved the efficiency and accuracy of biocuration efforts. These systems have been integrated into many biocuration pipelines and have helped to speed up the curation process and enhance the quality of curated data.
See also
External links
Notes and References
- Web site: What is biocuration? International Society for Biocuration. 2020-09-06. www.biocuration.org.
- Howe D, Costanzo M, Fey P, Gojobori T, Hannick L, Hide W, Hill DP, Kania R, Schaeffer M, St Pierre S, Twigger S, White O, Rhee SY . 6 . Big data: The future of biocuration . Nature . 455 . 7209 . 47–50 . September 2008 . 18769432 . 2819144 . 10.1038/455047a . 2008Natur.455...47H .
- Burge S, Attwood TK, Bateman A, Berardini TZ, Cherry M, O'Donovan C, Xenarios L, Gaudet P . 6 . Biocurators and biocuration: surveying the 21st century challenges . Database . 2012 . bar059 . 2012-03-20 . 22434828 . 3308150 . 10.1093/database/bar059 .
- Bateman A . Curators of the world unite: the International Society of Biocuration . Bioinformatics . 26 . 8 . 991 . April 2010 . 20305270 . 10.1093/bioinformatics/btq101 . free .
- Bourne PE, McEntyre J . Biocurators: contributors to the world of science . PLOS Computational Biology . 2 . 10 . e142 . October 2006 . 17411327 . 1626157 . 10.1371/journal.pcbi.0020142 . 2006PLSCB...2..142B . free .
- Salimi N, Vita R . The biocurator: connecting and enhancing scientific data . PLOS Computational Biology . 2 . 10 . e125 . October 2006 . 17069454 . 1626147 . 10.1371/journal.pcbi.0020125 . 2006PLSCB...2..125S . free .
- Biocuration. International Society for. 2018-04-16. Biocuration: Distilling data into knowledge.. PLOS Biology. English. 16. 4. e2002846. 10.1371/JOURNAL.PBIO.2002846. 29659566. 5919672 . free .
- Web site: GOBLET The Global Organisation for Bioinformatics Learning, Education & Training. 2020-12-19. en-US.
- free.
- Web site: EMBL-EBI . Biocuration EMBL-EBI Training . 2022-05-06 . www.ebi.ac.uk . en.
- Sanderson. Katharine. February 2011. Bioinformatics: Curation generation. Nature. en. 470. 7333. 295–296. 10.1038/nj7333-295a. 21348148. 1476-4687. free.
- Web site: Anonymous. 2019-10-30. Postgraduate Certificate in Biocuration. 2020-10-06. www.ice.cam.ac.uk. en.
- Tang YA, Pichler K, Füllgrabe A, Lomax J, Malone J, Munoz-Torres MC, Vasant DV, Williams E, Haendel M . 6 . Ten quick tips for biocuration . PLOS Computational Biology . 15 . 5 . e1006906 . May 2019 . 31048830 . 6497217 . 10.1371/journal.pcbi.1006906 . 2019PLSCB..15E6906T . free .
- Harper. Lisa. Campbell. Jacqueline D.. Cannon. Ethalinda K. S.. Jung. Sook. Poelchau. Monica F.. Walls. Ramona L.. Andorf. Carson M.. Arnaud. Elizabeth. Berardini. Tanya Z.. Birkett. Clayton. Cannon. Steve. 2018-01-01. AgBioData consortium recommendations for sustainable genomics and genetics databases for agriculture. Database. English. 2018. 1–32. 10.1093/DATABASE/BAY088. 30239679. 6146126.
- Web site: Biocurator - ClinGen Clinical Genome Resource. 2021-05-26. www.clinicalgenome.org.
- 2016-11-29. UniProt: the universal protein knowledgebase. Nucleic Acids Research. 45. D1. D158–D169. 10.1093/nar/gkw1099. 27899622. 5210571. 0305-1048.
- Berman. Helen M.. Westbrook. J.. Feng. Z.. Gilliland. G.. Bhat. T. N.. Weissig. H.. Shindyalov. Ilya. Bourne. Philip. 2000-01-01. The Protein Data Bank. Nucleic Acids Research. English. 28. 1. 235–242. 10.1093/NAR/28.1.235. 10592235. 102472.
- Chen. Qingyu. Britto. Ramona. Erill. Ivan. Jeffery. Constance J.. Constance Jeffery. Liberzon. Arthur. Magrane. Michele. Onami. Jun-Ichi. Robinson-Rechavi. Marc. Sponarova. Jana. Zobel. Justin. Verspoor. Karin. 2020-07-08. Quality Matters: Biocuration Experts on the Impact of Duplication and Other Data Quality Issues in Biological Databases. Genomics Proteomics and Bioinformatics. English. 18. 2. 91–103. 10.1016/J.GPB.2018.11.006. 7646089 . 32652120.
- 1998-01-01. FlyBase: a Drosophila database. Flybase Consortium. Nucleic Acids Research. 26. 1. 85–88. 10.1093/nar/26.1.85. 9399806. 147222. 1362-4962. Flybase . Consortium .
- Lock. Antonia. Rutherford. Kim. Harris. Midori A. Hayles. Jacqueline. Oliver. Stephen G. Bähler. Jürg. Wood. Valerie. 2018-10-13. PomBase 2018: user-driven reimplementation of the fission yeast database provides rapid and intuitive access to diverse, interconnected information. Nucleic Acids Research. 47. D1. D821–D827. 10.1093/nar/gky961 . 6324063 . 30321395. 0305-1048.
- Ruzicka. Leyla. Howe. Douglas G.. Ramachandran. Sridhar. Toro. Sabrina. Slyke. Ceri E. Van. Bradford. Yvonne M.. Eagle. Anne. Fashena. David. Frazer. Ken. Kalita. Patrick. Mani. Prita. 2019-01-01. The Zebrafish Information Network: new support for non-coding genes, richer Gene Ontology annotations and the Alliance of Genome Resources. Nucleic Acids Research. English. 47. D1. D867–D873. 10.1093/NAR/GKY1090. 30407545. 6323962.
- Malone J, Stevens R, Jupp S, Hancocks T, Parkinson H, Brooksbank C . Ten Simple Rules for Selecting a Bio-ontology . PLOS Computational Biology . 12 . 2 . e1004743 . February 2016 . 26867217 . 4750991 . 10.1371/journal.pcbi.1004743 . 2016PLSCB..12E4743M . free .
- Bodenreider O . The Unified Medical Language System (UMLS): integrating biomedical terminology . Nucleic Acids Research . 32 . Database issue . D267-70 . January 2004 . 14681409 . 308795 . 10.1093/nar/gkh061 .
- McMurry JA, Juty N, Blomberg N, Burdett T, Conlin T, Conte N, Courtot M, Deck J, Dumontier M, Fellows DK, Gonzalez-Beltran A, Gormanns P, Grethe J, Hastings J, Hériché JK, Hermjakob H, Ison JC, Jimenez RC, Jupp S, Kunze J, Laibe C, Le Novère N, Malone J, Martin MJ, McEntyre JR, Morris C, Muilu J, Müller W, Rocca-Serra P, Sansone SA, Sariyar M, Snoep JL, Soiland-Reyes S, Stanford NJ, Swainston N, Washington N, Williams AR, Wimalaratne SM, Winfree LM, Wolstencroft K, Goble C, Mungall CJ, Haendel MA, Parkinson H . 6 . Identifiers for the 21st century: How to design, provision, and reuse persistent identifiers to maximize utility and impact of life science data . PLOS Biology . 15 . 6 . e2001414 . June 2017 . 28662064 . 5490878 . 10.1371/journal.pbio.2001414 . free .
- Mons B . Which gene did you mean? . BMC Bioinformatics . 6 . 1 . 142 . June 2005 . 15941477 . 1173089 . 10.1186/1471-2105-6-142 . free .
- Venkatesan A, Kim JH, Talo F, Ide-Smith M, Gobeill J, Carter J, Batista-Navarro R, Ananiadou S, Ruch P, McEntyre J . 6 . SciLite: a platform for displaying text-mined annotations as a means to link research articles with biological data . Wellcome Open Research . 1 . 25 . 2016-12-12 . 28948232 . 10.12688/wellcomeopenres.10210.1 . 5527546 . free .
- Wei CH, Allot A, Leaman R, Lu Z . PubTator central: automated concept annotation for biomedical full text articles . Nucleic Acids Research . 47 . W1 . W587–W593 . July 2019 . 31114887 . 10.1093/nar/gkz389 . 6602571 .
- Kwon D, Kim S, Wei CH, Leaman R, Lu Z . ezTag: tagging biomedical concepts via interactive learning . Nucleic Acids Research . 46 . W1 . W523–W529 . July 2018 . 29788413 . 6030907 . 10.1093/nar/gky428 .
- Manotas . María Carolina . Rivera . Ana Lucia . Sanabria-Salas . María Carolina . 2023-03-10 . Variant curation and interpretation in hereditary cancer genes: An institutional experience in Latin America . Molecular Genetics & Genomic Medicine . 11 . 5 . e2141 . 10.1002/mgg3.2141 . 2324-9269 . 36905130. 10178801 .
- Richards . Sue . Aziz . Nazneen . Bale . Sherri . Bick . David . Das . Soma . Gastier-Foster . Julie . Grody . Wayne W. . Hegde . Madhuri . Lyon . Elaine . Spector . Elaine . Voelkerding . Karl . Rehm . Heidi L. . ACMG Laboratory Quality Assurance Committee . May 2015 . Standards and guidelines for the interpretation of sequence variants: a joint consensus recommendation of the American College of Medical Genetics and Genomics and the Association for Molecular Pathology . Genetics in Medicine. 17 . 5 . 405–424 . 10.1038/gim.2015.30 . 1530-0366 . 4544753 . 25741868.
- Pandey . Kapil Raj . Maden . Narendra . Poudel . Barsha . Pradhananga . Sailendra . Sharma . Amit Kumar . December 2012 . The Curation of Genetic Variants: Difficulties and Possible Solutions . Genomics, Proteomics & Bioinformatics . 10 . 6 . 317–325 . 10.1016/j.gpb.2012.06.006 . 1672-0229 . 5054708 . 23317699.
- Web site: Genetic testing for rare diseases company 3billion . 2024-05-18 . 3billion.io . en.
- Web site: ACGS Best Practice Guidelines for Variant Classification in Rare Disease 2024 . 2024-05-18 . The Association for Clinical Genomic Science . en.
- Landsman. D.. Gentleman. R.. Kelso. J.. Francis Ouellette. B. F.. 2010-01-05. DATABASE: A new forum for biological databases and curation. Database. 2009. bap002. 10.1093/database/bap002. 20157475. 2790300. 1758-0463.
- Naithani. Sushma. Gupta. Parul. Preece. Justin. Garg. Priyanka. Fraser. Valerie. Padgitt-Cobb. Lillian K. Martin. Matthew. Vining. Kelly. Jaiswal. Pankaj. 2019-01-01. Involving community in genes and pathway curation. Database. 2019. 10.1093/database/bay146 . 6334007 . 30649295. 1758-0463.
- Lee RY, Howe KL, Harris TW, Arnaboldi V, Cain S, Chan J, Chen WJ, Davis P, Gao S, Grove C, Kishore R, Muller HM, Nakamura C, Nuin P, Paulini M, Raciti D, Rodgers F, Russell M, Schindelman G, Tuli MA, Van Auken K, Wang Q, Williams G, Wright A, Yook K, Berriman M, Kersey P, Schedl T, Stein L, Sternberg PW . 6 . WormBase 2017: molting into a new stage . Nucleic Acids Research . 46 . D1 . D869–D874 . January 2018 . 29069413 . 5753391 . 10.1093/nar/gkx998 .
- Bunt SM, Grumbling GB, Field HI, Marygold SJ, Brown NH, Millburn GH . Directly e-mailing authors of newly published papers encourages community curation . Database . 2012 . bas024 . 2012 . 22554788 . 3342516 . 10.1093/database/bas024 .
- Antonazzo G, Urbano JM, Marygold SJ, Millburn GH, Brown NH . Building a pipeline to solicit expert knowledge from the community to aid gene summary curation . Database . 2020 . January 2020 . 31960022 . 6971343 . 10.1093/database/baz152 .
- Rutherford KM, Harris MA, Lock A, Oliver SG, Wood V . Canto: an online tool for community literature curation . Bioinformatics . 30 . 12 . 1791–2 . June 2014 . 24574118 . 4058955 . 10.1093/bioinformatics/btu103 .
- Web site: pombase/canto . PomBase . 25 September 2020.
- Lock A, Harris MA, Rutherford K, Hayles J, Wood V . Community curation in PomBase: enabling fission yeast experts to provide detailed, standardized, sharable annotation from research publications . Database . 2020 . January 2020 . 32353878 . 7192550 . 10.1093/database/baaa028 .
- 2016-11-29. UniProt: the universal protein knowledgebase. Nucleic Acids Research. 45. D1. D158–D169. 10.1093/nar/gkw1099. 27899622. 5210571. 0305-1048. free.
- Khare. Ritu. Good. Benjamin M.. Leaman. Robert. Su. Andrew I.. Lu. Zhiyong. 2016-01-01. Crowdsourcing in biomedicine: challenges and opportunities. Briefings in Bioinformatics. English. 17. 1. 23–32. 10.1093/BIB/BBV021. 25888696. 4719068.
- Dai L, Tian M, Wu J, Xiao J, Wang X, Townsend JP, Zhang Z . AuthorReward: increasing community curation in biological knowledge wikis through automated authorship quantification . Bioinformatics . 29 . 14 . 1837–9 . July 2013 . 23732274 . 3702255 . 10.1093/bioinformatics/btt284 .
- Zhang Z, Sang J, Ma L, Wu G, Wu H, Huang D, Zou D, Liu S, Li A, Hao L, Tian M, Xu C, Wang X, Wu J, Xiao J, Dai L, Chen LL, Hu S, Yu J . 6 . RiceWiki: a wiki-based database for community curation of rice genes . Nucleic Acids Research . 42 . Database issue . D1222-8 . January 2014 . 24136999 . 3964990 . 10.1093/nar/gkt926 .
- Web site: 2017-10-20. Os01g0883800 - RiceWiki. 2020-09-06. https://web.archive.org/web/20171020084027/http://ricewiki.big.ac.cn/index.php/Os01g0883800. 2017-10-20.
- Consortium. CAZypedia. 2017-10-11. Ten years of CAZypedia: a living encyclopedia of carbohydrate-active enzymes.. Glycobiology. 28. 1. 3–8. 10.1093/GLYCOB/CWX089. 29040563. free. 21.11116/0000-0003-B7EB-6. free.
- Giles J . Key biology databases go wiki . Nature . 445 . 7129 . 691 . February 2007 . 17301755 . 10.1038/445691a . 2007Natur.445..691G . 4410783 . free .
- Mons B, Ashburner M, Chichester C, van Mulligen E, Weeber M, den Dunnen J, van Ommen GJ, Musen M, Cockerill M, Hermjakob H, Mons A, Packer A, Pacheco R, Lewis S, Berkeley A, Melton W, Barris N, Wales J, Meijssen G, Moeller E, Roes PJ, Borner K, Bairoch A . 6 . Calling on a million minds for community annotation in WikiProteins . Genome Biology . 9 . 5 . R89 . 2008-05-28 . 18507872 . 2441475 . 10.1186/gb-2008-9-5-r89 . free .
- Web site: WikiPathways - WikiPathways. 2020-10-14. www.wikipathways.org.
- Wodak SJ, Mietchen D, Collings AM, Russell RB, Bourne PE . Topic pages: PLOS Computational Biology meets Wikipedia . PLOS Computational Biology . 8 . 3 . e1002446 . 2012 . 22479174 . 3315447 . 10.1371/journal.pcbi.1002446 . 2012PLSCB...8E2446W . free .
- Finn RD, Gardner PP, Bateman A . Making your database available through Wikipedia: the pros and cons . Nucleic Acids Research . 40 . Database issue . D9-12 . January 2012 . 22144683 . 3245093 . 10.1093/nar/gkr1195 .
- Page RD . Linking NCBI to Wikipedia: a wiki-based approach . PLOS Currents . 3 . RRN1228 . March 2011 . 21516242 . 3080707 . 10.1371/currents.RRN1228 . free .
- Gardner PP, Daub J, Tate J, Moore BL, Osuch IH, Griffiths-Jones S, Finn RD, Nawrocki EP, Kolbe DL, Eddy SR, Bateman A . 6 . Rfam: Wikipedia, clans and the "decimal" release . Nucleic Acids Research . 39 . Database issue . D141-5 . January 2011 . 21062808 . 3013711 . 10.1093/nar/gkq1129 . Sean Eddy . Alex Bateman .
- Daub J, Gardner PP, Tate J, Ramsköld D, Manske M, Scott WG, Weinberg Z, Griffiths-Jones S, Bateman A . 6 . The RNA WikiProject: community annotation of RNA families . RNA . 14 . 12 . 2462–4 . December 2008 . 18945806 . 2590952 . 10.1261/rna.1200508 . Magnus Manske .
- Burkhardt K, Schneider B, Ory J . A biocurator perspective: annotation at the Research Collaboratory for Structural Bioinformatics Protein Data Bank . PLOS Computational Biology . 2 . 10 . e99 . October 2006 . 17069453 . 1626146 . 10.1371/journal.pcbi.0020099 . 2006PLSCB...2...99B . free .
- Logan DW, Sandal M, Gardner PP, Manske M, Bateman A . Ten simple rules for editing Wikipedia . PLOS Computational Biology . 6 . 9 . e1000941 . September 2010 . 20941386 . 2947980 . 10.1371/journal.pcbi.1000941 . 2010PLSCB...6E0941L . Magnus Manske . Alex Bateman . free .
- Butler D . 2008. Publish in Wikipedia or perish: Journal to require authors to post in the free online encyclopaedia. Nature. 10.1038/news.2008.1312.
- Huss JW, Lindenbaum P, Martone M, Roberts D, Pizarro A, Valafar F, Hogenesch JB, Su AI . 6 . The Gene Wiki: community intelligence applied to human gene annotation . Nucleic Acids Research . 38 . Database issue . D633-9 . January 2010 . 19755503 . 2808918 . 10.1093/nar/gkp760 .
- free.
- Alcock. Brian P.. Raphenya. Amogelang R.. Lau. Tammy T. Y.. Tsang. Kara K.. Bouchard. Mégane. Edalatmand. Arman. Huynh. William. Nguyen. Anna-Lisa V.. Cheng. Annie A.. Liu. Sihan. Min. Sally Y.. 2020-01-01. CARD 2020: antibiotic resistome surveillance with the comprehensive antibiotic resistance database. Nucleic Acids Research. English. 48. D1. D517–D525. 10.1093/NAR/GKZ935. 31665441. 7145624.
- Waagmeester A, Stupp G, Burgstaller-Muehlbacher S, Good BM, Griffith M, Griffith OL, Hanspers K, Hermjakob H, Hudson TS, Hybiske K, Keating SM, Manske M, Mayers M, Mietchen D, Mitraka E, Pico AR, Putman T, Riutta A, Queralt-Rosinach N, Schriml LM, Shafee T, Slenter D, Stephan R, Thornton K, Tsueng G, Tu R, Ul-Hasan S, Willighagen E, Wu C, Su AI . 6 . Wikidata as a knowledge graph for the life sciences . eLife . 9 . e52614 . March 2020 . 32180547 . 10.7554/eLife.52614 . 7077981 . Rodgers P, Mungall C . 212739087 . free .
- Rutz . Adriano . Sorokina . Maria . Galgonek . Jakub . Mietchen . Daniel . Willighagen . Egon . Gaudry . Arnaud . Graham . James G . Stephan . Ralf . Page . Roderic . Vondrášek . Jiří . Steinbeck . Christoph . Pauli . Guido F . Wolfender . Jean-Luc . Bisson . Jonathan . Allard . Pierre-Marie . The LOTUS initiative for open knowledge management in natural products research . eLife . 26 May 2022 . 11 . e70780 . 10.7554/eLife.70780. 35616633 . 9135406 . 249064853 . free .
- Rutz . Adriano . Sorokina . Maria . Galgonek . Jakub . Mietchen . Daniel . Willighagen . Egon . Gaudry . Arnaud . Graham . James G. . Stephan . Ralf . Page . Roderic . Vondrášek . Jiří . Steinbeck . Christoph . Pauli . Guido F. . Wolfender . Jean-Luc . Bisson . Jonathan . Allard . Pierre-Marie . The LOTUS Initiative for Open Natural Products Research: Knowledge Management through Wikidata . 24 December 2021 . 2021.02.28.433265 . 10.1101/2021.02.28.433265.
- Web site: Turki. Houcemeddine. Taieb. Mohamed Ali Hadj. Shafee. Thomas. Lubiana. Tiago. Jemielniak. Dariusz. Aouicha. Mohamed Ben. Gayo. José Emilio Labra. Youngstrom. Eric. Banat. Mossab. Das. Diptanshu. Mietchen. Daniel. 2021-02-18. Haller. Armin. Representing COVID-19 information in collaborative knowledge graphs: the case of Wikidata.
- Waagmeester. Andra. Willighagen. Egon L.. Su. Andrew I.. Kutmon. Martina. Gayo. Jose Emilio Labra. Fernández-Álvarez. Daniel. Groom. Quentin. Schaap. Peter J.. Verhagen. Lisa M.. Koehorst. Jasper J.. 2021-01-22. A protocol for adding knowledge to Wikidata: aligning resources on human coronaviruses. BMC Biology. 19. 1. 12. 10.1186/s12915-020-00940-y. 33482803. 7820539. 1741-7007 . free .
- Burgstaller-Muehlbacher S, Waagmeester A, Mitraka E, Turner J, Putman T, Leong J, Naik C, Pavlidis P, Schriml L, Good BM, Su AI . 6 . Wikidata as a semantic framework for the Gene Wiki initiative . Database . 2016 . baw015 . 2016 . 26989148 . 4795929 . 10.1093/database/baw015 .
- free.
- Tsueng G, Nanis SM, Fouquier J, Good BM, Su AI . Citizen Science for Mining the Biomedical Literature . Citizen Science . 1 . 2 . 14 . 2016-12-31 . 30416754 . 6226017 . 10.5334/cstp.56 . free .
- Tsueng G, Nanis M, Fouquier JT, Mayers M, Good BM, Su AI . Applying citizen science to gene, drug and disease relationship extraction from biomedical abstracts . Bioinformatics . 36 . 4 . 1226–1233 . February 2020 . 31504205 . 10.1093/bioinformatics/btz678 . 8104067 .
- Web site: Play Mark2Cure, help identify key terms in biomedical research abstracts. 2020-09-06. Citizen Science Games. en-US.
- Web site: Cochrane Crowd. 2020-09-25. crowd.cochrane.org.
- Gartlehner G, Affengruber L, Titscher V, Noel-Storr A, Dooley G, Ballarini N, König F . Single-reviewer abstract screening missed 13 percent of relevant studies: a crowd-based, randomized controlled trial . Journal of Clinical Epidemiology . 121 . 20–28 . May 2020 . 31972274 . 10.1016/j.jclinepi.2020.01.005 . free .
- Griffith. Malachi. Spies. Nicholas C. Krysiak. Kilannin. McMichael. Joshua F. Coffman. Adam C. Danos. Arpad M. Ainscough. Benjamin J. Ramirez. Cody A. Rieke. Damian T. Kujan. Lynzey. Barnell. Erica K. 2017-01-31. CIViC is a community knowledgebase for expert crowdsourcing the clinical interpretation of variants in cancer. Nature Genetics. 49. 2. 170–174. 10.1038/ng.3774. 28138153. 5367263. 10230/46299. 1061-4036.
- Web site: CIViC - Clinical Interpretation of Variants in Cancer. 2021-04-14. civicdb.org.
- Hatos. András. Quaglia. Federica. Piovesan. Damiano. Tosatto. Silvio C. E.. 2021-04-21. APICURON: a database to credit and acknowledge the work of biocurators. Database: The Journal of Biological Databases and Curation. 2021. baab019. 10.1093/database/baab019. 1758-0463. 8060004. 33882120.
- Hirschman L, Burns GA, Krallinger M, Arighi C, Cohen KB, Valencia A, Wu CH, Chatr-Aryamontri A, Dowell KG, Huala E, Lourenço A, Nash R, Veuthey AL, Wiegers T, Winter AG . 6 . Text mining for the biocuration workflow . Database . 2012 . bas020 . 2012 . 22513129 . 3328793 . 10.1093/database/bas020 .
- Ananiadou. Sophia. Kell. Douglas B.. Tsujii. Jun-ichi. December 2006. Text mining and its potential applications in systems biology. Trends in Biotechnology. 24. 12. 571–579. 10.1016/j.tibtech.2006.10.002. 17045684. 0167-7799.
- Winnenburg. R.. Wachter. T.. Plake. C.. Doms. A.. Schroeder. M.. 2008-07-11. Facts from text: can text mining help to scale-up high-quality manual curation of gene products with ontologies?. Briefings in Bioinformatics. en. 9. 6. 466–478. 10.1093/bib/bbn043. 19060303. 1467-5463. free.
- Percha. Bethany. Altman. Russ. 2018-02-27. A global network of biomedical relationships derived from text.. Bioinformatics. English. 34. 15. 2614–2624. 10.1093/BIOINFORMATICS/BTY114. 29490008. 6061699. free.
- free.
- Wang. Lucy Lu. Lo. Kyle. 2020-12-07. Text mining approaches for dealing with the rapidly expanding literature on COVID-19. Briefings in Bioinformatics. 22. 2. 781–799. 10.1093/BIB/BBAA296. 33279995. 7799291 . free.
- Neumann M, King D, Beltagy I, Ammar W . 2019. ScispaCy: Fast and Robust Models for Biomedical Natural Language Processing. Proceedings of the 18th BioNLP Workshop and Shared Task. en. Florence, Italy. Association for Computational Linguistics. 319–327. 10.18653/v1/W19-5034. 1902.07669. 67788603.
- Altman RB, Bergman CM, Blake J, Blaschke C, Cohen A, Gannon F, Grivell L, Hahn U, Hersh W, Hirschman L, Jensen LJ, Krallinger M, Mons B, O'Donoghue SI, Peitsch MC, Rebholz-Schuhmann D, Shatkay H, Valencia A . 6 . Text mining for biology--the way forward: opinions from leading scientists . Genome Biology . 9 . Suppl 2 . S7 . 2008 . 18834498 . 2559991 . 10.1186/gb-2008-9-s2-s7 . free .
- Hanspers. Kristina. Riutta. Anders. Summer-Kutmon. Martina. Pico. Alexander R.. 2020-11-09. Pathway information extracted from 25 years of pathway figures. Genome Biology. 21. 1. 273. 10.1186/S13059-020-02181-2. 33168034. 7649569 . free .
- Book: Kuhn. Tobias. Royer. Loïc. Fuchs. Norbert E.. Schröder. Michael. Data Integration in the Life Sciences . Improving Text Mining with Controlled Natural Language: A Case Study for Protein Interactions . Lecture Notes in Computer Science . 2006-01-01. https://www.wikidata.org/wiki/Q57402195. 4075. English. 66–81. 10.1007/11799511_7. 978-3-540-36593-8.
- Singhal. Ayush. Leaman. Robert. Catlett. Natalie. Lemberger. Thomas. McEntyre. Johanna. Polson. Shawn. Xenarios. Ioannis. Arighi. Cecilia. Lu. Zhiyong. 2016. Pressing needs of biomedical text mining in biocuration and beyond: opportunities and challenges. Database. 2016. baw161. 10.1093/database/baw161. 28025348. 5199160. 1758-0463.
- Hirschman L, Yeh A, Blaschke C, Valencia A . Overview of BioCreAtIvE: critical assessment of information extraction for biology . BMC Bioinformatics . 6 . Suppl 1 . S1 . 2005 . 15960821 . 10.1186/1471-2105-6-s1-s1 . 1869002 . 5119495 . free .