Semantic similarity explained

Semantic similarity is a metric defined over a set of documents or terms, where the idea of distance between items is based on the likeness of their meaning or semantic content as opposed to lexicographical similarity. These are mathematical tools used to estimate the strength of the semantic relationship between units of language, concepts or instances, through a numerical description obtained according to the comparison of information supporting their meaning or describing their nature.[1] [2] The term semantic similarity is often confused with semantic relatedness. Semantic relatedness includes any relation between two terms, while semantic similarity only includes "is a" relations.[3] For example, "car" is similar to "bus", but is also related to "road" and "driving".

Computationally, semantic similarity can be estimated by defining a topological similarity, by using ontologies to define the distance between terms/concepts. For example, a naive metric for the comparison of concepts ordered in a partially ordered set and represented as nodes of a directed acyclic graph (e.g., a taxonomy), would be the shortest-path linking the two concept nodes. Based on text analyses, semantic relatedness between units of language (e.g., words, sentences) can also be estimated using statistical means such as a vector space model to correlate words and textual contexts from a suitable text corpus. The evaluation of the proposed semantic similarity / relatedness measures are evaluated through two main ways. The former is based on the use of datasets designed by experts and composed of word pairs with semantic similarity / relatedness degree estimation. The second way is based on the integration of the measures inside specific applications such as information retrieval, recommender systems, natural language processing, etc.

Terminology

The concept of semantic similarity is more specific than semantic relatedness, as the latter includes concepts as antonymy and meronymy, while similarity does not.[4] However, much of the literature uses these terms interchangeably, along with terms like semantic distance. In essence, semantic similarity, semantic distance, and semantic relatedness all mean, "How much does term A have to do with term B?" The answer to this question is usually a number between −1 and 1, or between 0 and 1, where 1 signifies extremely high similarity.

Visualization

An intuitive way of visualizing the semantic similarity of terms is by grouping together terms which are closely related and spacing wider apart the ones which are distantly related. This is also common in practice for mind maps and concept maps.

A more direct way of visualizing the semantic similarity of two linguistic items can be seen with the Semantic Folding approach. In this approach a linguistic item such as a term or a text can be represented by generating a pixel for each of its active semantic features in e.g. a 128 x 128 grid. This allows for a direct visual comparison of the semantics of two items by comparing image representations of their respective feature sets.

Applications

In biomedical informatics

Semantic similarity measures have been applied and developed in biomedical ontologies.[5] [6] They are mainly used to compare genes and proteins based on the similarity of their functions[7] rather than on their sequence similarity,but they are also being extended to other bioentities, such as diseases.[8]

These comparisons can be done using tools freely available on the web:

In geoinformatics

Similarity is also applied in geoinformatics to find similar geographic features or feature types:[12]

In computational linguistics

Several metrics use WordNet, a manually constructed lexical database of English words. Despite the advantages of having human supervision in constructing the database, since the words are not automatically learned the database cannot measure relatedness between multi-word term, non-incremental vocabulary.[18]

In natural language processing

Natural language processing (NLP) is a field of computer science and linguistics. Sentiment analysis, Natural language understanding and Machine translation (Automatically translate text from one human language to another) are a few of the major areas where it is being used. For example, knowing one information resource in the internet, it is often of immediate interest to find similar resources. The Semantic Web provides semantic extensions to find similar data by content and not just by arbitrary descriptors.[19] [20] [21] [22] [23] [24] [25] [26] [27] Deep learning methods have become an accurate way to gauge semantic similarity between two text passages, in which each passage is first embedded into a continuous vector representation.[28] [29]

In ontology matching

Semantic similarity plays a crucial role in ontology alignment, which aims to establish correspondences between entities from different ontologies. It involves quantifying the degree of similarity between concepts or terms using the information present in the ontology for each entity, such as labels, descriptions, and hierarchical relations to other entities. Traditional metrics used in ontology matching are based on a lexical similarity between features of the entities, such as using the Levenshtein distance to measure the edit distance between entity labels.[30] However, it is difficult to capture the semantic similarity between entities using these metrics. For example, when comparing two ontologies describing conferences, the entities "Contribution" and "Paper" may have high semantic similarity since they share the same meaning. Nonetheless, due to their lexical differences, lexicographical similarity alone cannot establish this alignment. To capture these semantic similarities, embeddings are being adopted in ontology matching.[31] By encoding semantic relationships and contextual information, embeddings enable the calculation of similarity scores between entities based on the proximity of their vector representations in the embedding space. This approach allows for efficient and accurate matching of ontologies since embeddings can model semantic differences in entity naming, such as homonymy, by assigning different embeddings to the same word based on different contexts.

Measures

Topological similarity

There are essentially two types of approaches that calculate topological similarity between ontological concepts:

Other measures calculate the similarity between ontological instances:

Some examples:

Edge-based

Node-based

Node-and-relation-content-based

Pairwise

Groupwise

Statistical similarity

Statistical similarity approaches can be learned from data, or predefined. Similarity learning can often outperform predefined similarity measures. Broadly speaking, these approaches build a statistical model of documents, and use it to estimate similarity.

Semantics-based similarity

Semantics similarity networks

Gold standards

Researchers have collected datasets with similarity judgements on pairs of words, which are used to evaluate the cognitive plausibility of computational measures. The golden standard up to today is an old 65 word list where humans have judged the word similarity.[56] [57]

See also

Sources

External links

Survey articles

Notes and References

  1. Synthesis Lectures on Human Language Technologies . Harispe S. . Ranwez S.. Janaqi S.. Montmain J. . 2015 . Semantic Similarity from Natural Language and Ontology Analysis. 1–254 . 8 . 1 . 10.2200/S00639ED1V01Y201504HLT027. 1704.05295 . 17428739 .
  2. Knowledge Engineering Review . 32 . Feng Y. . Bagheri E. . Ensan F. . Jovanovic J. . 2017 . The state of the art in semantic relatedness: a framework for comparison. 1–30 . 10.1017/S0269888917000029. 52172371 .
  3. GeoInformatica . A. Ballatore . M. Bertolotto . D.C. Wilson . 2014 . An evaluative baseline for geo-semantic relatedness and similarity. 747–767 . 18. 4 . 1402.3371 . 10.1007/s10707-013-0197-8 . 2014arXiv1402.3371B . 17474023 .
  4. Budanitsky. Alexander. Hirst. Graeme. Pittsburgh. 2001. Semantic distance in WordNet: An experimental, application-oriented evaluation of five measures. Workshop on WordNet and Other Lexical Resources, Second Meeting of the North American Chapter of the Association for Computational Linguistics.
  5. Guzzi. Pietro Hiram. Marco . Mina . Mario. Cannataro. Concettina . Guerra. Semantic similarity analysis of protein data: assessment with biological features and issues. Briefings in Bioinformatics. 2012. 13. 569–585. 5. 10.1093/bib/bbr066. 22138322. free.
  6. Benabderrahmane. Sidahmed. Smail Tabbone. Malika. Poch. Olivier . Napoli. Amedeo. Devignes. Marie-Domonique. . IntelliGO: a new vector-based semantic similarity measure including annotation origin . BMC Bioinformatics. 11 . 588 . 2010 . 21122125 . 10.1186/1471-2105-11-588 . 3098105 . free .
  7. Chicco . D . Masseroli . M . 2015 . Software suite for gene and protein annotation prediction and similarity search . IEEE/ACM Transactions on Computational Biology and Bioinformatics . 12 . 4 . 837–843 . 10.1109/TCBB.2014.2382127 . 26357324 . 11311/959408 . 14714823 . free .
  8. Köhler . S . Schulz . MH . Krawitz . P . Bauer . S . Dolken . S . Ott . CE . Mundlos . C . Horn . D . Mundlos . S . Robinson . Peter N. . Clinical diagnostics in human genetics with semantic similarity searches in ontologies . American Journal of Human Genetics . 85 . 4 . 457–64 . 2009 . 19800049 . 2756558 . 10.1016/j.ajhg.2009.09.003. 8 .
  9. Web site: ProteInOn.
  10. Web site: CMPSim.
  11. Web site: CESSM.
  12. Janowicz, K.. Raubal, M.. Kuhn, W.. The semantics of similarity in geographic information retrieval. Journal of Spatial Information Science. 2. 2. 2011. 29–57. 10.5311/josis.2011.2.3. free.
  13. 10.1.1.172.5544 . Algorithm, implementation and application of the SIM-DL similarity server . 128–145 . 2007 . Lecture Notes in Computer Science . 4853 . Second International Conference on Geospatial Semantics (GEOS 2007).
  14. Web site: Geo-Net-PT Similarity Calculator.
  15. Web site: Geo-Net-PT.
  16. https://wiki.openstreetmap.org/wiki/OSM_Semantic_Network "OSM Semantic Network"
  17. Geographic Knowledge Extraction and Semantic Similarity in OpenStreetMap. A. Ballatore . D.C. Wilson . M. Bertolotto . Knowledge and Information Systems. 61–81.
  18. Book: Kaur, I. . Hornof, A.J. . Proceedings of the SIGCHI Conference on Human Factors in Computing Systems . A comparison of LSA, wordNet and PMI-IR for predicting user click behavior . amp . 2005. 51–60. 10.1145/1054972.1054980. 978-1-58113-998-3. 14347026 .
  19. http://www.di.uniba.it/~cdamato/PhDThesis_dAmato.pdf Similarity-based Learning Methods for the Semantic Web
  20. Gracia, J. . Mena, E. . amp . 2008. Web-Based Measure of Semantic Relatedness. Proceedings of the 9th International Conference on Web Information Systems Engineering (WISE '08). 136–150.
  21. Raveendranathan, P. (2005). Identifying Sets of Related Words from the World Wide Web. Master of Science Thesis, University of Minnesota Duluth.
  22. Wubben, S. (2008). Using free link structure to calculate semantic relatedness. In ILK Research Group Technical Report Series, nr. 08-01, 2008.
  23. Juvina, I., van Oostendorp, H., Karbor, P., & Pauw, B. (2005). Towards modeling contextual information in web navigation. In B. G. Bara & L. Barsalou & M. Bucciarelli (Eds.), 27th Annual Meeting of the Cognitive Science Society, CogSci2005 (pp. 1078–1083). Austin, Tx: The Cognitive Science Society, Inc.
  24. Navigli, R., Lapata, M. (2007). Graph Connectivity Measures for Unsupervised Word Sense Disambiguation, Proc. of the 20th International Joint Conference on Artificial Intelligence (IJCAI 2007), Hyderabad, India, January 6–12th, 2007, pp. 1683–1688.
  25. Pirolli, P.. 2005. Rational analyses of information foraging on the Web. Cognitive Science. 29. 3. 343–373. 10.1207/s15516709cog0000_20. 21702778. free.
  26. Book: Pirolli, P.. Fu, W.-T.. amp . 2003. SNIF-ACT: A model of information foraging on the World Wide Web. Lecture Notes in Computer Science. 2702. 45–54. 10.1007/3-540-44963-9_8. 978-3-540-40381-4. 10.1.1.6.1506.
  27. Turney, P. (2001). Mining the Web for Synonyms: PMI versus LSA on TOEFL. In L. De Raedt & P. Flach (Eds.), Proceedings of the Twelfth European Conference on Machine Learning (ECML-2001) (pp. 491–502). Freiburg, Germany.
  28. Book: Reimers. Nils. Gurevych. Iryna. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) . Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks . November 2019. https://www.aclweb.org/anthology/D19-1410. Hong Kong, China. Association for Computational Linguistics. 3982–3992. 10.18653/v1/D19-1410. 1908.10084. free.
  29. Mueller. Jonas. Thyagarajan. Aditya. 2016-03-05. Siamese Recurrent Architectures for Learning Sentence Similarity. Thirtieth AAAI Conference on Artificial Intelligence. 30 . 10.1609/aaai.v30i1.10350 . 16657628 . en. free.
  30. Cheatham . Michelle . Hitzler . Pascal . Advanced Information Systems Engineering . String Similarity Metrics for Ontology Alignment . 2013 . Alani . Harith . Kagal . Lalana . Fokoue . Achille . Groth . Paul . Biemann . Chris . Parreira . Josiane Xavier . Aroyo . Lora . Noy . Natasha . Welty . Chris . The Semantic Web – ISWC 2013 . Lecture Notes in Computer Science . 7908 . en . Berlin, Heidelberg . Springer . 294–309 . 10.1007/978-3-642-41338-4_19 . 978-3-642-41338-4. 18372966 . free .
  31. Sousa, G., Lima, R., & Trojahn, C. (2022). An eye on representation learning in ontology matching. OM@ISWC.
  32. Pekar . Viktor . Proceedings of the 19th international conference on Computational linguistics – . Staab . Steffen . 1 . 1–7 . 2002 . 10.3115/1072228.1072318. Taxonomy learning .
  33. 10.1081/BIP-200025659 . Cheng . J . Cline . M . Martin . J . Finkelstein . D . Awad . T . Kulp . D . Siani-Rose . MA . A knowledge-based clustering algorithm driven by Gene Ontology . Journal of Biopharmaceutical Statistics . 14 . 3 . 687–700 . 2004 . 15468759. 25224811 .
  34. Wu . H . Su . Z . Mao . F . Olman . V . Xu . Y . Prediction of functional modules based on comparative genome analysis and Gene Ontology application . Nucleic Acids Research . 33 . 9 . 2822–37 . 2005 . 15901854 . 1130488 . 10.1093/nar/gki573.
  35. Del Pozo . Angela . Pazos . Florencio . Valencia . Alfonso . Defining functional distances over Gene Ontology . BMC Bioinformatics . 9 . 50 . 2008 . 18221506 . 2375122 . 10.1186/1471-2105-9-50 . free .
  36. Philip Resnik. 1995. Using information content to evaluate semantic similarity in a taxonomy. Proceedings of the 14th International Joint Conference on Artificial Intelligence (IJCAI'95). Chris S. Mellish. 1. 448–453. 10.1.1.41.6956. 1995cmp.lg...11007R. cmp-lg/9511007.
  37. Dekang Lin. 1998. An Information-Theoretic Definition of Similarity. In Proceedings of the Fifteenth International Conference on Machine Learning (ICML '98), Jude W. Shavlik (Ed.). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 296–304
  38. Ana Gabriela Maguitman, Filippo Menczer, Heather Roinestad, Alessandro Vespignani: Algorithmic detection of semantic similarity. WWW 2005: 107–116
  39. J. J. Jiang and D. W. Conrath. Semantic Similarity Based on Corpus Statistics and Lexical Taxonomy. In International Conference on Research on Computational Linguistics (ROCLING X), pages 9008+, September 1997
  40. M. T. Pilehvar, D. Jurgens and R. Navigli. Align, Disambiguate and Walk: A Unified Approach for Measuring Semantic Similarity.. Proc. of the 51st Annual Meeting of the Association for Computational Linguistics (ACL 2013), Sofia, Bulgaria, August 4–9, 2013, pp. 1341–1351.
  41. Book: Dong. Hai. Lecture Notes in Computer Science . On the Move to Meaningful Internet Systems: OTM 2009 Workshops. A Hybrid Concept Similarity Measure Model for Ontology Environment. 2009. 5872. 848–857. 2009LNCS.5872..848D. 10.1007/978-3-642-05290-3_103. 978-3-642-05289-7.
  42. Dong. Hai. A context-aware semantic similarity model for ontology environments. Concurrency and Computation: Practice and Experience. 2011. 23. 2. 505–524. 10.1002/cpe.1652. 412845.
  43. Landauer . T. K. . Dumais . S. T. . 1997 . A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge . Psychological Review . 104 . 2. 211–240 . 10.1037/0033-295x.104.2.211. 10.1.1.184.4759 . 1144461 .
  44. Landauer, T. K.. Foltz, P. W.. Laham, D.. amp. 1998. Introduction to Latent Semantic Analysis. Discourse Processes. 25. 2–3. 259–284. 10.1080/01638539809545028. 10.1.1.125.109. 16625196 .
  45. Web site: Google Similarity Distance .
  46. Carrillo, F.. Cecchi, G. A.. Sigman, M.. Slezak, D. F. . Fast Distributed Dynamics of Semantic Networks via Social Media. Computational Intelligence and Neuroscience. 2015. 712835. 2015. 10.1155/2015/712835. 4449913. 26074953. free.
  47. Web site: Samer Hassan.
  48. Wilson Wong. Wei Liu. Mohammed Bennamoun. Featureless similarities for terms clustering using tree-traversing ants. PCAR '06: Proceedings of the 2006 international symposium on Practical cognitive agents and robots. November 2006. 177–191. 10.1145/1232425.1232448.
  49. Web site: 6 Degrees of Wikipedia. May 28, 2008. The Chronicle of Higher Education. The Wired Campus. https://web.archive.org/web/20080530043310/http://chronicle.com/wiredcampus/article/3041/six-degrees-of-wikipedia. May 30, 2008. dead.
  50. Web site: Defining the Dimensions of the Human Semantic Space. V. D. Veksler. Ryan Z. Govostes. 2008.
  51. J. Camacho-Collados. M. T. Pilehvar. R. Navigli. NASARI: a Novel Approach to a Semantically-Aware Representation of Items. Proceedings of the North American Chapter of the Association of Computational Linguistics (NAACL 2015). Denver, US. 567–577. 2015.
  52. J. Camacho-Collados. M. T. Pilehvar. R. Navigli. A Unified Multilingual Semantic Representation of Concepts. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics (ACL 2015). Beijing, China. July 27–29, 2015. 741–751.
  53. Fähndrich J.. Weber S.. Ahrndt S.. 2016. Design and Use of a Semantic Similarity Measure for Interoperability Among Agents. Klusch M.. Unland R.. Shehory O.. Pokahr A.. Ahrndt S. . Multiagent System Technologies. MATES 2016. Lecture Notes in Computer Science. 9872. Springer. Available at author version
  54. C. d'Amato. S. Staab. N. Fanizzi. On the influence of description logics ontologies on conceptual similarity. Knowledge Engineering: Practice and Patterns. 48–63. 2008. 10.1007/978-3-540-87696-0_7.
  55. Book: Bendeck, F.. 2008. WSM-P Workflow Semantic Matching Platform, PhD dissertation, University of Trier, Germany . Verlag Dr. Hut. .
  56. Rubenstein, Herbert, and John B. Goodenough. Contextual correlates of synonymy. Communications of the ACM, 8(10):627–633, 1965.
  57. For a list of datasets, and an overview of the state of the art see https://www.aclweb.org/.
  58. Rubenstein. Herbert. Goodenough. John B.. 1965-10-01. Contextual correlates of synonymy. Communications of the ACM. 8. 10. 627–633. 10.1145/365628.365657. 18309234. free.
  59. Miller. George A.. Charles. Walter G.. 1991-01-01. Contextual correlates of semantic similarity. Language and Cognitive Processes. 6. 1. 1–28. 10.1080/01690969108406936. 0169-0965.
  60. 2002-01-01. Placing search in context. ACM Transactions on Information Systems . 20. 116–131. EN. 10.1145/503104.503110. 12956853. 10.1.1.29.1912.