{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T15:38:35Z","timestamp":1781624315677,"version":"3.54.5"},"reference-count":79,"publisher":"MIT Press","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computational Linguistics"],"published-print":{"date-parts":[[2016,12]]},"abstract":"<jats:p>NLP tasks differ in the semantic information they require, and at this time no single semantic representation fulfills all requirements. Logic-based representations characterize sentence structure, but do not capture the graded aspect of meaning. Distributional models give graded similarity ratings for words and phrases, but do not capture sentence structure in the same detail as logic-based approaches. It has therefore been argued that the two are complementary.<\/jats:p><jats:p>We adopt a hybrid approach that combines logical and distributional semantics using probabilistic logic, specifically Markov Logic Networks. In this article, we focus on the three components of a practical system:<jats:sup>1<\/jats:sup>1) Logical representation focuses on representing the input problems in probabilistic logic; 2) knowledge base construction creates weighted inference rules by integrating distributional information with other sources; and 3) probabilistic inference involves solving the resulting MLN inference problems efficiently. To evaluate our approach, we use the task of textual entailment, which can utilize the strengths of both logic-based and distributional representations. In particular we focus on the SICK data set, where we achieve state-of-the-art results. We also release a lexical entailment data set of 10,213 rules extracted from the SICK data set, which is a valuable resource for evaluating lexical entailment systems.<jats:sup>2<\/jats:sup><\/jats:p>","DOI":"10.1162\/coli_a_00266","type":"journal-article","created":{"date-parts":[[2016,9,28]],"date-time":"2016-09-28T14:20:41Z","timestamp":1475072441000},"page":"763-808","source":"Crossref","is-referenced-by-count":19,"title":["Representing Meaning with a Combination of Logical and Distributional Models"],"prefix":"10.1162","volume":"42","author":[{"given":"I.","family":"Beltagy","sequence":"first","affiliation":[{"name":"The University of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephen","family":"Roller","sequence":"additional","affiliation":[{"name":"The University of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pengxiang","family":"Cheng","sequence":"additional","affiliation":[{"name":"The University of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katrin","family":"Erk","sequence":"additional","affiliation":[{"name":"The University of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Raymond J.","family":"Mooney","sequence":"additional","affiliation":[{"name":"The University of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","reference":[{"key":"R2","doi-asserted-by":"publisher","DOI":"10.1037\/a0016261"},{"key":"R3","unstructured":"Bach, Stephen H., Bert Huang, Ben London, and Lise Getoor. 2013. Hinge-loss Markov random fields: Convex inference for structured prediction. In UAI 2013, pages 32\u201341, Bellevue, WA."},{"key":"R4","unstructured":"Baroni, Marco, Raffaella Bernardi, Ngoc-Quynh Do, and Chung-chieh Shan. 2012. Entailment above the word level in distributional semantics. In EACL 2012, pages 23\u201332, Avignon."},{"key":"R5","doi-asserted-by":"crossref","unstructured":"Baroni, Marco, Raffaella Bernardi, and Roberto Zamparelli. 2014. Frege in space: A program for compositional distributional semantics. Linguistic Issues in Language Technology, 9(6):5\u2013110.","DOI":"10.33011\/lilt.v9i.1321"},{"key":"R6","doi-asserted-by":"publisher","DOI":"10.1162\/coli_a_00016"},{"key":"R7","unstructured":"Baroni, Marco and Alessandro Lenci. 2011. How we BLESSed distributional semantic evaluation. In GEMS 2011 Workshop on GEometrical Models of Natural Language Semantics, pages 1\u201310, Edinburgh."},{"key":"R8","unstructured":"Baroni, Marco and Roberto Zamparelli. 2010. Nouns are vectors, adjectives are matrices: Representing adjective-noun constructions in semantic space. In EMNLP 2010, pages 1183\u20131193, Cambridge, MA."},{"key":"R9","unstructured":"Beltagy, I., Cuong Chau, Gemma Boleda, Dan Garrette, Katrin Erk, and Raymond Mooney. 2013. Montague meets Markov: Deep semantics with probabilistic logical form. In *SEM 2013, pages 11\u201321, Atlanta, GA."},{"key":"R10","unstructured":"Beltagy, I. and Katrin Erk. 2015. On the proper treatment of quantifiers in probabilistic logic semantics. In IWCS 2015, pages 140\u2013150, London."},{"key":"R11","doi-asserted-by":"crossref","unstructured":"Beltagy, I., Katrin Erk, and Raymond Mooney. 2014. Probabilistic soft logic for semantic textual similarity. In ACL 2014, pages 1210\u20131219, Baltimore, MD.","DOI":"10.3115\/v1\/P14-1114"},{"key":"R12","unstructured":"Beltagy, I. and Raymond J. Mooney. 2014. Efficient Markov logic inference for natural language semantics. In StarAI 2014, pages 9\u201314. Quebec City."},{"key":"R13","doi-asserted-by":"crossref","unstructured":"Berant, Jonathan, Andrew Chou, Roy Frostig, and Percy Liang. 2013. Semantic parsing on Freebase from question-answer pairs. In EMNLP 2013, pages 1533\u20131544, Seattle, WA.","DOI":"10.18653\/v1\/D13-1160"},{"key":"R15","doi-asserted-by":"crossref","unstructured":"Bjerva, Johannes, Johan Bos, Rob van der Goot, and Malvina Nissim. 2014. The meaning factory: Formal semantics for recognizing textual entailment and determining semantic similarity. In SemEval 2014, pages 642\u2013646, Dublin.","DOI":"10.3115\/v1\/S14-2114"},{"key":"R17","doi-asserted-by":"publisher","DOI":"10.3115\/1626481.1626503"},{"key":"R18","doi-asserted-by":"publisher","DOI":"10.1016\/j.jal.2007.07.008"},{"key":"R19","unstructured":"Broecheler, Matthias, Lilyana Mihalkova, and Lise Getoor. 2010. Probabilistic Similarity Logic. In UAI 2010, pages 73\u201382, Catalina Island, CA."},{"key":"R20","doi-asserted-by":"crossref","unstructured":"Brown, Susan Windisch. 2008. Choosing sense distinctions for WSD: Psycholinguistic evidence. In ACL 2008, pages 249\u2013252, Columbus, OH.","DOI":"10.3115\/1557690.1557762"},{"key":"R21","unstructured":"Bruni, Elia, Gemma Boleda, Marco Baroni, and Nam-Khanh Tran. 2012. Distributional semantics in technicolor. In ACL 2012, pages 136\u2013145, Jeju Island."},{"key":"R25","doi-asserted-by":"crossref","unstructured":"Clark, Stephen and James R. Curran. 2004. Parsing the WSJ using CCG and log-linear models. In ACL 2004, pages 103\u2013110, Barcelona.","DOI":"10.3115\/1218955.1218969"},{"key":"R26","unstructured":"Coecke, Bob, Mehrnoosh Sadrzadeh, and Stephen Clark. 2011. Mathematical foundations for a compositional distributed model of meaning. Linguistic Analysis, 36(1\u20134):345\u2013384."},{"key":"R27","doi-asserted-by":"crossref","unstructured":"Cooper, Robin, Simon Dobnik, Shalom Lappin, and Staffan Larsson. 2015. Probabilistic type theory and natural language semantics. Linguistic Issues in Language Technology, 10(4):1\u201343.","DOI":"10.33011\/lilt.v10i.1357"},{"key":"R28","unstructured":"Copestake, Ann and Dan Flickinger. 2000. An open-source grammar development environment and broad-coverage English grammar using HPSG. In LREC 2000, Athens."},{"key":"R29","doi-asserted-by":"publisher","DOI":"10.2200\/S00509ED1V01Y201305HLT023"},{"key":"R30","unstructured":"Dechter, Rina, Kalev Kask, and Robert Mateescu. 2002. Iterative join-graph propagation. In UAI 2002, pages 128\u2013136, Edmonton."},{"key":"R31","doi-asserted-by":"publisher","DOI":"10.1016\/S0004-3702(96)00034-3"},{"key":"R32","unstructured":"Dinu, Georgiana, Stefan Thater, and S\u00f6ren Laue. 2012. A comparison of models of word meaning in context. In HLT-NAACL 2012, pages 611\u2013615, Montreal."},{"key":"R34","unstructured":"Edmonds, Philip and Graeme Hirst. 2000. Reconciling fine-grained lexical knowledge and coarse-grained ontologies in the representation of near-synonyms. In Proceedings of the Workshop on Semantic Approximation, Granularity, and Vagueness, Breckenridge, CO."},{"key":"R35","doi-asserted-by":"crossref","unstructured":"Erk, Katrin and Sebastian Pad\u00f3. 2008. A structured vector space model for word meaning in context. In EMNLP 2008, pages 897\u2013906, Honolulu, HI.","DOI":"10.3115\/1613715.1613831"},{"key":"R36","doi-asserted-by":"crossref","unstructured":"Fu, Ruiji, Jiang Guo, Bing Qin, Wanxiang Che, Haifeng Wang, and Ting Liu. 2014. Learning semantic hierarchies via word embeddings. In ACL 2014, pages 1199\u20131209, Baltimore, MD.","DOI":"10.3115\/v1\/P14-1113"},{"key":"R37","unstructured":"Ganitkevitch, Juri, Benjamin Van Durme, and Chris Callison-Burch. 2013. PPDB: The paraphrase database. In NAACL-HLT 2013, pages 758\u2013764, Atlanta, GA."},{"key":"R38","unstructured":"Garrette, Dan, Katrin Erk, and Raymond Mooney. 2011. Integrating logical representations with probabilistic information using Markov logic. In IWCS 2011, pages 105\u2013114, Oxford."},{"key":"R39","doi-asserted-by":"crossref","unstructured":"Geffet, Maayan and Ido Dagan. 2005. The distributional inclusion hypotheses and lexical entailment. In ACL 2005, pages 107\u2013114, Ann Arbor, MI.","DOI":"10.3115\/1219840.1219854"},{"key":"R44","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2010.10.009"},{"key":"R45","unstructured":"Gogate, Vibhav and Pedro Domingos. 2011. Probabilistic theorem proving. In UAI 2011, pages 256\u2013265, Barcelona."},{"key":"R46","unstructured":"Grefenstette, Edward. 2013. Towards a formal distributional semantics: Simulating logical calculi with tensors. In *SEM 2013, pages 11\u201321, Atlanta, GA."},{"key":"R47","unstructured":"Grefenstette, Edward and Mehrnoosh Sadrzadeh. 2011. Experimental support for a categorical compositional distributional model of meaning. In EMNLP 2011, pages 1394\u20131404, Edinburgh, Scotland."},{"key":"R48","doi-asserted-by":"crossref","unstructured":"Herbelot, Aur\u00e9lie and Eva Maria Vecchi. 2015. Building a shared world: Mapping distributional to model-theoretic semantic spaces. In EMNLP 2015, pages 22\u201332, Lisbon.","DOI":"10.18653\/v1\/D15-1003"},{"key":"R49","doi-asserted-by":"crossref","unstructured":"Hobbs, Jerry R., Mark E. Stickel, Paul Martin, and Douglas Edwards. 1988. Interpretation as abduction. In ACL 1988, pages 95\u2013103, Buffalo, NY.","DOI":"10.3115\/982023.982035"},{"key":"R52","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324910000124"},{"key":"R53","doi-asserted-by":"crossref","unstructured":"Kruszewski, German, Denis Paperno, and Marco Baroni. 2015. Deriving Boolean structures from distributional vectors. TACL 2015, 3:375\u2013388.","DOI":"10.1162\/tacl_a_00145"},{"key":"R54","doi-asserted-by":"crossref","unstructured":"Kwiatkowski, Tom, Eunsol Choi, Yoav Artzi, and Luke Zettlemoyer. 2013. Scaling semantic parsers with on-the-fly ontology matching. In EMNLP 2013, pages 1545\u20131556, Seattle, WA.","DOI":"10.18653\/v1\/D13-1161"},{"key":"R55","doi-asserted-by":"crossref","unstructured":"Lai, Alice and Julia Hockenmaier. 2014. Illinois-lh: A denotational and distributional approach to semantics. In SemEval 2014, pages 329\u2013334, Dublin.","DOI":"10.3115\/v1\/S14-2055"},{"key":"R56","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.104.2.211"},{"key":"R57","unstructured":"Lenci, Alessandro and Giulia Benotto. 2012. Identifying hypernyms in distributional semantic spaces. In *SEM 2012, pages 75\u201379, Montreal."},{"key":"R58","doi-asserted-by":"crossref","unstructured":"Levy, Omer, Steffen Remus, Chris Biemann, and Ido Dagan. 2015. Do supervised distributional methods really learn lexical inference relations? In NAACL HLT 2015, pages 970\u2013976, Denver, CO.","DOI":"10.3115\/v1\/N15-1098"},{"key":"R59","doi-asserted-by":"crossref","unstructured":"Lewis, Mike and Mark Steedman. 2013. Combined distributional and logical semantics. TACL 2013, 1:179\u2013192.","DOI":"10.1162\/tacl_a_00219"},{"key":"R60","doi-asserted-by":"crossref","unstructured":"Lewis, Mike and Mark Steedman. 2014. A* CCG parsing with a supertag-factored model. In EMNLP 2014, pages 990\u20131000, Doha.","DOI":"10.3115\/v1\/D14-1107"},{"key":"R61","unstructured":"Liang, Percy, Michael Jordan, and Dan Klein. 2011. Learning dependency-based compositional semantics. In ACL-HLT 2011, pages 590\u2013599, Portland, OR."},{"key":"R62","doi-asserted-by":"publisher","DOI":"10.3758\/BF03204766"},{"key":"R63","doi-asserted-by":"crossref","unstructured":"MacCartney, Bill and Christopher D. Manning. 2009. An extended model of natural logic. In IWCS 2009, pages 140\u2013156, Tilburg.","DOI":"10.3115\/1693756.1693772"},{"key":"R64","doi-asserted-by":"crossref","unstructured":"Marelli, Marco, Luisa Bentivogli, Marco Baroni, Raffaella Bernardi, Stefano Menini, and Roberto Zamparelli. 2014a. SemEval-2014 task 1: Evaluation of compositional distributional semantic models on full sentences through semantic relatedness and textual entailment. In SemEval 2014, pages 1\u20138, Dublin.","DOI":"10.3115\/v1\/S14-2001"},{"key":"R65","unstructured":"Marelli, Marco, Stefano Menini, Marco Baroni, Luisa Bentivogli, Raffaella Bernardi, and Roberto Zamparelli. 2014b. A SICK cure for the evaluation of compositional distributional semantic models. In LREC 2014, pages 216\u2013223, Reykjavik."},{"key":"R66","unstructured":"Mikolov, Tomas, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. In ICLR 2013, Scottsdale, AZ."},{"key":"R67","unstructured":"Mikolov, Tomas, Wentau Yih, and Geoffrey Zweig. 2013. Linguistic regularities in continuous space word representations. In NAACL-HLT 2013, pages 746\u2013751, Atlanta, GA."},{"key":"R68","unstructured":"Mitchell, Jeff and Mirella Lapata. 2008. Vector-based models of semantic composition. In ACL 2008, pages 236\u2013244, Columbus, OH."},{"key":"R69","doi-asserted-by":"publisher","DOI":"10.1111\/j.1551-6709.2010.01106.x"},{"key":"R70","doi-asserted-by":"publisher","DOI":"10.1111\/j.1755-2567.1970.tb00434.x"},{"key":"R71","unstructured":"Ng, Dominick and James R Curran. 2012. Dependency hashing for n-best CCG parsing. In InACL 2012, pages 497\u2013505, Jeju Island."},{"key":"R72","doi-asserted-by":"crossref","unstructured":"Paperno, Denis, Nghia The Pham, and Marco Baroni. 2014. A practical and linguistically-motivated approach to compositional distributional semantics. In ACL 2014, pages 90\u201399, Baltimore, MD.","DOI":"10.3115\/v1\/P14-1009"},{"key":"R74","unstructured":"Pasupat, Panupong and Percy Liang. 2015. Compositional semantic parsing on semi-structured tables. In ACL 2015, pages 1470\u20131480, Beijing."},{"key":"R76","doi-asserted-by":"crossref","unstructured":"Poon, Hoifung and Pedro Domingos. 2008. Joint unsupervised coreference resolution with Markov logic. In EMNLP 2008, pages 650\u2013659, Honolulu, HI.","DOI":"10.3115\/1613715.1613796"},{"key":"R78","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-006-5833-1"},{"key":"R79","doi-asserted-by":"crossref","unstructured":"Riedel, Sebastian, Hong-Woo Chun, Toshihisa Takagi, and Jun'ichi Tsujii. 2009. A Markov logic approach to bio-molecular event extraction. In BioNLP 2009, pages 41\u201349, Boulder, CA.","DOI":"10.3115\/1572340.1572347"},{"key":"R80","doi-asserted-by":"publisher","DOI":"10.3115\/1596324.1596357"},{"key":"R81","doi-asserted-by":"publisher","DOI":"10.1145\/321250.321253"},{"key":"R82","unstructured":"Roller, Stephen, Katrin Erk, and Gemma Boleda. 2014. Inclusive yet selective: Supervised distributional hypernymy detection. In COLING 2014, pages 1025\u20131036, Dublin."},{"key":"R83","doi-asserted-by":"publisher","DOI":"10.1093\/logcom\/ext044"},{"key":"R85","unstructured":"Sch\u00fctze, Hinrich. 1998. Automatic word sense discrimination. Computational Linguistics, 24(1):97\u2013123."},{"key":"R86","unstructured":"Silberer, Carina and Mirella Lapata. 2012. Grounded models of semantic representation. In EMNLP-CoNLL 2012, pages 1423\u20131433, Jeju Island."},{"key":"R87","unstructured":"Skolem, Thoralf. 1920. Logisch-kombinatorische Untersuchungen \u00fcber die Erf\u00fcllbarkeit oder Beweisbarkeit mathematischer S\u00e4tze. Skrifter utgit av Videnskapselskapet i Kristiania, 4:4\u201336."},{"key":"R88","doi-asserted-by":"crossref","unstructured":"Snow, Rion, Daniel Jurafsky, and Andrew Y. Ng. 2006. Semantic taxonomy induction from heterogenous evidence. In COLING\/ACL 2006, pages 801\u2013808, Sydney.","DOI":"10.3115\/1220175.1220276"},{"key":"R89","doi-asserted-by":"publisher","DOI":"10.1093\/mind\/LIX.235.320"},{"key":"R90","unstructured":"Thater, Stefan, Hagen F\u00fcrstenau, and Manfred Pinkal. 2010. Contextualizing semantic representations using syntactically enriched vector models. In ACL 2010, pages 948\u2013957, Uppsala."},{"key":"R91","doi-asserted-by":"crossref","unstructured":"Tian, Ran, Yusuke Miyao, and Matsuzaki Takuya. 2014. Logical inference on dependency-based compositional semantics. In ACL 2014, pages 78\u201389, Baltimore, MD.","DOI":"10.3115\/v1\/P14-1008"},{"key":"R92","doi-asserted-by":"publisher","DOI":"10.1613\/jair.2934"},{"key":"R95","unstructured":"Weeds, Julie, Daoud Clarke, Jeremy Reffin, David Weir, and Bill Keller. 2014. Learning to distinguish hypernyms and co-hyponyms. In COLING 2014, pages 2249\u20132259, Dublin."},{"key":"R96","doi-asserted-by":"crossref","unstructured":"Weeds, Julie, David Weir, and Diana McCarthy. 2004. Characterising measures of lexical distributional similarity. In COLING 2004, pages 1015\u20131021, Geneva.","DOI":"10.3115\/1220355.1220501"},{"key":"R97","unstructured":"Zelle, John M. and Raymond J. Mooney. 1996. Learning to parse database queries using inductive logic programming. In AAAI 1996, pages 1050\u20131055, Portland, OR."},{"key":"R98","unstructured":"Zirn, C\u00e4cilia, Mathias Niepert, Heiner Stuckenschmidt, and Michael Strube. 2011. Fine-grained sentiment analysis with structural features. In IJCNLP 2011, pages 336\u2013344, Chiang Mai."}],"container-title":["Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/COLI_a_00266","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,10]],"date-time":"2025-06-10T21:47:01Z","timestamp":1749592021000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/coli\/article\/42\/4\/763-808\/1553"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,12]]},"references-count":79,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2016,12]]}},"alternative-id":["10.1162\/COLI_a_00266"],"URL":"https:\/\/doi.org\/10.1162\/coli_a_00266","relation":{},"ISSN":["0891-2017","1530-9312"],"issn-type":[{"value":"0891-2017","type":"print"},{"value":"1530-9312","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,12]]}}}