{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,14]],"date-time":"2026-03-14T09:52:30Z","timestamp":1773481950005,"version":"3.50.1"},"reference-count":45,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2017,9,30]],"date-time":"2017-09-30T00:00:00Z","timestamp":1506729600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Data and Information Quality"],"published-print":{"date-parts":[[2017,9,30]]},"abstract":"<jats:p>\n            Among different characteristics of knowledge bases, data quality is one of the most relevant to maximize the benefits of the provided information. Knowledge base quality assessment poses a number of big data challenges such as high volume, variety, velocity, and veracity. In this article, we focus on answering questions related to the assessment of the veracity of facts through Deep Fact Validation (DeFacto), a\n            <jats:italic>triple validation<\/jats:italic>\n            framework designed to assess facts in RDF knowledge bases. Despite current developments in the research area, the underlying framework faces many challenges. This article pinpoints and discusses these issues and conducts a thorough analysis of its pipeline, aiming at reducing the error propagation through its components. Furthermore, we discuss recent developments related to this fact validation as well as describing advantages and drawbacks of state-of-the-art models. As a result of this exploratory analysis, we give insights and directions toward a better architecture to tackle the complex task of fact-checking in knowledge bases.\n          <\/jats:p>","DOI":"10.1145\/3177873","type":"journal-article","created":{"date-parts":[[2018,2,20]],"date-time":"2018-02-20T16:45:32Z","timestamp":1519145132000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Toward Veracity Assessment in RDF Knowledge Bases"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1676-545X","authenticated-orcid":false,"given":"Diego","family":"Esteves","sequence":"first","affiliation":[{"name":"University of Bonn, Bonn, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anisa","family":"Rula","sequence":"additional","affiliation":[{"name":"University of Milano-Bicocca and University of Bonn, Bonn, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aniketh Janardhan","family":"Reddy","sequence":"additional","affiliation":[{"name":"Birla Institute of Technology and Science, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jens","family":"Lehmann","sequence":"additional","affiliation":[{"name":"University of Bonn and Fraunhofer IAIS, Bonn, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,2,20]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"344","article-title":"Leveraging linguistic structure for open domain information extraction. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing","volume":"1","author":"Angeli Gabor","year":"2015","unstructured":"Gabor Angeli , Melvin Johnson Premkumar , and Christopher D. Manning . 2015 . Leveraging linguistic structure for open domain information extraction. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing . Association for Computational Linguistics , Vol. 1 , 344 -- 354 . Gabor Angeli, Melvin Johnson Premkumar, and Christopher D. Manning. 2015. Leveraging linguistic structure for open domain information extraction. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing. Association for Computational Linguistics, Vol. 1, 344--354.","journal-title":"Association for Computational Linguistics"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766462.2767734"},{"key":"e_1_2_1_3_1","doi-asserted-by":"crossref","unstructured":"Laure Berti-\u00c9quille and Javier Borge-Holthoefer. 2015. Veracity of Data: From Truth Discovery Computation Algorithms to Models of Misinformation Dynamics. Morgan 8 Claypool Publishers.   Laure Berti-\u00c9quille and Javier Borge-Holthoefer. 2015. Veracity of Data: From Truth Discovery Computation Algorithms to Models of Misinformation Dynamics. Morgan 8 Claypool Publishers.","DOI":"10.1007\/978-3-031-01855-8"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2009.07.002"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/645504.656274"},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the 14th Conference on Computational Natural Language Learning. Association for Computational Linguistics, 153--161","author":"de Albornoz Jorge Carrillo","year":"2010","unstructured":"Jorge Carrillo de Albornoz , Laura Plaza , and Pablo Gerv\u00e1s . 2010 . A hybrid approach to emotional sentence polarity and intensity classification . In Proceedings of the 14th Conference on Computational Natural Language Learning. Association for Computational Linguistics, 153--161 . Jorge Carrillo de Albornoz, Laura Plaza, and Pablo Gerv\u00e1s. 2010. A hybrid approach to emotional sentence polarity and intensity classification. In Proceedings of the 14th Conference on Computational Natural Language Learning. Association for Computational Linguistics, 153--161."},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the 8th International Conference on Uncertainty Reasoning for the Semantic Web","volume":"900","author":"Ceolin Davide","year":"2012","unstructured":"Davide Ceolin , Paul Groth , Willem Robert Van Hage , Archana Nottamkandath , and Wan Fokkink . 2012 . Trust evaluation through user reputation and provenance analysis . In Proceedings of the 8th International Conference on Uncertainty Reasoning for the Semantic Web , Vol. 900 . CEUR-WS.org, 15--26. Davide Ceolin, Paul Groth, Willem Robert Van Hage, Archana Nottamkandath, and Wan Fokkink. 2012. Trust evaluation through user reputation and provenance analysis. In Proceedings of the 8th International Conference on Uncertainty Reasoning for the Semantic Web, Vol. 900. CEUR-WS.org, 15--26."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022627411411"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2014.10.006"},{"key":"e_1_2_1_10_1","volume-title":"Leveraging text and knowledge bases for triple scoring: An ensemble approach\u2014The BOKCHOY triple scorer at WSDM Cup","author":"Ding Boyang","year":"2017","unstructured":"Boyang Ding , Quan Wang , and Bin Wang . 2017. Leveraging text and knowledge bases for triple scoring: An ensemble approach\u2014The BOKCHOY triple scorer at WSDM Cup 2017 . In WSDM Cup 2017 Notebook Papers, February 10, Cambridge, UK, Martin Potthast, Stefan Heindorf, and Hannah Bast (Eds.). CEUR-WS.org. Retrieved from http:\/\/www.wsdm-cup-2017.org\/proceedings.html. Boyang Ding, Quan Wang, and Bin Wang. 2017. Leveraging text and knowledge bases for triple scoring: An ensemble approach\u2014The BOKCHOY triple scorer at WSDM Cup 2017. In WSDM Cup 2017 Notebook Papers, February 10, Cambridge, UK, Martin Potthast, Stefan Heindorf, and Hannah Bast (Eds.). CEUR-WS.org. Retrieved from http:\/\/www.wsdm-cup-2017.org\/proceedings.html."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2814864.2814883"},{"key":"e_1_2_1_12_1","volume-title":"Named entity recognition in Twitter using images and text. Arxiv:1710.11027","author":"Esteves Diego","year":"2017","unstructured":"Diego Esteves , Rafael Peres , Jens Lehmann , and Giulio Napolitano . 2017. Named entity recognition in Twitter using images and text. Arxiv:1710.11027 ( 2017 ). Diego Esteves, Rafael Peres, Jens Lehmann, and Giulio Napolitano. 2017. Named entity recognition in Twitter using images and text. Arxiv:1710.11027 (2017)."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/988672.988687"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2015.08.001"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33876-2_10"},{"key":"e_1_2_1_16_1","volume-title":"WWW2009 Workshop: Linked Data on the Web (LDOW2009)","author":"Glaser Hugh","year":"2009","unstructured":"Hugh Glaser , Afraz Jaffri , and Ian Millard . 2009 . Managing co-reference on the semantic web . WWW2009 Workshop: Linked Data on the Web (LDOW2009) . University of Southampton Institutional Repository. https:\/\/eprints.soton.ac.uk\/267587\/. Hugh Glaser, Afraz Jaffri, and Ian Millard. 2009. Managing co-reference on the semantic web. WWW2009 Workshop: Linked Data on the Web (LDOW2009). University of Southampton Institutional Repository. https:\/\/eprints.soton.ac.uk\/267587\/."},{"key":"e_1_2_1_17_1","volume-title":"Supervised ranking of triples for type-like relations\u2014the cress triple scorer at the WSDM Cup","author":"Hasibi Faegheh","year":"2017","unstructured":"Faegheh Hasibi , Dar\u00edo Garigliotti , Shuo Zhang , and Krisztian Balog . 2017. Supervised ranking of triples for type-like relations\u2014the cress triple scorer at the WSDM Cup 2017 . In WSDM Cup 2017 Notebook Papers, February 10, Cambridge, UK, Martin Potthast, Stefan Heindorf, and Hannah Bast (Eds.). CEUR-WS.org. Retrieved from http:\/\/www.wsdm-cup-2017.org\/proceedings.html. Faegheh Hasibi, Dar\u00edo Garigliotti, Shuo Zhang, and Krisztian Balog. 2017. Supervised ranking of triples for type-like relations\u2014the cress triple scorer at the WSDM Cup 2017. In WSDM Cup 2017 Notebook Papers, February 10, Cambridge, UK, Martin Potthast, Stefan Heindorf, and Hannah Bast (Eds.). CEUR-WS.org. Retrieved from http:\/\/www.wsdm-cup-2017.org\/proceedings.html."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.14778\/2733004.2733029"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers. Dublin City University and Association for Computational Linguistics, Dublin, 1248--1259","author":"Hong Soon Gill","year":"2014","unstructured":"Soon Gill Hong , Sin-hee Cho, and Mun Yong Yi . 2014 . Unsupervised verb inference from nouns crossing root boundary . In Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers. Dublin City University and Association for Computational Linguistics, Dublin, 1248--1259 . Soon Gill Hong, Sin-hee Cho, and Mun Yong Yi. 2014. Unsupervised verb inference from nouns crossing root boundary. In Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers. Dublin City University and Association for Computational Linguistics, Dublin, 1248--1259."},{"key":"e_1_2_1_20_1","unstructured":"Soon Gill Hong and Mun Yong Yi. 2017. Plausibility assessment of triples with instance-based learning distantly supervised by background knowledge. Submitted to Semant. Web J. Retrieved from http:\/\/www.semantic-web-journal.net\/system\/files\/swj1546.pdf.  Soon Gill Hong and Mun Yong Yi. 2017. Plausibility assessment of triples with instance-based learning distantly supervised by background knowledge. Submitted to Semant. Web J. Retrieved from http:\/\/www.semantic-web-journal.net\/system\/files\/swj1546.pdf."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-35176-1_20"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.14778\/3137628.3137646"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2011.5767859"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2850417"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of Euralex98","author":"Macleod Catherine","year":"1998","unstructured":"Catherine Macleod , Ralph Grishman , Adam Meyers , Leslie Barrett , and Ruth Reeves . 1998 . NOMLEX: A lexicon of nominalizations . In Proceedings of Euralex98 . 187--193. Catherine Macleod, Ralph Grishman, Adam Meyers, Leslie Barrett, and Ruth Reeves. 1998. NOMLEX: A lexicon of nominalizations. In Proceedings of Euralex98. 187--193."},{"key":"e_1_2_1_27_1","volume-title":"Named entity recognition: Fallacies, challenges and opportunities. Computer Standards 8 Interfaces 35, 5","author":"Marrero M\u00f3nica","year":"2013","unstructured":"M\u00f3nica Marrero , Juli\u00e1n Urbano , Sonia S\u00e1nchez-Cuadrado , Jorge Morato , and Juan Miguel G\u00f3mez-Berb\u00eds . 2013. Named entity recognition: Fallacies, challenges and opportunities. Computer Standards 8 Interfaces 35, 5 ( 2013 ), 482--489. M\u00f3nica Marrero, Juli\u00e1n Urbano, Sonia S\u00e1nchez-Cuadrado, Jorge Morato, and Juan Miguel G\u00f3mez-Berb\u00eds. 2013. Named entity recognition: Fallacies, challenges and opportunities. Computer Standards 8 Interfaces 35, 5 (2013), 482--489."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/219717.219748"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1568234.1568246"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1963192.1963243"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.5555\/2283696.2283785"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2488388.2488476"},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. 815--825","author":"Qian Zhong","unstructured":"Zhong Qian , Peifeng Li , Qiaoming Zhu , Guodong Zhou , Zhunchen Luo , and Wei Luo . Speculation and negation scope detection via convolutional neural networks . In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. 815--825 . Zhong Qian, Peifeng Li, Qiaoming Zhu, Guodong Zhou, Zhunchen Luo, and Wei Luo. Speculation and negation scope detection via convolutional neural networks. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. 815--825."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.5555\/1596374.1596399"},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, 74--84","author":"Riedel Sebastian","unstructured":"Sebastian Riedel , Limin Yao , Andrew McCallum , and Benjamin M. Marlin . 2013. Relation extraction with matrix factorization and universal schemas . In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, 74--84 . Sebastian Riedel, Limin Yao, Andrew McCallum, and Benjamin M. Marlin. 2013. Relation extraction with matrix factorization and universal schemas. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, 74--84."},{"key":"e_1_2_1_36_1","volume-title":"Computational Processing of the Portuguese Language-12th International Conference, PROPOR. 13--15","author":"Rocha Gil","year":"2016","unstructured":"Gil Rocha , Henrique Lopes Cardoso , and Jorge Teixeira . 2016 . ArgMine: A framework for argumentation mining . Computational Processing of the Portuguese Language-12th International Conference, PROPOR. 13--15 . Gil Rocha, Henrique Lopes Cardoso, and Jorge Teixeira. 2016. ArgMine: A framework for argumentation mining. Computational Processing of the Portuguese Language-12th International Conference, PROPOR. 13--15."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2014.6816764"},{"key":"e_1_2_1_38_1","volume-title":"2014 IEEE 30th International Conference on Data Engineering. 1294--1297","author":"Saha B.","unstructured":"B. Saha and D. Srivastava . 2014. Data quality: The other face of Big Data . In 2014 IEEE 30th International Conference on Data Engineering. 1294--1297 . B. Saha and D. Srivastava. 2014. Data quality: The other face of Big Data. In 2014 IEEE 30th International Conference on Data Engineering. 1294--1297."},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the 13th AAAI Conference on Artificial Intelligence (AAAI\u201916)","author":"Samadi Mehdi","year":"2016","unstructured":"Mehdi Samadi , Partha Talukdar , Manuela Veloso , and Manuel Blum . 2016 . ClaimEval: Integrated and flexible framework for claim evaluation using credibility of sources . In Proceedings of the 13th AAAI Conference on Artificial Intelligence (AAAI\u201916) . AAAI Press, 222--228. Mehdi Samadi, Partha Talukdar, Manuela Veloso, and Manuel Blum. 2016. ClaimEval: Integrated and flexible framework for claim evaluation using credibility of sources. In Proceedings of the 13th AAAI Conference on Artificial Intelligence (AAAI\u201916). AAAI Press, 222--228."},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the Twenty-Seventh AAAI Conference on Artificial Intelligence (AAAI\u201913)","author":"Samadi Mehdi","year":"2013","unstructured":"Mehdi Samadi , Manuela M. Veloso , and Manuel Blum . 2013 . OpenEval: Web information query evaluation . In Proceedings of the Twenty-Seventh AAAI Conference on Artificial Intelligence (AAAI\u201913) . AAAI Press, Bellevue, Washington, 1163--1169. http:\/\/dl.acm.org\/citation.cfm?id&equals;2891460.2891622. Mehdi Samadi, Manuela M. Veloso, and Manuel Blum. 2013. OpenEval: Web information query evaluation. In Proceedings of the Twenty-Seventh AAAI Conference on Artificial Intelligence (AAAI\u201913). AAAI Press, Bellevue, Washington, 1163--1169. http:\/\/dl.acm.org\/citation.cfm?id&equals;2891460.2891622."},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP\u201913)","volume":"1631","author":"Socher Richard","year":"2013","unstructured":"Richard Socher , Alex Perelygin , Jean Y. Wu , Jason Chuang , Christopher D. Manning , Andrew Y. Ng , Christopher Potts , and others. 2013 . Recursive deep models for semantic compositionality over a sentiment treebank . In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP\u201913) , Vol. 1631 . Citeseer, 1642. Richard Socher, Alex Perelygin, Jean Y. Wu, Jason Chuang, Christopher D. Manning, Andrew Y. Ng, Christopher Potts, and others. 2013. Recursive deep models for semantic compositionality over a sentiment treebank. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP\u201913), Vol. 1631. Citeseer, 1642."},{"key":"e_1_2_1_42_1","volume-title":"AAAI-04 Workshop on Adaptive Text Extraction and Mining. 21--26","author":"Soderland Stephen","unstructured":"Stephen Soderland , Oren Etzioni , Tal Shaked , and D. Weld . 2004. The use of web-based statistics to validate information extraction . In AAAI-04 Workshop on Adaptive Text Extraction and Mining. 21--26 . Stephen Soderland, Oren Etzioni, Tal Shaked, and D. Weld. 2004. The use of web-based statistics to validate information extraction. In AAAI-04 Workshop on Adaptive Text Extraction and Mining. 21--26."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-2508"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.3233\/SW-150175"},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval\u201914)","author":"Zhu Xiaodan","unstructured":"Xiaodan Zhu , Svetlana Kiritchenko , and Saif M. Mohammad . 2014. NRC-Canada-2014: Recent improvements in the sentiment analysis of tweets . In Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval\u201914) . Citeseer, 443--447. Xiaodan Zhu, Svetlana Kiritchenko, and Saif M. Mohammad. 2014. NRC-Canada-2014: Recent improvements in the sentiment analysis of tweets. In Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval\u201914). Citeseer, 443--447."},{"key":"e_1_2_1_46_1","volume-title":"\u201cgoosefoot","author":"Zmiycharov Valentin","year":"2017","unstructured":"Valentin Zmiycharov , Dimitar Alexandrov , Preslav Nakov , Ivan Koychev , and Yasen Kiprov . 2017. Finding people\u2019s professions and nationalities using distant supervision: The FMI@SU \u201cgoosefoot \u201d team at the WSDM Cup 2017 triple scoring task. In WSDM Cup 2017 Notebook Papers, February 10, Cambridge, UK, Martin Potthast, Stefan Heindorf, and Hannah Bast (Eds.). CEUR-WS. org. http:\/\/www.wsdm-cup-2017.org\/proceedings.html. Valentin Zmiycharov, Dimitar Alexandrov, Preslav Nakov, Ivan Koychev, and Yasen Kiprov. 2017. Finding people\u2019s professions and nationalities using distant supervision: The FMI@SU \u201cgoosefoot\u201d team at the WSDM Cup 2017 triple scoring task. In WSDM Cup 2017 Notebook Papers, February 10, Cambridge, UK, Martin Potthast, Stefan Heindorf, and Hannah Bast (Eds.). CEUR-WS.org. http:\/\/www.wsdm-cup-2017.org\/proceedings.html."}],"container-title":["Journal of Data and Information Quality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3177873","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3177873","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:02:55Z","timestamp":1750215775000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3177873"}},"subtitle":["An Exploratory Analysis"],"short-title":[],"issued":{"date-parts":[[2017,9,30]]},"references-count":45,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2017,9,30]]}},"alternative-id":["10.1145\/3177873"],"URL":"https:\/\/doi.org\/10.1145\/3177873","relation":{},"ISSN":["1936-1955","1936-1963"],"issn-type":[{"value":"1936-1955","type":"print"},{"value":"1936-1963","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,9,30]]},"assertion":[{"value":"2017-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-02-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}