{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T16:22:36Z","timestamp":1783786956158,"version":"3.55.0"},"reference-count":50,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2014,1,1]],"date-time":"2014-01-01T00:00:00Z","timestamp":1388534400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100006754","name":"U.S. Army Research Laboratory","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100006754","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Sen. Netw."],"published-print":{"date-parts":[[2014,1]]},"abstract":"<jats:p>This article addresses the challenge of truth discovery from noisy social sensing data. The work is motivated by the emergence of social sensing as a data collection paradigm of growing interest, where humans perform sensory data collection tasks. Unlike the case with well-calibrated and well-tested infrastructure sensors, humans are less reliable, and the likelihood that participants' measurements are correct is often unknown a priori. Given a set of human participants of unknown trustworthiness together with their sensory measurements, we pose the question of whether one can use this information alone to determine, in an analytically founded manner, the probability that a given measurement is true. In our previous conference paper, we offered the first maximum likelihood solution to the aforesaid truth discovery problem for<jats:italic>corroborating observations<\/jats:italic>only. In contrast, this article extends the conference paper and provides the first maximum likelihood solution to handle the cases where measurements from different participants may be<jats:italic>conflicting<\/jats:italic>. The article focuses on binary measurements. The approach is shown to outperform our previous work used for corroborating observations, the state-of-the-art fact-finding baselines, as well as simple heuristics such as majority voting.<\/jats:p>","DOI":"10.1145\/2530289","type":"journal-article","created":{"date-parts":[[2014,1,28]],"date-time":"2014-01-28T13:49:22Z","timestamp":1390916962000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":79,"title":["Maximum likelihood analysis of conflicting observations in social sensing"],"prefix":"10.1145","volume":"10","author":[{"given":"Dong","family":"Wang","sequence":"first","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, IL"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lance","family":"Kaplan","sequence":"additional","affiliation":[{"name":"US Army Research Laboratory, Adelphi, MD"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tarek F.","family":"Abdelzaher","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-champaign, Urbana, IL"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2014,1,31]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2007.38"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2005.99"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCPS.2011.20"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1869983.1869994"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1963405.1963440"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1999995.2000006"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2307636.2307659"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the Biennial Conference on Innovative Data Systems Research (CIDR'09)","author":"Berti-Equille Laure","year":"2009","unstructured":"Laure Berti-Equille , Anish Das Sarma , Xin Dong , Am\u00e9lie Marian , and Divesh Srivastava . 2009 . Sailing the information ocean with awareness of currents: Discovery and application of source dependence . In Proceedings of the Biennial Conference on Innovative Data Systems Research (CIDR'09) . Laure Berti-Equille, Anish Das Sarma, Xin Dong, Am\u00e9lie Marian, and Divesh Srivastava. 2009. Sailing the information ocean with awareness of currents: Discovery and application of source dependence. In Proceedings of the Biennial Conference on Innovative Data Systems Research (CIDR'09)."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.5555\/297805.297827"},{"key":"e_1_2_1_10_1","volume-title":"Mathematical Methods of Statistics","author":"Cramer Harald","unstructured":"Harald Cramer . 1946. Mathematical Methods of Statistics . Princeton University Press . Harald Cramer. 1946. Mathematical Methods of Statistics. Princeton University Press."},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the 22nd Annual Conference on Learning Theory.","author":"Dekel Ofer","year":"2009","unstructured":"Ofer Dekel and Ohad Shamir . 2009 . Vox populi: Collecting high-quality labels from a crowd . In Proceedings of the 22nd Annual Conference on Learning Theory. Ofer Dekel and Ohad Shamir. 2009. Vox populi: Collecting high-quality labels from a crowd. In Proceedings of the 22nd Annual Conference on Learning Theory."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10588-006-9007-2"},{"key":"e_1_2_1_13_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.2517-6161.1977.tb01600.x","article-title":"Maximum likelihood from incomplete data via the em algorithm","volume":"39","author":"Dempster A. P.","year":"1977","unstructured":"A. P. Dempster , N. M. Laird , and D. B. Rubin . 1977 . Maximum likelihood from incomplete data via the em algorithm . J. Royal Statist. Soc. B39 , 1, 1 -- 38 . A. P. Dempster, N. M. Laird, and D. B. Rubin. 1977. Maximum likelihood from incomplete data via the em algorithm. J. Royal Statist. Soc. B39, 1, 1--38.","journal-title":"J. Royal Statist. Soc."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.14778\/1920841.1921008"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.14778\/1687627.1687691"},{"key":"e_1_2_1_16_1","volume-title":"Eds.","author":"Doucet Arnaud","year":"2001","unstructured":"Arnaud Doucet , Nando De Freitas, and Neil Gordon , Eds. 2001 . Sequential Monte Carlo Methods in Practice. Springer . Arnaud Doucet, Nando De Freitas, and Neil Gordon, Eds. 2001. Sequential Monte Carlo Methods in Practice. Springer."},{"key":"e_1_2_1_17_1","volume-title":"Stork","author":"Duda Richard O.","year":"2001","unstructured":"Richard O. Duda , Peter E. Hart , and David G . Stork . 2001 . Pattern Classification. 2 nd Ed. Wiley-Interscience . Richard O. Duda, Peter E. Hart, and David G. Stork. 2001. Pattern Classification. 2nd Ed. Wiley-Interscience.","edition":"2"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1322263.1322273"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1718487.1718504"},{"key":"e_1_2_1_20_1","volume-title":"Data Mining: Concepts and Techniques","author":"Han J.","year":"2011","unstructured":"J. Han , M. Kamber , and Jian Pei . 2011 . Data Mining: Concepts and Techniques . 3 rd Ed. Morgan Kaufman . J. Han, M. Kamber, and Jian Pei. 2011. Data Mining: Concepts and Techniques. 3rd Ed. Morgan Kaufman.","edition":"3"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1098918.1098938"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.4018\/jats.2010070103"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1182807.1182821"},{"key":"e_1_2_1_24_1","unstructured":"R. A. Johnson and D. W. Wichern. 2002. Applied Multivariate Statistical Analysis. Prentice-Hall Upper Saddle River NJ. R. A. Johnson and D. W. Wichern. 2002. Applied Multivariate Statistical Analysis. Prentice-Hall Upper Saddle River NJ."},{"key":"e_1_2_1_25_1","doi-asserted-by":"crossref","unstructured":"R. E. Kalman. 1960. A new approach to linear filtering and prediction problems. Trans. ASME J. Basic Engin. D82 35--45. R. E. Kalman. 1960. A new approach to linear filtering and prediction problems. Trans. ASME J. Basic Engin. D82 35--45.","DOI":"10.1115\/1.3662552"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/324133.324140"},{"key":"e_1_2_1_27_1","first-page":"467","article-title":"Expectation maximization clustering algorithm for user modeling in web usage mining systems. Euro","volume":"32","author":"Mustapha Norwati","year":"2009","unstructured":"Norwati Mustapha , Manijeh Jalali , and Mehrdad Jalali . 2009 . Expectation maximization clustering algorithm for user modeling in web usage mining systems. Euro . J. Sci. Res. 32 , 4, 467 -- 476 . Norwati Mustapha, Manijeh Jalali, and Mehrdad Jalali. 2009. Expectation maximization clustering algorithm for user modeling in web usage mining systems. Euro. J. Sci. Res. 32, 4, 467--476.","journal-title":"J. Sci. Res."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2307636.2307640"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070942.2070969"},{"key":"e_1_2_1_30_1","volume-title":"International Conference on Computational Linguistics (COLING'10)","author":"Pasternack J.","unstructured":"J. Pasternack and D. Roth . 2010. Knowing what to believe (when you already know something) . In International Conference on Computational Linguistics (COLING'10) . J. Pasternack and D. Roth. 2010. Knowing what to believe (when you already know something). In International Conference on Computational Linguistics (COLING'10)."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-11917-0_8"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-01818-3_12"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-12654-3_9"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753598"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1401965"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1557019.1557107"},{"key":"e_1_2_1_37_1","volume-title":"Solving Data Mining Problems Using Pattern Recognition Software with Cdrom","author":"Technologies Unica","unstructured":"Unica Technologies . 1997. Solving Data Mining Problems Using Pattern Recognition Software with Cdrom . 1 st Ed. Prentice Hall PTR , Upper Saddle River, NJ. Unica Technologies. 1997. Solving Data Mining Problems Using Pattern Recognition Software with Cdrom. 1st Ed. Prentice Hall PTR, Upper Saddle River, NJ.","edition":"1"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 14th International Conference on Information Fusion (Fusion'11)","author":"Wang Dong","year":"2011","unstructured":"Dong Wang , Tarek Abdelzaher , Hossein Ahmadi , Jeff Pasternack , Dan Roth , Manish Gupta , Jiawei Han , Omid Fatemieh , and Hieu Le . 2011 a. On bayesian interpretation of fact-finding in information networks . In Proceedings of the 14th International Conference on Information Fusion (Fusion'11) . Dong Wang, Tarek Abdelzaher, Hossein Ahmadi, Jeff Pasternack, Dan Roth, Manish Gupta, Jiawei Han, Omid Fatemieh, and Hieu Le. 2011a. On bayesian interpretation of fact-finding in information networks. In Proceedings of the 14th International Conference on Information Fusion (Fusion'11)."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDCS.2013.54"},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the 7th IEEE International Conference on Distributed Computing in Sensor Systems (DCoSS'11)","author":"Wang Dong","unstructured":"Dong Wang , H. Ahmadi , T. Abdelzaher , H. Chenji , R. Stoleru , and C. C. Aggarwal . 2011b. Optimizing quality-of-information in cost-sensitive sensor data fusion . In Proceedings of the 7th IEEE International Conference on Distributed Computing in Sensor Systems (DCoSS'11) . Dong Wang, H. Ahmadi, T. Abdelzaher, H. Chenji, R. Stoleru, and C. C. Aggarwal. 2011b. Optimizing quality-of-information in cost-sensitive sensor data fusion. In Proceedings of the 7th IEEE International Conference on Distributed Computing in Sensor Systems (DCoSS'11)."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185677.2185737"},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the 9th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks (SECON'12)","author":"Wang Dong","unstructured":"Dong Wang , Lance Kaplan , Tarek Abdelzaher , and Charu C. Aggarwal . 2012b. On scalability and robustness limitations of real and asymptotic confidence bounds in social sensing . In Proceedings of the 9th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks (SECON'12) . Dong Wang, Lance Kaplan, Tarek Abdelzaher, and Charu C. Aggarwal. 2012b. On scalability and robustness limitations of real and asymptotic confidence bounds in social sensing. In Proceedings of the 9th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks (SECON'12)."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2013.130605"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1176346060"},{"key":"e_1_2_1_45_1","first-page":"1","article-title":"Social consensus through the influence of committed minorities","volume":"84","author":"Xie J.","year":"2011","unstructured":"J. Xie , S. Sreenivasan , G. Korniss , W. Zhang , C. Lim , and B. K. Szymanski . 2011 . Social consensus through the influence of committed minorities . Phys. Rev. E84 , 1 . J. Xie, S. Sreenivasan, G. Korniss, W. Zhang, C. Lim, and B. K. Szymanski. 2011. Social consensus through the influence of committed minorities. Phys. Rev. E84, 1.","journal-title":"Phys. Rev."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2007.190745"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1963405.1963439"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.14778\/2168651.2168656"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2307636.2307671"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2309996.2310053"}],"container-title":["ACM Transactions on Sensor Networks"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2530289","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2530289","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T08:09:52Z","timestamp":1750234192000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2530289"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,1]]},"references-count":50,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2014,1]]}},"alternative-id":["10.1145\/2530289"],"URL":"https:\/\/doi.org\/10.1145\/2530289","relation":{},"ISSN":["1550-4859","1550-4867"],"issn-type":[{"value":"1550-4859","type":"print"},{"value":"1550-4867","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,1]]},"assertion":[{"value":"2012-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2013-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-01-31","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}