{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T19:00:43Z","timestamp":1791486043644,"version":"4.3.4"},"reference-count":71,"publisher":"Wiley","issue":"8","license":[{"start":{"date-parts":[[2021,11,14]],"date-time":"2021-11-14T00:00:00Z","timestamp":1636848000000},"content-version":"am","delay-in-days":365,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#am"},{"start":{"date-parts":[[2020,11,14]],"date-time":"2020-11-14T00:00:00Z","timestamp":1605312000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1762807"],"award-info":[{"award-number":["1762807"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Risk Analysis"],"published-print":{"date-parts":[[2022,8]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Social media has been increasingly utilized to spread breaking news and risk communications during disasters of all magnitudes. Unfortunately, due to the unmoderated nature of social media platforms such as Twitter, rumors and misinformation are able to propagate widely. Given this, a surfeit of research has studied false rumor diffusion on Twitter, especially during natural disasters. Within this domain, studies have also focused on the misinformation control efforts from government organizations and other major agencies. A prodigious gap in research exists in studying the monitoring of misinformation on social media platforms in times of disasters and other crisis events. Such studies would offer organizations and agencies new tools and ideologies to monitor misinformation on platforms such as Twitter, and make informed decisions on whether or not to use their resources in order to debunk. In this work, we fill the research gap by developing a machine learning framework to predict the veracity of tweets that are spread during crisis events. The tweets are tracked based on the veracity of their content as either true, false, or neutral. We conduct four separate studies, and the results suggest that our framework is capable of tracking multiple cases of misinformation simultaneously, with  scores exceeding 87%. In the case of tracking a single case of misinformation, our framework reaches an  score of 83%. We collect and drive the algorithms with 15,952 misinformation\u2010related tweets from the Boston Marathon bombing (2013), Manchester Arena bombing (2017), Hurricane Harvey (2017), Hurricane Irma (2017), and the Hawaii ballistic missile false alert (2018). This article provides novel insights on how to efficiently monitor misinformation that is spread during\u00a0disasters.<\/jats:p>","DOI":"10.1111\/risa.13634","type":"journal-article","created":{"date-parts":[[2020,11,15]],"date-time":"2020-11-15T01:22:55Z","timestamp":1605403375000},"page":"1728-1748","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":59,"title":["Monitoring Misinformation on Twitter During Crisis Events: A Machine Learning Approach"],"prefix":"10.1111","volume":"42","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7847-9715","authenticated-orcid":false,"given":"Kyle","family":"Hunt","sequence":"first","affiliation":[{"name":"Department of Industrial and Systems Engineering The State University of New York at Buffalo  Buffalo NY USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Puneet","family":"Agarwal","sequence":"additional","affiliation":[{"name":"Department of Industrial and Systems Engineering The State University of New York at Buffalo  Buffalo NY USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4830-6570","authenticated-orcid":false,"given":"Jun","family":"Zhuang","sequence":"additional","affiliation":[{"name":"Department of Industrial and Systems Engineering The State University of New York at Buffalo  Buffalo NY USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2020,11,14]]},"reference":[{"key":"e_1_2_8_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/BDCloud.2014.17"},{"key":"e_1_2_8_3_1","doi-asserted-by":"publisher","DOI":"10.1504\/IJWBC.2011.041206"},{"key":"e_1_2_8_4_1","doi-asserted-by":"publisher","DOI":"10.1111\/risa.13480"},{"key":"e_1_2_8_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819964"},{"key":"e_1_2_8_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.csda.2014.02.001"},{"key":"e_1_2_8_7_1","first-page":"373","volume-title":"Twitter and Society","author":"Bruns A.","year":"2014"},{"key":"e_1_2_8_8_1","doi-asserted-by":"publisher","DOI":"10.1108\/IntR-05-2012-0095"},{"key":"e_1_2_8_9_1","volume-title":"Proceedings of SDAIR\u201094, Third Annual Symposium on Document Analysis and Information Retrieval","author":"Cavnar W. B.","year":"1994"},{"key":"e_1_2_8_10_1","doi-asserted-by":"publisher","DOI":"10.1140\/epjb\/e2012-30483-5"},{"key":"e_1_2_8_11_1","doi-asserted-by":"publisher","DOI":"10.1177\/0002764217717561"},{"key":"e_1_2_8_12_1","volume-title":"Countering false information on social media in disasters and emergencies","author":"DHS","year":"2018"},{"key":"e_1_2_8_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2018.06.003"},{"key":"e_1_2_8_14_1","unstructured":"FEMA. (2017a).Harvey rumor control. Retrieved fromhttps:\/\/www.fema.gov\/disaster\/4332\/updates\/rumor-control"},{"key":"e_1_2_8_15_1","unstructured":"FEMA. (2017b).Hurricane Irma rumor control. Retrieved January 2019 fromhttps:\/\/www.fema.gov\/hurricane-irma-rumor-control"},{"key":"e_1_2_8_16_1","doi-asserted-by":"publisher","DOI":"10.1089\/153871303771861450"},{"key":"e_1_2_8_17_1","volume-title":"Social media use during disasters: A review of the knowledge base and gaps","author":"Fraustino J. D.","year":"2012"},{"key":"e_1_2_8_18_1","volume-title":"The elements of statistical learning","author":"Friedman J.","year":"2001"},{"key":"e_1_2_8_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185354.2185356"},{"key":"e_1_2_8_20_1","doi-asserted-by":"publisher","DOI":"10.1162\/153244303322753616"},{"key":"e_1_2_8_21_1","first-page":"71","volume-title":"Proceedings of the Fifth International Conference on Social Media Technologies, Communication, and Informatics","author":"Hamidian S.","year":"2015"},{"key":"e_1_2_8_22_1","doi-asserted-by":"publisher","DOI":"10.1111\/disa.12092"},{"issue":"1","key":"e_1_2_8_23_1","first-page":"34","article-title":"Fighting fake news during disasters","volume":"47","author":"Hunt K.","year":"2020","journal-title":"OR\/MS Today"},{"key":"e_1_2_8_24_1","volume-title":"Proceedings of the 2019 IISE Annual Conference","author":"Hunt K.","year":"2019"},{"issue":"9","key":"e_1_2_8_25_1","first-page":"28","article-title":"Tracking storms of misinformation spread amid disasters","volume":"51","author":"Hunt K.","year":"2019","journal-title":"ISE Magazine"},{"key":"e_1_2_8_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11069-020-04016-6"},{"key":"e_1_2_8_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICACCI.2016.7732347"},{"key":"e_1_2_8_28_1","doi-asserted-by":"publisher","DOI":"10.1080\/10485252.2017.1404598"},{"key":"e_1_2_8_29_1","doi-asserted-by":"crossref","unstructured":"Kochkina E. Liakata M. &Augenstein I.(2017).Turing at SemEval\u20102017 task 8 Sequential approach to rumour stance classification with branch\u2010LSTM.arXiv preprint arXiv:1704.07221.","DOI":"10.18653\/v1\/S17-2083"},{"key":"e_1_2_8_30_1","volume-title":"Content analysis: An introduction to its methodology","author":"Krippendorff K.","year":"2013"},{"key":"e_1_2_8_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2013.61"},{"key":"e_1_2_8_32_1","doi-asserted-by":"publisher","DOI":"10.1111\/risa.12407"},{"key":"e_1_2_8_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/HICSS.2015.240"},{"key":"e_1_2_8_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441842"},{"key":"e_1_2_8_35_1","doi-asserted-by":"publisher","DOI":"10.1111\/risa.12829"},{"key":"e_1_2_8_36_1","volume-title":"Feature selection for knowledge discovery and data mining","author":"Liu H.","year":"2012"},{"key":"e_1_2_8_37_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-2064"},{"key":"e_1_2_8_38_1","volume-title":"Risk communication: A handbook for communicating environmental, safety, and health risks","author":"Lundgren R. E.","year":"2018"},{"key":"e_1_2_8_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675280"},{"key":"e_1_2_8_40_1","volume-title":"CSCW 2015 Workshop on Ethics for Studying Sociotechnical Systems in a Big Data World","author":"Maddock J.","year":"2015"},{"key":"e_1_2_8_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2015.08.041"},{"key":"e_1_2_8_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1964858.1964869"},{"key":"e_1_2_8_43_1","doi-asserted-by":"publisher","DOI":"10.1080\/15536548.2009.10855867"},{"key":"e_1_2_8_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/HICSS.2013.576"},{"key":"e_1_2_8_45_1","doi-asserted-by":"publisher","DOI":"10.25300\/MISQ\/2013\/37.2.05"},{"key":"e_1_2_8_46_1","unstructured":"Park M. Allen K. Davidson L. &Turrell L.(2018).Hawaii false missile alert \u201cbutton pusher\u201d is fired. Retrieved fromhttps:\/\/www.cnn.com\/2018\/01\/30\/us\/hawaii-false-alarm-investigation\/index.html"},{"key":"e_1_2_8_47_1","doi-asserted-by":"publisher","DOI":"10.1080\/13645579.2013.774172"},{"key":"e_1_2_8_48_1","first-page":"1589","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing","author":"Qazvinian V.","year":"2011"},{"key":"e_1_2_8_49_1","unstructured":"Qiu L.(2017).Fact check: Manchester bombing rumors and hoaxes. Retrievedhttps:\/\/www.nytimes.com\/2017\/05\/24\/world\/europe\/fact-check-manchester-bombing-rumors-and-hoaxes.html."},{"key":"e_1_2_8_50_1","unstructured":"Sager J.(2013).10 Boston marathon bombing rumors that need to be stopped immediately. Retrieved fromhttps:\/\/thestir.cafemom.com\/crime\/154242\/10_boston_marathon_bombing_rumors"},{"key":"e_1_2_8_51_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444816634054"},{"key":"e_1_2_8_52_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijinfomgt.2015.07.001"},{"key":"e_1_2_8_53_1","doi-asserted-by":"publisher","DOI":"10.3390\/foods9040511"},{"key":"e_1_2_8_54_1","doi-asserted-by":"publisher","DOI":"10.1080\/01463373.2015.1012219"},{"key":"e_1_2_8_55_1","volume-title":"IConference 2014 Proceedings","author":"Starbird K.","year":"2014"},{"key":"e_1_2_8_56_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0121443"},{"key":"e_1_2_8_57_1","first-page":"2387","volume-title":"Annual Meeting of the Cognitive Science Society","author":"Tanaka Y.","year":"2012"},{"key":"e_1_2_8_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753486"},{"key":"e_1_2_8_59_1","doi-asserted-by":"publisher","DOI":"10.1111\/risa.13140"},{"key":"e_1_2_8_60_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.aap9559"},{"key":"e_1_2_8_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11069-017-2960-x"},{"key":"e_1_2_8_62_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11069-018-3344-6"},{"key":"e_1_2_8_63_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1539-6924.2010.01530.x"},{"key":"e_1_2_8_64_1","first-page":"35","volume-title":"Proceedings of ICML","author":"Yang Y.","year":"1997"},{"key":"e_1_2_8_65_1","doi-asserted-by":"publisher","DOI":"10.1002\/meet.14504701243"},{"key":"e_1_2_8_66_1","doi-asserted-by":"publisher","DOI":"10.4103\/0256-4602.113522"},{"key":"e_1_2_8_67_1","volume-title":"Tenth International AAAI Conference on Web and Social Media","author":"Zeng L.","year":"2016"},{"key":"e_1_2_8_68_1","first-page":"317","volume-title":"Proceedings of the 2015 International Conference on the Theory of Information Retrieval","author":"Zhang D."},{"key":"e_1_2_8_69_1","doi-asserted-by":"publisher","DOI":"10.1111\/hir.12115"},{"key":"e_1_2_8_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3161603"},{"key":"e_1_2_8_71_1","unstructured":"Zubiaga A. Kochkina E. Liakata M. Procter R. &Lukasik M.(2016a).Stance classification in rumours as a sequential task exploiting the tree structure of social media conversations.arXiv preprint arXiv:1609.09028."},{"key":"e_1_2_8_72_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0150989"}],"container-title":["Risk Analysis"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/risa.13634","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/risa.13634","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/am-pdf\/10.1111\/risa.13634","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/risa.13634","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,20]],"date-time":"2023-08-20T01:52:23Z","timestamp":1692496343000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/risa.13634"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,14]]},"references-count":71,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2022,8]]}},"alternative-id":["10.1111\/risa.13634"],"URL":"https:\/\/doi.org\/10.1111\/risa.13634","archive":["Portico"],"relation":{},"ISSN":["0272-4332","1539-6924"],"issn-type":[{"value":"0272-4332","type":"print"},{"value":"1539-6924","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,14]]},"assertion":[{"value":"2019-10-27","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-10-20","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-11-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}