{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:34:46Z","timestamp":1750221286029,"version":"3.41.0"},"reference-count":66,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2018,3,31]],"date-time":"2018-03-31T00:00:00Z","timestamp":1522454400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Data and Information Quality"],"published-print":{"date-parts":[[2018,3,31]]},"abstract":"<jats:p>\n            Data from Twitter have been employed in prior research to study the impacts of events. Conventionally, researchers use keyword-based samples of tweets to create a panel of Twitter users who mention event-related keywords during and after an event. However, the keyword-based sampling is limited in its\n            <jats:italic>objectivity<\/jats:italic>\n            dimension of data and information quality. First, the technique suffers from selection bias since users who discuss an event are already more likely to discuss event-related topics beforehand. Second, there are no viable control groups for comparison to a keyword-based sample of Twitter users. We propose an alternative sampling approach to construct panels of users defined by their geolocation.\n            <jats:italic>Geolocated panels<\/jats:italic>\n            are exogenous to the keywords in users\u2019 tweets, resulting in less selection bias than the keyword panel method. Geolocated panels allow us to follow within-person changes over time and enable the creation of comparison groups. We compare different panels in two real-world settings: response to mass shootings and TV advertising. We first show the strength of the selection biases of keyword panels. Then, we empirically illustrate how geolocated panels reduce selection biases and allow meaningful comparison groups regarding the impact of the studied events. We are the first to provide a clear, empirical example of how a better panel selection design, based on an exogenous variable such as geography, both reduces selection bias compared to the current state of the art and increases the value of Twitter research for studying events. While we advocate for the use of a geolocated panel, we also discuss its weaknesses and application scenario seriously. This article also calls attention to the importance of selection bias in impacting the objectivity of social media data.\n          <\/jats:p>","DOI":"10.1145\/3185048","type":"journal-article","created":{"date-parts":[[2018,5,29]],"date-time":"2018-05-29T12:24:26Z","timestamp":1527596666000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Addressing Selection Bias in Event Studies with General-Purpose Social Media Panels"],"prefix":"10.1145","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2912-8780","authenticated-orcid":false,"given":"Han","family":"Zhang","sequence":"first","affiliation":[{"name":"Princeton University, Princeton, New Jersey, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shawndra","family":"Hill","sequence":"additional","affiliation":[{"name":"Microsoft Research, New York, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Rothschild","sequence":"additional","affiliation":[{"name":"Microsoft Research, New York, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,5,29]]},"reference":[{"volume-title":"Proceedings of the International Conference on Information Quality (ICIQ\u201910)","year":"2010","author":"Agarwal Nitin","key":"e_1_2_1_1_1"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1140\/epjds\/s13688-015-0058-9"},{"volume-title":"Angrist and J\u00f6rn-Steffen Pischke","year":"2008","author":"Joshua","key":"e_1_2_1_3_1"},{"key":"e_1_2_1_4_1","first-page":"370","article-title":"Dissecting the spirit of Gezi: Influence vs. selection in the occupy Gezi movement","volume":"2","author":"Budak Ceren","year":"2015","journal-title":"Soc. Sci."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.2121"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/PASSAT\/SocialCom.2011.120"},{"volume-title":"Social Informatics","author":"Chen Lu","key":"e_1_2_1_7_1"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2020408.2020579"},{"volume-title":"Ma Nang Laik, and Koo Ping Shung","year":"2011","author":"Choy Murphy","key":"e_1_2_1_9_1"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2396761.2398519"},{"volume-title":"Proceedings of theJoint Statistical Meetings.","year":"2014","author":"Culotta A.","key":"e_1_2_1_11_1"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2145204.2145242"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0145406"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0079449"},{"key":"e_1_2_1_15_1","first-page":"363","article-title":"Sadness shifts to anxiety over time and distance from the national tragedy in Newtown","volume":"26","author":"Dor\u00e9 Bruce","year":"2015","journal-title":"Connecticut. Psycholog. Sci."},{"volume-title":"Natural Experiments in the Social Sciences: A Design-Based Approach","author":"Dunning Thad","key":"e_1_2_1_16_1","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139084444"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2700171.2791033"},{"volume-title":"Proceedings of the Pacific Asia Conference on Information Systems (PACIS\u201913)","year":"2013","author":"Emamjome Fahame F.","key":"e_1_2_1_18_1"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2684822.2685296"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2001269.2001297"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1093\/pan\/2.1.131"},{"key":"e_1_2_1_22_1","doi-asserted-by":"crossref","unstructured":"Jeremy Ginsberg Matthew H. Mohebbi Rajan S. Patel Lynnette Brammer Mark S. Smolinski and Larry Brilliant. 2009. Detecting influenza epidemics using search engine query data. Nature 457 7232 1012--1014.  Jeremy Ginsberg Matthew H. Mohebbi Rajan S. Patel Lynnette Brammer Mark S. Smolinski and Larry Brilliant. 2009. Detecting influenza epidemics using search engine query data. Nature 457 7232 1012--1014.","DOI":"10.1038\/nature07634"},{"key":"e_1_2_1_23_1","first-page":"2","article-title":"In defense of forensic social science","volume":"2","author":"Goldberg Amir","year":"2015","journal-title":"BD&S"},{"key":"e_1_2_1_24_1","doi-asserted-by":"crossref","unstructured":"Marta C. Gonz\u00e1lez C\u00e9sar A. Hidalgo and Albert-L\u00e1szl\u00f3 Barab\u00e1si. 2008. Understanding individual human mobility patterns. Nature 453 7196 779--782.  Marta C. Gonz\u00e1lez C\u00e9sar A. Hidalgo and Albert-L\u00e1szl\u00f3 Barab\u00e1si. 2008. Understanding individual human mobility patterns. Nature 453 7196 779--782.","DOI":"10.1038\/nature06958"},{"volume-title":"Chi","year":"2011","author":"Hecht Brent","key":"e_1_2_1_25_1"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.2307\/1912352"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2771588"},{"volume-title":"Analyzing Political Communication with Digital Trace Data: The Role of Twitter Messages in Social Science Research","author":"Jungherr Andreas","key":"e_1_2_1_28_1","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-20319-5"},{"volume-title":"Proceedings of the 9th International AAAI Conference on Weblogs and Social Media (ICWSM\u201915)","year":"2015","author":"Jurgens David","key":"e_1_2_1_29_1"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487788.2488172"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1093\/pan\/mpu014"},{"volume-title":"Proceedings of the 8th International AAAI Conference on Weblogs and Social Media.","year":"2014","author":"K\u0131c\u0131man Emre","key":"e_1_2_1_32_1"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2631775.2631824"},{"volume-title":"Designing Social Inquiry: Scientific Inference in Qualitative Research","author":"King Gary","key":"e_1_2_1_34_1","doi-asserted-by":"crossref","DOI":"10.1515\/9781400821211"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2648584.2648591"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-008-0114-1"},{"volume-title":"Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (ACL\u201913)","year":"2013","author":"Lampos Vasileios","key":"e_1_2_1_37_1"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2187836.2187871"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2600428.2609582"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2488388.2488453"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1993.10476368"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2505515.2505695"},{"volume-title":"Proceedings of the 5th International AAAI Conference on Weblogs and Social Media.","author":"Mislove Alan","key":"e_1_2_1_43_1"},{"volume-title":"Morgan and Christopher Winship","year":"2014","author":"Stephen","key":"e_1_2_1_44_1"},{"volume-title":"Carley","year":"2013","author":"Morstatter Fred","key":"e_1_2_1_45_1"},{"volume-title":"Proceedings of the 4th International AAAI Conference on Weblogs and Social Media. 122--129","author":"O\u2019Connor Brendan","key":"e_1_2_1_46_1"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1964858.1964859"},{"volume-title":"Proceedings of the 8th International AAAI Conference on Weblogs and Social Media (ICWSM\u201914)","year":"2014","author":"Olteanu Alexandra","key":"e_1_2_1_48_1"},{"volume-title":"Proceedings of the 9th International AAAI Conference on Web and Social Media.","year":"2015","author":"Park Minsu","key":"e_1_2_1_49_1"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772777"},{"volume-title":"Proceedings of the Workshop on Semantic Analysis in Social Media. 53--60","year":"2012","author":"Kim Sang Erik Tjong","key":"e_1_2_1_51_1"},{"volume-title":"Model Assisted Survey Sampling","author":"S\u00e4rndal Carl-Erik","key":"e_1_2_1_52_1"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1177\/0049124108327128"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2996198"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0019467"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/HICSS.2012.607"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1086\/267075"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASONAM.2012.99"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.21462"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623670"},{"volume-title":"Proceedings of the 8th International AAAI Conference on Weblogs and Social Media.","year":"2014","author":"Tufekci Zeynep","key":"e_1_2_1_61_1"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1080\/07421222.1996.11518099"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijforecast.2014.06.001"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2492517.2492557"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.so.18.080192.001551"},{"volume-title":"Proceedings of the Annual Meeting of the ASA.","year":"2015","author":"Zhang Han","key":"e_1_2_1_66_1"}],"container-title":["Journal of Data and Information Quality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3185048","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3185048","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:11:25Z","timestamp":1750212685000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3185048"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,3,31]]},"references-count":66,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2018,3,31]]}},"alternative-id":["10.1145\/3185048"],"URL":"https:\/\/doi.org\/10.1145\/3185048","relation":{},"ISSN":["1936-1955","1936-1963"],"issn-type":[{"type":"print","value":"1936-1955"},{"type":"electronic","value":"1936-1963"}],"subject":[],"published":{"date-parts":[[2018,3,31]]},"assertion":[{"value":"2017-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-05-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}