{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T14:49:44Z","timestamp":1776350984975,"version":"3.51.2"},"reference-count":52,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,11,30]],"date-time":"2021-11-30T00:00:00Z","timestamp":1638230400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM\/IMS Trans. Data Sci."],"published-print":{"date-parts":[[2021,11,30]]},"abstract":"<jats:p>Measures of public opinion on economic matters are vital in creating accurate official statistics needed to design appropriate policy interventions and shape private investment decisions. This is traditionally done using public opinion polls and representative surveys. However, this process is time and money intensive and currently suffers from reduced public participation. As a result, official statistics are usually delayed and are not frequently available at the resolution needed for better policy interventions. Hence, researchers have looked into anonymized digital data to continuously sense information about public behaviors, especially those related to consumer sentiment index and unemployment insurance claims. However, past studies relied on linear models with simplistic assumptions and thus provided limited extrapolatory power and no insights as to why these predictive methods work. Worryingly, the strong correlations reported in these studies disappeared when the original models were tested with newer social media data.<\/jats:p>\n                  <jats:p>We propose a novel interpretable machine learning model, called Group Additive Gaussian Processes, to provide accurate and near real-time estimates of economic indicators about public behaviors using social media data, along with insights into the model behavior. Our model exploits the underlying structure in data and encodes interpretability in the modeling framework. It is based on Gaussian Process regression, which provides a robust non-parametric Bayesian learning framework that produces calibrated uncertainty measures along with its predictions. A key challenge in the learning task is learning from limited training data. We demonstrate how our model not only learns but also generalizes well in these scenarios. Through extensive evaluation we show how our model performs on two important indicators of economic health-consumer confidence index and unemployment insurance claims data. Further, we demonstrate how our model can reduce the need to conduct surveys by producing highly accurate and frequent estimates in between the surveying periods.<\/jats:p>","DOI":"10.1145\/3498332","type":"journal-article","created":{"date-parts":[[2022,3,17]],"date-time":"2022-03-17T03:16:17Z","timestamp":1647486977000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["An Interpretable Model for Real-time Tracking of Economic Indicators Using Social Media Data"],"prefix":"10.1145","volume":"2","author":[{"given":"Neeti","family":"Pokhriyal","sequence":"first","affiliation":[{"name":"Dartmouth College, Hanover, NH"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Benjamin","family":"Valentino","sequence":"additional","affiliation":[{"name":"Dartmouth College, Hanover, NH"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Soroush","family":"Vosoughi","sequence":"additional","affiliation":[{"name":"Dartmouth College, Hanover, NH"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,3,17]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.3386\/w20010"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313634"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/3343038"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.drugalcdep.2018.10.014"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1177\/0002716212456834"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/UIC-ATC.2017.8397411"},{"key":"e_1_3_2_8_2","unstructured":"Hyunyoung Choi and Hal Varian. 2009. Predicting Initial Claims for Unemployment Benefits. Retrieved from https:\/\/ssrn.com\/abstract=1659307."},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1475-4932.2012.00809.x"},{"key":"e_1_3_2_10_2","volume-title":"Proceedings of the 27th International Conference on Computational Linguistics","author":"Cohan Arman","year":"2018","unstructured":"Arman Cohan, Bart Desmet, Andrew Yates, Luca Soldaini, Sean MacAvaney, and Nazli Goharian. 2018. SMHD: A large-scale resource for exploring online language usage for multiple mental health conditions. In Proceedings of the 27th International Conference on Computational Linguistics."},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1177\/0894439319875692"},{"key":"e_1_3_2_12_2","article-title":"The university of michigan\u2019s consumer sentiment index","author":"Curtin Richard","year":"2007","unstructured":"Richard Curtin. 2007. The university of michigan\u2019s consumer sentiment index. In Encyclopedia of Survey Research Methods.","journal-title":"Encyclopedia of Survey Research Methods"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-007-0753-5_542"},{"key":"e_1_3_2_14_2","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Delbridge Ian A.","year":"2020","unstructured":"Ian A. Delbridge, David S. Bindel, and Andrew Gordon Wilson. 2020. Randomly projected additive gaussian processes for regression. In Proceedings of the International Conference on Machine Learning."},{"key":"e_1_3_2_15_2","volume-title":"Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)."},{"key":"e_1_3_2_16_2","doi-asserted-by":"crossref","unstructured":"Xianlen Dong and Johan Bollen. 2015. Computational models of consumer confidence from large-scale online attention data: Crowd-sourcing econometrics. PLoS ONE 10 3(2015) e0120039.","DOI":"10.1371\/journal.pone.0120039"},{"key":"e_1_3_2_17_2","volume-title":"Automatic Model Construction with Gaussian Processes","author":"Duvenaud David","year":"2014","unstructured":"David Duvenaud. 2014. Automatic Model Construction with Gaussian Processes. Ph.D. Dissertation. University of Cambridge."},{"key":"e_1_3_2_18_2","first-page":"226","volume-title":"Advances in Neural Information Processing Systems","author":"Duvenaud David K.","year":"2011","unstructured":"David K. Duvenaud, Hannes Nickisch, and Carl E. Rasmussen. 2011. Additive gaussian processes. In Advances in Neural Information Processing Systems. 226\u2013234."},{"key":"e_1_3_2_19_2","first-page":"1311","volume-title":"Proceedings of the 20th International Conference on Artificial Intelligence and Statistics","volume":"54","author":"Gardner Jacob","year":"2017","unstructured":"Jacob Gardner, Chuan Guo, Kilian Weinberger, Roman Garnett, and Roger Grosse. 2017. Discovering and exploiting additive structure for bayesian optimization. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, Vol. 54. 1311\u20131319."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.3233\/AF-160055"},{"key":"e_1_3_2_21_2","article-title":"A survey of methods for explaining black box models","author":"Guidotti Riccardo","year":"2018","unstructured":"Riccardo Guidotti, Anna Monreale, Salvatore Ruggieri, Franco Turini, Fosca Giannotti, and Dino Pedreschi. 2018. A survey of methods for explaining black box models. Comput. Surv. 51, 5 (2018), 1\u201342.","journal-title":"Comput. Surv."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v8i1.14550"},{"key":"e_1_3_2_23_2","doi-asserted-by":"crossref","unstructured":"Nur Shazwani Kamarudin Vineeth Rakesh Ghazaleh Beigi Lydia Manikouda and Huan Liu. 2018. A study of reddit-user\u2019s response to rape. In Proceedings of the 2018 IEEE\/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM\u201918).","DOI":"10.1109\/ASONAM.2018.8508855"},{"key":"e_1_3_2_24_2","first-page":"295","volume-title":"Proceedings of the 32nd International Conference on Machine Learning","volume":"37","author":"Kandasamy Kirthevasan","year":"2015","unstructured":"Kirthevasan Kandasamy, Jeff Schneider, and Barnabas Poczos. 2015. High dimensional bayesian optimisation and bandits via additive models. In Proceedings of the 32nd International Conference on Machine Learning, Vol. 37. 295\u2013304."},{"issue":"1","key":"e_1_3_2_25_2","first-page":"1","article-title":"A deep learning model for detecting mental illness from user content on social media","volume":"10","author":"Kim Jina","year":"2020","unstructured":"Jina Kim, Jieon Lee, Eunil Park, and Jinyoung Han. 2020. A deep learning model for detecting mental illness from user content on social media. Sci. Rep. 10, 1 (2020), 1\u20136.","journal-title":"Sci. Rep."},{"key":"e_1_3_2_26_2","volume-title":"Proceedings of the 31st International Conference on Machine Learning","author":"Le Quoc","year":"2014","unstructured":"Quoc Le and Tomas Mikolov. 2014. Distributed representations of sentences and documents. In Proceedings of the 31st International Conference on Machine Learning."},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICAIIC48513.2020.9065045"},{"key":"e_1_3_2_28_2","article-title":"Twitter for sparking a movement, reddit for sharing the moment:# metoo through the lens of social media","author":"Manikonda Lydia","year":"2018","unstructured":"Lydia Manikonda, Ghazaleh Beigi, Huan Liu, and Subbarao Kambhampati. 2018. Twitter for sparking a movement, reddit for sharing the moment:# metoo through the lens of social media. arXiv:1803.08022. Retrieved from https:\/\/arxiv.org\/abs\/1803.08022.","journal-title":"arXiv:1803.08022"},{"key":"e_1_3_2_29_2","doi-asserted-by":"crossref","unstructured":"Wagner Meira Antonio L. P. Ribeiro Derick M. Oliveira and Antonio H. Ribeiro. 2020. Contextualized interpretable machine learning for medical diagnosis. Communications of the ACM 63 11 (2020) 56\u201358.","DOI":"10.1145\/3416965"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1900654116"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v4i1.14031"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.8219"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.4324\/9781351209434-5"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1093\/poq\/nfy030"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v14i1.7322"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-5212"},{"key":"e_1_3_2_37_2","volume-title":"The Development and Psychometric Properties of LIWC2015","author":"Pennebaker James W.","year":"2015","unstructured":"James W. Pennebaker, Ryan L. Boyd, Kayla Jordan, and Kate Blackburn. 2015. The Development and Psychometric Properties of LIWC2015. Technical Report. University of Texas at Austin."},{"key":"e_1_3_2_38_2","volume-title":"Detrended Cross-Correlation Analysis: A New Method for Analyzing Two Non-stationary Time Series","author":"Podobnik Boris","year":"2007","unstructured":"Boris Podobnik and H. Eugene Stanley. 2007. Detrended Cross-Correlation Analysis: A New Method for Analyzing Two Non-stationary Time Series. Technical Report."},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/3383455.3422556"},{"key":"e_1_3_2_40_2","doi-asserted-by":"crossref","unstructured":"Shalini Priya. 2018. Where should one get news updates: Twitter or reddit. Online Social Networks and Media. 9 1 (2019) 17\u201329.","DOI":"10.1016\/j.osnem.2018.11.001"},{"key":"e_1_3_2_41_2","unstructured":"Shaan Qamar and Surya T. Tokdar. 2014. Additive Gaussian Process Regression. arXiv:1411.7009. Retrieved from https:\/\/arxiv.org\/abs\/1411.7009."},{"key":"e_1_3_2_42_2","first-page":"63","volume-title":"Summer School on Machine Learning","author":"Rasmussen Carl Edward","year":"2003","unstructured":"Carl Edward Rasmussen. 2003. Gaussian processes in machine learning. In Summer School on Machine Learning. Springer, 63\u201371."},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1410"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_3_2_45_2","volume-title":"Proceedings of 21st International Conference on Artificial Intelligence and Statistics","volume":"84","author":"Rolland Paul","year":"2018","unstructured":"Paul Rolland, Jonathan Scarlett, Ilija Bogunovic, and Volkan Cevher. 2018. High-dimensional bayesian optimization via additive models with overlapping groups. In Proceedings of 21st International Conference on Artificial Intelligence and Statistics, Vol. 84."},{"key":"e_1_3_2_46_2","volume-title":"Forecasting Private Consumption: Survey-based Indicators vs. Google Trends","author":"Schmidt Torsten","year":"2009","unstructured":"Torsten Schmidt and Simeon Vosen. 2009. Forecasting Private Consumption: Survey-based Indicators vs. Google Trends. Ruhr Economic Papers. RWI\u2013Leibniz-Institut f\u00fcr Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen."},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1093\/poq\/nfv048"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1309"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1093\/poq\/nfx007"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1177\/0261927X09351676"},{"key":"e_1_3_2_51_2","volume-title":"Unemployment? Google it! Analyzing the Usability of Google Queries in Order to Predict Unemployment","author":"Brake Gijs te","year":"2017","unstructured":"Gijs te Brake. 2017. Unemployment? Google it! Analyzing the Usability of Google Queries in Order to Predict Unemployment. Master\u2019s thesis. Universitat de Barcelona."},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/3343039"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-6213"}],"container-title":["ACM\/IMS Transactions on Data Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3498332","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3498332","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T13:55:39Z","timestamp":1776347739000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3498332"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,30]]},"references-count":52,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,11,30]]}},"alternative-id":["10.1145\/3498332"],"URL":"https:\/\/doi.org\/10.1145\/3498332","relation":{},"ISSN":["2691-1922"],"issn-type":[{"value":"2691-1922","type":"print"}],"subject":[],"published":{"date-parts":[[2021,11,30]]},"assertion":[{"value":"2020-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-11-01","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-03-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}