{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T05:42:13Z","timestamp":1774330933064,"version":"3.50.1"},"reference-count":36,"publisher":"MIS Quarterly","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,3,1]]},"abstract":"<jats:p>The burgeoning interest in data mining has catalyzed a proliferation of innovative techniques in extracting useful information from unstructured data sources, such as text and images in social sciences. One typical research design involves a two-stage process. In the first stage, researchers apply the classification algorithm to predict an individual-level categorical variable. In the second stage, researchers aggregate the predicted values to construct a group-level variable for further regression analysis. For example, text classification has been applied to classify whether a review is positive or negative. The predicted review sentiment is aggregated at the product level as a focal independent variable in a regression model to examine the impact of the average review sentiment on product sales. Since the first-stage classification will inevitably have errors, the aggregated variable may suffer from a measurement error in the regression analysis. Our study attempts to systematically investigate the theoretical properties of the estimation bias and introduce solutions rooted in theory to mitigate the issue of measurement error. We propose one exact solution and two approximated solutions based on the central limit theorem (CLT) and the law of large numbers (LLN), respectively. Our theoretical analysis and experimentation confirm that the consistency of regression estimators can be recovered across all examined scenarios and the approximated solutions offer a significantly reduced computational complexity compared to the exact solution. We also provide heuristic guidelines to choose one of three solutions.<\/jats:p>","DOI":"10.25300\/misq\/2024\/18026","type":"journal-article","created":{"date-parts":[[2024,8,7]],"date-time":"2024-08-07T15:42:31Z","timestamp":1723045351000},"page":"29-60","source":"Crossref","is-referenced-by-count":3,"title":["Correcting Measurement Error in Regression Models with Variables Constructed from Aggregated Output of Data Mining Models"],"prefix":"10.25300","volume":"49","author":[{"given":"Mengke","family":"Qiao","sequence":"first","affiliation":[{"name":"Culverhouse College of Business, University of Alabama, Tuscaloosa, AL, U.S.A."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ke-Wei","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Computing, National University of Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"10933","published-online":{"date-parts":[[2025,3,1]]},"reference":[{"issue":"4","key":"2025082211033108900_b1-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"1093","DOI":"10.25300\/MISQ\/2013\/37.4.05","article-title":"Differential influence of blogs across different stages of decision making: The case of venture capitalists","volume":"37","author":"Aggarwal","year":"2013","journal-title":"MIS Quarterly"},{"issue":"2","key":"2025082211033108900_b2-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1137\/S0040585X97981123","article-title":"A Lyapunov-type bound in Rd.","volume":"49","author":"Bentkus","year":"2005","journal-title":"Theory of Probability & Its Applications"},{"key":"2025082211033108900_b3-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","DOI":"10.1201\/9781420066586","volume-title":"Measurement error: models, methods, and applications","author":"Buonaccorsi","year":"2010"},{"key":"2025082211033108900_b4-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","DOI":"10.1201\/9781420010138","volume-title":"Measurement error in nonlinear models: A modern perspective","author":"Carroll","year":"2006"},{"issue":"7","key":"2025082211033108900_b5-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"2973","DOI":"10.1287\/mnsc.2017.2756","article-title":"Hiring preferences in online labor markets: Evidence of a female hiring bias","volume":"64","author":"Chan","year":"2018","journal-title":"Management Science"},{"issue":"4","key":"2025082211033108900_b6-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"1165","DOI":"10.2307\/41703503","article-title":"Business intelligence and analytics: from big data to big impact","volume":"36","author":"Chen","year":"2012","journal-title":"MIS Quarterly"},{"key":"2025082211033108900_b7-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.293978","article-title":"Xgboost: A scalable tree boosting system","author":"Chen","year":"2016"},{"issue":"428","key":"2025082211033108900_b8-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"1314","DOI":"10.1080\/01621459.1994.10476871","article-title":"Simulation-extrapolation estimation in parametric measurement error models","volume":"89","author":"Cook","year":"1994","journal-title":"Journal of the American Statistical Association"},{"issue":"3","key":"2025082211033108900_b9-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"895","DOI":"10.25300\/MISQ\/2018\/1426","article-title":"The interaction between microblog sentiment and stock return: An empirical examination","volume":"42","author":"Deng","year":"2018","journal-title":"MIS Quarterly"},{"key":"2025082211033108900_b10-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","DOI":"10.1080\/00224065.1970.11980411","volume-title":"An introduction to probability theory and its applications","author":"Feller","year":"2008"},{"key":"2025082211033108900_b11-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","DOI":"10.1002\/9780470316665","volume-title":"Measurement Error Models","author":"Fuller","year":"1987"},{"issue":"10","key":"2025082211033108900_b12-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"1498","DOI":"10.1109\/TKDE.2010.188","article-title":"Estimating the helpfulness and economic impact of product reviews: Mining text and reviewer characteristics","volume":"23","author":"Ghose","year":"2011","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"issue":"3","key":"2025082211033108900_b13-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1287\/mksc.1110.0700","article-title":"Designing ranking systems for hotels on travel search engines by mining user-generated and crowdsourced content","volume":"31","author":"Ghose","year":"2012","journal-title":"Marketing Science"},{"key":"2025082211033108900_b14-02_ma_10_25300_misq_2024_18026","volume-title":"Econometric analysis","author":"Greene","year":"2012"},{"issue":"3","key":"2025082211033108900_b15-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"604","DOI":"10.1287\/isre.2014.0531","article-title":"Research note\u2014The allure of homophily in social media: Evidence from investor responses on virtual communities","volume":"25","author":"Gu","year":"2014","journal-title":"Information Systems Research"},{"issue":"1","key":"2025082211033108900_b16-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1287\/isre.1070.0114","article-title":"Competition among virtual communities and user valuation: The case of investing-related communities","volume":"18","author":"Gu","year":"2007","journal-title":"Information Systems Research"},{"key":"2025082211033108900_b17-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","DOI":"10.1145\/2872427.2883037","article-title":"Ups and downs: Modeling the visual evolution of fashion trends with one-class collaborative filtering","author":"He","year":"2016"},{"issue":"2","key":"2025082211033108900_b18-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"395","DOI":"10.25300\/MISQ\/2019\/13225","article-title":"Sharing is caring: Social support provision and companionship activities in healthcare virtual support communities","volume":"43","author":"Huang","year":"2019","journal-title":"MIS Quarterly"},{"issue":"1","key":"2025082211033108900_b19-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"187","DOI":"10.25300\/MISQ\/2014\/38.1.09","article-title":"Leveraging philanthropic behavior for customer support: The case of user support forums","volume":"38","author":"Jabr","year":"2014","journal-title":"MIS Quarterly"},{"issue":"1","key":"2025082211033108900_b20-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1111\/j.1541-0420.2005.00396.x","article-title":"A general method for dealing with misclassification in regression: The misclassification SIMEX","volume":"62","author":"K\u00fcchenhoff","year":"2006","journal-title":"Biometrics"},{"issue":"1","key":"2025082211033108900_b21-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"257","DOI":"10.25300\/MISQ\/2020\/15107","article-title":"Go to YouTube and call me in the morning: Use of social media for chronic conditions","volume":"44","author":"Liu","year":"2020","journal-title":"MIS Quarterly"},{"issue":"17","key":"2025082211033108900_b22-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"3366","DOI":"10.1002\/sim.3303","article-title":"Beta-binomial\/Poisson regression models for repeated bivariate counts","volume":"27","author":"Lora","year":"2008","journal-title":"Statistics in Medicine"},{"issue":"2","key":"2025082211033108900_b23-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1214\/10-BJPS118","article-title":"Beta-binomial\/gamma-Poisson regression models for repeated counts with random parameters","volume":"25","author":"Lora","year":"2011","journal-title":"Brazilian Journal of Probability and Statistics"},{"issue":"2","key":"2025082211033108900_b24-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"371","DOI":"10.25300\/MISQ\/2017\/41.2.03","article-title":"Expert blogs and consumer perceptions of competing brands","volume":"41","author":"Luo","year":"2013","journal-title":"MIS Quarterly"},{"issue":"1","key":"2025082211033108900_b25-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1214\/19-AOAS1283","article-title":"Modeling microbial abundances and dysbiosis with beta-binomial regression","volume":"14","author":"Martin","year":"2020","journal-title":"Annals of Applied Statistics"},{"issue":"4","key":"2025082211033108900_b26-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"865","DOI":"10.1214\/19-AOAS1283","article-title":"Doing business with strangers: Reputation in online service marketplaces","volume":"25","author":"Moreno","year":"2014","journal-title":"Information Systems Research"},{"issue":"1","key":"2025082211033108900_b27-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"88","DOI":"10.1198\/073500102753410417","article-title":"Estimation and inference in two-step econometric models","volume":"20","author":"Murphy","year":"2002","journal-title":"Journal of Business & Economic Statistics"},{"issue":"3","key":"2025082211033108900_b28-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"123","DOI":"10.3390\/econometrics2030123","article-title":"Two-part models for fractional responses defined as ratios of integers","volume":"2","author":"Oberhofer","year":"2014","journal-title":"Econometrics"},{"issue":"2","key":"2025082211033108900_b29-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"462","DOI":"10.1287\/isre.2020.0977","article-title":"Correcting misclassification bias in regression models with variables generated via data mining","volume":"32","author":"Qiao","year":"2021","journal-title":"Information Systems Research"},{"key":"2025082211033108900_b30-02_ma_10_25300_misq_2024_18026","volume-title":"Probability for dummies","author":"Rumsey","year":"2006"},{"issue":"1","key":"2025082211033108900_b31-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"23","DOI":"10.2307\/2685162","article-title":"Two rules of thumb for the approximation of the binomial distribution by the normal distribution","volume":"43","author":"Schader","year":"1989","journal-title":"The American Statistician"},{"issue":"1","key":"2025082211033108900_b32-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1287\/isre.2013.0509","article-title":"How to attract and retain readers in enterprise blogging?","volume":"25","author":"Singh","year":"2014","journal-title":"Information Systems Research"},{"issue":"3","key":"2025082211033108900_b33-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"745","DOI":"10.25300\/MISQ\/2019\/14420","article-title":"Operationalizing regulatory focus in the digital age: Evidence from an e-commerce context","volume":"43","author":"Wu","year":"2019","journal-title":"MIS Quarterly"},{"issue":"1","key":"2025082211033108900_b34-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1287\/isre.2017.0727","article-title":"Mind the gap: Accounting for measurement error and misclassification in variables generated via data mining","volume":"29","author":"Yang","year":"2018","journal-title":"Information Systems Research"},{"key":"2025082211033108900_b35-02_ma_10_25300_misq_2024_18026","article-title":"How much is an image worth? An empirical analysis of property\u2019s image aesthetic quality on demand at AirBNB","author":"Zhang","year":"2016"},{"issue":"4","key":"2025082211033108900_b36-02_ma_10_25300_misq_2024_18026","doi-asserted-by":"publisher","first-page":"955","DOI":"10.1111\/j.0006-341X.2003.00110.x","article-title":"Modeling the dependence between number of trials and success probability in beta-binomial-Poisson mixture distributions","volume":"59","author":"Zhu","year":"2003","journal-title":"Biometrics"}],"container-title":["MIS Quarterly"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/misq.umn.edu\/misq\/article-pdf\/49\/1\/29\/1774\/02_ma_10.25300_misq_2024_18026.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/misq.umn.edu\/misq\/article-pdf\/49\/1\/29\/1774\/02_ma_10.25300_misq_2024_18026.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T15:03:38Z","timestamp":1755875018000},"score":1,"resource":{"primary":{"URL":"https:\/\/misq.umn.edu\/misq\/article\/49\/1\/29\/89\/Correcting-Measurement-Error-in-Regression-Models"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,1]]},"references-count":36,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,3,1]]},"published-print":{"date-parts":[[2025,3,1]]}},"URL":"https:\/\/doi.org\/10.25300\/misq\/2024\/18026","relation":{},"ISSN":["0276-7783","2162-9730"],"issn-type":[{"value":"0276-7783","type":"print"},{"value":"2162-9730","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,1]]}}}