{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T14:50:41Z","timestamp":1776351041086,"version":"3.51.2"},"reference-count":49,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2020,5,31]],"date-time":"2020-05-31T00:00:00Z","timestamp":1590883200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"DARPA D3M program and NSF","award":["OAC-1640864"],"award-info":[{"award-number":["OAC-1640864"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM\/IMS Trans. Data Sci."],"published-print":{"date-parts":[[2020,5,31]]},"abstract":"<jats:p>\n                    We propose\n                    <jats:italic toggle=\"yes\">Predictable Outliers in Data-trendS (PODS)<\/jats:italic>\n                    , a method that, given a collection of temporal datasets, derives data-driven explanations for outliers by identifying\n                    <jats:italic toggle=\"yes\">meaningful<\/jats:italic>\n                    relationships between them. First, we formalize the notion of meaningfulness, which so far has been informally framed in terms of explainability. Next, since outliers are rare and it is difficult to determine whether their relationships are meaningful, we develop a new criterion that does so by checking if these relationships could have been predicted from non-outliers, i.e., whether\n                    <jats:italic toggle=\"yes\">we could see the outlier relationships coming<\/jats:italic>\n                    . Finally, searching for meaningful outlier relationships between every pair of datasets in a large data collection is computationally infeasible. To address that, we propose an indexing strategy that prunes irrelevant comparisons across datasets, making the approach scalable. We present the results of an experimental evaluation using real datasets and different baselines, which demonstrates the effectiveness, robustness, and scalability of our approach.\n                  <\/jats:p>","DOI":"10.1145\/3385192","type":"journal-article","created":{"date-parts":[[2020,6,12]],"date-time":"2020-06-12T14:06:31Z","timestamp":1591970791000},"page":"1-33","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Effective Discovery of Meaningful Outlier Relationships"],"prefix":"10.1145","volume":"1","author":[{"given":"Aline","family":"Bessa","sequence":"first","affiliation":[{"name":"New York University, Brooklyn, New York"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Juliana","family":"Freire","sequence":"additional","affiliation":[{"name":"New York University, Brooklyn, New York"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tamraparni","family":"Dasu","sequence":"additional","affiliation":[{"name":"AT8T Labs-Research, Bedminster, NJ"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Divesh","family":"Srivastava","sequence":"additional","affiliation":[{"name":"AT8T Labs-Research, Bedminster, NJ"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,6,12]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"311-heating-complaint [n.d.]. Heat or Hot Water Complaint. Retrieved from https:\/\/www1.nyc.gov\/nyc-resources\/service\/1813\/heat-or-hot-water-complaint."},{"key":"e_1_2_1_2_1","volume-title":"Outlier Analysis","author":"Aggarwal Charu C.","unstructured":"Charu C. Aggarwal. 2013. Outlier Analysis. Springer."},{"key":"e_1_2_1_3_1","volume-title":"Modern Information Retrieval","author":"Baeza-Yates Ricardo","unstructured":"Ricardo Baeza-Yates and Berthier Ribeiro-Neto. 2011. Modern Information Retrieval (2nd ed.). Pearson Addison Wesley, Harlow, England.","edition":"2"},{"key":"e_1_2_1_4_1","doi-asserted-by":"crossref","unstructured":"Peter Bailis Edward Gan Samuel Madden Deepak Narayanan Kexin Rong and Sahaana Suri. 2017. MacroBase: Prioritizing attention in fast data. In SIGMOD. 541--556.","DOI":"10.1145\/3035918.3035928"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1089\/big.2014.0020"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.22158\/wjssr.v3n1p37"},{"key":"e_1_2_1_7_1","article-title":"Power failure: Why small sample size undermines the reliability of neuroscience","volume":"14","author":"Button Katherine","year":"2013","unstructured":"Katherine Button, John Ioannidis, Claire Mokrysz, Brian Nosek, Jonathan Flint, Emma Robinson, and Marcus Munafo. 2013. Power failure: Why small sample size undermines the reliability of neuroscience. Nat. Rev. Neurosci. 14, 04 (2013).","journal-title":"Nat. Rev. Neurosci."},{"key":"e_1_2_1_8_1","unstructured":"Chicago 2018. City of Chicago Data Portal. Retrieved from https:\/\/data.cityofchicago.org."},{"key":"e_1_2_1_9_1","doi-asserted-by":"crossref","unstructured":"Fernando Chirigati Harish Doraiswamy Theodoros Damoulas and Juliana Freire. 2016. Data polygamy: The many-many relationships among urban spatio-temporal data sets. In SIGMOD. 1011--1025.","DOI":"10.1145\/2882903.2915245"},{"key":"e_1_2_1_10_1","volume-title":"Statistical Power Analysis for the Behavioral Sciences","author":"Cohen Jacob","unstructured":"Jacob Cohen. 1988. Statistical Power Analysis for the Behavioral Sciences. Routledge."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.112.1.155"},{"key":"e_1_2_1_12_1","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-40270-8","volume-title":"Ng","author":"Dang Xuan-Hong","year":"2013","unstructured":"Xuan-Hong Dang, Barbora Micenkov\u00e1, Ira Assent, and Raymond T. Ng. 2013. Local outlier detection with interpretation. In ECML\/PKDD (3), Lecture Notes in Computer Science, Vol. 8190. Springer, 304--320."},{"key":"e_1_2_1_13_1","volume-title":"Exploratory Data Mining and Data Cleaning","author":"Dasu Tamraparni","unstructured":"Tamraparni Dasu and Theodore Johnson. 2003. Exploratory Data Mining and Data Cleaning. John Wiley."},{"key":"e_1_2_1_14_1","volume-title":"Ji Meng Loh, and Divesh Srivastava","author":"Dasu Tamraparni","year":"2014","unstructured":"Tamraparni Dasu, Ji Meng Loh, and Divesh Srivastava. 2014. Empirical glitch explanations. In KDD. ACM, 572--581."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.14778\/2824032.2824070"},{"key":"e_1_2_1_16_1","volume-title":"Tibshirani","author":"Efron Bradley","year":"1993","unstructured":"Bradley Efron and Robert J. Tibshirani. 1993. An Introduction to the Bootstrap. Number 57 in Monographs on Statistics and Applied Probability. Chapman 8 Hall\/CRC, Boca Raton, FL."},{"key":"e_1_2_1_17_1","volume-title":"C","author":"Ellen Ingrid Gould","year":"2013","unstructured":"Ingrid Gould Ellen, Johanna Lacoe, and Claudia Ayanna Sharygin. 2013. Do foreclosures cause crime? J. Urban Econ. 74, C (2013), 59--70."},{"key":"e_1_2_1_18_1","volume-title":"Beyond Transparency: Open Data and the Future of Civic Innovation","author":"Goldstein Brett","year":"2013","unstructured":"Brett Goldstein and Lauren Dyson. 2013. Beyond Transparency: Open Data and the Future of Civic Innovation. Code for America Press."},{"key":"e_1_2_1_19_1","volume-title":"Probability and Random Processes for Electrical and Computer Engineers","author":"Gubner John A.","unstructured":"John A. Gubner. 2006. Probability and Random Processes for Electrical and Computer Engineers. Cambridge University Press."},{"key":"e_1_2_1_20_1","volume-title":"Time Series Analysis","author":"Hamilton James Douglas","unstructured":"James Douglas Hamilton. 1994. Time Series Analysis. Vol. 2. Princeton University Press Princeton, NJ."},{"key":"e_1_2_1_21_1","volume-title":"The Elements of Statistical Learning","author":"Hastie Trevor","unstructured":"Trevor Hastie, Robert Tibshirani, and Jerome Friedman. 2001. The Elements of Statistical Learning. Springer, New York."},{"key":"e_1_2_1_22_1","volume-title":"The Elements of Statistical Learning: Data Mining, Inference and Prediction","author":"Hastie Trevor","unstructured":"Trevor Hastie, Robert Tibshirani, and Jerome Friedman. 2009. The Elements of Statistical Learning: Data Mining, Inference and Prediction (2nd ed.). Springer.","edition":"2"},{"key":"e_1_2_1_23_1","volume-title":"An adaptive information-theoretic approach for identifying temporal correlations in big data sets","author":"Ho Nguyen","unstructured":"Nguyen Ho, Huy Vo, and Mai Vu. 2016. An adaptive information-theoretic approach for identifying temporal correlations in big data sets. In IEEE Big Data. IEEE Computer Society, 666--675."},{"key":"e_1_2_1_24_1","volume-title":"How to Detect and Handle Outliers","author":"Iglewicz Boris","unstructured":"Boris Iglewicz and David Hoaglin. 1993. How to Detect and Handle Outliers. American Society for Quality Control, Milwaukee, WI."},{"key":"e_1_2_1_25_1","volume-title":"Ng","author":"Knorr Edwin M.","year":"1999","unstructured":"Edwin M. Knorr and Raymond T. Ng. 1999. Finding intensional knowledge of distance-based outliers. In VLDB. 211--222."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/s007780050007"},{"key":"e_1_2_1_27_1","doi-asserted-by":"crossref","unstructured":"Hans-Peter Kriegel Peer Kroger Erich Schubert and Arthur Zimek. 2009. LoOP: Local outlier probabilities. In CIKM. 1649--1652.","DOI":"10.1145\/1645953.1646195"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.14778\/3352063.3352071"},{"key":"e_1_2_1_29_1","volume-title":"Machine Learning : A Probabilistic Perspective","author":"Murphy Kevin P.","unstructured":"Kevin P. Murphy. 2013. Machine Learning : A Probabilistic Perspective. MIT Press."},{"key":"e_1_2_1_30_1","unstructured":"New York City [n.d.]. NYC Vision Zero Initiative. Retrieved from http:\/\/www1.nyc.gov\/site\/visionzero\/index.page."},{"key":"e_1_2_1_31_1","unstructured":"New York City 2018. NYC Open Data. Retrieved from https:\/\/opendata.cityofnewyork.us\/."},{"key":"e_1_2_1_32_1","unstructured":"nyc-summer-eat-out 2019. The Best Time to Eat Out in NYC Is in the Summer. Retrieved from https:\/\/ny.eater.com\/2019\/6\/14\/18638711\/summer-dining-in-nyc-best."},{"key":"e_1_2_1_33_1","unstructured":"ParisData [n.d.]. Paris Data. Retieved from https:\/\/opendata.paris.fr."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1080\/00031305.1994.10476030"},{"key":"e_1_2_1_35_1","volume-title":"Linear Statistical Inference and Its Applications","author":"Rao C. R.","unstructured":"C. R. Rao. 1973. Linear Statistical Inference and Its Applications. Wiley, New York."},{"key":"e_1_2_1_36_1","unstructured":"restaurant-inspection [n.d.]. Food Establishment Inspections. Retrieved from https:\/\/www1.nyc.gov\/site\/doh\/services\/restaurant-grades.page."},{"key":"e_1_2_1_37_1","unstructured":"RioOpenData [n.d.]. Portal de Armazenamento de Dados\u2014Rio de Janeiro. Retrieved from http:\/\/www.data.rio."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1080\/00401706.1959.10489860"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.14778\/2856318.2856329"},{"key":"e_1_2_1_40_1","unstructured":"San Francisco 2018. San Francisco Open Data. Retrieved from https:\/\/datasf.org\/opendata\/."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1080\/10511482.2002.9521454"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11524-017-0181-y"},{"key":"e_1_2_1_43_1","doi-asserted-by":"crossref","unstructured":"Ramakrishnan Srikant and Rakesh Agrawal. 1996. Mining quantitative association rules in large relational tables. In SIGMOD. 1--12.","DOI":"10.1145\/235968.233311"},{"key":"e_1_2_1_44_1","first-page":"157","article-title":"Finding interesting rare association rules using rare pattern tree","volume":"8","author":"Tsang Sidney","year":"2013","unstructured":"Sidney Tsang, Yun Sing Koh, and Gillian Dobbie. 2013. Finding interesting rare association rules using rare pattern tree. Trans. Large-Scale Data Knowl.-Center. Syst. 8 (2013), 157--173.","journal-title":"Trans. Large-Scale Data Knowl.-Center. Syst."},{"key":"e_1_2_1_45_1","volume-title":"Xin Luna Dong, and Alexandra Meliou","author":"Wang Xiaolan","year":"2015","unstructured":"Xiaolan Wang, Xin Luna Dong, and Alexandra Meliou. 2015. Data X-Ray: A diagnostic tool for data errors. In SIGMOD. 1231--1245."},{"key":"e_1_2_1_46_1","unstructured":"wikipedia-sandy [n.d.]. Wikipedia entry on hurricane Sandy. Retrieved from https:\/\/en.wikipedia.org\/wiki\/Hurricane_Sandy."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536354.2536356"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0164-1212(02)00128-0"},{"key":"e_1_2_1_49_1","unstructured":"Haopeng Zhang Yanlei Diao and Alexandra Meliou. 2017. EXstream: Explaining anomalies in event stream monitoring. In EDBT. 156--167."}],"container-title":["ACM\/IMS Transactions on Data Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3385192","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3385192","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T13:56:53Z","timestamp":1776347813000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3385192"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,31]]},"references-count":49,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,5,31]]}},"alternative-id":["10.1145\/3385192"],"URL":"https:\/\/doi.org\/10.1145\/3385192","relation":{},"ISSN":["2691-1922"],"issn-type":[{"value":"2691-1922","type":"print"}],"subject":[],"published":{"date-parts":[[2020,5,31]]},"assertion":[{"value":"2019-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-02-01","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-06-12","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}