{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,22]],"date-time":"2026-01-22T18:43:08Z","timestamp":1769107388509,"version":"3.49.0"},"reference-count":30,"publisher":"Association for Computing Machinery (ACM)","issue":"2-3","license":[{"start":{"date-parts":[[2017,6,13]],"date-time":"2017-06-13T00:00:00Z","timestamp":1497312000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"US Department of Education"},{"name":"GAANN","award":["P200A150283"],"award-info":[{"award-number":["P200A150283"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Manage. Inf. Syst."],"published-print":{"date-parts":[[2017,9,30]]},"abstract":"<jats:p>We develop a similarity measure for medical event sequences (MESs) and empirically evaluate it using U.S. Medicare claims data. Existing similarity measures do not use unique characteristics of MESs and have never been evaluated on real MESs. Our similarity measure, the Optimal Temporal Common Subsequence for Medical Event Sequences (OTCS-MES), provides a matching component that integrates event prevalence, event duplication, and hierarchical coding, important elements of MESs. The OTCS-MES also uses normalization to mitigate the impact of heavy positive skew of matching events and compact distribution of event prevalence. We empirically evaluate the OTCS-MES measure against two other measures specifically designed for MESs, the original OTCS and Artemis, a measure incorporating event alignment. Our evaluation uses two substantial data sets of Medicare claims data containing inpatient and outpatient sequences with different medical event coding. We find a small overlap in nearest neighbors among the three similarity measures, demonstrating the superior design of the OTCS-MES with its emphasis on unique aspects of MESs. The evaluation also provides evidence about the impact of component weights, neighborhood size, and sequence length.<\/jats:p>","DOI":"10.1145\/3070684","type":"journal-article","created":{"date-parts":[[2017,6,13]],"date-time":"2017-06-13T12:18:36Z","timestamp":1497356316000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Development and Evaluation of a Similarity Measure for Medical Event Sequences"],"prefix":"10.1145","volume":"8","author":[{"given":"Michael","family":"Mannino","sequence":"first","affiliation":[{"name":"University of Colorado Denver, The Business School, Denver"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joel","family":"Fredrickson","sequence":"additional","affiliation":[{"name":"University of Colorado Denver, The Business School, Denver"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Farnoush","family":"Banaei-Kashani","sequence":"additional","affiliation":[{"name":"Computer Science Department, University of Colorado Denver, Denver, CO"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Iris","family":"Linck","sequence":"additional","affiliation":[{"name":"Computer Science Department, University of Colorado Denver, Denver, CO"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Raghda Alqurashi","family":"Raghda","sequence":"additional","affiliation":[{"name":"Computer Science Department, University of Colorado Denver, Denver, CO"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,6,13]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-012-1334-3"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1186\/1472-6963-10-231"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1377\/hlthaff.24.5.1334"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1055\/s-0038-1634682"},{"key":"e_1_2_1_5_1","volume-title":"CMS 2008--2010 Data entrepreneurs\u2019 synthetic public use file (DE-SynPUF).","year":"2015","unstructured":"cms.gov. 2015 . CMS 2008--2010 Data entrepreneurs\u2019 synthetic public use file (DE-SynPUF). Retrieved from http:\/\/www.cms.gov\/Research-Statistics-Data-and-Systems\/Downloadable-Public-Use-Files\/SynPUFs\/DE_Syn_PUF.html. cms.gov. 2015. CMS 2008--2010 Data entrepreneurs\u2019 synthetic public use file (DE-SynPUF). Retrieved from http:\/\/www.cms.gov\/Research-Statistics-Data-and-Systems\/Downloadable-Public-Use-Files\/SynPUFs\/DE_Syn_PUF.html."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1142\/S0219720013710017"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1080\/10580530601036786"},{"key":"e_1_2_1_8_1","unstructured":"ddod.healthdata.gov\/wiki\/Use_Case_30:_Identify_dual_eligibles_in_CMS_DE-SynPUF. 2017. Use Case 30: Identify dual eligibles in CMS DE-SynPUF. Retrieved from http:\/\/ddod.healthdata.gov\/wiki\/Use_Case_30:_Identify_dual_eligibles_in_CMS_DE-SynPUF.  ddod.healthdata.gov\/wiki\/Use_Case_30:_Identify_dual_eligibles_in_CMS_DE-SynPUF. 2017. Use Case 30: Identify dual eligibles in CMS DE-SynPUF. Retrieved from http:\/\/ddod.healthdata.gov\/wiki\/Use_Case_30:_Identify_dual_eligibles_in_CMS_DE-SynPUF."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jacc.2009.02.010"},{"key":"e_1_2_1_10_1","unstructured":"en.wikipedia.org. 2015. Edit_distance. Retrieve from https:\/\/en.wikipedia.org\/wiki\/Edit_distance.  en.wikipedia.org. 2015. Edit_distance. Retrieve from https:\/\/en.wikipedia.org\/wiki\/Edit_distance."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btt491"},{"key":"e_1_2_1_12_1","volume-title":"Weights and measures: An axiomatic model for similarity computations","author":"France R. K.","unstructured":"R. K. France . 1994. Weights and measures: An axiomatic model for similarity computations . Virginia Tech Digital Library Research Laboratory Report . https:\/\/vtechworks.lib.vt.edu\/handle\/10919\/52847. R. K. France. 1994. Weights and measures: An axiomatic model for similarity computations. Virginia Tech Digital Library Research Laboratory Report. https:\/\/vtechworks.lib.vt.edu\/handle\/10919\/52847."},{"key":"e_1_2_1_13_1","doi-asserted-by":"crossref","first-page":"S37","DOI":"10.1097\/MLR.0b013e31829b1dbd","article-title":"Caveats for the use of operational electronic health record data in comparative effectiveness research","volume":"51","author":"Hersh W. R.","year":"2013","unstructured":"W. R. Hersh , M. G. Weiner , P. J. Embi , J. R. Logan , P. R. Payne , E. V. Bernstam , and J. H. Saltz . 2013 . Caveats for the use of operational electronic health record data in comparative effectiveness research . Medical Care 51 (8 Suppl 3) , S30 S37 . W. R. Hersh, M. G. Weiner, P. J. Embi, J. R. Logan, P. R. Payne, E. V. Bernstam, and J. H. Saltz. 2013. Caveats for the use of operational electronic health record data in comparative effectiveness research. Medical Care 51 (8 Suppl 3), S30 S37.","journal-title":"Medical Care"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1093\/fampra\/cmh409"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-23783-6_15"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1377\/hlthaff.23.2.116"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the AMIA Symposium. American Medical Informatics Association","author":"Stefano Monti","year":"1998","unstructured":"Monti Stefano and Gregory F. Cooper . 1998. The impact of modeling the dependencies among patient findings on classification accuracy and calibration . In Proceedings of the AMIA Symposium. American Medical Informatics Association , 1998 . Monti Stefano and Gregory F. Cooper. 1998. The impact of modeling the dependencies among patient findings on classification accuracy and calibration. In Proceedings of the AMIA Symposium. American Medical Informatics Association, 1998."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1137\/0105003"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1097\/01.mlr.0000182534.19832.83"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-007-9089-5"},{"key":"e_1_2_1_21_1","first-page":"508","article-title":"Adoption of electronic medical records in family practice: The providers\u2019 perspective","volume":"41","author":"Terry A.","year":"2009","unstructured":"A. Terry , G. Giles , J. Brown , A. Thind , and M. Stewart . 2009 . Adoption of electronic medical records in family practice: The providers\u2019 perspective . Family Medicine 41 , 7, 508 -- 512 . A. Terry, G. Giles, J. Brown, A. Thind, and M. Stewart. 2009. Adoption of electronic medical records in family practice: The providers\u2019 perspective. Family Medicine 41, 7, 508--512.","journal-title":"Family Medicine"},{"key":"e_1_2_1_22_1","unstructured":"D. Sanders D. A. Burton and D. Protti. 2013. The healthcare analytics adoption model: A framework and roadmap. HealthCatalyst White Paper. https:\/\/www.healthcatalyst.com\/wp-content\/uploads\/2013\/11\/analytics-adoption-model-Nov-2013.pdf.  D. Sanders D. A. Burton and D. Protti. 2013. The healthcare analytics adoption model: A framework and roadmap. HealthCatalyst White Paper. https:\/\/www.healthcatalyst.com\/wp-content\/uploads\/2013\/11\/analytics-adoption-model-Nov-2013.pdf."},{"key":"e_1_2_1_23_1","unstructured":"Seachhealthit.techtarget. 2016 clinical decision support system (CDSS). http:\/\/searchhealthit. techtarget.com\/definition\/clinical-decision-support-system-CDSS. Accessed December 5 2015.  Seachhealthit.techtarget. 2016 clinical decision support system (CDSS). http:\/\/searchhealthit. techtarget.com\/definition\/clinical-decision-support-system-CDSS. Accessed December 5 2015."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1097\/01974520-200301000-00002"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1097\/01.mlr.0000118861.56848.ee"},{"key":"e_1_2_1_26_1","unstructured":"stagecms.archimedesmodel.com\/PR-1-May-2013. 2017. Archimedes Inc. Collaborates with HHS and CMS to Provide Researchers and Software Developers Unprecedented Access to Health Data. Retrieved from http:\/\/ddod.healthdata.gov\/wiki\/Use_Case_30:_Identify_dual_eligibles_in_CMS_DE-SynPUF.  stagecms.archimedesmodel.com\/PR-1-May-2013. 2017. Archimedes Inc. Collaborates with HHS and CMS to Provide Researchers and Software Developers Unprecedented Access to Health Data. Retrieved from http:\/\/ddod.healthdata.gov\/wiki\/Use_Case_30:_Identify_dual_eligibles_in_CMS_DE-SynPUF."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.5555\/2017212.2017217"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2009.5332595"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835804.1835831"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the 2010 2nd International Conference on Software Engineering and Data Mining (SEDM). IEEE, 316--321","author":"Zheng A.","unstructured":"A. Zheng , X. Zhou , J. Ma , and M. Petridis . 2010. The optimal temporal common subsequence . In Proceedings of the 2010 2nd International Conference on Software Engineering and Data Mining (SEDM). IEEE, 316--321 A. Zheng, X. Zhou, J. Ma, and M. Petridis. 2010. The optimal temporal common subsequence. In Proceedings of the 2010 2nd International Conference on Software Engineering and Data Mining (SEDM). IEEE, 316--321"}],"container-title":["ACM Transactions on Management Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3070684","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3070684","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:30:27Z","timestamp":1750217427000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3070684"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,6,13]]},"references-count":30,"journal-issue":{"issue":"2-3","published-print":{"date-parts":[[2017,9,30]]}},"alternative-id":["10.1145\/3070684"],"URL":"https:\/\/doi.org\/10.1145\/3070684","relation":{},"ISSN":["2158-656X","2158-6578"],"issn-type":[{"value":"2158-656X","type":"print"},{"value":"2158-6578","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,6,13]]},"assertion":[{"value":"2016-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-06-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}