{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T20:07:03Z","timestamp":1772136423132,"version":"3.50.1"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,5,22]],"date-time":"2023-05-22T00:00:00Z","timestamp":1684713600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,5,22]],"date-time":"2023-05-22T00:00:00Z","timestamp":1684713600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002790","name":"Canadian Network for Research and Innovation in Machining Technology, Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","award":["50503-10275 500"],"award-info":[{"award-number":["50503-10275 500"]}],"id":[{"id":"10.13039\/501100002790","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>In machine learning (ML), association patterns in the data, paths in decision trees, and weights between layers of the neural network are often entangled due to multiple underlying causes, thus masking the pattern-to-source relation, weakening prediction, and defying explanation. This paper presents a revolutionary ML paradigm: pattern discovery and disentanglement (PDD) that disentangles associations and provides an all-in-one knowledge system capable of (a) disentangling patterns to associate with distinct primary sources; (b) discovering rare\/imbalanced groups, detecting anomalies and rectifying discrepancies to improve class association, pattern and entity clustering; and (c) organizing knowledge for statistically supported interpretability for causal exploration. Results from case studies have validated such capabilities. The explainable knowledge reveals pattern-source relations on entities, and underlying factors for causal inference, and clinical study and practice; thus, addressing the major concern of interpretability, trust, and reliability when applying ML to healthcare, which is a step towards closing the AI chasm.<\/jats:p>","DOI":"10.1038\/s41746-023-00816-9","type":"journal-article","created":{"date-parts":[[2023,5,22]],"date-time":"2023-05-22T06:02:15Z","timestamp":1684735335000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Theory and rationale of interpretable all-in-one pattern discovery and disentanglement system"],"prefix":"10.1038","volume":"6","author":[{"given":"Andrew K. C.","family":"Wong","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6651-0079","authenticated-orcid":false,"given":"Pei-Yuan","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Annie E.-S.","family":"Lee","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,5,22]]},"reference":[{"key":"816_CR1","doi-asserted-by":"crossref","unstructured":"Sambasivan, N. et al. Everyone wants to do the model work, not the data work: Data Cascades in High-Stakes AI, in Proc. 2021 CHI Conference on Human Factors in Computing Systems (2021).","DOI":"10.1145\/3411764.3445518"},{"key":"816_CR2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3457607","volume":"54","author":"N Mehrabi","year":"2021","unstructured":"Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K. & Galstyan, A. A survey on bias and fairness in machine learning. ACM Comput. Surv. 54, 1\u201335 (2021).","journal-title":"ACM Comput. Surv."},{"key":"816_CR3","unstructured":"Danilevsky, M. et al. A survey of the state of explainable AI for natural language processing. In Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing, Suzhou, China. Association for Computational Linguistics. pp. 447\u2013459."},{"key":"816_CR4","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1038\/s42256-019-0048-x","volume":"1","author":"C Rudin","year":"2019","unstructured":"Rudin, C. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nat. Mach. Intell. 1, 206\u2013215 (2019).","journal-title":"Nat. Mach. Intell."},{"key":"816_CR5","doi-asserted-by":"publisher","first-page":"572","DOI":"10.1038\/s41586-020-03136-0","volume":"589","author":"D Hangartner","year":"2021","unstructured":"Hangartner, D., Kopp, D. & Siegenthaler, M. Monitoring hiring discrimination through online recruitment platforms. Nature 589, 572\u2013576 (2021).","journal-title":"Nature"},{"key":"816_CR6","unstructured":"Madsen, A., Reddy, S. & Chandar, S. Post-hoc Interpretability for Neural NLP: A Survey. Preprint at https:\/\/arxiv.org\/abs\/2108.04840 (2021)."},{"key":"816_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1214\/21-SS133","volume":"16","author":"C Rudin","year":"2022","unstructured":"Rudin, C. et al. Interpretable machine learning: Fundamental principles and 10 grand challenges. Stat. Surv. 16, 1\u201385 (2022).","journal-title":"Stat. Surv."},{"key":"816_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12911-020-01332-6","volume":"20","author":"J Amann","year":"2020","unstructured":"Amann, J., Blasimme, A., Vayena, E., Frey, D. & Madai, V. I. Explainability for artificial intelligence in healthcare: a multidisciplinary perspective. BMC Med. Inform. Decis. Mak. 20, 1\u20139 (2020).","journal-title":"BMC Med. Inform. Decis. Mak."},{"key":"816_CR9","doi-asserted-by":"publisher","first-page":"5688","DOI":"10.1038\/s41598-021-84869-4","volume":"11","author":"AK Wong","year":"2021","unstructured":"Wong, A. K., Zhou, P. & Butt, Z. A. Pattern discovery and disentanglement on relational datasets. Sci. Rep. 11, 5688 (2021).","journal-title":"Sci. Rep."},{"key":"816_CR10","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1038\/s41591-018-0300-7","volume":"25","author":"E Topol","year":"2019","unstructured":"Topol, E. High-performance medicine: the convergence of human and artificial intelligence. Nat. Med. 25, 44\u201356 (2019).","journal-title":"Nat. Med."},{"key":"816_CR11","unstructured":"Samek, W., Wiegand, T. & M\u00fcller, K. Explainable artificial intelligence: Understanding, visualizing and interpreting deep learning models. Preprint at https:\/\/arxiv.org\/abs\/1708.08296 (2017)."},{"key":"816_CR12","doi-asserted-by":"publisher","first-page":"3299","DOI":"10.1007\/s10462-020-09948-w","volume":"54","author":"M Injadat","year":"2021","unstructured":"Injadat, M. et al. Machine learning towards intelligent systems: applications, challenges, and opportunities. Artif. Intell. Rev. 54, 3299\u20133348 (2021).","journal-title":"Artif. Intell. Rev."},{"key":"816_CR13","doi-asserted-by":"publisher","first-page":"719","DOI":"10.1038\/s41551-018-0305-z","volume":"2","author":"K-H Yu","year":"2018","unstructured":"Yu, K.-H., Beam, A. & Kohane, I. Artificial intelligence in healthcare. Nat. Biomed. Eng. 2, 719\u2013731 (2018).","journal-title":"Nat. Biomed. Eng."},{"key":"816_CR14","doi-asserted-by":"crossref","unstructured":"Aggarwal, C. & Sathe, S. Bias Reduction in Outlier Ensembles: The Guessing Game, in Outlier Ensembles (Springer, 2017).","DOI":"10.1007\/978-3-319-54765-7"},{"key":"816_CR15","doi-asserted-by":"publisher","first-page":"563","DOI":"10.1007\/s10844-015-0368-1","volume":"46","author":"K Napierala","year":"2016","unstructured":"Napierala, K. & Stefanowski, J. Types of minority class examples and their influence on learning classifiers from imbalanced data,. J. Intell. Inf. Syst. 46, 563\u2013597 (2016).","journal-title":"J. Intell. Inf. Syst."},{"key":"816_CR16","doi-asserted-by":"publisher","first-page":"687","DOI":"10.1142\/S0218001409007326","volume":"23","author":"Y Sun","year":"2009","unstructured":"Sun, Y., Wong, A. K. & Kamel, M. Classification of imbalanced data: a review. Int. J. Pattern Recognit. Artif. Intell. 23, 687\u2013719 (2009).","journal-title":"Int. J. Pattern Recognit. Artif. Intell."},{"key":"816_CR17","doi-asserted-by":"crossref","unstructured":"Holzinger, A. The next frontier: Ai we can really trust, in Joint European Conference on Machine Learning and Knowledge Discovery in Databases, pp. 427\u2013440 (Springer, 2021).","DOI":"10.1007\/978-3-030-93736-2_33"},{"key":"816_CR18","doi-asserted-by":"crossref","unstructured":"Holzinger, A., Saranti, A., Molnar, C., Biecek, P. & Samek, W. Explainable AI methods-a brief overview, in International Workshop on Extending Explainable AI Beyond Deep Models and Classifiers, pp. 13\u201338, (Springer, 2022).","DOI":"10.1007\/978-3-031-04083-2_2"},{"key":"816_CR19","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1126\/science.aax2342","volume":"336","author":"Z Obermeyer","year":"2019","unstructured":"Obermeyer, Z., Powers, B., Vogeli, C. & Mullainathan, S. Dissecting racial bias in an algorithm used to manage the health of populations. Science 336, 447\u2013453 (2019).","journal-title":"Science"},{"key":"816_CR20","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1002\/1097-0134(20010501)43:2<89::AID-PROT1021>3.0.CO;2-H","volume":"2","author":"F Glaser","year":"2001","unstructured":"Glaser, F., Steinberg, D., Vakser, I. & Ben-Tal, N. Residue frequencies and pairing preferences at protein\u2013protein interfaces,. Proteins: Struct., Funct., Bioinforma. 2, 89\u2013102 (2001).","journal-title":"Proteins: Struct., Funct., Bioinforma."},{"key":"816_CR21","first-page":"2045","volume":"8","author":"AK Wong","year":"2018","unstructured":"Wong, A. K., Sze-To, A. H. Y. & Johanning, G. L. Pattern to knowledge: deep knowledge-directed machine learning for residue-residue interaction prediction,. Nat. Sci. Rep. 8, 2045\u20132322 (2018).","journal-title":"Nat. Sci. Rep."},{"key":"816_CR22","unstructured":"Wong, A. K., Zhou, P.-Y. & Sze-To, A. Discovering deep knowledge from relational data by attribute-value association, in Proc. International Conference on Data Science (ICDATA) (2017)."},{"key":"816_CR23","doi-asserted-by":"publisher","first-page":"10","DOI":"10.3390\/proteomes6010010","volume":"6","author":"P-Y Zhou","year":"2018","unstructured":"Zhou, P.-Y., Lee, A. E., Sze-To, A. & Wong, A. K. Revealing subtle functional subgroups in class A scavenger receptors by pattern discovery and disentanglement of aligned pattern clusters. Proteomes 6, 10 (2018).","journal-title":"Proteomes"},{"key":"816_CR24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12911-020-01356-y","volume":"21","author":"P Zhou","year":"2021","unstructured":"Zhou, P. & Wong, A. K. Explanation and prediction of clinical data with imbalanced class distribution based on pattern discovery and disentanglement. BMC Med. Inform. Decis. Mak. 21, 1\u201315 (2021).","journal-title":"BMC Med. Inform. Decis. Mak."},{"key":"816_CR25","doi-asserted-by":"publisher","first-page":"548","DOI":"10.1109\/TCBB.2014.2306840","volume":"11","author":"AK Wong","year":"2014","unstructured":"Wong, A. K. & Lee, A. E. Aligning and clustering patterns to reveal the protein functionality of sequences,. IEEE\/ACM Trans. Comput. Biol. Bioinforma. 11, 548\u2013560 (2014).","journal-title":"IEEE\/ACM Trans. Comput. Biol. Bioinforma."},{"key":"816_CR26","unstructured":"Statlog (Heart) Data Set. https:\/\/archive.ics.uci.edu\/ml\/datasets\/Statlog+(Heart)."},{"key":"816_CR27","unstructured":"Wolberg, W. Breast Cancer Wisconsin (Original) Data Set. https:\/\/archive.ics.uci.edu\/ml\/datasets\/breast+cancer+wisconsin+(original)."},{"key":"816_CR28","unstructured":"Repository, U. M. L. Thoracic Surgery Data Data Set, November 2013. http:\/\/archive.ics.uci.edu\/ml\/datasets\/Thoracic+Surgery+Data."},{"key":"816_CR29","unstructured":"Asuncion, A. & Newman, D. UCI Machine Learning Repository, School of Information and Computer Science, University of California, Irvine, CA, 2007. http:\/\/archive.ics.uci.edu\/ml\/."},{"key":"816_CR30","doi-asserted-by":"publisher","first-page":"877","DOI":"10.1109\/69.649314","volume":"9","author":"AK Wong","year":"1997","unstructured":"Wong, A. K. & Wang, Y. High-order pattern discovery from discrete-valued data. IEEE Trans. Knowl. Data Eng. 9, 877\u2013893 (1997).","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"816_CR31","doi-asserted-by":"crossref","unstructured":"Cheng, J., Ke, Y. & Ng, W. \\delta-Tolerance Closed Frequent Itemsets, in Data Mining, 2006. ICDM'06. Sixth International Conference on. IEEE, (2006).","DOI":"10.1109\/ICDM.2006.1"},{"key":"816_CR32","doi-asserted-by":"crossref","unstructured":"Li, J., Liu, G. & Wong, L. Mining statistically important equivalence classes and delta-discriminative emerging patterns, in Proc. 13th ACM SIGKDD international conference on Knowledge discovery and data mining. (ACM, 2007).","DOI":"10.1145\/1281192.1281240"},{"key":"816_CR33","doi-asserted-by":"publisher","first-page":"7847","DOI":"10.1109\/ACCESS.2016.2624418","volume":"4","author":"P-Y Zhou","year":"2016","unstructured":"Zhou, P.-Y., Li, G. C. & Wong, A. K. An effective pattern pruning and summarization method retaining high quality patterns with high area coverage in relational datasets. IEEE Access 4, 7847\u20137858 (2016).","journal-title":"IEEE Access"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00816-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00816-9","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00816-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,22]],"date-time":"2023-05-22T06:27:24Z","timestamp":1684736844000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00816-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,22]]},"references-count":33,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["816"],"URL":"https:\/\/doi.org\/10.1038\/s41746-023-00816-9","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-1867622\/v1","asserted-by":"object"}]},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,22]]},"assertion":[{"value":"8 August 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 April 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 May 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"We confirm that ethical approval was not required for this study as the research did not involve human subjects or animals and did not infringe on any ethical standards or guidelines.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics"}}],"article-number":"92"}}