{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,26]],"date-time":"2026-03-26T08:56:08Z","timestamp":1774515368097,"version":"3.50.1"},"reference-count":59,"publisher":"Public Library of Science (PLoS)","issue":"9","license":[{"start":{"date-parts":[[2023,9,11]],"date-time":"2023-09-11T00:00:00Z","timestamp":1694390400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000057","name":"National Institute of General Medical Sciences","doi-asserted-by":"publisher","award":["2R01GM104987-09"],"award-info":[{"award-number":["2R01GM104987-09"]}],"id":[{"id":"10.13039\/100000057","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000070","name":"National Institute of Biomedical Imaging and Bioengineering","doi-asserted-by":"publisher","award":["R01EB030362"],"award-info":[{"award-number":["R01EB030362"]}],"id":[{"id":"10.13039\/100000070","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006108","name":"National Center for Advancing Translational Sciences","doi-asserted-by":"publisher","award":["UL1TR002378"],"award-info":[{"award-number":["UL1TR002378"]}],"id":[{"id":"10.13039\/100006108","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000936","name":"Gordon and Betty Moore Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000936","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100014600","name":"MathWorks","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100014600","id-type":"DOI","asserted-by":"publisher"}]},{"name":"ERDF A way of making Europe","award":["IT1717-22"],"award-info":[{"award-number":["IT1717-22"]}]},{"DOI":"10.13039\/501100005856","name":"Faculdade de Ci\u00eancias e Tecnologia, Universidade Nova de Lisboa","doi-asserted-by":"publisher","award":["UIDB\/50014\/2020"],"award-info":[{"award-number":["UIDB\/50014\/2020"]}],"id":[{"id":"10.13039\/501100005856","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005856","name":"Faculdade de Ci\u00eancias e Tecnologia, Universidade Nova de Lisboa","doi-asserted-by":"publisher","award":["UIDB\/50014\/2020"],"award-info":[{"award-number":["UIDB\/50014\/2020"]}],"id":[{"id":"10.13039\/501100005856","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100014600","name":"MathWorks","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100014600","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000936","name":"Gordon and Betty Moore Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000936","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000057","name":"National Institute of General Medical Sciences","doi-asserted-by":"publisher","award":["2R01GM104987-09"],"award-info":[{"award-number":["2R01GM104987-09"]}],"id":[{"id":"10.13039\/100000057","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000070","name":"National Institute of Biomedical Imaging and Bioengineering","doi-asserted-by":"publisher","award":["R01EB030362"],"award-info":[{"award-number":["R01EB030362"]}],"id":[{"id":"10.13039\/100000070","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006108","name":"National Center for Advancing Translational Sciences","doi-asserted-by":"publisher","award":["UL1TR002378"],"award-info":[{"award-number":["UL1TR002378"]}],"id":[{"id":"10.13039\/100006108","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosdigitalhealth.org"],"crossmark-restriction":false},"short-container-title":["PLOS Digit Health"],"abstract":"<jats:p>Cardiac auscultation is an accessible diagnostic screening tool that can help to identify patients with heart murmurs, who may need follow-up diagnostic screening and treatment for abnormal cardiac function. However, experts are needed to interpret the heart sounds, limiting the accessibility of cardiac auscultation in resource-constrained environments. Therefore, the George B. Moody PhysioNet Challenge 2022 invited teams to develop algorithmic approaches for detecting heart murmurs and abnormal cardiac function from phonocardiogram (PCG) recordings of heart sounds. For the Challenge, we sourced 5272 PCG recordings from 1452 primarily pediatric patients in rural Brazil, and we invited teams to implement diagnostic screening algorithms for detecting heart murmurs and abnormal cardiac function from the recordings. We required the participants to submit the complete training and inference code for their algorithms, improving the transparency, reproducibility, and utility of their work. We also devised an evaluation metric that considered the costs of screening, diagnosis, misdiagnosis, and treatment, allowing us to investigate the benefits of algorithmic diagnostic screening and facilitate the development of more clinically relevant algorithms. We received 779 algorithms from 87 teams during the Challenge, resulting in 53 working codebases for detecting heart murmurs and abnormal cardiac function from PCG recordings. These algorithms represent a diversity of approaches from both academia and industry, including methods that use more traditional machine learning techniques with engineered clinical and statistical features as well as methods that rely primarily on deep learning models to discover informative features. The use of heart sound recordings for identifying heart murmurs and abnormal cardiac function allowed us to explore the potential of algorithmic approaches for providing more accessible diagnostic screening in resource-constrained environments. The submission of working, open-source algorithms and the use of novel evaluation metrics supported the reproducibility, generalizability, and clinical relevance of the research from the Challenge.<\/jats:p>","DOI":"10.1371\/journal.pdig.0000324","type":"journal-article","created":{"date-parts":[[2023,9,11]],"date-time":"2023-09-11T17:26:31Z","timestamp":1694453191000},"page":"e0000324","update-policy":"https:\/\/doi.org\/10.1371\/journal.pdig.corrections_policy","source":"Crossref","is-referenced-by-count":52,"title":["Heart murmur detection from phonocardiogram recordings: The George B. Moody PhysioNet Challenge 2022"],"prefix":"10.1371","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4688-7965","authenticated-orcid":true,"given":"Matthew A.","family":"Reyna","sequence":"first","affiliation":[]},{"given":"Yashar","family":"Kiarashi","sequence":"additional","affiliation":[]},{"given":"Andoni","family":"Elola","sequence":"additional","affiliation":[]},{"given":"Jorge","family":"Oliveira","sequence":"additional","affiliation":[]},{"given":"Francesco","family":"Renna","sequence":"additional","affiliation":[]},{"given":"Annie","family":"Gu","sequence":"additional","affiliation":[]},{"given":"Erick A.","family":"Perez Alday","sequence":"additional","affiliation":[]},{"given":"Nadi","family":"Sadr","sequence":"additional","affiliation":[]},{"given":"Ashish","family":"Sharma","sequence":"additional","affiliation":[]},{"given":"Jacques","family":"Kpodonu","sequence":"additional","affiliation":[]},{"given":"Sandra","family":"Mattos","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7501-6523","authenticated-orcid":true,"given":"Miguel T.","family":"Coimbra","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4913-6825","authenticated-orcid":true,"given":"Reza","family":"Sameni","sequence":"additional","affiliation":[]},{"given":"Ali Bahrami","family":"Rad","sequence":"additional","affiliation":[]},{"given":"Gari D.","family":"Clifford","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2023,9,11]]},"reference":[{"issue":"1","key":"pdig.0000324.ref001","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2174\/2213275910801010001","article-title":"Features for heartbeat sound signal normal and pathological","volume":"1","author":"DS Amin","year":"2008","journal-title":"Recent Patents on Computer Science"},{"issue":"5","key":"pdig.0000324.ref002","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1080\/03091900500282772","article-title":"Computer aided analysis of phonocardiogram","volume":"31","author":"J Singh","year":"2007","journal-title":"Journal of Medical Engineering & Technology"},{"issue":"6","key":"pdig.0000324.ref003","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1001\/archinte.166.6.617","article-title":"Relationship Between Accurate Auscultation of a Clinically Useful Third Heart Sound and Level of Experience","volume":"166","author":"G Marcus","year":"2006","journal-title":"Archives of Internal Medicine"},{"key":"pdig.0000324.ref004","first-page":"870","volume-title":"Chest","author":"AA Ishmail","year":"1987"},{"key":"pdig.0000324.ref005","first-page":"278","volume-title":"Encyclopedia of Medical Devices and Instrumentation","author":"H Vermarien","year":"2006","edition":"2"},{"issue":"6","key":"pdig.0000324.ref006","doi-asserted-by":"crossref","first-page":"2524","DOI":"10.1109\/JBHI.2021.3137048","article-title":"The CirCor DigiScope Dataset: From Murmur Detection to Murmur Classification","volume":"26","author":"JH Oliveira","year":"2021","journal-title":"IEEE Journal of Biomedical and Health Informatics"},{"issue":"12","key":"pdig.0000324.ref007","doi-asserted-by":"crossref","first-page":"2181","DOI":"10.1088\/0967-3334\/37\/12\/2181","article-title":"An open access database for the evaluation of heart sound algorithms","volume":"37","author":"C Liu","year":"2016","journal-title":"Physiological Measurement"},{"issue":"2","key":"pdig.0000324.ref008","doi-asserted-by":"crossref","first-page":"642","DOI":"10.1109\/JBHI.2018.2841197","article-title":"Adaptive Sojourn Time HSMM for Heart Sound Segmentation","volume":"23","author":"J Oliveira","year":"2019","journal-title":"IEEE Journal of Biomedical and Health Informatics"},{"issue":"6","key":"pdig.0000324.ref009","doi-asserted-by":"crossref","first-page":"2435","DOI":"10.1109\/JBHI.2019.2894222","article-title":"Deep Convolutional Neural Networks for Heart Sound Segmentation","volume":"23","author":"F Renna","year":"2019","journal-title":"IEEE Journal of Biomedical and Health Informatics"},{"issue":"11","key":"pdig.0000324.ref010","first-page":"1371","article-title":"The Clinical Significance of the Systolic Murmur","volume":"6","author":"AR Freeman","year":"1933","journal-title":"Annals of Internal Medicine"},{"issue":"23","key":"pdig.0000324.ref011","doi-asserted-by":"crossref","first-page":"e215","DOI":"10.1161\/01.CIR.101.23.e215","article-title":"PhysioBank, PhysioToolkit, and PhysioNet: Components of a New Research Resource for Complex Physiologic Signals","volume":"101","author":"AL Goldberger","year":"2000","journal-title":"Circulation"},{"key":"pdig.0000324.ref012","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1097\/CCM.0000000000004145","article-title":"Early Prediction of Sepsis from Clinical Data: the PhysioNet\/Computing in Cardiology Challenge 2019","volume":"48","author":"MA Reyna","year":"2019","journal-title":"Critical Care Medicine"},{"key":"pdig.0000324.ref013","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1257\/pandp.20211078","article-title":"On the Inequity of Predicting A While Hoping for B","volume":"111","author":"S Mullainathan","year":"2021","journal-title":"AEA Papers and Proceedings"},{"issue":"4","key":"pdig.0000324.ref014","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1001\/jama.2022.10561","article-title":"Rethinking Algorithm Performance Metrics for Artificial Intelligence in Diagnostic Medicine","volume":"328","author":"MA Reyna","year":"2022","journal-title":"JAMA"},{"key":"pdig.0000324.ref015","first-page":"1189","article-title":"Greedy function approximation: a gradient boosting machine","author":"JH Friedman","year":"2001","journal-title":"Annals of Statistics"},{"key":"pdig.0000324.ref016","doi-asserted-by":"crossref","unstructured":"Chen T, Guestrin C. XGBoost: A scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining; 2016. p. 785\u2013794.","DOI":"10.1145\/2939672.2939785"},{"key":"pdig.0000324.ref017","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"L Breiman","year":"2001","journal-title":"Machine Learning"},{"key":"pdig.0000324.ref018","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"M Reyna","year":"2022"},{"key":"pdig.0000324.ref019","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"H Lu","year":"2022"},{"key":"pdig.0000324.ref020","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"A McDonald","year":"2022"},{"key":"pdig.0000324.ref021","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"Y Xu","year":"2022"},{"key":"pdig.0000324.ref022","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"F Krones","year":"2022"},{"key":"pdig.0000324.ref023","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"J Lee","year":"2022"},{"key":"pdig.0000324.ref024","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"M Alkhodari","year":"2022"},{"key":"pdig.0000324.ref025","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"S Monteiro","year":"2022"},{"key":"pdig.0000324.ref026","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"Antoni \u013dubom\u00edr","year":"2022"},{"key":"pdig.0000324.ref027","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"P Nejedly","year":"2022"},{"key":"pdig.0000324.ref028","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"S Summerton","year":"2022"},{"key":"pdig.0000324.ref029","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"Z Bai","year":"2022"},{"key":"pdig.0000324.ref030","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"M Rohr","year":"2022"},{"key":"pdig.0000324.ref031","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"A Ballas","year":"2022"},{"key":"pdig.0000324.ref032","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"H WEN","year":"2022"},{"key":"pdig.0000324.ref033","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"J Costa","year":"2022"},{"key":"pdig.0000324.ref034","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"M Knorr","year":"2022"},{"key":"pdig.0000324.ref035","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"M Araujo","year":"2022"},{"key":"pdig.0000324.ref036","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"P Xia","year":"2022"},{"key":"pdig.0000324.ref037","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"VV Venkataramani","year":"2022"},{"key":"pdig.0000324.ref038","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"Y Chang","year":"2022"},{"key":"pdig.0000324.ref039","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"J Kim","year":"2022"},{"key":"pdig.0000324.ref040","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"JM Shin","year":"2022"},{"key":"pdig.0000324.ref041","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"G Peng","year":"2022"},{"key":"pdig.0000324.ref042","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"R Petrolis","year":"2022"},{"key":"pdig.0000324.ref043","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"P Gemke","year":"2022"},{"key":"pdig.0000324.ref044","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"L Hu","year":"2022"},{"key":"pdig.0000324.ref045","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"P Warrick","year":"2022"},{"key":"pdig.0000324.ref046","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"Z Imran","year":"2022"},{"key":"pdig.0000324.ref047","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"X Wang","year":"2022"},{"key":"pdig.0000324.ref048","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"BJ Singstad","year":"2022"},{"key":"pdig.0000324.ref049","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"S Choi","year":"2022"},{"key":"pdig.0000324.ref050","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"X Li","year":"2022"},{"key":"pdig.0000324.ref051","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"A Cornely","year":"2022"},{"key":"pdig.0000324.ref052","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"Y Gao","year":"2022"},{"key":"pdig.0000324.ref053","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"J Ding","year":"2022"},{"key":"pdig.0000324.ref054","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"K Jalali","year":"2022"},{"key":"pdig.0000324.ref055","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"G Stein","year":"2022"},{"key":"pdig.0000324.ref056","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"W Rudman","year":"2022"},{"key":"pdig.0000324.ref057","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"P Fan","year":"2022"},{"key":"pdig.0000324.ref058","first-page":"1","volume-title":"2022 Computing in Cardiology (CinC)","author":"E Bondareva","year":"2022"},{"key":"pdig.0000324.ref059","first-page":"1","volume-title":"2017 Computing in Cardiology (CinC)","author":"GD Clifford","year":"2017"}],"container-title":["PLOS Digital Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pdig.0000324","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,11]],"date-time":"2023-09-11T17:27:06Z","timestamp":1694453226000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pdig.0000324"}},"subtitle":[],"editor":[{"given":"Leo Anthony","family":"Celi","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2023,9,11]]},"references-count":59,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2023,9,11]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pdig.0000324","relation":{},"ISSN":["2767-3170"],"issn-type":[{"value":"2767-3170","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,11]]}}}