{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:24:28Z","timestamp":1750220668223,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":25,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,10,19]],"date-time":"2020-10-19T00:00:00Z","timestamp":1603065600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,10,19]]},"DOI":"10.1145\/3340531.3412693","type":"proceedings-article","created":{"date-parts":[[2020,10,19]],"date-time":"2020-10-19T07:01:44Z","timestamp":1603090904000},"page":"2717-2724","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Continuous Improvement of Medical Diagnostic Systems with Large Scale Patient Vignette Simulation"],"prefix":"10.1145","author":[{"given":"Suhrid","family":"Satyal","sequence":"first","affiliation":[{"name":"Medius Health, Sydney, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nick","family":"Fletcher","sequence":"additional","affiliation":[{"name":"Medius Health, Sydney, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shameek","family":"Ghosh","sequence":"additional","affiliation":[{"name":"Medius Health, Sydney, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,10,19]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1088\/1742-5468\/2008\/10\/P10008"},{"key":"e_1_3_2_2_2_1","volume-title":"On testing machine learning programs. arXiv preprint arXiv:1812.02257","author":"Braiek Houssem Ben","year":"2018","unstructured":"Houssem Ben Braiek and Foutse Khomh . 2018. On testing machine learning programs. arXiv preprint arXiv:1812.02257 ( 2018 ). Houssem Ben Braiek and Foutse Khomh. 2018. On testing machine learning programs. arXiv preprint arXiv:1812.02257 (2018)."},{"key":"e_1_3_2_2_3_1","volume-title":"Machine Learning for Health Care Conference, MLHC","author":"Choi Edward","year":"2017","unstructured":"Edward Choi , Siddharth Biswal , Bradley A. Malin , Jon Duke , Walter F. Stewart , and Jimeng Sun . 2017 . Generating Multi-label Discrete Patient Records using Generative Adversarial Networks . In Machine Learning for Health Care Conference, MLHC 2017. 286--305. Edward Choi, Siddharth Biswal, Bradley A. Malin, Jon Duke, Walter F. Stewart, and Jimeng Sun. 2017. Generating Multi-label Discrete Patient Records using Generative Adversarial Networks. In Machine Learning for Health Care Conference, MLHC 2017. 286--305."},{"key":"e_1_3_2_2_4_1","first-page":"318","article-title":"A novel program to assess and manage pain","volume":"9","author":"Clayton Holly A","year":"2000","unstructured":"Holly A Clayton , Gary LC Reschak , Sandra E Gaynor , and Julie L Creamer . 2000 . A novel program to assess and manage pain . MedSurg Nursing , Vol. 9 , 6 (2000), 318 . Holly A Clayton, Gary LC Reschak, Sandra E Gaynor, and Julie L Creamer. 2000. A novel program to assess and manage pain. MedSurg Nursing, Vol. 9, 6 (2000), 318.","journal-title":"MedSurg Nursing"},{"volume-title":"Differential diagnosis in primary care","author":"Collins R Douglas","key":"e_1_3_2_2_5_1","unstructured":"R Douglas Collins . 2008. Differential diagnosis in primary care . Lippincott Williams & Wilkins . R Douglas Collins. 2008. Differential diagnosis in primary care. Lippincott Williams & Wilkins."},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1111\/eci.13072"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(18)32819-8"},{"key":"e_1_3_2_2_8_1","volume-title":"Friedman","author":"Hastie Trevor","year":"2009","unstructured":"Trevor Hastie , Robert Tibshirani , and Jerome H . Friedman . 2009 . The Elements of Statistical Learning: Data Mining , Inference, and Prediction, Ed. 2. Springer . Trevor Hastie, Robert Tibshirani, and Jerome H. Friedman. 2009. The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Ed. 2. Springer."},{"key":"e_1_3_2_2_9_1","volume-title":"Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation. Pearson Education.","author":"Humble Jez","year":"2010","unstructured":"Jez Humble and David Farley . 2010 . Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation. Pearson Education. Jez Humble and David Farley. 2010. Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation. Pearson Education."},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11902"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TR.2018.2834476"},{"key":"e_1_3_2_2_12_1","volume-title":"Sorting out symptoms: design and evaluation of the'babylon check 'automated triage system. arXiv preprint arXiv:1606.02041","author":"Middleton Katherine","year":"2016","unstructured":"Katherine Middleton , Mobasher Butt , Nils Hammerla , Steven Hamblin , Karan Mehta , and Ali Parsa . 2016. Sorting out symptoms: design and evaluation of the'babylon check 'automated triage system. arXiv preprint arXiv:1606.02041 ( 2016 ). Katherine Middleton, Mobasher Butt, Nils Hammerla, Steven Hamblin, Karan Mehta, and Ali Parsa. 2016. Sorting out symptoms: design and evaluation of the'babylon check 'automated triage system. arXiv preprint arXiv:1606.02041 (2016)."},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1056\/NEJM198208193070803"},{"key":"e_1_3_2_2_14_1","volume-title":"Foundations and Trends in Information Retrieval","volume":"4","author":"Najork Marc","year":"2010","unstructured":"Marc Najork . 2010 . Web Crawling . Foundations and Trends in Information Retrieval , Vol. 4 (2010). Marc Najork. 2010. Web Crawling. Foundations and Trends in Information Retrieval, Vol. 4 (2010)."},{"key":"e_1_3_2_2_15_1","volume-title":"Creation of realistic appearing simulated patient cases using the INTERNIST-1\/QMR knowledge base and interrelationship properties of manifestations. Methods of information in medicine","author":"Parker RC","year":"1989","unstructured":"RC Parker and RA Miller . 1989. Creation of realistic appearing simulated patient cases using the INTERNIST-1\/QMR knowledge base and interrelationship properties of manifestations. Methods of information in medicine , Vol. 28 , 04 ( 1989 ), 346--351. RC Parker and RA Miller. 1989. Creation of realistic appearing simulated patient cases using the INTERNIST-1\/QMR knowledge base and interrelationship properties of manifestations. Methods of information in medicine, Vol. 28, 04 (1989), 346--351."},{"key":"e_1_3_2_2_16_1","volume-title":"How to Check the Reliability of Artificial Intelligence Solutions - Ensuring Client Expectations are Met. Applied clinical informatics","author":"Patrick Jon","year":"2019","unstructured":"Jon Patrick . 2019. How to Check the Reliability of Artificial Intelligence Solutions - Ensuring Client Expectations are Met. Applied clinical informatics , Vol. 10 , 02 ( 2019 ), 269--271. Jon Patrick. 2019. How to Check the Reliability of Artificial Intelligence Solutions - Ensuring Client Expectations are Met. Applied clinical informatics, Vol. 10, 02 (2019), 269--271."},{"volume-title":"Mining of massive datasets","author":"Rajaraman Anand","key":"e_1_3_2_2_17_1","unstructured":"Anand Rajaraman and Jeffrey David Ullman . 2011. Mining of massive datasets . Cambridge University Press . Anand Rajaraman and Jeffrey David Ullman. 2011. Mining of massive datasets. Cambridge University Press."},{"key":"e_1_3_2_2_18_1","volume-title":"et almbox","author":"Razzaki Salman","year":"2018","unstructured":"Salman Razzaki , Adam Baker , Yura Perov , Katherine Middleton , Janie Baxter , Daniel Mullarkey , Davinder Sangar , Michael Taliercio , Mobasher Butt , Azeem Majeed , et almbox . 2018 . A comparative study of artificial intelligence and human doctors for the purpose of triage and diagnosis. arXiv preprint arXiv:1806.10698 (2018). Salman Razzaki, Adam Baker, Yura Perov, Katherine Middleton, Janie Baxter, Daniel Mullarkey, Davinder Sangar, Michael Taliercio, Mobasher Butt, Azeem Majeed, et almbox. 2018. A comparative study of artificial intelligence and human doctors for the purpose of triage and diagnosis. arXiv preprint arXiv:1806.10698 (2018)."},{"key":"e_1_3_2_2_19_1","volume-title":"Comparison of physician and computer diagnostic accuracy. JAMA internal medicine","author":"Semigran Hannah L","year":"2016","unstructured":"Hannah L Semigran , David M Levine , Shantanu Nundy , and Ateev Mehrotra . 2016. Comparison of physician and computer diagnostic accuracy. JAMA internal medicine , Vol. 176 , 12 ( 2016 ), 1860--1861. Hannah L Semigran, David M Levine, Shantanu Nundy, and Ateev Mehrotra. 2016. Comparison of physician and computer diagnostic accuracy. JAMA internal medicine, Vol. 176, 12 (2016), 1860--1861."},{"key":"e_1_3_2_2_20_1","volume-title":"Evaluation of symptom checkers for self diagnosis and triage: audit study. bmj","author":"Semigran Hannah L","year":"2015","unstructured":"Hannah L Semigran , Jeffrey A Linder , Courtney Gidengil , and Ateev Mehrotra . 2015. Evaluation of symptom checkers for self diagnosis and triage: audit study. bmj , Vol. 351 ( 2015 ), h3480. Hannah L Semigran, Jeffrey A Linder, Courtney Gidengil, and Ateev Mehrotra. 2015. Evaluation of symptom checkers for self diagnosis and triage: audit study. bmj, Vol. 351 (2015), h3480."},{"key":"e_1_3_2_2_21_1","volume-title":"Accuracy of a Popular Online Symptom Checker for Ophthalmic Diagnoses. JAMA ophthalmology","author":"Shen Carl","year":"2019","unstructured":"Carl Shen , Michael Nguyen , Alexander Gregor , Gloria Isaza , and Anne Beattie . 2019. Accuracy of a Popular Online Symptom Checker for Ophthalmic Diagnoses. JAMA ophthalmology , Vol. 137 , 6 ( 2019 ), 690--692. Carl Shen, Michael Nguyen, Alexander Gregor, Gloria Isaza, and Anne Beattie. 2019. Accuracy of a Popular Online Symptom Checker for Ophthalmic Diagnoses. JAMA ophthalmology, Vol. 137, 6 (2019), 690--692."},{"key":"e_1_3_2_2_22_1","unstructured":"Liz Szabo. [n.d.]. Artificial Intelligence Is Rushing Into Patient Care - And Could Raise Risks. https:\/\/www.scientificamerican.com\/article\/artificial-intelligence-is-rushing-into-patient-care-and-could-raise-risks\/. Accessed: 2020-01-02.  Liz Szabo. [n.d.]. Artificial Intelligence Is Rushing Into Patient Care - And Could Raise Risks. https:\/\/www.scientificamerican.com\/article\/artificial-intelligence-is-rushing-into-patient-care-and-could-raise-risks\/. Accessed: 2020-01-02."},{"key":"e_1_3_2_2_23_1","volume-title":"High-performance medicine: the convergence of human and artificial intelligence. Nature medicine","author":"Topol Eric J","year":"2019","unstructured":"Eric J Topol . 2019. High-performance medicine: the convergence of human and artificial intelligence. Nature medicine , Vol. 25 , 1 ( 2019 ), 44. Eric J Topol. 2019. High-performance medicine: the convergence of human and artificial intelligence. Nature medicine, Vol. 25, 1 (2019), 44."},{"key":"e_1_3_2_2_24_1","volume-title":"Machine Learning Testing: Survey, Landscapes and Horizons. arXiv preprint arXiv:1906.10742","author":"Zhang Jie M","year":"2019","unstructured":"Jie M Zhang , Mark Harman , Lei Ma , and Yang Liu . 2019. Machine Learning Testing: Survey, Landscapes and Horizons. arXiv preprint arXiv:1906.10742 ( 2019 ). Jie M Zhang, Mark Harman, Lei Ma, and Yang Liu. 2019. Machine Learning Testing: Survey, Landscapes and Horizons. arXiv preprint arXiv:1906.10742 (2019)."},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2013.39"}],"event":{"name":"CIKM '20: The 29th ACM International Conference on Information and Knowledge Management","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGIR ACM Special Interest Group on Information Retrieval"],"location":"Virtual Event Ireland","acronym":"CIKM '20"},"container-title":["Proceedings of the 29th ACM International Conference on Information & Knowledge Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3340531.3412693","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3340531.3412693","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:02:54Z","timestamp":1750197774000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3340531.3412693"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,19]]},"references-count":25,"alternative-id":["10.1145\/3340531.3412693","10.1145\/3340531"],"URL":"https:\/\/doi.org\/10.1145\/3340531.3412693","relation":{},"subject":[],"published":{"date-parts":[[2020,10,19]]},"assertion":[{"value":"2020-10-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}