{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T16:27:52Z","timestamp":1779294472996,"version":"3.51.4"},"reference-count":29,"publisher":"Oxford University Press (OUP)","issue":"12","license":[{"start":{"date-parts":[[2020,10,8]],"date-time":"2020-10-08T00:00:00Z","timestamp":1602115200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,12,9]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Accurate estimations of surgical case durations can lead to the cost-effective utilization of operating rooms. We developed a novel machine learning approach, using both structured and unstructured features as input, to predict a continuous probability distribution of surgical case durations.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>The data set consisted of 53\u00a0783 surgical cases performed over 4 years at a tertiary-care pediatric hospital. Features extracted included categorical (American Society of Anesthesiologists [ASA] Physical Status, inpatient status, day of week), continuous (scheduled surgery duration, patient age), and unstructured text (procedure name, surgical diagnosis) variables. A mixture density network (MDN) was trained and compared to multiple tree-based methods and a Bayesian statistical method. A continuous ranked probability score (CRPS), a generalized extension of mean absolute error, was the primary performance measure. Pinball loss (PL) was calculated to assess accuracy at specific quantiles. Performance measures were additionally evaluated on common and rare surgical procedures. Permutation feature importance was measured for the best performing model.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>MDN had the best performance, with a CRPS of 18.1 minutes, compared to tree-based methods (19.5\u201322.1 minutes) and the Bayesian method (21.2 minutes). MDN had the best PL at all quantiles, and the best CRPS and PL for both common and rare procedures. Scheduled duration and procedure name were the most important features in the MDN.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>Using natural language processing of surgical descriptors, we demonstrated the use of ML approaches to predict the continuous probability distribution of surgical case durations. The more discerning forecast of the ML-based MDN approach affords opportunities for guiding intelligent schedule design and day-of-surgery operational decisions.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocaa140","type":"journal-article","created":{"date-parts":[[2020,6,12]],"date-time":"2020-06-12T03:35:20Z","timestamp":1591932920000},"page":"1885-1893","source":"Crossref","is-referenced-by-count":53,"title":["Probabilistic forecasting of surgical case duration using machine learning: model development and validation"],"prefix":"10.1093","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4316-7930","authenticated-orcid":false,"given":"York","family":"Jiao","sequence":"first","affiliation":[{"name":"Department of Anesthesiology, Washington University School of Medicine, St. Louis, Missouri, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anshuman","family":"Sharma","sequence":"additional","affiliation":[{"name":"Department of Anesthesiology, Washington University School of Medicine, St. Louis, Missouri, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Arbi","family":"Ben Abdallah","sequence":"additional","affiliation":[{"name":"Department of Anesthesiology, Washington University School of Medicine, St. Louis, Missouri, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas M","family":"Maddox","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Department of Internal Medicine, Washington University School of Medicine, St. Louis, Missouri, USA"},{"name":"Healthcare Innovation Lab, BJC HealthCare\/Washington University School of Medicine, St. Louis, Missouri, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4119-4836","authenticated-orcid":false,"given":"Thomas","family":"Kannampallil","sequence":"additional","affiliation":[{"name":"Department of Anesthesiology, Washington University School of Medicine, St. Louis, Missouri, USA"},{"name":"Institute for Informatics, Washington University School of Medicine, St. Louis, Missouri, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2020,10,8]]},"reference":[{"issue":"2025","key":"2020121009243468200_ocaa140-B1","first-page":"195","article-title":"National and surgical health care expenditures","volume":"251","author":"Mu\u00f1oz","year":"2005","journal-title":"Ann Surg"},{"issue":"4","key":"2020121009243468200_ocaa140-B2","doi-asserted-by":"crossref","first-page":"e176233","DOI":"10.1001\/jamasurg.2017.6233","article-title":"Understanding costs of care in the operating room","volume":"153","author":"Childers","year":"2018","journal-title":"JAMA Surg"},{"issue":"3","key":"2020121009243468200_ocaa140-B3","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1016\/S0952-8180(97)00032-9","article-title":"Cancellation of pediatric outpatient surgery: economic and emotional implications for patients and their families","volume":"9","author":"Tait","year":"1997","journal-title":"J Clin Anesth"},{"issue":"8","key":"2020121009243468200_ocaa140-B4","doi-asserted-by":"crossref","first-page":"992","DOI":"10.1111\/anae.14629","article-title":"Mathematical model of the risk of drug error during anaesthesia: the influence of drug choices, injection routes, operation duration and fatigue","volume":"74","author":"Sivia","year":"2019","journal-title":"Anaesthesia"},{"issue":"12","key":"2020121009243468200_ocaa140-B5","doi-asserted-by":"crossref","first-page":"1294","DOI":"10.1001\/jama.2009.1389","article-title":"Association of resident fatigue and distress with perceived medical errors","volume":"302","author":"West","year":"2009","journal-title":"JAMA"},{"issue":"2","key":"2020121009243468200_ocaa140-B6","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1097\/00005110-200302000-00008","article-title":"Reasons registered nurses leave or change employment status","volume":"33","author":"Strachota","year":"2003","journal-title":"J Nurs Adm"},{"issue":"2","key":"2020121009243468200_ocaa140-B7","doi-asserted-by":"crossref","first-page":"446","DOI":"10.1016\/j.joms.2012.10.009","article-title":"Accuracy of predicting the duration\u00a0of a surgical operation","volume":"71","author":"Laskin","year":"2013","journal-title":"J Oral Maxillofac Surg"},{"issue":"3","key":"2020121009243468200_ocaa140-B8","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1111\/j.1937-5956.2011.01221.x","article-title":"The surgical scheduling problem: current research and future opportunities","volume":"20","author":"May","year":"2011","journal-title":"Prod Oper Manage"},{"issue":"1","key":"2020121009243468200_ocaa140-B9","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.jmig.2014.07.004","article-title":"The accuracy of surgeons\u2019 provided estimates for the duration of hysterectomies: a pilot study","volume":"22","author":"Roque","year":"2015","journal-title":"J Minim Invasive Gynecol"},{"issue":"6","key":"2020121009243468200_ocaa140-B10","doi-asserted-by":"crossref","first-page":"1259","DOI":"10.1097\/00000542-200512000-00023","article-title":"Bayesian prediction bounds and comparisons of operating room times even for procedures with few or no historic data","volume":"103","author":"Dexter","year":"2005","journal-title":"Anesthesiology"},{"issue":"3","key":"2020121009243468200_ocaa140-B11","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1007\/s10916-019-1160-5","article-title":"Machine learning can improve estimation of surgical case duration: a pilot study","volume":"43","author":"Tuwatananurak","year":"2019","journal-title":"J Med Syst"},{"issue":"2","key":"2020121009243468200_ocaa140-B12","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1007\/s10916-018-1151-y","article-title":"A machine learning approach to predicting case duration for robot-assisted surgery","volume":"43","author":"Zhao","year":"2019","journal-title":"J Med Syst"},{"issue":"4","key":"2020121009243468200_ocaa140-B13","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.jamcollsurg.2019.05.029","article-title":"Improving operating room efficiency: machine learning approach to predict case-time duration","volume":"229","author":"Bartek","year":"2019","journal-title":"J Am Coll Surg"},{"issue":"10","key":"2020121009243468200_ocaa140-B14","doi-asserted-by":"crossref","first-page":"999","DOI":"10.1111\/pan.12709","article-title":"The nature and sources of variability in pediatric surgical case duration","volume":"25","author":"Bravo","year":"2015","journal-title":"Paediatr Anaesth"},{"issue":"1","key":"2020121009243468200_ocaa140-B15","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1007\/s41060-017-0055-0","article-title":"Improving predictions of pediatric surgical durations with supervised learning","volume":"4","author":"Master","year":"2017","journal-title":"Int J Data Sci Anal"},{"issue":"5","key":"2020121009243468200_ocaa140-B16","doi-asserted-by":"crossref","first-page":"642","DOI":"10.1111\/anae.14958","volume":"75","author":"Pandit","year":"2020","journal-title":". Anaesthesia"},{"issue":"3","key":"2020121009243468200_ocaa140-B17","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1002\/bjs.9736","article-title":"Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement","volume":"102","author":"Collins","year":"2015","journal-title":"Br J Surg"},{"issue":"2","key":"2020121009243468200_ocaa140-B18","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1213\/ANE.0000000000001430","article-title":"Effect of individual surgeons and anesthesiologists on operating room time","volume":"123","author":"Van Eijk","year":"2016","journal-title":"Anesth Analg"},{"key":"2020121009243468200_ocaa140-B19","author":"Bishop","year":"1994"},{"key":"2020121009243468200_ocaa140-B20","author":"Hjorth","year":"7\u201310, 1999; , ."},{"key":"2020121009243468200_ocaa140-B21","author":"Makansi"},{"issue":"667","key":"2020121009243468200_ocaa140-B22","doi-asserted-by":"crossref","first-page":"1611","DOI":"10.1002\/qj.1891","article-title":"Evaluating raw ensembles with the continuous ranked probability score","volume":"138","author":"Br\u00f6cker","year":"2012","journal-title":"QJR Meteorol Soc"},{"issue":"477","key":"2020121009243468200_ocaa140-B23","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1198\/016214506000001437","article-title":"Strictly proper scoring rules, prediction, and estimation","volume":"102","author":"Gneiting","year":"2007","journal-title":"J Am Stat Assoc"},{"key":"2020121009243468200_ocaa140-B24","first-page":"263","author":"von Holstein","year":"1977"},{"issue":"1","key":"2020121009243468200_ocaa140-B25","doi-asserted-by":"crossref","first-page":"211","DOI":"10.3150\/10-BEJ267","article-title":"Estimating conditional quantiles with the help of the pinball loss","volume":"17","author":"Steinwart","year":"2011","journal-title":"Bernoulli"},{"issue":"1","key":"2020121009243468200_ocaa140-B26","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach Learn"},{"key":"2020121009243468200_ocaa140-B27","first-page":"1","volume-title":"J Mac Learn Res","author":"Fisher"},{"key":"2020121009243468200_ocaa140-B28","author":"Tensorflow"},{"key":"2020121009243468200_ocaa140-B29"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/12\/1885\/34838553\/ocaa140.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/12\/1885\/34838553\/ocaa140.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,12,10]],"date-time":"2020-12-10T14:38:58Z","timestamp":1607611138000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/27\/12\/1885\/5919678"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,8]]},"references-count":29,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2020,10,8]]},"published-print":{"date-parts":[[2020,12,9]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocaa140","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,12]]},"published":{"date-parts":[[2020,10,8]]}}}