{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,12]],"date-time":"2026-05-12T16:44:15Z","timestamp":1778604255142,"version":"3.51.4"},"reference-count":157,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,1,8]],"date-time":"2021-01-08T00:00:00Z","timestamp":1610064000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,1,8]],"date-time":"2021-01-08T00:00:00Z","timestamp":1610064000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>A decade of unprecedented progress in artificial intelligence (AI) has demonstrated the potential for many fields\u2014including medicine\u2014to benefit from the insights that AI techniques can extract from data. Here we survey recent progress in the development of modern computer vision techniques\u2014powered by deep learning\u2014for medical applications, focusing on medical imaging, medical video, and clinical deployment. We start by briefly summarizing a decade of progress in convolutional neural networks, including the vision tasks they enable, in the context of healthcare. Next, we discuss several example medical imaging applications that stand to benefit\u2014including cardiology, pathology, dermatology, ophthalmology\u2013and propose new avenues for continued work. We then expand into general medical video, highlighting ways in which clinical workflows can integrate computer vision to enhance care. Finally, we discuss the challenges and hurdles required for real-world clinical deployment of these technologies.<\/jats:p>","DOI":"10.1038\/s41746-020-00376-2","type":"journal-article","created":{"date-parts":[[2021,1,8]],"date-time":"2021-01-08T11:19:34Z","timestamp":1610104774000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1094,"title":["Deep learning-enabled medical computer vision"],"prefix":"10.1038","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1937-9682","authenticated-orcid":false,"given":"Andre","family":"Esteva","sequence":"first","affiliation":[]},{"given":"Katherine","family":"Chou","sequence":"additional","affiliation":[]},{"given":"Serena","family":"Yeung","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5191-2726","authenticated-orcid":false,"given":"Nikhil","family":"Naik","sequence":"additional","affiliation":[]},{"given":"Ali","family":"Madani","sequence":"additional","affiliation":[]},{"given":"Ali","family":"Mottaghi","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4079-8275","authenticated-orcid":false,"given":"Yun","family":"Liu","sequence":"additional","affiliation":[]},{"given":"Eric","family":"Topol","sequence":"additional","affiliation":[]},{"given":"Jeff","family":"Dean","sequence":"additional","affiliation":[]},{"given":"Richard","family":"Socher","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,1,8]]},"reference":[{"key":"376_CR1","doi-asserted-by":"crossref","unstructured":"Szeliski, R. Computer Vision: Algorithms and Applications (Springer Science & Business Media, 2010).","DOI":"10.1007\/978-1-84882-935-0"},{"key":"376_CR2","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun, Y., Bengio, Y. & Hinton, G. Deep learning. Nature 521, 436\u2013444 (2015).","journal-title":"Nature"},{"key":"376_CR3","unstructured":"Sanders, J. & Kandrot, E. CUDA by example: an introduction to general-purpose GPU programming. Addison-Wesley Professional; 2010 Jul 19.BibTeXEndNoteRefManRefWorks"},{"key":"376_CR4","doi-asserted-by":"crossref","unstructured":"Deng, J. et al. ImageNet: A large-scale hierarchical image database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition 248\u2013255 (IEEE, 2009).","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"376_CR5","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1038\/s41591-018-0316-z","volume":"25","author":"A Esteva","year":"2019","unstructured":"Esteva, A. et al. A guide to deep learning in healthcare. Nat. Med. 25, 24\u201329 (2019).","journal-title":"Nat. Med."},{"key":"376_CR6","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1038\/s41591-018-0300-7","volume":"25","author":"EJ Topol","year":"2019","unstructured":"Topol, E. J. High-performance medicine: the convergence of human and artificial intelligence. Nat. Med. 25, 44\u201356 (2019).","journal-title":"Nat. Med."},{"key":"376_CR7","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nature21056","volume":"542","author":"A Esteva","year":"2017","unstructured":"Esteva, A. et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature 542, 115\u2013118 (2017).","journal-title":"Nature"},{"key":"376_CR8","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1038\/s41746-019-0087-z","volume":"2","author":"S Yeung","year":"2019","unstructured":"Yeung, S. et al. A computer vision system for deep learning-based detection of patient mobilization activities in the ICU. NPJ Digit Med. 2, 11 (2019).","journal-title":"NPJ Digit Med."},{"key":"376_CR9","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","volume":"115","author":"O Russakovsky","year":"2015","unstructured":"Russakovsky, O. et al. ImageNet Large Scale Visual Recognition Challenge. Int. J. Comput. Vis. 115, 211\u2013252 (2015).","journal-title":"Int. J. Comput. Vis."},{"key":"376_CR10","unstructured":"Krizhevsky, A., Sutskever, I. & Hinton, G. E. in Advances in Neural Information Processing Systems 25 (eds Pereira, F., Burges, C. J. C., Bottou, L. & Weinberger, K. Q.) 1097\u20131105 (Curran Associates, Inc., 2012)."},{"key":"376_CR11","unstructured":"Sermanet, P. et al. OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks. Preprint at https:\/\/arxiv.org\/abs\/1312.6229 (2013)."},{"key":"376_CR12","unstructured":"Simonyan, K. & Zisserman, A. Very deep convolutional networks for large-scale image recognition. Preprint at https:\/\/arxiv.org\/abs\/1409.1556 (2014)."},{"key":"376_CR13","doi-asserted-by":"crossref","unstructured":"Szegedy, C. et al. Going deeper with convolutions. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 1\u20139 (2015).","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"376_CR14","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. In Proc. IEEE Conference on Computer Vision and Pattern Recognition 770\u2013778 (2016).","DOI":"10.1109\/CVPR.2016.90"},{"key":"376_CR15","doi-asserted-by":"crossref","unstructured":"Gebru, T., Hoffman, J. & Fei-Fei, L. Fine-grained recognition in the wild: a multi-task domain adaptation approach. In 2017 IEEE International Conference on Computer Vision (ICCV) 1358\u20131367 (IEEE, 2017).","DOI":"10.1109\/ICCV.2017.151"},{"key":"376_CR16","doi-asserted-by":"publisher","unstructured":"Gulshan, V. et al. Performance of a deep-learning algorithm vs manual grading for detecting diabetic retinopathy in india. JAMA Ophthalmol. https:\/\/doi.org\/10.1001\/jamaophthalmol.2019.2004 (2014).","DOI":"10.1001\/jamaophthalmol.2019.2004"},{"key":"376_CR17","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P. & Brox, T. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention 234\u2013241 (Springer, Cham, 2015).","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"376_CR18","unstructured":"Isensee, F. et al. nnU-Net: self-adapting framework for U-Net-based medical image segmentation. Preprint at https:\/\/arxiv.org\/abs\/1809.10486 (2018)."},{"key":"376_CR19","unstructured":"LeCun, Y. & Bengio, Y. in The Handbook of Brain Theory and Neural Networks 255\u2013258 (MIT Press, 1998)."},{"key":"376_CR20","doi-asserted-by":"crossref","unstructured":"Cubuk, E. D., Zoph, B., Mane, D., Vasudevan, V. & Le, Q. V. AutoAugment: learning augmentation policies from data. Preprint at https:\/\/arxiv.org\/abs\/1805.09501 (2018).","DOI":"10.1109\/CVPR.2019.00020"},{"key":"376_CR21","unstructured":"Goodfellow, I. et al. Generative adversarial nets. In Advances inneural information processing systems 2672\u20132680 (2014)."},{"key":"376_CR22","unstructured":"\u00d8rting, S. et al. A survey of Crowdsourcing in medical image analysis. Preprint at https:\/\/arxiv.org\/abs\/1902.09159 (2019)."},{"key":"376_CR23","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.9330","volume":"20","author":"P Cr\u00e9quit","year":"2018","unstructured":"Cr\u00e9quit, P., Mansouri, G., Benchoufi, M., Vivot, A. & Ravaud, P. Mapping of Crowdsourcing in health: systematic review. J. Med. Internet Res. 20, e187 (2018).","journal-title":"J. Med. Internet Res."},{"key":"376_CR24","unstructured":"Jing, L. & Tian, Y. in IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE, 2020)."},{"key":"376_CR25","unstructured":"McMahan, B., Moore, E., Ramage, D., Hampson, S. & y Arcas, B. A. Communication-efficient learning of deep networks from decentralized data. In Artificial Intelligence and Statistics 1273\u20131282 (PMLR, 2017)."},{"key":"376_CR26","doi-asserted-by":"crossref","unstructured":"Karpathy, A. & Fei-Fei, L. Deep visual-semantic alignments for generating image descriptions. In Proc. IEEE Conference on Computer Vision and Pattern Recognition 3128\u20133137 (IEEE, 2015).","DOI":"10.1109\/CVPR.2015.7298932"},{"key":"376_CR27","doi-asserted-by":"crossref","unstructured":"Lv, D. et al. Research on the technology of LIDAR data processing. In 2017 First International Conference on Electronics Instrumentation Information Systems (EIIS) 1\u20135 (IEEE, 2017).","DOI":"10.1109\/EIIS.2017.8298694"},{"key":"376_CR28","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1016\/j.imavis.2016.11.004","volume":"59","author":"I Lillo","year":"2017","unstructured":"Lillo, I., Niebles, J. C. & Soto, A. Sparse composition of body poses and atomic actions for human activity recognition in RGB-D videos. Image Vis. Comput. 59, 63\u201375 (2017).","journal-title":"Image Vis. Comput."},{"key":"376_CR29","unstructured":"Haque, A. et al. Towards vision-based smart hospitals: a system for tracking and monitoring hand hygiene compliance. In Proceedings of the 2nd Machine Learning for Healthcare Conference, 68, 75\u201387 (PMLR, 2017)."},{"key":"376_CR30","doi-asserted-by":"crossref","unstructured":"Heilbron, F. C., Escorcia, V., Ghanem, B. & Niebles, J. C. ActivityNet: a large-scale video benchmark for human activity understanding. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 961\u2013970 (IEEE, 2015).","DOI":"10.1109\/CVPR.2015.7298698"},{"key":"376_CR31","unstructured":"Liu, Y. et al. Learning to describe scenes with programs. In ICLR (Open Access, 2019)."},{"key":"376_CR32","doi-asserted-by":"publisher","first-page":"1316","DOI":"10.1093\/jamia\/ocaa115","volume":"27","author":"A Singh","year":"2020","unstructured":"Singh, A. et al. Automatic detection of hand hygiene using computer visiontechnology. J. Am. Med. Inform. Assoc. 27, 1316\u20131320 (2020).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"376_CR33","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1016\/j.media.2017.07.005","volume":"42","author":"G Litjens","year":"2017","unstructured":"Litjens, G. et al. A survey on deep learning in medical image analysis. Med. Image Anal. 42, 60\u201388 (2017).","journal-title":"Med. Image Anal."},{"key":"376_CR34","unstructured":"Maron, O. & Lozano-P\u00e9rez, T. in A Framework for Multiple-Instance Learning. in Advances in Neural Information Processing Systems 10 (eds Jordan, M. I., Kearns, M. J. & Solla, S. A.) 570\u2013576 (MIT Press, 1998)."},{"key":"376_CR35","doi-asserted-by":"publisher","unstructured":"Singh, S. P. et al. 3D Deep Learning On Medical Images: A Review. Sensors 20, https:\/\/doi.org\/10.3390\/s20185097 (2020).","DOI":"10.3390\/s20185097"},{"key":"376_CR36","doi-asserted-by":"publisher","first-page":"252","DOI":"10.1038\/s41586-020-2145-8","volume":"580","author":"D Ouyang","year":"2020","unstructured":"Ouyang, D. et al. Video-based AI for beat-to-beat assessment of cardiac function. Nature 580, 252\u2013256 (2020).","journal-title":"Nature"},{"key":"376_CR37","doi-asserted-by":"publisher","first-page":"118","DOI":"10.1038\/s41746-020-00324-0","volume":"3","author":"S Benjamens","year":"2020","unstructured":"Benjamens, S., Dhunnoo, P. & Mesk\u00f3, B. The state of artificial intelligence-based FDA-approved medical devices and algorithms: an online database. NPJ Digit. Med. 3, 118 (2020).","journal-title":"NPJ Digit. Med."},{"key":"376_CR38","doi-asserted-by":"crossref","unstructured":"Beede, E. et al. A human-centered evaluation of a deep learning system deployed in clinics for the detection of diabetic retinopathy. In Proc. 2020 CHI Conference on Human Factors in Computing Systems 1\u201312 (Association for Computing Machinery, 2020).","DOI":"10.1145\/3313831.3376718"},{"key":"376_CR39","unstructured":"Viz.ai Granted Medicare New Technology Add-on Payment. PR Newswire https:\/\/www.prnewswire.com\/news-releases\/vizai-granted-medicare-new-technology-add-on-payment-301123603.html (2020)."},{"key":"376_CR40","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1002\/lary.27850","volume":"130","author":"MG Crowson","year":"2020","unstructured":"Crowson, M. G. et al. A contemporary review of machine learning in otolaryngology-head and neck surgery. Laryngoscope 130, 45\u201351 (2020).","journal-title":"Laryngoscope"},{"key":"376_CR41","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1186\/s40463-019-0389-9","volume":"48","author":"D Livingstone","year":"2019","unstructured":"Livingstone, D., Talai, A. S., Chau, J. & Forkert, N. D. Building an Otoscopic screening prototype tool using deep learning. J. Otolaryngol. Head. Neck Surg. 48, 66 (2019).","journal-title":"J. Otolaryngol. Head. Neck Surg."},{"key":"376_CR42","doi-asserted-by":"publisher","first-page":"1453","DOI":"10.1038\/s41591-019-0539-7","volume":"25","author":"P-HC Chen","year":"2019","unstructured":"Chen, P.-H. C. et al. An augmented reality microscope with real-time artificial intelligence integration for cancer diagnosis. Nat. Med. 25, 1453\u20131457 (2019).","journal-title":"Nat. Med."},{"key":"376_CR43","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-017-18564-8","volume":"8","author":"G Gun\u010dar","year":"2018","unstructured":"Gun\u010dar, G. et al. An application of machine learning to haematological diagnosis. Sci. Rep. 8, 411 (2018).","journal-title":"Sci. Rep."},{"key":"376_CR44","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1049\/htl.2018.5098","volume":"6","author":"MM Alam","year":"2019","unstructured":"Alam, M. M. & Islam, M. T. Machine learning approach of automatic identification and counting of blood cells. Health. Technol. Lett. 6, 103\u2013108 (2019).","journal-title":"Health. Technol. Lett."},{"key":"376_CR45","doi-asserted-by":"publisher","first-page":"326","DOI":"10.1097\/CM9.0000000000000623","volume":"133","author":"A El Hajjar","year":"2020","unstructured":"El Hajjar, A. & Rey, J.-F. Artificial intelligence in gastrointestinal endoscopy: general overview. Chin. Med. J. 133, 326\u2013334 (2020).","journal-title":"Chin. Med. J."},{"key":"376_CR46","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1016\/j.gie.2018.07.037","volume":"89","author":"Y Horie","year":"2019","unstructured":"Horie, Y. et al. Diagnostic outcomes of esophageal cancer by artificial intelligence using convolutional neural networks. Gastrointest. Endosc. 89, 25\u201332 (2019).","journal-title":"Gastrointest. Endosc."},{"key":"376_CR47","doi-asserted-by":"publisher","first-page":"653","DOI":"10.1007\/s10120-018-0793-2","volume":"21","author":"T Hirasawa","year":"2018","unstructured":"Hirasawa, T. et al. Application of artificial intelligence using a convolutional neural network for detecting gastric cancer in endoscopic images. Gastric Cancer 21, 653\u2013660 (2018).","journal-title":"Gastric Cancer"},{"key":"376_CR48","doi-asserted-by":"publisher","first-page":"1485","DOI":"10.1007\/s00464-011-2036-z","volume":"26","author":"K Kubota","year":"2012","unstructured":"Kubota, K., Kuroda, J., Yoshida, M., Ohta, K. & Kitajima, M. Medical image analysis: computer-aided diagnosis of gastric cancer invasion on endoscopic images. Surg. Endosc. 26, 1485\u20131489 (2012).","journal-title":"Surg. Endosc."},{"key":"376_CR49","doi-asserted-by":"publisher","first-page":"E139","DOI":"10.1055\/s-0043-120830","volume":"6","author":"T Itoh","year":"2018","unstructured":"Itoh, T., Kawahira, H., Nakashima, H. & Yata, N. Deep learning analyzes Helicobacter pylori infection by upper gastrointestinal endoscopy images. Endosc. Int Open 6, E139\u2013E144 (2018).","journal-title":"Endosc. Int Open"},{"key":"376_CR50","doi-asserted-by":"publisher","first-page":"2379","DOI":"10.1109\/TIP.2018.2801119","volume":"27","author":"J-Y He","year":"2018","unstructured":"He, J.-Y., Wu, X., Jiang, Y.-G., Peng, Q. & Jain, R. Hookworm detection in wireless capsule endoscopy images with deep learning. IEEE Trans. Image Process. 27, 2379\u20132392 (2018).","journal-title":"IEEE Trans. Image Process."},{"key":"376_CR51","doi-asserted-by":"publisher","first-page":"624","DOI":"10.1038\/s41551-020-0534-9","volume":"4","author":"S-M Park","year":"2020","unstructured":"Park, S.-M. et al. A mountable toilet system for personalized health monitoring via the analysis of excreta. Nat. Biomed. Eng. 4, 624\u2013635 (2020).","journal-title":"Nat. Biomed. Eng."},{"key":"376_CR52","doi-asserted-by":"publisher","first-page":"770","DOI":"10.1093\/humrep\/deaa013","volume":"35","author":"M VerMilyea","year":"2020","unstructured":"VerMilyea, M. et al. Development of an artificial intelligence-based assessment model for prediction of embryo viability using static images captured by optical light microscopy during IVF. Hum. Reprod. 35, 770\u2013784 (2020).","journal-title":"Hum. Reprod."},{"key":"376_CR53","doi-asserted-by":"publisher","first-page":"318","DOI":"10.1148\/radiol.2018171820","volume":"288","author":"G Choy","year":"2018","unstructured":"Choy, G. et al. Current applications and future impact of machine learning in radiology. Radiology 288, 318\u2013328 (2018).","journal-title":"Radiology"},{"key":"376_CR54","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1016\/j.ejrad.2019.02.038","volume":"114","author":"L Saba","year":"2019","unstructured":"Saba, L. et al. The present and future of deep learning in radiology. Eur. J. Radiol. 114, 14\u201324 (2019).","journal-title":"Eur. J. Radiol."},{"key":"376_CR55","doi-asserted-by":"publisher","first-page":"939","DOI":"10.1002\/jmri.26534","volume":"49","author":"MA Mazurowski","year":"2019","unstructured":"Mazurowski, M. A., Buda, M., Saha, A. & Bashir, M. R. Deep learning in radiology: an overview of the concepts and a survey of the state of the art with focus on MRI. J. Magn. Reson. Imaging 49, 939\u2013954 (2019).","journal-title":"J. Magn. Reson. Imaging"},{"key":"376_CR56","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-019-0322-0","volume":"6","author":"AEW Johnson","year":"2019","unstructured":"Johnson, A. E. W. et al. MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports. Sci. Data 6, 317 (2019).","journal-title":"Sci. Data"},{"key":"376_CR57","doi-asserted-by":"crossref","unstructured":"Irvin, J. et al. Chexpert: A large chest radiograph dataset with uncertainty labels and expert comparison. In Proc. of the AAAI Conference on Artificial Intelligence Vol. 33, 590\u2013597 (2019).","DOI":"10.1609\/aaai.v33i01.3301590"},{"key":"376_CR58","doi-asserted-by":"crossref","unstructured":"Wang, X. et al. Chestx-ray8: Hospital-scale chest x-ray database and benchmarks on weakly-supervisedclassification and localization of common thorax diseases. In Proc. IEEE Conference on Computer Vision and Pattern Recognition 2097\u20132106 (2017).","DOI":"10.1109\/CVPR.2017.369"},{"key":"376_CR59","doi-asserted-by":"publisher","first-page":"2388","DOI":"10.1016\/S0140-6736(18)31645-3","volume":"392","author":"S Chilamkurthy","year":"2018","unstructured":"Chilamkurthy, S. et al. Deep learning algorithms for detection of critical findings in head CT scans: a retrospective study. Lancet 392, 2388\u20132396 (2018).","journal-title":"Lancet"},{"key":"376_CR60","doi-asserted-by":"publisher","first-page":"669","DOI":"10.1148\/radiol.2018181432","volume":"290","author":"AD Weston","year":"2019","unstructured":"Weston, A. D. et al. Automated abdominal segmentation of CT scans for body composition analysis using deep learning. Radiology 290, 669\u2013679 (2019).","journal-title":"Radiology"},{"key":"376_CR61","doi-asserted-by":"crossref","unstructured":"Ding, J., Li, A., Hu, Z. & Wang, L. in Medical Image Computing and Computer Assisted Intervention\u2014MICCAI 2017 559\u2013567 (Springer International Publishing, 2017).","DOI":"10.1007\/978-3-319-66179-7_64"},{"key":"376_CR62","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1016\/j.media.2017.04.002","volume":"39","author":"LK Tan","year":"2017","unstructured":"Tan, L. K., Liew, Y. M., Lim, E. & McLaughlin, R. A. Convolutional neural network regression for short-axis left ventricle segmentation in cardiac cine MR sequences. Med. Image Anal. 39, 78\u201386 (2017).","journal-title":"Med. Image Anal."},{"key":"376_CR63","unstructured":"Zhang, J. et al. Viral pneumonia screening on chest X-ray images using confidence-aware anomaly detection. Preprint at https:\/\/arxiv.org\/abs\/2003.12338 (2020)."},{"key":"376_CR64","doi-asserted-by":"publisher","unstructured":"Zhang, X., Feng, C., Wang, A., Yang, L. & Hao, Y. CT super-resolution using multiple dense residual block based GAN. J. VLSI Signal Process. Syst. Signal Image Video Technol., https:\/\/doi.org\/10.1007\/s11760-020-01790-5 (2020).","DOI":"10.1007\/s11760-020-01790-5"},{"key":"376_CR65","doi-asserted-by":"publisher","first-page":"502","DOI":"10.1016\/j.jacc.2015.10.090","volume":"67","author":"A Papolos","year":"2016","unstructured":"Papolos, A., Narula, J., Bavishi, C., Chaudhry, F. A. & Sengupta, P. P. U. S. Hospital use of echocardiography: insights from the nationwide inpatient sample. J. Am. Coll. Cardiol. 67, 502\u2013511 (2016).","journal-title":"J. Am. Coll. Cardiol."},{"key":"376_CR66","unstructured":"HeartFlowNXT\u2014HeartFlow Analysis of Coronary Blood Flow Using Coronary CT Angiography\u2014Study Results\u2014ClinicalTrials.gov. https:\/\/clinicaltrials.gov\/ct2\/show\/results\/NCT01757678."},{"key":"376_CR67","doi-asserted-by":"crossref","unstructured":"Madani, A., Arnaout, R., Mofrad, M. & Arnaout, R. Fast and accurate view classification of echocardiograms using deep learning. NPJ Digit. Med. 1, 6 (2018).","DOI":"10.1038\/s41746-017-0013-1"},{"key":"376_CR68","doi-asserted-by":"publisher","first-page":"1623","DOI":"10.1161\/CIRCULATIONAHA.118.034338","volume":"138","author":"J Zhang","year":"2018","unstructured":"Zhang, J. et al. Fully automated echocardiogram interpretation in clinical practice. Circulation 138, 1623\u20131635 (2018).","journal-title":"Circulation"},{"key":"376_CR69","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1038\/s41746-019-0216-8","volume":"3","author":"A Ghorbani","year":"2020","unstructured":"Ghorbani, A. et al. Deep learning interpretation of echocardiograms. NPJ Digit. Med. 3, 10 (2020).","journal-title":"NPJ Digit. Med."},{"key":"376_CR70","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1038\/s41746-018-0065-x","volume":"1","author":"A Madani","year":"2018","unstructured":"Madani, A., Ong, J. R., Tibrewal, A. & Mofrad, M. R. K. Deep echocardiography: data-efficient supervised and semi-supervised deep learning towards automated diagnosis of cardiac disease. NPJ Digit. Med. 1, 59 (2018).","journal-title":"NPJ Digit. Med."},{"key":"376_CR71","doi-asserted-by":"publisher","first-page":"443","DOI":"10.1111\/j.1524-4741.2007.00463.x","volume":"13","author":"C Perkins","year":"2007","unstructured":"Perkins, C., Balma, D. & Garcia, R. Members of the Consensus Group & Susan G. Komen for the Cure. Why current breast pathology practices must be evaluated. A Susan G. Komen for the Cure white paper: June 2006. Breast J. 13, 443\u2013447 (2007).","journal-title":"Breast J."},{"key":"376_CR72","doi-asserted-by":"publisher","first-page":"126","DOI":"10.1016\/j.juro.2010.03.021","volume":"184","author":"F Brimo","year":"2010","unstructured":"Brimo, F., Schultz, L. & Epstein, J. I. The value of mandatory second opinion pathology review of prostate needle biopsy interpretation before radical prostatectomy. J. Urol. 184, 126\u2013130 (2010).","journal-title":"J. Urol."},{"key":"376_CR73","doi-asserted-by":"publisher","first-page":"1122","DOI":"10.1001\/jama.2015.1405","volume":"313","author":"JG Elmore","year":"2015","unstructured":"Elmore, J. G. et al. Diagnostic concordance among pathologists interpreting breast biopsy specimens. JAMA 313, 1122\u20131132 (2015).","journal-title":"JAMA"},{"key":"376_CR74","doi-asserted-by":"publisher","first-page":"1383","DOI":"10.5858\/arpa.2017-0496-CP","volume":"142","author":"AJ Evans","year":"2018","unstructured":"Evans, A. J. et al. US food and drug administration approval of whole slide imaging for primary diagnosis: a key milestone is reached and new questions are raised. Arch. Pathol. Lab. Med. 142, 1383\u20131387 (2018).","journal-title":"Arch. Pathol. Lab. Med."},{"key":"376_CR75","doi-asserted-by":"crossref","unstructured":"Srinidhi, C. L., Ciga, O. & Martel, A. L. Deep neural network models for computational histopathology: A survey. Medical Image Analysis. p. 101813 (2020).","DOI":"10.1016\/j.media.2020.101813"},{"key":"376_CR76","doi-asserted-by":"publisher","first-page":"703","DOI":"10.1038\/s41571-019-0252-y","volume":"16","author":"K Bera","year":"2019","unstructured":"Bera, K., Schalper, K. A., Rimm, D. L., Velcheti, V. & Madabhushi, A. Artificial intelligence in digital pathology - new tools for diagnosis and precision oncology. Nat. Rev. Clin. Oncol. 16, 703\u2013715 (2019).","journal-title":"Nat. Rev. Clin. Oncol."},{"key":"376_CR77","doi-asserted-by":"crossref","unstructured":"Cire\u015fan, D. C., Giusti, A., Gambardella, L. M. & Schmidhuber, J. in Medical Image Computing and Computer-Assisted Intervention\u2014MICCAI 2013 411\u2013418 (Springer Berlin Heidelberg, 2013).","DOI":"10.1007\/978-3-642-40763-5_51"},{"key":"376_CR78","doi-asserted-by":"publisher","first-page":"034003","DOI":"10.1117\/1.JMI.1.3.034003","volume":"1","author":"H Wang","year":"2014","unstructured":"Wang, H. et al. Mitosis detection in breast cancer pathology images by combining handcrafted and convolutional neural network features. J. Med Imaging (Bellingham) 1, 034003 (2014).","journal-title":"J. Med Imaging (Bellingham)"},{"key":"376_CR79","doi-asserted-by":"crossref","unstructured":"Kashif, M. N., Ahmed Raza, S. E., Sirinukunwattana, K., Arif, M. & Rajpoot, N. Handcrafted features with convolutional neural networks for detection of tumor cells in histology images. In 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI) 1029\u20131032 (IEEE, 2016).","DOI":"10.1109\/ISBI.2016.7493441"},{"key":"376_CR80","unstructured":"Wang, D., Khosla, A., Gargeya, R., Irshad, H. & Beck, A. H. Deep learning for identifying metastatic breast cancer. Preprint at https:\/\/arxiv.org\/abs\/1606.05718 (2016)."},{"key":"376_CR81","doi-asserted-by":"crossref","unstructured":"BenTaieb, A. & Hamarneh, G. in Medical Image Computing and Computer-Assisted Intervention\u2014MICCAI 2016 460\u2013468 (Springer International Publishing, 2016).","DOI":"10.1007\/978-3-319-46723-8_53"},{"key":"376_CR82","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1016\/j.media.2016.11.004","volume":"36","author":"H Chen","year":"2017","unstructured":"Chen, H. et al. DCAN: Deep contour-aware networks for object instance segmentation from histology images. Med. Image Anal. 36, 135\u2013146 (2017).","journal-title":"Med. Image Anal."},{"key":"376_CR83","doi-asserted-by":"publisher","first-page":"2901","DOI":"10.1109\/TBME.2017.2649485","volume":"64","author":"Y Xu","year":"2017","unstructured":"Xu, Y. et al. Gland instance segmentation using deep multichannel neural networks. IEEE Trans. Biomed. Eng. 64, 2901\u20132912 (2017).","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"376_CR84","doi-asserted-by":"publisher","DOI":"10.1038\/srep26286","volume":"6","author":"G Litjens","year":"2016","unstructured":"Litjens, G. et al. Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis. Sci. Rep. 6, 26286 (2016).","journal-title":"Sci. Rep."},{"key":"376_CR85","doi-asserted-by":"publisher","first-page":"1559","DOI":"10.1038\/s41591-018-0177-5","volume":"24","author":"N Coudray","year":"2018","unstructured":"Coudray, N. et al. Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning. Nat. Med. 24, 1559\u20131567 (2018).","journal-title":"Nat. Med."},{"key":"376_CR86","doi-asserted-by":"publisher","first-page":"1301","DOI":"10.1038\/s41591-019-0508-1","volume":"25","author":"G Campanella","year":"2019","unstructured":"Campanella, G. et al. Clinical-grade computational pathology using weakly supervised deep learning on whole slide images. Nat. Med. 25, 1301\u20131309 (2019).","journal-title":"Nat. Med."},{"key":"376_CR87","doi-asserted-by":"publisher","first-page":"E2970","DOI":"10.1073\/pnas.1717139115","volume":"115","author":"P Mobadersany","year":"2018","unstructured":"Mobadersany, P. et al. Predicting cancer outcomes from histology and genomics using convolutional networks. Proc. Natl Acad. Sci. U. S. A. 115, E2970\u2013E2979 (2018).","journal-title":"Proc. Natl Acad. Sci. U. S. A."},{"key":"376_CR88","doi-asserted-by":"publisher","first-page":"1519","DOI":"10.1038\/s41591-019-0583-3","volume":"25","author":"P Courtiol","year":"2019","unstructured":"Courtiol, P. et al. Deep learning-based classification of mesothelioma improves prediction of patient outcome. Nat. Med. 25, 1519\u20131525 (2019).","journal-title":"Nat. Med."},{"key":"376_CR89","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-020-64156-4","volume":"10","author":"RR Rawat","year":"2020","unstructured":"Rawat, R. R. et al. Deep learned tissue \u2018fingerprints\u2019 classify breast cancers by ER\/PR\/Her2 status from H&E images. Sci. Rep. 10, 7275 (2020).","journal-title":"Sci. Rep."},{"key":"376_CR90","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1016\/S0004-3702(96)00034-3","volume":"89","author":"TG Dietterich","year":"1997","unstructured":"Dietterich, T. G., Lathrop, R. H. & Lozano-P\u00e9rez, T. Solving the multiple instance problem with axis-parallel rectangles. Artif. Intell. 89, 31\u201371 (1997).","journal-title":"Artif. Intell."},{"key":"376_CR91","doi-asserted-by":"publisher","first-page":"792","DOI":"10.1016\/j.cell.2018.03.040","volume":"173","author":"EM Christiansen","year":"2018","unstructured":"Christiansen, E. M. et al. In silico labeling: predicting fluorescent labels in unlabeled images. Cell 173, 792\u2013803.e19 (2018).","journal-title":"Cell"},{"key":"376_CR92","doi-asserted-by":"publisher","first-page":"1795","DOI":"10.1016\/S0140-6736(19)32726-6","volume":"394","author":"A Esteva","year":"2019","unstructured":"Esteva, A. & Topol, E. Can skin cancer diagnosis be transformed by AI? Lancet 394, 1795 (2019).","journal-title":"Lancet"},{"key":"376_CR93","doi-asserted-by":"publisher","first-page":"1836","DOI":"10.1093\/annonc\/mdy166","volume":"29","author":"HA Haenssle","year":"2018","unstructured":"Haenssle, H. A. et al. Man against machine: diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists. Ann. Oncol. 29, 1836\u20131842 (2018).","journal-title":"Ann. Oncol."},{"key":"376_CR94","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1016\/j.ejca.2019.04.001","volume":"113","author":"TJ Brinker","year":"2019","unstructured":"Brinker, T. J. et al. Deep learning outperformed 136 of 157 dermatologists in a head-to-head dermoscopic melanoma image classification task. Eur. J. Cancer 113, 47\u201354 (2019).","journal-title":"Eur. J. Cancer"},{"key":"376_CR95","doi-asserted-by":"publisher","first-page":"900","DOI":"10.1038\/s41591-020-0842-3","volume":"26","author":"Y Liu","year":"2020","unstructured":"Liu, Y. et al. A deep learning system for differential diagnosis of skin diseases. Nat. Med. 26, 900\u2013908 (2020).","journal-title":"Nat. Med."},{"key":"376_CR96","doi-asserted-by":"publisher","first-page":"1261","DOI":"10.1111\/exd.13777","volume":"27","author":"J Yap","year":"2018","unstructured":"Yap, J., Yolland, W. & Tschandl, P. Multimodal skin lesion classification using deep learning. Exp. Dermatol. 27, 1261\u20131267 (2018).","journal-title":"Exp. Dermatol."},{"key":"376_CR97","doi-asserted-by":"publisher","first-page":"270","DOI":"10.1016\/j.jaad.2017.08.016","volume":"78","author":"MA Marchetti","year":"2018","unstructured":"Marchetti, M. A. et al. Results of the 2016 International Skin Imaging Collaboration International Symposium on Biomedical Imaging challenge: Comparison of the accuracy of computer algorithms to dermatologists for the diagnosis of melanoma from dermoscopic images. J. Am. Acad. Dermatol. 78, 270\u2013277 (2018).","journal-title":"J. Am. Acad. Dermatol."},{"key":"376_CR98","unstructured":"Li, Y. et al. Skin cancer detection and tracking using data synthesis and deep learning. Preprint at https:\/\/arxiv.org\/abs\/1612.01074 (2016)."},{"key":"376_CR99","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1136\/bjophthalmol-2018-313173","volume":"103","author":"DSW Ting","year":"2019","unstructured":"Ting, D. S. W. et al. Artificial intelligence and deep learning in ophthalmology. Br. J. Ophthalmol. 103, 167\u2013175 (2019).","journal-title":"Br. J. Ophthalmol."},{"key":"376_CR100","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1038\/s41746-018-0048-y","volume":"1","author":"PA Keane","year":"2018","unstructured":"Keane, P. A. & Topol, E. J. With an eye to AI and autonomous diagnosis. NPJ Digit. Med. 1, 40 (2018).","journal-title":"NPJ Digit. Med."},{"key":"376_CR101","doi-asserted-by":"publisher","first-page":"2141","DOI":"10.1016\/S0140-6736(19)33051-X","volume":"394","author":"P Keane","year":"2019","unstructured":"Keane, P. & Topol, E. Reinventing the eye exam. Lancet 394, 2141 (2019).","journal-title":"Lancet"},{"key":"376_CR102","doi-asserted-by":"publisher","first-page":"1342","DOI":"10.1038\/s41591-018-0107-6","volume":"24","author":"J De Fauw","year":"2018","unstructured":"De Fauw, J. et al. Clinically applicable deep learning for diagnosis and referral in retinal disease. Nat. Med. 24, 1342\u20131350 (2018).","journal-title":"Nat. Med."},{"key":"376_CR103","doi-asserted-by":"publisher","first-page":"312","DOI":"10.1136\/bjophthalmol-2019-314161","volume":"104","author":"C Kern","year":"2020","unstructured":"Kern, C. et al. Implementation of a cloud-based referral platform in ophthalmology: making telemedicine services a reality in eye care. Br. J. Ophthalmol. 104, 312\u2013317 (2020).","journal-title":"Br. J. Ophthalmol."},{"key":"376_CR104","doi-asserted-by":"publisher","first-page":"2402","DOI":"10.1001\/jama.2016.17216","volume":"316","author":"V Gulshan","year":"2016","unstructured":"Gulshan, V. et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316, 2402\u20132410 (2016).","journal-title":"JAMA"},{"key":"376_CR105","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1038\/s41746-019-0099-8","volume":"2","author":"P Raumviboonsuk","year":"2019","unstructured":"Raumviboonsuk, P. et al. Deep learning versus human graders for classifying diabetic retinopathy severity in a nationwide screening program. NPJ Digit Med. 2, 25 (2019).","journal-title":"NPJ Digit Med."},{"key":"376_CR106","doi-asserted-by":"publisher","first-page":"5200","DOI":"10.1167\/iovs.16-19964","volume":"57","author":"MD Abr\u00e0moff","year":"2016","unstructured":"Abr\u00e0moff, M. D. et al. Improved automated detection of diabetic retinopathy on a publicly available dataset through integration of deep learning. Invest. Ophthalmol. Vis. Sci. 57, 5200\u20135206 (2016).","journal-title":"Invest. Ophthalmol. Vis. Sci."},{"key":"376_CR107","doi-asserted-by":"publisher","first-page":"2211","DOI":"10.1001\/jama.2017.18152","volume":"318","author":"DSW Ting","year":"2017","unstructured":"Ting, D. S. W. et al. Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes. JAMA 318, 2211\u20132223 (2017).","journal-title":"JAMA"},{"key":"376_CR108","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1038\/s41746-018-0040-6","volume":"1","author":"MD Abr\u00e0moff","year":"2018","unstructured":"Abr\u00e0moff, M. D., Lavin, P. T., Birch, M., Shah, N. & Folk, J. C. Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices. NPJ Digit. Med. 1, 39 (2018).","journal-title":"NPJ Digit. Med."},{"key":"376_CR109","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-019-13922-8","volume":"11","author":"AV Varadarajan","year":"2020","unstructured":"Varadarajan, A. V. et al. Predicting optical coherence tomography-derived diabetic macular edema grades from fundus photographs using deep learning. Nat. Commun. 11, 130 (2020).","journal-title":"Nat. Commun."},{"key":"376_CR110","doi-asserted-by":"publisher","first-page":"892","DOI":"10.1038\/s41591-020-0867-7","volume":"26","author":"J Yim","year":"2020","unstructured":"Yim, J. et al. Predicting conversion to wet age-related macular degeneration using deep learning. Nat. Med. 26, 892\u2013899 (2020).","journal-title":"Nat. Med."},{"key":"376_CR111","doi-asserted-by":"publisher","first-page":"1199","DOI":"10.1016\/j.ophtha.2018.01.023","volume":"125","author":"Z Li","year":"2018","unstructured":"Li, Z. et al. Efficacy of a deep learning system for detecting glaucomatous optic neuropathy based on color fundus photographs. Ophthalmology 125, 1199\u20131206 (2018).","journal-title":"Ophthalmology"},{"key":"376_CR112","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1016\/j.ajo.2018.06.007","volume":"193","author":"S Yousefi","year":"2018","unstructured":"Yousefi, S. et al. Detection of longitudinal visual field progression in glaucoma using machine learning. Am. J. Ophthalmol. 193, 71\u201379 (2018).","journal-title":"Am. J. Ophthalmol."},{"key":"376_CR113","doi-asserted-by":"publisher","first-page":"803","DOI":"10.1001\/jamaophthalmol.2018.1934","volume":"136","author":"JM Brown","year":"2018","unstructured":"Brown, J. M. et al. Automated diagnosis of plus disease in retinopathy of prematurity using deep convolutional neural networks. JAMA Ophthalmol. 136, 803\u2013810 (2018).","journal-title":"JAMA Ophthalmol."},{"key":"376_CR114","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1038\/s41551-018-0195-0","volume":"2","author":"R Poplin","year":"2018","unstructured":"Poplin, R. et al. Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning. Nat. Biomed. Eng. 2, 158\u2013164 (2018).","journal-title":"Nat. Biomed. Eng."},{"key":"376_CR115","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1038\/s41551-019-0487-z","volume":"4","author":"A Mitani","year":"2020","unstructured":"Mitani, A. et al. Detection of anaemia from retinal fundus images via deep learning. Nat. Biomed. Eng. 4, 18\u201327 (2020).","journal-title":"Nat. Biomed. Eng."},{"key":"376_CR116","doi-asserted-by":"publisher","first-page":"e295","DOI":"10.1016\/S2589-7500(20)30063-7","volume":"2","author":"C Sabanayagam","year":"2020","unstructured":"Sabanayagam, C. et al. A deep learning algorithm to detect chronic kidney disease from retinal photographs in community-based populations. Lancet Digital Health 2, e295\u2013e302 (2020).","journal-title":"Lancet Digital Health"},{"key":"376_CR117","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1038\/s41551-017-0132-7","volume":"1","author":"L Maier-Hein","year":"2017","unstructured":"Maier-Hein, L. et al. Surgical data science for next-generation interventions. Nat. Biomed. Eng. 1, 691\u2013696 (2017).","journal-title":"Nat. Biomed. Eng."},{"key":"376_CR118","doi-asserted-by":"crossref","unstructured":"Garc\u00eda-Peraza-Herrera, L. C. et al. ToolNet: Holistically-nested real-time segmentation of robotic surgical tools. In 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS) 5717\u20135722 (IEEE, 2017).","DOI":"10.1109\/IROS.2017.8206462"},{"key":"376_CR119","doi-asserted-by":"publisher","first-page":"443","DOI":"10.1007\/s11548-018-1704-z","volume":"13","author":"A Zia","year":"2018","unstructured":"Zia, A., Sharma, Y., Bettadapura, V., Sarin, E. L. & Essa, I. Video and accelerometer-based motion analysis for automated surgical skills assessment. Int. J. Comput. Assist. Radiol. Surg. 13, 443\u2013455 (2018).","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"376_CR120","doi-asserted-by":"publisher","first-page":"1542","DOI":"10.1109\/TMI.2017.2665671","volume":"36","author":"D Sarikaya","year":"2017","unstructured":"Sarikaya, D., Corso, J. J. & Guru, K. A. Detection and localization of robotic tools in robot-assisted surgery videos using deep neural networks for region proposal and detection. IEEE Trans. Med. Imaging 36, 1542\u20131549 (2017).","journal-title":"IEEE Trans. Med. Imaging"},{"key":"376_CR121","doi-asserted-by":"crossref","unstructured":"Jin, A. et al. Tool detection and operative skill assessment in surgical videos using region-based convolutional neural networks. In 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) 691\u2013699 (IEEE, 2018).","DOI":"10.1109\/WACV.2018.00081"},{"key":"376_CR122","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1109\/TMI.2016.2593957","volume":"36","author":"AP Twinanda","year":"2017","unstructured":"Twinanda, A. P. et al. EndoNet: a deep architecture for recognition tasks on laparoscopic videos. IEEE Trans. Med. Imaging 36, 86\u201397 (2017).","journal-title":"IEEE Trans. Med. Imaging"},{"key":"376_CR123","doi-asserted-by":"publisher","first-page":"220","DOI":"10.3109\/10929080600989189","volume":"11","author":"HC Lin","year":"2006","unstructured":"Lin, H. C., Shafran, I., Yuh, D. & Hager, G. D. Towards automatic skill evaluation: detection and segmentation of robot-assisted surgical motions. Comput. Aided Surg. 11, 220\u2013230 (2006).","journal-title":"Comput. Aided Surg."},{"key":"376_CR124","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2020.1664","volume":"3","author":"S Khalid","year":"2020","unstructured":"Khalid, S., Goldenberg, M., Grantcharov, T., Taati, B. & Rudzicz, F. Evaluation of deep learning models for identifying surgical actions and measuring performance. JAMA Netw. Open 3, e201664 (2020).","journal-title":"JAMA Netw. Open"},{"key":"376_CR125","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1016\/j.amjsurg.2005.04.004","volume":"190","author":"MC Vassiliou","year":"2005","unstructured":"Vassiliou, M. C. et al. A global assessment tool for evaluation of intraoperative laparoscopic skills. Am. J. Surg. 190, 107\u2013113 (2005).","journal-title":"Am. J. Surg."},{"key":"376_CR126","doi-asserted-by":"publisher","first-page":"1114","DOI":"10.1109\/TMI.2017.2787657","volume":"37","author":"Y Jin","year":"2018","unstructured":"Jin, Y. et al. SV-RCNet: Workflow recognition from surgical videos using recurrent convolutional network. IEEE Trans. Med. Imaging 37, 1114\u20131126 (2018).","journal-title":"IEEE Trans. Med. Imaging"},{"key":"376_CR127","doi-asserted-by":"publisher","first-page":"632","DOI":"10.1016\/j.media.2010.10.001","volume":"16","author":"N Padoy","year":"2012","unstructured":"Padoy, N. et al. Statistical modeling and recognition of surgical workflow. Med. Image Anal. 16, 632\u2013641 (2012).","journal-title":"Med. Image Anal."},{"key":"376_CR128","doi-asserted-by":"publisher","first-page":"574","DOI":"10.1097\/SLA.0000000000002478","volume":"269","author":"DP Azari","year":"2019","unstructured":"Azari, D. P. et al. Modeling surgical technical skill using expert assessment for automated computer rating. Ann. Surg. 269, 574\u2013581 (2019).","journal-title":"Ann. Surg."},{"key":"376_CR129","doi-asserted-by":"publisher","first-page":"630","DOI":"10.1097\/CCM.0000000000002265","volume":"45","author":"AJ Ma","year":"2017","unstructured":"Ma, A. J. et al. Measuring patient mobility in the ICU using a novel noninvasive sensor. Crit. Care Med. 45, 630\u2013636 (2017).","journal-title":"Crit. Care Med."},{"key":"376_CR130","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-019-44004-w","volume":"9","author":"A Davoudi","year":"2019","unstructured":"Davoudi, A. et al. Intelligent ICU for autonomous patient monitoring using pervasive sensing and deep learning. Sci. Rep. 9, 8020 (2019).","journal-title":"Sci. Rep."},{"key":"376_CR131","doi-asserted-by":"crossref","unstructured":"Chakraborty, I., Elgammal, A. & Burd, R. S. Video based activity recognition in trauma resuscitation. In 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) 1\u20138 (IEEE, 2013).","DOI":"10.1109\/FG.2013.6553758"},{"key":"376_CR132","doi-asserted-by":"publisher","first-page":"737","DOI":"10.1007\/s11548-015-1186-1","volume":"10","author":"AP Twinanda","year":"2015","unstructured":"Twinanda, A. P., Alkan, E. O., Gangi, A., de Mathelin, M. & Padoy, N. Data-driven spatio-temporal RGBD feature encoding for action recognition in operating rooms. Int. J. Comput. Assist. Radiol. Surg. 10, 737\u2013747 (2015).","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"376_CR133","first-page":"46","volume":"89","author":"RS Kaplan","year":"2011","unstructured":"Kaplan, R. S. & Porter, M. E. How to solve the cost crisis in health care. Harv. Bus. Rev. 89, 46\u201352 (2011). 54, 56\u201361 passim.","journal-title":"Harv. Bus. Rev."},{"key":"376_CR134","doi-asserted-by":"publisher","first-page":"11603","DOI":"10.1007\/s11042-015-2698-y","volume":"75","author":"S Wang","year":"2016","unstructured":"Wang, S., Chen, L., Zhou, Z., Sun, X. & Dong, J. Human fall detection in surveillance video based on PCANet. Multimed. Tools Appl. 75, 11603\u201311613 (2016).","journal-title":"Multimed. Tools Appl."},{"key":"376_CR135","doi-asserted-by":"crossref","unstructured":"N\u00fa\u00f1ez-Marcos, A., Azkune, G. & Arganda-Carreras, I. Vision-Based Fall Detection with Convolutional Neural Networks. In Proc. International Wireless Communications and Mobile Computing Conference 2017 (ACM, 2017).","DOI":"10.1155\/2017\/9474806"},{"key":"376_CR136","unstructured":"Luo, Z. et al. Computer vision-based descriptive analytics of seniors\u2019 daily activities for long-term health monitoring. In Machine Learning for Healthcare (MLHC) 2 (JMLR, 2018)."},{"key":"376_CR137","doi-asserted-by":"publisher","first-page":"12","DOI":"10.4018\/ijcvip.2012040102","volume":"2","author":"C Zhang","year":"2012","unstructured":"Zhang, C. & Tian, Y. RGB-D camera-based daily living activity recognition. J. Comput. Vis. image Process. 2, 12 (2012).","journal-title":"J. Comput. Vis. image Process."},{"key":"376_CR138","doi-asserted-by":"crossref","unstructured":"Pirsiavash, H. & Ramanan, D. Detecting activities of daily living in first-person camera views. In 2012 IEEE Conference on Computer Vision and Pattern Recognition 2847\u20132854 (IEEE, 2012).","DOI":"10.1109\/CVPR.2012.6248010"},{"key":"376_CR139","doi-asserted-by":"crossref","unstructured":"Kishore, P. V. V., Prasad, M. V. D., Kumar, D. A. & Sastry, A. S. C. S. Optical flow hand tracking and active contour hand shape features for continuous sign language recognition with artificial neural networks. In 2016 IEEE 6th International Conference on Advanced Computing (IACC) 346\u2013351 (IEEE, 2016).","DOI":"10.1109\/IACC.2016.71"},{"key":"376_CR140","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1186\/1743-0003-11-108","volume":"11","author":"D Webster","year":"2014","unstructured":"Webster, D. & Celik, O. Systematic review of Kinect applications in elderly care and stroke rehabilitation. J. Neuroeng. Rehabil. 11, 108 (2014).","journal-title":"J. Neuroeng. Rehabil."},{"key":"376_CR141","doi-asserted-by":"crossref","unstructured":"Chen, W. & McDuff, D. Deepphys: video-based physiological measurement using convolutional attention networks. In Proc. European Conference on Computer Vision (ECCV) 349\u2013365 (Springer Science+Business Media, 2018).","DOI":"10.1007\/978-3-030-01216-8_22"},{"key":"376_CR142","doi-asserted-by":"publisher","first-page":"104345","DOI":"10.1016\/j.jcv.2020.104345","volume":"126","author":"B Moazzami","year":"2020","unstructured":"Moazzami, B., Razavi-Khorasani, N., Dooghaie Moghadam, A., Farokhi, E. & Rezaei, N. COVID-19 and telemedicine: Immediate action required for maintaining healthcare providers well-being. J. Clin. Virol. 126, 104345 (2020).","journal-title":"J. Clin. Virol."},{"key":"376_CR143","doi-asserted-by":"publisher","unstructured":"Gerke, S., Yeung, S. & Cohen, I. G. Ethical and legal aspects of ambient intelligence in hospitals. JAMA https:\/\/doi.org\/10.1001\/jama.2019.21699 (2020).","DOI":"10.1001\/jama.2019.21699"},{"key":"376_CR144","doi-asserted-by":"publisher","first-page":"1504","DOI":"10.1016\/j.jid.2020.02.026","volume":"140","author":"AT Young","year":"2020","unstructured":"Young, A. T., Xiong, M., Pfau, J., Keiser, M. J. & Wei, M. L. Artificial intelligence in dermatology: a primer. J. Invest. Dermatol. 140, 1504\u20131512 (2020).","journal-title":"J. Invest. Dermatol."},{"key":"376_CR145","doi-asserted-by":"crossref","unstructured":"Schaekermann, M., Cai, C. J., Huang, A. E. & Sayres, R. Expert discussions improve comprehension of difficult cases in medical image assessment. In Proc. 2020 CHI Conference on Human Factors in Computing Systems 1\u201313 (Association for Computing Machinery, 2020).","DOI":"10.1145\/3313831.3376290"},{"key":"376_CR146","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1167\/tvst.8.6.40","volume":"8","author":"M Schaekermann","year":"2019","unstructured":"Schaekermann, M. et al. Remote tool-based adjudication for grading diabetic retinopathy. Transl. Vis. Sci. Technol. 8, 40 (2019).","journal-title":"Transl. Vis. Sci. Technol."},{"key":"376_CR147","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1023\/A:1007379606734","volume":"28","author":"R Caruana","year":"1997","unstructured":"Caruana, R. Multitask learning. Mach. Learn. 28, 41\u201375 (1997).","journal-title":"Mach. Learn."},{"key":"376_CR148","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0233678","volume":"15","author":"E Wulczyn","year":"2020","unstructured":"Wulczyn, E. et al. Deep learning-based survival prediction for multiple cancer types using histopathology images. PLoS ONE 15, e0233678 (2020).","journal-title":"PLoS ONE"},{"key":"376_CR149","unstructured":"Simonyan, K., Vedaldi, A. & Zisserman, A. Deep inside convolutional networks: visualising image classification models and saliency maps. Preprint at https:\/\/arxiv.org\/abs\/1312.6034 (2013)."},{"key":"376_CR150","unstructured":"Ren, J. et al. in Advances in Neural Information Processing Systems 32 (eds Wallach, H. et al.) 14707\u201314718 (Curran Associates, Inc., 2019)."},{"key":"376_CR151","doi-asserted-by":"crossref","unstructured":"Dusenberry, M. W. et al. Analyzing the role of model uncertainty for electronic health records. In Proc. ACM Conference on Health, Inference, and Learning 204\u2013213 (Association for Computing Machinery, 2020).","DOI":"10.1145\/3368555.3384457"},{"key":"376_CR152","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1126\/science.aax2342","volume":"366","author":"Z Obermeyer","year":"2019","unstructured":"Obermeyer, Z., Powers, B., Vogeli, C. & Mullainathan, S. Dissecting racial bias in an algorithm used to manage the health of populations. Science 366, 447\u2013453 (2019).","journal-title":"Science"},{"key":"376_CR153","doi-asserted-by":"publisher","first-page":"m3164","DOI":"10.1136\/bmj.m3164","volume":"370","author":"X Liu","year":"2020","unstructured":"Liu, X. et al. Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI Extension. BMJ 370, m3164 (2020).","journal-title":"BMJ"},{"key":"376_CR154","doi-asserted-by":"publisher","first-page":"m3210","DOI":"10.1136\/bmj.m3210","volume":"370","author":"SC Rivera","year":"2020","unstructured":"Rivera, S. C. et al. Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI Extension. BMJ 370, m3210 (2020).","journal-title":"BMJ"},{"key":"376_CR155","doi-asserted-by":"publisher","DOI":"10.2196\/15154","volume":"22","author":"O Asan","year":"2020","unstructured":"Asan, O., Bayrak, A. E. & Choudhury, A. Artificial intelligence and human trust in healthcare: focus on clinicians. J. Med. Internet Res. 22, e15154 (2020).","journal-title":"J. Med. Internet Res."},{"key":"376_CR156","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1038\/s41586-019-1799-6","volume":"577","author":"SM McKinney","year":"2020","unstructured":"McKinney, S. M. et al. International evaluation of an AI system for breast cancer screening. Nature 577, 89\u201394 (2020).","journal-title":"Nature"},{"key":"376_CR157","doi-asserted-by":"publisher","unstructured":"Kamulegeya, L. H. et al. Using artificial intelligence on dermatology conditions in Uganda: a case for diversity in training data sets for machine learning. https:\/\/doi.org\/10.1101\/826057 (2019).","DOI":"10.1101\/826057"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-00376-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-00376-2","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-00376-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,17]],"date-time":"2023-10-17T06:36:33Z","timestamp":1697524593000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-00376-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,8]]},"references-count":157,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["376"],"URL":"https:\/\/doi.org\/10.1038\/s41746-020-00376-2","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,8]]},"assertion":[{"value":"17 August 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 December 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 January 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A.E., N.N., Ali Madani, and R.S. are or were employees of Salesforce.com and own Salesforce stock. K.C., Y.L., and J.D. are employees of Google, L.L.C. and own Alphabet stock. S.Y., Ali Mottaghi and E.T. have no competing interests to declare.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"5"}}