{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,16]],"date-time":"2026-05-16T16:04:06Z","timestamp":1778947446148,"version":"3.51.4"},"reference-count":49,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2018,11,8]],"date-time":"2018-11-08T00:00:00Z","timestamp":1541635200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2018,11,8]],"date-time":"2018-11-08T00:00:00Z","timestamp":1541635200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digital Med"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Inexpensive embedded computing and the related Internet of Things technologies enable the recent development of smart products that can respond to human needs and improve everyday tasks in an attempt to make traditional environments more \u201cintelligent\u201d. Several projects have augmented mirrors for a range of smarter applications in automobiles and homes. The opportunity to apply smart mirror technology to healthcare to predict and to monitor aspects of health and disease is a natural but mostly underdeveloped idea. We envision that smart mirrors comprising a combination of intelligent hardware and software could identify subtle, yet clinically relevant changes in physique and appearance. Similarly, a smart mirror could record and evaluate body position and motion to identify posture and movement issues, as well as offer feedback for corrective actions. Successful development and implementation of smart mirrors for healthcare applications will require overcoming new challenges in engineering, machine learning, computer vision, and biomedical research. This paper examines the potential uses of smart mirrors in healthcare and explores how this technology might benefit users in various medical environments. We also provide a brief description of the state-of-the-art, including a functional prototype concept developed by our group, and highlight the directions to make this device more mainstream in health-related applications.<\/jats:p>","DOI":"10.1038\/s41746-018-0068-7","type":"journal-article","created":{"date-parts":[[2018,11,2]],"date-time":"2018-11-02T13:34:41Z","timestamp":1541165681000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":50,"title":["Reflecting health: smart mirrors for personalized medicine"],"prefix":"10.1038","volume":"1","author":[{"given":"Riccardo","family":"Miotto","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matteo","family":"Danieletto","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jerome R.","family":"Scelza","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brian A.","family":"Kidd","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joel T.","family":"Dudley","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2018,11,8]]},"reference":[{"key":"68_CR1","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1109\/MC.2005.107","volume":"38","author":"S Helal","year":"2005","unstructured":"Helal, S. et al. The gator tech smart house: a programmable pervasive space. Computer 38, 50\u201360 (2005).","journal-title":"Computer"},{"key":"68_CR2","doi-asserted-by":"publisher","first-page":"775","DOI":"10.1097\/01.opx.0000237925.65901.c0","volume":"83","author":"JM Enoch","year":"2006","unstructured":"Enoch, J. M. History of mirrors dating back 8000 years. Optom. Vis. Sci. 83, 775\u2013781 (2006).","journal-title":"Optom. Vis. Sci."},{"key":"68_CR3","doi-asserted-by":"crossref","unstructured":"Anwar Hossain, M., Atrey, P. K. & El Saddik, A. Smart mirror for ambient home environment. In The 3rd IET International Conference on Intelligent Environments 589\u2013596 (IET Conference Publications, Ulm, 2007).","DOI":"10.1049\/cp:20070431"},{"key":"68_CR4","doi-asserted-by":"crossref","unstructured":"Pan, J., Appia, V., Villarreal, J., Weaver, L. & Kwon, D.-K. Rear-stitched view panorama: a low-power embedded implementation for smart rear-view mirrors on vehicles. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition Workshops 20\u201329 (2017).","DOI":"10.1109\/CVPRW.2017.157"},{"key":"68_CR5","unstructured":"Nissan Motor Co. Intelligent Rearview Mirror. Nissan Technological Development Activities https:\/\/www.nissan-global.com\/EN\/TECHNOLOGY\/OVERVIEW\/smart_rearview_mirror.html. Accessed 20 March 2018."},{"key":"68_CR6","unstructured":"Memomi: A. Memory Mirror. http:\/\/memorymirror.com\/. Accessed 20 March 2018."},{"issue":"1","key":"68_CR7","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1093\/bib\/bbv118","volume":"18","author":"Khader Shameer","year":"2016","unstructured":"Shameer, K. et al. Translational bioinformatics in the era of real-time biomedical, health care and wellness data streams. Brief. Bioinformatics 18, 105\u2013124 (2016).","journal-title":"Briefings in Bioinformatics"},{"key":"68_CR8","doi-asserted-by":"publisher","first-page":"1215","DOI":"10.1001\/jama.2017.11295","volume":"318","author":"TR Insel","year":"2017","unstructured":"Insel, T. R. Digital phenotyping: technology for a new science of behavior. JAMA 318, 1215\u20131216 (2017).","journal-title":"JAMA"},{"key":"68_CR9","unstructured":"Mango Mirror - Reflect your best life! https:\/\/www.mangomirror.com\/. Accessed 19 April 2018"},{"key":"68_CR10","doi-asserted-by":"publisher","first-page":"2109","DOI":"10.1007\/s10845-011-0618-1","volume":"23","author":"M Akhlaq","year":"2012","unstructured":"Akhlaq, M., Sheltami, T. R., Helgeson, B. & Shakshuki, E. M. Designing an integrated driver assistance system using image sensors. J. Intell. Manuf. 23, 2109\u20132132 (2012).","journal-title":"J. Intell. Manuf."},{"key":"68_CR11","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1016\/j.jretconser.2016.08.006","volume":"40","author":"M Beck","year":"2018","unstructured":"Beck, M. & Cri\u00e9, D. I virtually try it \u2026 I want it ! Virtual fitting room: a tool to increase on-line and off-line exploratory behavior, patronage and purchase intentions. J. Retail. Consum. Serv. 40, 279\u2013286 (2018).","journal-title":"J. Retail. Consum. Serv."},{"key":"68_CR12","first-page":"1","volume":"2","author":"MZ Poh","year":"2011","unstructured":"Poh, M.-Z., McDuff, D. & Picard, R. A medical mirror for non-contact health monitoring. ACM SIGGRAPH 2011 Emerg. Technol. 2, 1 (2011).","journal-title":"ACM SIGGRAPH 2011 Emerg. Technol."},{"key":"68_CR13","doi-asserted-by":"publisher","first-page":"10762","DOI":"10.1364\/OE.18.010762","volume":"18","author":"MZ Poh","year":"2010","unstructured":"Poh, M.-Z., McDuff, D. J. & Picard, R. W. Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. Opt. Express 18, 10762\u201310774 (2010).","journal-title":"Opt. Express"},{"key":"68_CR14","doi-asserted-by":"crossref","unstructured":"Besserer, D. et al. Fitmirror: a smart mirror for positive affect in everyday user morning routines. In Proc. of the Workshop on Multimodal Analyses Enabling Artificial Agents in Human-Machine Interaction 48\u201355 (ACM, New York, NY, 2016).","DOI":"10.1145\/3011263.3011265"},{"key":"68_CR15","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1016\/j.biosystemseng.2015.06.008","volume":"138","author":"S Colantonio","year":"2015","unstructured":"Colantonio, S. et al. A smart mirror to promote a healthy lifestyle. Biosyst. Eng. 138, 33\u201343 (2015).","journal-title":"Biosyst. Eng."},{"key":"68_CR16","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.cviu.2016.03.018","volume":"148","author":"Y Andreu","year":"2016","unstructured":"Andreu, Y. et al. Wize Mirror - a smart, multisensory cardio-metabolic risk monitoring system. Comput. Vis. Image Underst. 148, 3\u201322 (2016).","journal-title":"Comput. Vis. Image Underst."},{"key":"68_CR17","doi-asserted-by":"publisher","first-page":"3575","DOI":"10.1098\/rstb.2009.0143","volume":"364","author":"RW Picard","year":"2009","unstructured":"Picard, R. W. Future affective technology for autism and emotion communication. Philos. Trans. R. Soc. Lond. B. Biol. Sci. 364, 3575\u20133584 (2009).","journal-title":"Philos. Trans. R. Soc. Lond. B. Biol. Sci."},{"issue":"7","key":"68_CR18","doi-asserted-by":"publisher","first-page":"876","DOI":"10.1001\/jamaneurol.2018.0809","volume":"75","author":"Andong Zhan","year":"2018","unstructured":"Zhan, A. et al. Using smartphones and machine learning to quantify Parkinson disease severity: the mobile parkinson disease score. JAMA Neurol. 75, 876\u2013880 (2018).","journal-title":"JAMA Neurology"},{"key":"68_CR19","unstructured":"Gomez-Carmona, O. & Casado-Mansilla, D. SmiWork: an interactive smart mirror platform for workplace health promotion. In 2nd International Multidisciplinary Conference on Computer and Energy Science (SpliTech), 2017 1\u20136 (IEEE, Split, 2017)."},{"key":"68_CR20","doi-asserted-by":"publisher","first-page":"358","DOI":"10.1016\/S0140-6736(17)30154-X","volume":"389","author":"ED Muse","year":"2017","unstructured":"Muse, E. D., Barrett, P. M., Steinhubl, S. R. & Topol, E. J. Towards a smart medical home. Lancet 389, 358 (2017).","journal-title":"Lancet"},{"key":"68_CR21","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun, Y., Bengio, Y. & Hinton, G. Deep learning. Nature 521, 436\u2013444 (2015).","journal-title":"Nature"},{"key":"68_CR22","doi-asserted-by":"crossref","unstructured":"Kim, J., Lee, J. K. & Lee, K. M. Deeply-recursive convolutional network for image super-resolution. arXiv [cs.CV] (2015).","DOI":"10.1109\/CVPR.2016.181"},{"key":"68_CR23","doi-asserted-by":"crossref","unstructured":"Ledig, C. et al. Photo-realistic single image super-resolution using a generative adversarial network. arXiv preprint (2016).","DOI":"10.1109\/CVPR.2017.19"},{"key":"68_CR24","doi-asserted-by":"crossref","unstructured":"Dahl, R., Norouzi, M. & Shlens, J. Pixel recursive super resolution. arXiv [cs.CV] (2017).","DOI":"10.1109\/ICCV.2017.581"},{"key":"68_CR25","unstructured":"Karras, T., Aila, T., Laine, S. & Lehtinen, J. Progressive growing of GANs for improved quality, stability, and variation. arXiv [cs.NE] (2017)."},{"key":"68_CR26","doi-asserted-by":"crossref","unstructured":"Miotto, R., Wang, F., Wang, S., Jiang, X. & Dudley, J. T. Deep learning for healthcare: review, opportunities and challenges. Brief. Bioinformatics bbx044, (2017).","DOI":"10.1093\/bib\/bbx044"},{"key":"68_CR27","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1016\/j.media.2017.07.005","volume":"42","author":"G Litjens","year":"2017","unstructured":"Litjens, G. et al. A survey on deep learning in medical image analysis. Med. Image Anal. 42, 60\u201388 (2017).","journal-title":"Med. Image Anal."},{"key":"68_CR28","doi-asserted-by":"publisher","first-page":"1271","DOI":"10.1056\/NEJMp1716891","volume":"378","author":"S Yeung","year":"2018","unstructured":"Yeung, S., Downing, N. L., Fei-Fei, L. & Milstein, A. Bedside computer vision - moving artificial intelligence from driver assistance to patient safety. N. Engl. J. Med. 378, 1271\u20131273 (2018).","journal-title":"N. Engl. J. Med."},{"key":"68_CR29","doi-asserted-by":"publisher","first-page":"2668","DOI":"10.1016\/j.jacc.2018.03.521","volume":"71","author":"KW Johnson","year":"2018","unstructured":"Johnson, K. W. et al. Artificial intelligence in cardiology. J. Am. Coll. Cardiol. 71, 2668\u20132679 (2018).","journal-title":"J. Am. Coll. Cardiol."},{"key":"68_CR30","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1016\/S0140-6736(17)31764-6","volume":"390","author":"G Quer","year":"2017","unstructured":"Quer, G., Muse, E. D., Nikzad, N., Topol, E. J. & Steinhubl, S. R. Augmenting diagnostic vision with AI. Lancet 390, 221 (2017).","journal-title":"Lancet"},{"key":"68_CR31","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1038\/s41551-018-0195-0","volume":"2","author":"R Poplin","year":"2018","unstructured":"Poplin, R. et al. Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning. Nat. Biomed. Eng. 2, 158\u2013164 (2018).","journal-title":"Nat. Biomed. Eng."},{"issue":"22","key":"68_CR32","doi-asserted-by":"publisher","first-page":"2402","DOI":"10.1001\/jama.2016.17216","volume":"316","author":"Varun Gulshan","year":"2016","unstructured":"Gulshan, V. et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316, 2402\u20132410 (2016).","journal-title":"JAMA"},{"issue":"7639","key":"68_CR33","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nature21056","volume":"542","author":"Andre Esteva","year":"2017","unstructured":"Esteva, A. et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature 542, 115\u2013118 (2017).","journal-title":"Nature"},{"key":"68_CR34","unstructured":"A skin cancer melanoma detection App. SkinVision. https:\/\/www.skinvision.com\/. Accessed 22 March 2018."},{"key":"68_CR35","doi-asserted-by":"crossref","unstructured":"Toshev, A. & Szegedy, C. Deeppose: Human pose estimation via deep neural networks. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition 1653\u20131660 (2014).","DOI":"10.1109\/CVPR.2014.214"},{"key":"68_CR36","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1007\/978-3-319-16808-1_21","volume-title":"Computer Vision -- ACCV 2014","author":"Arjun Jain","year":"2015","unstructured":"Jain, A., Tompson, J., LeCun, Y. & Bregler, C. MoDeep: a deep learning framework using motion features for human pose estimation. In Computer Vision\u2014ACCV 2014 302\u2013315 (Springer International Publishing, Singapore, 2015)."},{"key":"68_CR37","doi-asserted-by":"crossref","unstructured":"G\u00fcler, R. A., Neverova, N. & Kokkinos, I. DensePose: dense human pose estimation in the wild. arXiv [cs.CV] (2018).","DOI":"10.1109\/CVPR.2018.00762"},{"key":"68_CR38","doi-asserted-by":"crossref","unstructured":"Cvetkoska, B., Marina, N., Bogatinoska, D. C. & Mitreski, Z. Smart mirror E-health assistant\u2014Posture analyze algorithm proposed model for upright posture. In IEEE EUROCON 2017-17th International Conference on Smart Technologies 507\u2013512 (IEEE, Ohrid, 2017).","DOI":"10.1109\/EUROCON.2017.8011163"},{"key":"68_CR39","unstructured":"Moon, Y. B. et al. Smart mirror health management services based on iot platform. In Proc. of the 14th International Conference on Applications of Computer Engineering 87\u201389 (2013)."},{"key":"68_CR40","unstructured":"Choi, E., Bahadori, M. T., Schuetz, A., Stewart, W. F. & Sun, J. Doctor AI: Predicting Clinical Events via Recurrent Neural Networks. arXiv [cs.LG] (2015)."},{"key":"68_CR41","doi-asserted-by":"publisher","DOI":"10.1038\/srep26094","volume":"6","author":"R Miotto","year":"2016","unstructured":"Miotto, R., Li, L., Kidd, B. A. & Dudley, J. T. Deep Patient: an unsupervised representation to predict the future of patients from the electronic health records. Sci. Rep. 6, 26094 (2016).","journal-title":"Sci. Rep."},{"issue":"5","key":"68_CR42","doi-asserted-by":"publisher","first-page":"429","DOI":"10.2217\/pme-2018-0044","volume":"15","author":"Jessilyn Dunn","year":"2018","unstructured":"Dunn, J., Runge, R. & Snyder, M. Wearables and the medical revolution. Per. Med. 15, 429\u2013448 (2018).","journal-title":"Personalized Medicine"},{"key":"68_CR43","doi-asserted-by":"crossref","unstructured":"Hippocrate, A. A. E., Luhanga, E. T., Masashi, T., Watanabe, K. & Yasumoto, K. Smart Gyms Need Smart Mirrors: Design of a Smart Gym Concept Through Contextual Inquiry. In Proc. of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers 658\u2013661 (ACM, Honolulu, 2017).","DOI":"10.1145\/3123024.3124427"},{"key":"68_CR44","doi-asserted-by":"crossref","unstructured":"Nazari Khanamiri, H., Nakatsuka, A. & El-Annan, J. Smartphone Fundus Photography. J. Vis. Exp. 125, 55958 (2017).","DOI":"10.3791\/55958"},{"key":"68_CR45","doi-asserted-by":"publisher","first-page":"170","DOI":"10.4103\/0301-4738.154407","volume":"63","author":"B Raju","year":"2015","unstructured":"Raju, B. & Raju, N. S. D. Regarding fundus imaging with a mobile phone: a review of techniques. Indian J. Ophthalmol. 63, 170\u2013171 (2015).","journal-title":"Indian J. Ophthalmol."},{"key":"68_CR46","doi-asserted-by":"publisher","first-page":"743","DOI":"10.1038\/gim.2016.183","volume":"19","author":"PL Sankar","year":"2016","unstructured":"Sankar, P. L. & Parker, L. S. The Precision Medicine Initiative\u2019s All of Us Research Program: an agenda for research on its ethical, legal, and social issues. Genet. Med. 19, 743 (2016).","journal-title":"Genet. Med."},{"key":"68_CR47","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1001\/jamacardio.2016.4395","volume":"2","author":"MV McConnell","year":"2017","unstructured":"McConnell, M. V. et al. Feasibility of obtaining measures of lifestyle from a smartphone app: the MyHeart counts cardiovascular health study. JAMA Cardiol. 2, 67\u201376 (2017).","journal-title":"JAMA Cardiol."},{"key":"68_CR48","doi-asserted-by":"publisher","first-page":"336","DOI":"10.1038\/nature23018","volume":"547","author":"T Althoff","year":"2017","unstructured":"Althoff, T. et al. Large-scale physical activity data reveal worldwide activity inequality. Nature 547, 336\u2013339 (2017).","journal-title":"Nature"},{"key":"68_CR49","doi-asserted-by":"publisher","DOI":"10.1186\/s12889-018-5123-4","volume":"18","author":"I Ten Haken","year":"2018","unstructured":"Ten Haken, I., Ben Allouch, S. & van Harten, W. H. The use of advanced medical technologies at home: a systematic review of the literature. BMC Public Health 18, 284 (2018).","journal-title":"BMC Public Health"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-018-0068-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-018-0068-7","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-018-0068-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,21]],"date-time":"2022-12-21T12:44:13Z","timestamp":1671626653000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-018-0068-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,11,8]]},"references-count":49,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2018,12]]}},"alternative-id":["68"],"URL":"https:\/\/doi.org\/10.1038\/s41746-018-0068-7","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,11,8]]},"assertion":[{"value":"7 August 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 October 2018","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 November 2018","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"62"}}