{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T16:04:06Z","timestamp":1781625846792,"version":"3.54.5"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2021,5,3]],"date-time":"2021-05-03T00:00:00Z","timestamp":1620000000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,5,3]],"date-time":"2021-05-03T00:00:00Z","timestamp":1620000000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100007065","name":"Universit\u00e0 degli Studi di Salerno","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100007065","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Real-Time Image Proc"],"published-print":{"date-parts":[[2021,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Melanoma is considered the deadliest skin cancer and when it is in an advanced state it is difficult to treat. Diagnoses are visually performed by dermatologists, by naked-eye observation. This paper proposes an augmented reality smartphone application for supporting the dermatologist in the real-time analysis of a skin lesion. The app augments the camera view with information related to the lesion features generally measured by the dermatologist for formulating the diagnosis. The lesion is also classified by a deep learning approach for identifying melanoma. The real-time process adopted for generating the augmented content is described. The real-time performances are also evaluated and a user study is also conducted. Results revealed that the real-time process may be entirely executed on the Smartphone and that the support provided is well judged by the target users.<\/jats:p>","DOI":"10.1007\/s11554-021-01109-8","type":"journal-article","created":{"date-parts":[[2021,5,3]],"date-time":"2021-05-03T19:52:31Z","timestamp":1620071551000},"page":"1247-1259","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["A mobile augmented reality application for supporting real-time skin lesion analysis based on deep learning"],"prefix":"10.1007","volume":"18","author":[{"given":"Rita","family":"Francese","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria","family":"Frasca","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michele","family":"Risi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Genoveffa","family":"Tortora","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,5,3]]},"reference":[{"issue":"22","key":"1109_CR1","doi-asserted-by":"publisher","first-page":"2771","DOI":"10.1001\/jama.292.22.2771","volume":"292","author":"NR Abbasi","year":"2004","unstructured":"Abbasi, N.R., Shaw, H.M., Rigel, D.S., Friedman, R.J., McCarthy, W.H., Osman, I., Kopf, A.W., Polsky, D.: Early diagnosis of cutaneous melanoma: revisiting the abcd criteria. JAMA 292(22), 2771\u20132776 (2004)","journal-title":"JAMA"},{"key":"1109_CR2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/JTEHM.2015.2419612","volume":"3","author":"O Abuzaghleh","year":"2015","unstructured":"Abuzaghleh, O., Barkana, B.D., Faezipour, M.: Noninvasive real-time automated skin lesion analysis system for melanoma early detection and prevention. IEEE J. Transl. Eng. Health Med. 3, 1\u201312 (2015)","journal-title":"IEEE J. Transl. Eng. Health Med."},{"issue":"2","key":"1109_CR3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.5826\/dpc.0702a01","volume":"7","author":"Z Apalla","year":"2017","unstructured":"Apalla, Z., Lallas, A., Sotiriou, E., Lazaridou, E., Ioannides, D.: Epidemiological trends in skin cancer. Dermatol. Pract. Concept. 7(2), 1 (2017)","journal-title":"Dermatol. Pract. Concept."},{"issue":"3","key":"1109_CR4","doi-asserted-by":"publisher","first-page":"158","DOI":"10.4103\/2229-5178.156381","volume":"6","author":"K Ashique","year":"2015","unstructured":"Ashique, K., Kaliyadan, F., Aurangabadkar, S.J.: Clinical photography in dermatology using smartphones: An overview. Indian Dermatol. Online J. 6(3), 158 (2015)","journal-title":"Indian Dermatol. Online J."},{"issue":"1","key":"1109_CR5","doi-asserted-by":"publisher","first-page":"13","DOI":"10.5826\/dpc.0201a03","volume":"2","author":"M B\u00e4r","year":"2012","unstructured":"B\u00e4r, M., Tschandl, P., Kittler, H.: Differentiation of pigmented spitz nevi and reed nevi by integration of dermatopathologic and dermatoscopic findings. Dermatol. Pract. Concept. 2(1), 13 (2012)","journal-title":"Dermatol. Pract. Concept."},{"issue":"3","key":"1109_CR6","doi-asserted-by":"publisher","first-page":"965","DOI":"10.1109\/JSYST.2013.2271540","volume":"8","author":"C Barata","year":"2013","unstructured":"Barata, C., Ruela, M., Francisco, M., Mendon\u00e7a, T., Marques, J.S.: Two systems for the detection of melanomas in dermoscopy images using texture and color features. IEEE Syst. J. 8(3), 965\u2013979 (2013)","journal-title":"IEEE Syst. J."},{"issue":"3","key":"1109_CR7","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1007\/s11263-006-8815-7","volume":"72","author":"R Basri","year":"2007","unstructured":"Basri, R., Jacobs, D., Kemelmacher, I.: Photometric stereo with general, unknown lighting. Int. J. Comput. Vis. 72(3), 239\u2013257 (2007)","journal-title":"Int. J. Comput. Vis."},{"issue":"194","key":"1109_CR8","first-page":"4","volume":"189","author":"J Brooke","year":"1996","unstructured":"Brooke, J.: SUS\u2014a quick and dirty usability scale. Usability Eval. Ind. 189(194), 4\u20137 (1996)","journal-title":"Usability Eval. Ind."},{"issue":"1","key":"1109_CR9","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1097\/00008469-200502000-00007","volume":"14","author":"P Carli","year":"2005","unstructured":"Carli, P., De Giorgi, V., Crocetti, E., Caldini, L., Ressel, C., Giannotti, B.: Diagnostic and referral accuracy of family doctors in melanoma screening: effect of a short formal training. Eur. J. Cancer Prev. 14(1), 51\u201355 (2005)","journal-title":"Eur. J. Cancer Prev."},{"key":"1109_CR10","doi-asserted-by":"crossref","unstructured":"Castro, P.B., Krohling, B., Pacheco, A.G., Krohling, R.A.: An app to detect melanoma using deep learning: an approach to handle imbalanced data based on evolutionary algorithms. In: International Joint Conference on Neural Networks (IJCNN), pp. 1\u20136. IEEE (2020)","DOI":"10.1109\/IJCNN48605.2020.9207552"},{"issue":"6","key":"1109_CR11","doi-asserted-by":"publisher","first-page":"362","DOI":"10.1016\/j.compmedimag.2007.01.003","volume":"31","author":"ME Celebi","year":"2007","unstructured":"Celebi, M.E., Kingravi, H.A., Uddin, B., Iyatomi, H., Aslandogan, Y.A., Stoecker, W.V., Moss, R.H.: A methodological approach to the classification of dermoscopy images. Comput. Med. Imaging Graph. 31(6), 362\u2013373 (2007)","journal-title":"Comput. Med. Imaging Graph."},{"issue":"1","key":"1109_CR12","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1109\/34.368149","volume":"17","author":"BB Chaudhuri","year":"1995","unstructured":"Chaudhuri, B.B., Sarkar, N.: Texture segmentation using fractal dimension. IEEE Trans. Pattern Anal. Mach. Intell. 17(1), 72\u201377 (1995)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"issue":"1","key":"1109_CR13","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1089\/tmj.2014.0249","volume":"22","author":"RH Chen","year":"2016","unstructured":"Chen, R.H., Snorrason, M., Enger, S.M., Mostafa, E., Ko, J.M., Aoki, V., Bowling, J.: Validation of a skin-lesion image-matching algorithm based on computer vision technology. Telemed. e-Health 22(1), 45\u201350 (2016)","journal-title":"Telemed. e-Health"},{"issue":"5","key":"1109_CR14","doi-asserted-by":"publisher","first-page":"306","DOI":"10.1177\/120347541201600506","volume":"16","author":"MD Corbo","year":"2012","unstructured":"Corbo, M.D., Wismer, J.: Agreement between dermatologists and primary care practitioners in the diagnosis of malignant melanoma: review of the literature. J. Cutan. Med. Surg. 16(5), 306\u2013310 (2012)","journal-title":"J. Cutan. Med. Surg."},{"key":"1109_CR15","doi-asserted-by":"crossref","unstructured":"Criminisi, A., Perez, P., Toyama, K.: Object removal by exemplar-based inpainting. In: Computer Vision and Pattern Recognition, vol.\u00a02. IEEE (2003)","DOI":"10.1109\/CVPR.2003.1211538"},{"key":"1109_CR16","unstructured":"Dermengine.: https:\/\/www.dermengine.com"},{"issue":"10","key":"1109_CR17","doi-asserted-by":"publisher","first-page":"2849","DOI":"10.1109\/TMM.2018.2814346","volume":"20","author":"T Do","year":"2018","unstructured":"Do, T., Hoang, T., Pomponiu, V., Zhou, Y., Chen, Z., Cheung, N., Koh, D., Tan, A., Tan, S.: Accessible melanoma detection using smartphones and mobile image analysis. IEEE Trans. Multimed. 20(10), 2849\u20132864 (2018)","journal-title":"IEEE Trans. Multimed."},{"issue":"1","key":"1109_CR18","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1109\/JSTSP.2008.2011156","volume":"3","author":"J Fernandez Alcon","year":"2009","unstructured":"Fernandez Alcon, J., Ciuhu, C., ten Kate, W., Heinrich, A., Uzunbajakava, N., Krekels, G., Siem, D., de Haan, G.: Automatic imaging system with decision support for inspection of pigmented skin lesions and melanoma diagnosis. J. Sel. Top. Signal Process. 3(1), 14\u201325 (2009)","journal-title":"J. Sel. Top. Signal Process."},{"key":"1109_CR19","doi-asserted-by":"crossref","unstructured":"Francese, R., Frasca, M., Risi, M., Tortora, G.: An augmented reality mobile application for skin lesion data visualization. In: 24th International Conference on Information Visualisation (IV), pp. 51\u201356 (2020)","DOI":"10.1109\/IV51561.2020.00018"},{"key":"1109_CR20","unstructured":"Frasca, M., Nappi, M., Risi, M., Tortora, G., Citarella, A.A.: A comparison of neural network approaches for melanoma classification. In: 25th International Conference on Pattern Recognition (ICPR) (2020)"},{"key":"1109_CR21","doi-asserted-by":"crossref","unstructured":"Freeman, K., Dinnes, J., Chuchu, N., Takwoingi, Y., Bayliss, S.E., Matin, R.N., Jain, A., Walter, F.M., Williams, H.C., Deeks, J.J.: Algorithm based smartphone apps to assess risk of skin cancer in adults: systematic review of diagnostic accuracy studies. BMJ 368 (2020)","DOI":"10.1136\/bmj.m127"},{"issue":"3","key":"1109_CR22","doi-asserted-by":"publisher","first-page":"130","DOI":"10.3322\/canjclin.35.3.130","volume":"35","author":"RJ Friedman","year":"1985","unstructured":"Friedman, R.J., Rigel, D.S., Kopf, A.W.: Early detection of malignant melanoma: the role of physician examination and self-examination of the skin. CA Cancer J. Clin. 35(3), 130\u2013151 (1985)","journal-title":"CA Cancer J. Clin."},{"key":"1109_CR23","doi-asserted-by":"crossref","unstructured":"Ignatov, A., Timofte, R., Chou, W., Wang, K., Wu, M., Hartley, T., Van\u00a0Gool, L.: Ai benchmark: Running deep neural networks on android smartphones. In: Procs. of the European Conf. on Computer Vision (ECCV) (2018)","DOI":"10.1007\/978-3-030-11021-5_19"},{"issue":"1\u20132","key":"1109_CR24","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1007\/s40487-015-0012-9","volume":"3","author":"ML Juh\u00e1sz","year":"2015","unstructured":"Juh\u00e1sz, M.L., Marmur, E.S.: Reviewing challenges in the diagnosis and treatment of lentigo maligna and lentigo-maligna melanoma. Rare Cancers Therapy 3(1\u20132), 133\u2013145 (2015)","journal-title":"Rare Cancers Therapy"},{"issue":"6","key":"1109_CR25","doi-asserted-by":"publisher","first-page":"1507","DOI":"10.1111\/bjd.13665","volume":"172","author":"A Kassianos","year":"2015","unstructured":"Kassianos, A., Emery, J., Murchie, P., Walter, F.M.: Smartphone applications for melanoma detection by community, patient and generalist clinician users: a review. Br. J. Dermatol. 172(6), 1507\u20131518 (2015)","journal-title":"Br. J. Dermatol."},{"key":"1109_CR26","doi-asserted-by":"crossref","unstructured":"Laotrakunchai, S., Wongkaew, A., Patanukhom, K.: Measurement of size and distance of objects using mobile devices. In: Intl. Conf. on Signal-Image Technology Internet-Based Systems, pp. 156\u2013161 (2013)","DOI":"10.1109\/SITIS.2013.36"},{"issue":"4","key":"1109_CR27","doi-asserted-by":"publisher","first-page":"663","DOI":"10.1111\/jdv.12648","volume":"29","author":"T Maier","year":"2015","unstructured":"Maier, T., Kulichova, D., Schotten, K., Astrid, R., Ruzicka, T., Berking, C., Udrea, A.: Accuracy of a smartphone application using fractal image analysis of pigmented moles compared to clinical diagnosis and histological result. J. Eur. Acad. Dermatol. Venereol. 29(4), 663\u2013667 (2015)","journal-title":"J. Eur. Acad. Dermatol. Venereol."},{"key":"1109_CR28","doi-asserted-by":"publisher","first-page":"103545","DOI":"10.1016\/j.compbiomed.2019.103545","volume":"116","author":"AG Pacheco","year":"2020","unstructured":"Pacheco, A.G., Krohling, R.A.: The impact of patient clinical information on automated skin cancer detection. Comput. Biol. Med. 116, 103545 (2020)","journal-title":"Comput. Biol. Med."},{"key":"1109_CR29","unstructured":"Peverelli, R., Feniks, R.D.: Skinvision: Leading mobile solution to monitor, track and understand skin health. Digital Insurance Agenda (2017). https:\/\/www.digitalinsuranceagenda.com\/featured-insurtechs\/skinvision-leading-mobile-solution-to-monitor-track-and-understand-skin-health\/"},{"key":"1109_CR30","doi-asserted-by":"crossref","unstructured":"Phillips, M., Greenhalgh, J., Marsden, H., Palamaras, I.: Detection of malignant melanoma using artificial intelligence: an observational study of diagnostic accuracy. Dermatol. Pract. Concept. 10(1) (2020)","DOI":"10.5826\/dpc.1001a11"},{"key":"1109_CR31","unstructured":"Qualcomm.: Qualcomm neural processing sdk for AIDermengine. https:\/\/developer.qualcomm.com\/software\/qualcomm-neural-processing-sdk"},{"key":"1109_CR32","unstructured":"Quang, N.H., et\u00a0al.: Automatic skin lesion analysis towards melanoma detection. In: 21st Asia Pacific Symposium on Intelligent and Evolutionary Systems (IES), pp. 106\u2013111. IEEE (2017)"},{"issue":"5","key":"1109_CR33","doi-asserted-by":"publisher","first-page":"301","DOI":"10.3322\/caac.20074","volume":"60","author":"DS Rigel","year":"2010","unstructured":"Rigel, D.S., Russak, J., Friedman, R.: The evolution of melanoma diagnosis: 25 years beyond the abcds. CA Cancer J. Clin. 60(5), 301\u2013316 (2010)","journal-title":"CA Cancer J. Clin."},{"issue":"5","key":"1109_CR34","doi-asserted-by":"publisher","first-page":"1216","DOI":"10.1016\/j.jaad.2019.07.008","volume":"81","author":"P Sharma","year":"2019","unstructured":"Sharma, P., Vleugels, R.A., Nambudiri, V.E.: Augmented reality in dermatology: are we ready for AR? J. Am. Acad. Dermatol. 81(5), 1216\u20131222 (2019)","journal-title":"J. Am. Acad. Dermatol."},{"issue":"3","key":"1109_CR35","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1111\/j.1600-0846.2005.00117.x","volume":"11","author":"WV Stoecker","year":"2005","unstructured":"Stoecker, W.V., Gupta, K., Stanley, R.J., Moss, R.H., Shrestha, B.: Detection of asymmetric blotches (asymmetric structureless areas) in dermoscopy images of malignant melanoma using relative color. Skin Res. Technol. 11(3), 179\u2013184 (2005)","journal-title":"Skin Res. Technol."},{"issue":"3","key":"1109_CR36","doi-asserted-by":"publisher","first-page":"230","DOI":"10.1111\/srt.12015","volume":"19","author":"MTB Toossi","year":"2013","unstructured":"Toossi, M.T.B., Pourreza, H.R., Zare, H., Sigari, M.H., Layegh, P., Azimi, A.: An effective hair removal algorithm for dermoscopy images. Skin Res. Technol. 19(3), 230\u2013235 (2013)","journal-title":"Skin Res. Technol."},{"issue":"4","key":"1109_CR37","doi-asserted-by":"publisher","first-page":"717","DOI":"10.1016\/j.jaad.2015.01.025","volume":"72","author":"H Tsao","year":"2015","unstructured":"Tsao, H., Olazagasti, J.M., Cordoro, K.M., Brewer, J.D., Taylor, S.C., Bordeaux, J.S., Chren, M.M., Sober, A.J., Tegeler, C., Bhushan, R., et al.: Early detection of melanoma: reviewing the abcdes. J. Am. Acad. Dermatol. 72(4), 717\u2013723 (2015)","journal-title":"J. Am. Acad. Dermatol."},{"issue":"4","key":"1109_CR38","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1109\/51.107171","volume":"10","author":"SE Umbaugh","year":"1991","unstructured":"Umbaugh, S.E., Moss, R.H., Stoecker, W.V.: Applying artificial intelligence to the identification of variegated coloring in skin tumors. IEEE Eng. Med. Biol. Mag. 10(4), 57\u201362 (1991)","journal-title":"IEEE Eng. Med. Biol. Mag."},{"issue":"2","key":"1109_CR39","first-page":"387","volume":"2","author":"HJ Vala","year":"2013","unstructured":"Vala, H.J., Baxi, A.: A review on Otsu image segmentation algorithm. Int. J. Adv. Res. Comput. Eng. Technol. 2(2), 387\u2013389 (2013)","journal-title":"Int. J. Adv. Res. Comput. Eng. Technol."},{"key":"1109_CR40","unstructured":"Vasconcelos, C.N., Vasconcelos, B.N.: Convolutional neural network committees for melanoma classification with classical and expert knowledge based image transforms data augmentation. arXiv preprint arXiv:1702.07025 (2017)"},{"key":"1109_CR41","doi-asserted-by":"crossref","unstructured":"Vocaturo, E., Zumpano, E., Veltri, P.: Features for melanoma lesions characterization in computer vision systems. In: Information, Intelligence, Systems and Applications (IISA), pp. 1\u20138. IEEE (2018)","DOI":"10.1109\/IISA.2018.8633651"},{"issue":"3","key":"1109_CR42","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1109\/TVCG.2009.99","volume":"16","author":"D Wagner","year":"2010","unstructured":"Wagner, D., Reitmayr, G., Mulloni, A., Drummond, T., Schmalstieg, D.: Real-time detection and tracking for augmented reality on mobile phones. IEEE Trans. Vis. Comput. Graph. 16(3), 355\u2013368 (2010)","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"1109_CR43","unstructured":"Wagner, D., Schmalstieg, D.: First steps towards handheld augmented reality. In: 7th IEEE Intl. Symposium on Wearable Computers, pp. 127\u2013135 (2003)"},{"key":"1109_CR44","unstructured":"Yue, S.: Human motion tracking and positioning for augmented reality. J. Real-Time Image Process. 1\u201312 (2020)"}],"container-title":["Journal of Real-Time Image Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11554-021-01109-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11554-021-01109-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11554-021-01109-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,30]],"date-time":"2024-08-30T03:19:53Z","timestamp":1724987993000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11554-021-01109-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,3]]},"references-count":44,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,8]]}},"alternative-id":["1109"],"URL":"https:\/\/doi.org\/10.1007\/s11554-021-01109-8","relation":{},"ISSN":["1861-8200","1861-8219"],"issn-type":[{"value":"1861-8200","type":"print"},{"value":"1861-8219","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,3]]},"assertion":[{"value":"15 January 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 April 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 May 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}