{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T07:08:28Z","timestamp":1776755308223,"version":"3.51.2"},"reference-count":32,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2023,3,27]],"date-time":"2023-03-27T00:00:00Z","timestamp":1679875200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>In rehabilitation settings that exploit Mixed Reality, a clinician risks losing empathy with the patient by being immersed in different worlds, either real and\/or virtual. While the patient perceives the rehabilitation stimuli in a mixed real\u2013virtual world, the physician is only immersed in the real part. While in rehabilitation, this may cause the impossibility for the clinician to intervene, in skill assessment, this may cause difficulty in evaluation. To overcome the above limitation, we propose an innovative Augmented Reality (AR) framework for rehabilitation and skill assessment in clinical settings. Data acquired by a distributed sensor network are used to feed a \u201cshared AR\u201d environment so that both therapists and end-users can effectively operate\/perceive it, taking into account the specific interface requirements for each user category: (1) for patients, simplicity, immersiveness, engagement and focus on the task; (2) for clinicians\/therapists, contextualization and natural interaction with the whole set of data that is linked with the users\u2019 performances in real-time. This framework has a strong potential in Occupational Therapy (OT) but also in physical, psychological, and neurological rehabilitation. Hybrid real and virtual environments may be quickly developed and personalized to match end users\u2019 abilities and emotional and physiological states and evaluate nearly all relevant performances, thus augmenting the clinical eye of the therapist and the clinician-patient empathy. In this paper, we describe a practical exploitation of the proposed framework in OT: setting-up the table for eating. Both a therapist and a user wear Microsoft HoloLens 2. First, the therapist sets up the table with virtual furniture. Next, the user places the corresponding real objects (also in shape) to match them as closely as possible to the corresponding virtual ones. The therapist\u2019s view is augmented during the test with motion, balance, and physiological estimated cues. Once the training is completed, he automatically perceives deviations in the position and attitude of each object and the elapsed time. We used a camera-based localization algorithm achieving a level of accuracy of 5 mm with a confidence level of 95% for position and 1\u00b0 for rotation. The framework was designed and tested in collaboration with clinical experts of Villa Rosa rehabilitation hospital in Pergine (Italy), involving both a set of patients and healthy users to demonstrate the effectiveness of the designed architecture and the significance of the analyzed parameters between healthy users and patients.<\/jats:p>","DOI":"10.3390\/info14040204","type":"journal-article","created":{"date-parts":[[2023,3,28]],"date-time":"2023-03-28T01:41:34Z","timestamp":1679967694000},"page":"204","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Sharing Augmented Reality between a Patient and a Clinician for Assessment and Rehabilitation in Daily Living Activities"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1562-0328","authenticated-orcid":false,"given":"Mariolino","family":"De Cecco","sequence":"first","affiliation":[{"name":"Department of Industrial Engineering, University of Trento, 38123 Trento, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0960-0996","authenticated-orcid":false,"given":"Alessandro","family":"Luchetti","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, University of Trento, 38123 Trento, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"suffix":"III","given":"Isidro","family":"Butaslac","sequence":"additional","affiliation":[{"name":"Division of Information Science, Nara Institute of Science and Technology, Nara 630-0192, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9051-6005","authenticated-orcid":false,"given":"Francesco","family":"Pilla","sequence":"additional","affiliation":[{"name":"Rehabilitation Unit, Azienda Provinciale Servizi Sanitari, Pergine Valsugana, 38057 Trentino, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giovanni Maria Achille","family":"Guandalini","sequence":"additional","affiliation":[{"name":"Rehabilitation Unit, Azienda Provinciale Servizi Sanitari, Pergine Valsugana, 38057 Trentino, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jacopo","family":"Bonavita","sequence":"additional","affiliation":[{"name":"Rehabilitation Unit, Azienda Provinciale Servizi Sanitari, Pergine Valsugana, 38057 Trentino, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6523-5458","authenticated-orcid":false,"given":"Monica","family":"Mazzucato","sequence":"additional","affiliation":[{"name":"Rare Diseases Coordinating Center, Rare Diseases Registry, Veneto Region, 38123 Padua, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3921-2871","authenticated-orcid":false,"given":"Kato","family":"Hirokazu","sequence":"additional","affiliation":[{"name":"Division of Information Science, Nara Institute of Science and Technology, Nara 630-0192, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Luchetti, A., Tomasin, P., Fornaser, A., Tallarico, P., Bosetti, P., and De Cecco, M. (2019, January 9\u201312). The Human Being at the Center of Smart Factories Thanks to Augmented Reality. Proceedings of the 2019 IEEE 5th International Forum on Research and Technology for Society and Industry (RTSI), Florence, Italy.","DOI":"10.1109\/RTSI.2019.8895555"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Butaslac, I., Luchetti, A., Parolin, E., Fujimoto, Y., Kanbara, M., Cecco, M.D., and Kato, H. (2020, January 7\u201310). The Feasibility of Augmented Reality as a Support Tool for Motor Rehabilitation. Proceedings of the International Conference on Augmented Reality, Virtual Reality and Computer Graphics, Lecce, Italy.","DOI":"10.1007\/978-3-030-58468-9_13"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Luchetti, A., Parolin, E., Butaslac, I., Fujimoto, Y., Kanbara, M., Bosetti, P., De Cecco, M., and Kato, H. (2020, January 9\u201313). Stepping over Obstacles with Augmented Reality based on Visual Exproprioception. Proceedings of the 2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Recife, Brazil.","DOI":"10.1109\/ISMAR-Adjunct51615.2020.00039"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"721","DOI":"10.1111\/j.1532-5415.1983.tb03391.x","article-title":"Assessing self-maintenance: Activities of daily living, mobility, and instrumental activities of daily living","volume":"31","author":"Katz","year":"1983","journal-title":"J. Am. Geriatr. Soc."},{"key":"ref_5","unstructured":"Fisher, A.G., and Marterella, A. (2019). Powerful Practice: A Model for Authentic Occupational Therapy, CIOTS-Center for Innovative OT Solutions."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1177\/030802260006301005","article-title":"An investigation into the use of the Assessment of Motor and Process Skills (AMPS) in clinical practice","volume":"63","author":"Chard","year":"2000","journal-title":"Br. J. Occup. Ther."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1186\/s12984-019-0530-z","article-title":"An augmented reality approach for ADL support in Alzheimer\u2019s disease: A crossover trial","volume":"16","author":"Rohrbach","year":"2019","journal-title":"J. Neuroeng. Rehabil."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wolf, D., Besserer, D., Sejunaite, K., Riepe, M., and Rukzio, E. (2018, January 14\u201317). Care: An augmented reality support system for dementia patients. Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings, Berlin, Germany.","DOI":"10.1145\/3266037.3266095"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Nakamura, Y., Yamamoto, S., Tamai, M., and Yasumoto, K. (2013, January 18\u201322). Supporting daily living activities using behavior logs and Augmented Reality. Proceedings of the 2013 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops), San Diego, CA, USA.","DOI":"10.1109\/PerComW.2013.6529575"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Khademi, M., Hondori, H.M., Dodakian, L., Cramer, S., and Lopes, C.V. (2013, January 3\u20137). Comparing \u201cpick and place\u201d task in spatial augmented reality versus non-immersive virtual reality for rehabilitation setting. Proceedings of the 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Osaka, Japan.","DOI":"10.1109\/EMBC.2013.6610575"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"De Cecco, M., Fornaser, A., Tomasin, P., Zanetti, M., Guandalini, G., Ianes, P.G., Pilla, F., Nollo, G., Valente, M., and Pisoni, T. (2017, January 12\u201315). Augmented reality to enhance the clinician\u2019s observation during assessment of daily living activities. Proceedings of the International Conference on Augmented Reality, Virtual Reality and Computer Graphics, Ugento, Italy.","DOI":"10.1007\/978-3-319-60928-7_1"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Piumsomboon, T., Lee, Y., Lee, G.A., Dey, A., and Billinghurst, M. (2017, January 27\u201329). Empathic mixed reality: Sharing what you feel and interacting with what you see. Proceedings of the 2017 International Symposium on Ubiquitous Virtual Reality (ISUVR), Nara, Japan.","DOI":"10.1109\/ISUVR.2017.20"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Oyeleke, R.O., Yu, C.-Y., and Chang, C.K. (2018, January 23\u201327). Situ-Centric Reinforcement Learning for Recommendation of Tasks in Activities of Daily Living In Smart Homes. Proceedings of the IEEE 42nd Annual Computer Software and Applications Conference, Tokyo, Japan.","DOI":"10.1109\/COMPSAC.2018.10250"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ohiwa, T., Yamamoto, H., and Yamazaki, K. (2016, January 15\u201318). Sensor system to advice health-aware information for elderly people on daily living activities. Proceedings of the International Conference on Computing, Networking and Communications, Kauai, HI, USA.","DOI":"10.1109\/ICCNC.2016.7440556"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Karakostas, A., Lazarou, I., Meditskos, G., Stavropoulos, T.G., Kompatsiaris, I., and Tsolaki, M. (2015, January 6\u20139). Supporting Cognitive Skills of People Suffering from Dementia through a Sensor-Based System. Proceedings of the IEEE 15th International Conference on Advanced Learning Technologies, Hualien, Taiwan.","DOI":"10.1109\/ICALT.2015.129"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1099","DOI":"10.2522\/ptj.20090245","article-title":"The influence of the therapist-patient relationship on treatment outcome in physical rehabilitation: A systematic review","volume":"90","author":"Hall","year":"2010","journal-title":"Phys. Ther."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1109\/MC.2019.2951981","article-title":"The promise of interactive shared augmented reality","volume":"53","author":"Peitso","year":"2020","journal-title":"Computer"},{"key":"ref_18","unstructured":"Kiyokawa, K., Takemura, H., and Yokoya, N. (1999, January 12\u201315). A collaboration support technique by integrating a shared virtual reality and a shared augmented reality. Proceedings of the IEEE SMC\u201999 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No. 99CH37028), Tokyo, Japan."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Qiu, S., Liu, H., Zhang, Z., Zhu, Y., and Zhu, S.C. (2020, January 25\u201329). Human-robot interaction in a shared augmented reality workspace. Proceedings of the 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA.","DOI":"10.1109\/IROS45743.2020.9340781"},{"key":"ref_20","unstructured":"Grisenti, A., Nollo, G., Dalpr\u00e1, M., Natale, F.D., Cecco, M.D., Francesconi, A., Fornaser, A., Tomasin, P., Garau, N., and Guandalini, L. (2019). Italian Forum of Ambient Assisted Living, Springer."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Otte, K., Kayser, B., Mansow-Model, S., Verrel, J., Paul, F., Brandt, A.U., and Schmitz-H\u00fcbsch, T. (2016). Accuracy and reliability of the kinect version 2 for clinical measurement of motor function. PLoS ONE, 11.","DOI":"10.1371\/journal.pone.0166532"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1109\/TBME.1985.325532","article-title":"A real-time QRS detection algorithm","volume":"BME-32","author":"Pan","year":"1985","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Soille, P. (1999). Morphological Image Analysis: Principles and Applications, Springer.","DOI":"10.1007\/978-3-662-03939-7"},{"key":"ref_24","unstructured":"Haralick, R.M., and Shapiro, L.G. (1992). Computer and Robot Vision, Addison-Wesley."},{"key":"ref_25","unstructured":"Gonzalez, R.C., Woods, R.E., and Eddins, S.L. (2004). Digital Image Processing Using MATLAB, Pearson Prentice Hall."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image Qualifty Assessment: From Error Visibility to Structural Similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2280","DOI":"10.1016\/j.patcog.2014.01.005","article-title":"Automatic generation and detection of highly reliable fiducial markers under occlusion","volume":"47","year":"2014","journal-title":"Pattern Recogn."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1177\/027836498600500404","article-title":"On the representation and estimation of spatial uncertainty","volume":"5","author":"Smith","year":"1986","journal-title":"Int. J. Robot. Res."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"955","DOI":"10.1007\/s11548-021-02354-9","article-title":"Effect of marker position and size on the registration accuracy of HoloLens in a non-clinical setting with implications for high-precision surgical tasks","volume":"16","author":"Sharma","year":"2021","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"700","DOI":"10.3389\/fpsyg.2013.00700","article-title":"Good things peak in pairs: A note on the bimodality coefficient","volume":"4","author":"Pfister","year":"2013","journal-title":"Front. Psychol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"540","DOI":"10.4097\/kjae.2015.68.6.540","article-title":"T test as a parametric statistic","volume":"68","author":"Kim","year":"2015","journal-title":"Korean J. Anesthesiol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"823","DOI":"10.1016\/j.ijhcs.2004.09.007","article-title":"Speed\u2013accuracy tradeoff in Fitts\u2019 law tasks\u2014On the equivalency of actual and nominal pointing precision","volume":"61","author":"Zhai","year":"2004","journal-title":"Int. J. Hum. Comput. Stud."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/4\/204\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:04:26Z","timestamp":1760123066000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/4\/204"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,27]]},"references-count":32,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,4]]}},"alternative-id":["info14040204"],"URL":"https:\/\/doi.org\/10.3390\/info14040204","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,27]]}}}