{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:57:15Z","timestamp":1760144235189,"version":"build-2065373602"},"reference-count":65,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2024,4,3]],"date-time":"2024-04-03T00:00:00Z","timestamp":1712102400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"FCT\/MCTES","award":["UIDB\/05549\/2020","UIDP\/05549\/2020"],"award-info":[{"award-number":["UIDB\/05549\/2020","UIDP\/05549\/2020"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Electronics"],"abstract":"<jats:p>Phobias are characterized as the excessive or irrational fear of an object or situation, and specific phobias affect about 10% of the world population. Blood-injection-injury phobia is a specific phobia that has a unique physical response to phobic stimuli, that is, a vasovagal syncope that causes the person to faint. Phobos is a serious game intended for blood phobia treatment that was created to be played in virtual reality with an HTC Vive that has photorealistic graphics to provide a greater immersion. We also developed a console application in C# for electrocardiography sensor connectivity and data acquisition, which gathers a 1 min baseline reading and then has continuous data acquisition during gameplay. Usability tests were conducted with self-reported questionnaires and with a case study population of 10 testers, which gave insight into the previous game experience of the tester for both digital games and virtual reality games, evaluating the discomfort for hardware on both the sensor and the virtual reality headset, as well as the game regarding usability, user experience, level of immersion, and the existence of motion sickness and its source. The results corroborate that the immersion of the game is good, which suggests that it will help with triggering the phobia.<\/jats:p>","DOI":"10.3390\/electronics13071350","type":"journal-article","created":{"date-parts":[[2024,4,3]],"date-time":"2024-04-03T08:42:34Z","timestamp":1712133754000},"page":"1350","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Usability Analysis of a Virtual Reality Exposure Therapy Serious Game for Blood Phobia Treatment: Phobos"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0441-7992","authenticated-orcid":false,"given":"Jo\u00e3o","family":"Petersen","sequence":"first","affiliation":[{"name":"2Ai-School of Technology, IPCA, 4750-810 Barcelos, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4658-5844","authenticated-orcid":false,"given":"V\u00edtor","family":"Carvalho","sequence":"additional","affiliation":[{"name":"2Ai-School of Technology, IPCA, 4750-810 Barcelos, Portugal"},{"name":"Algoritmi Research Center, University of Minho, 4800-058 Guimaraes, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6624-8816","authenticated-orcid":false,"given":"Jo\u00e3o Tiago","family":"Oliveira","sequence":"additional","affiliation":[{"name":"CIPsi\u2014Psychology Research Center, School of Psychology, University of Minho, 4710-057 Braga, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8394-7088","authenticated-orcid":false,"given":"Eva","family":"Oliveira","sequence":"additional","affiliation":[{"name":"2Ai-School of Technology, IPCA, 4750-810 Barcelos, Portugal"},{"name":"INESC-TEC, 4200-465 Porto, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2024,4,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1685","DOI":"10.1007\/s11126-021-09935-6","article-title":"Virtual Reality Exposure Treatment in Phobias: A Systematic Review","volume":"92","author":"Freitas","year":"2021","journal-title":"Psychiatr. Q."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"593","DOI":"10.18203\/2319-2003.ijbcp20161496","article-title":"Treatment options for specific phobias","volume":"5","author":"Singh","year":"2016","journal-title":"Int. J. Basic Clin. Pharmacol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"678891","DOI":"10.3389\/fpsyt.2021.678891","article-title":"Cognitive Biases in Blood-Injection-Injury Phobia: A Review","volume":"12","author":"Abado","year":"2021","journal-title":"Front. Psychiatry"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/S0005-7967(01)00133-4","article-title":"Psychophysiologic effects of applied tension on the emotional fainting response to blood and injury","volume":"41","author":"Coles","year":"2003","journal-title":"Behav. Res. Ther."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/0005-7967(95)00060-7","article-title":"One versus five sessions of applied tension in the treatment of blood phobia","volume":"34","author":"Fellenius","year":"1996","journal-title":"Behav. Res. Ther."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"561","DOI":"10.1016\/0005-7967(91)90006-O","article-title":"Applied tension, exposure in vivo, and tension-only in the treatment of blood phobia","volume":"29","author":"Fellenius","year":"1991","journal-title":"Behav. Res. Ther."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/0005-7967(87)90111-2","article-title":"Applied Tension\u2014A specific behavioral method for treatment of blood phobia","volume":"25","author":"Sterner","year":"1987","journal-title":"Behav. Res. Ther."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Moffat, D.C., and Shapiro, A. (October, January 28). Serious games for interactive stories about emotionally challenging heritage. Proceedings of the 2015 Digital Heritage, Granada, Spain.","DOI":"10.1109\/DigitalHeritage.2015.7419604"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Effelsberg, W., and G\u00f6bel, S. (2014, January 3\u20137). Serious Games 2014: International Workshop on Serious Games. Proceedings of the 22nd ACM International Conference on Multimedia (MM \u201914), Orlando, FL, USA.","DOI":"10.1145\/2647868.2647880"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/MCG.2009.29","article-title":"Serious Games","volume":"29","author":"Barnes","year":"2009","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Kankaanranta, M., and Neittaanmki, P. (2008). Design and Use of Serious Games, Springer Science & Business Media.","DOI":"10.1007\/978-1-4020-9496-5"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2395","DOI":"10.1007\/s11423-020-09755-8","article-title":"Understanding students\u2019 game experiences throughout the developmental process of the number navigation game","volume":"68","author":"Bui","year":"2020","journal-title":"Educ. Tech. Res. Dev."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1021","DOI":"10.1016\/j.cpr.2008.02.007","article-title":"Psychological approaches in the treatment of specific phobias: A meta-analysis","volume":"28","author":"Horowitz","year":"2008","journal-title":"Clin. Psychol. Rev."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Coyle, D., McGlade, N., Doherty, G., and O\u2019Reilly, G. (2011, January 7\u201312). Exploratory evaluations of a computer game supporting cognitive behavioural therapy for adolescents. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI \u201911), Vancouver, BC, Canada.","DOI":"10.1145\/1978942.1979378"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1080\/16506070802694776","article-title":"Computer-aided psychotherapy for anxiety disorders: A meta-analytic review","volume":"38","author":"Cuijpers","year":"2009","journal-title":"Cogn. Behav. Ther."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Andrews, G., Craske, M.G., McEvoy, P., and Titov, N. (2010). Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: A meta-analysis. PLoS ONE, 5.","DOI":"10.1371\/journal.pone.0013196"},{"key":"ref_17","unstructured":"Goldstein, J., and Raessens, J. (2005). Handbook of Computer Game Studies, MIT Press."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1108\/17415650580000034","article-title":"Personal investigator: A therapeutic 3D game for adolescent psychotherapy","volume":"2","author":"Coyle","year":"2005","journal-title":"Interact. Technol. Smart Educ."},{"key":"ref_19","unstructured":"Andersen, S.K., Klein, G.O., Schulz, S., Aarts, J., and Mazzoleni, M.C. (2008). eHealth Beyond the Horizon\u2014Get iT There, SHTI, IOS Press."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1093\/occmed\/kqh077","article-title":"Computerized cognitive behavioural therapy at work: A randomized controlled trial in employees with recent stress-related absenteeism","volume":"54","author":"Grime","year":"2004","journal-title":"Occup. Med."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1017\/S135246580800492X","article-title":"Empirically grounded clinical interventions clients\u2019 and referrers\u2019 perceptions of computer-guided CBT (FearFighter)","volume":"37","author":"MacGregor","year":"2009","journal-title":"Behav. Cogn. Psychother."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"561","DOI":"10.1016\/j.janxdis.2007.04.006","article-title":"Virtual reality exposure therapy for anxiety disorders: A meta-analysis","volume":"22","author":"Powers","year":"2008","journal-title":"J. Anxiety Disord."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1080\/03069880902957056","article-title":"Virtual reality: An experiential tool for clinical psychology","volume":"37","author":"Riva","year":"2009","journal-title":"Br. J. Guid. Couns."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Funabashi, A.M.M., Aranha, R.V., Silva, T.D., Monteiro, C.B.M., Silva, W.S., and Nunes, F.L.S. (2017, January 1\u20134). AGaR: A VR serious game to support the recovery of post-stroke patients. Proceedings of the 2017 19th Symposium on Virtual and Augmented Reality (SVR), Curitiba, Brazil.","DOI":"10.1109\/SVR.2017.15"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1020","DOI":"10.1037\/0022-006X.68.6.1020","article-title":"A controlled study of virtual reality exposure therapy for the fear of flying","volume":"68","author":"Rothbaum","year":"2000","journal-title":"J. Consult. Clin. Psychol."},{"key":"ref_26","first-page":"121","article-title":"Fear of flying treatment methods: Virtual reality exposure vs. cognitive behavioral therapy","volume":"78","author":"Krijn","year":"2007","journal-title":"Aviat. Space Environ. Med."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"933","DOI":"10.1002\/da.20734","article-title":"Virtual reality exposure therapy in anxiety disorders: A systematic review of process-and-outcomes studies","volume":"27","author":"Emmelkamp","year":"2010","journal-title":"Depress. Anxiety"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Kultima, A. (2015, January 22\u201324). Game design research. Proceedings of the 19th International Academic Mindtrek Conference (AcademicMindTrek \u201915), Tampere, Finland.","DOI":"10.1145\/2818187.2818300"},{"key":"ref_29","unstructured":"Rouse, R. (2004). Game Design: Theory and Practice, Jones & Bartlett Learning. [2nd ed.]."},{"key":"ref_30","unstructured":"Smith, A.M. (2012). Mechanizing Exploratory Game Design, University of California."},{"key":"ref_31","unstructured":"Overmars, M.H. (2004). Technical Report UU-CS, Department of Computer Science, Utrecht University."},{"key":"ref_32","unstructured":"Hunicke, R., Leblanc, M., and Zubek, R. (2004, January 25\u201329). MDA: A Formal Approach to Game Design and Game Research. Proceedings of the AAAI Workshop on Challenges in Game AI, San Jose, CA, USA."},{"key":"ref_33","unstructured":"Duarte, L.C.S. (2023, October 19). Revisiting the MDA framework. Game Developer. Available online: https:\/\/www.gamedeveloper.com\/design\/revisiting-the-mda-framework."},{"key":"ref_34","unstructured":"Lantz, F. (2023, October 19). MDA. Game Design Advance. Available online: https:\/\/gamedesignadvance.com\/?p=2995."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Korn, O., and Lee, N. (2017). Game Dynamics, Springer.","DOI":"10.1007\/978-3-319-53088-8"},{"key":"ref_36","unstructured":"Schell, J. (2008). Morgan Kaufmann, CRC Press."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Ferdig, R. (2009). Handbook of Research on Effective Electronic Gaming in Education, IGI Global.","DOI":"10.4018\/978-1-59904-808-6"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Szilas, N. (2022, January 5\u20138). Serious game design in practice: Lessons learned from a corpus of games developed in an academic context. Proceedings of the 17th International Conference on the Foundations of Digital Games (FDG\u2019 22), Athens, Greece.","DOI":"10.1145\/3555858.3563283"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Antona, M., and Stephanidis, C. (2023). Universal Access in Human-Computer Interaction. HCII 2023. Lecture Notes in Computer Science, Springer.","DOI":"10.1007\/978-3-031-35681-0"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"100503","DOI":"10.1016\/j.ijcci.2022.100503","article-title":"Redesigning learning games for different learning contexts: Applying a serious game design framework to redesign Stop & Think","volume":"33","author":"Gauthier","year":"2022","journal-title":"Int. J. Child Comput. Interact."},{"key":"ref_41","first-page":"1","article-title":"Serious games design knowledge\u2014Experiences from a decade (+) of serious games development","volume":"6","author":"Backlund","year":"2021","journal-title":"EAI Endorsed Trans. Serious Games"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1177\/10468781211006758","article-title":"Research-Based Game Design for Serious Games","volume":"52","author":"Watt","year":"2021","journal-title":"Simul. Gaming"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"737351","DOI":"10.3389\/fpsyt.2021.737351","article-title":"Tips for Effective Implementation of Virtual Reality Exposure Therapy in Phobias\u2014A Systematic Review","volume":"12","author":"Krzystanek","year":"2021","journal-title":"Front. Psychiatry"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1002\/da.20910","article-title":"Virtual reality exposure therapy in anxiety disorders: A quantitative meta-analysis","volume":"29","author":"Opris","year":"2012","journal-title":"Depress. Anxiety"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"141","DOI":"10.3389\/fpsyg.2019.00141","article-title":"Causal interactive links between presence and fear in virtual reality height exposure","volume":"10","author":"Gromer","year":"2019","journal-title":"Front. Psychol."},{"key":"ref_46","unstructured":"Jashwanth, K., Shetty, S.R., Yashwanth, A.N., and Ravish, R. (2020, January 6\u20138). Phobia Therapy Using Virtual Reality. Proceedings of the 2020 IEEE International Conference for Innovation in Technology (INOCON), Bangluru, India."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"636","DOI":"10.1016\/j.jad.2020.07.076","article-title":"A randomised wait-list controlled pilot trial of one-session virtual reality exposure therapy for blood-injection-injury phobias","volume":"276","author":"Jiang","year":"2020","journal-title":"J. Affect. Disord."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Albakri, G., Bouaziz, R., Alharthi, W., Kammoun, S., Al-Sarem, M., Saeed, F., and Hadwan, M. (2022). Phobia Exposure Therapy Using Virtual and Augmented Reality: A Systematic Review. Appl. Sci., 12.","DOI":"10.3390\/app12031672"},{"key":"ref_49","unstructured":"Li, S., Yang, P., Li, R., Farha, F., Ding, J., Backlund, P., and Ning, H. (2022). A Review on Serious Games for Phobia. arXiv."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Ratha, N.K., and Govindaraju, V. (2008). Advances in Biometrics: Sensors, Algorithms and Systems, Springer Science & Business Media.","DOI":"10.1007\/978-1-84628-921-7"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1145\/328236.328110","article-title":"Biometric identification","volume":"43","author":"Jain","year":"2000","journal-title":"Commun. ACM"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"7532","DOI":"10.1109\/ACCESS.2016.2614720","article-title":"Unimodal and multimodal biometric sensing systems: A review","volume":"4","author":"Oloyede","year":"2016","journal-title":"IEEE Access"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2968215","article-title":"A survey of wearable biometric recognition systems","volume":"49","author":"Blasco","year":"2016","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_54","unstructured":"Champion, E. (2013). Game Mods: Design, Theory and Criticism, Lulu.com."},{"key":"ref_55","unstructured":"Silva, G.A., Nogueira, P.A., and Rodrigues, R. (2014, January 18\u201321). Multimodal vs. Unimodal biofeedback in videogames: An empirical player study using a First-Person Shooter. Proceedings of the 2014 9th Iberian Conference on Information Systems and Technologies (CISTI), Barcelona, Spain."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Martinho, M., Fred, A., and Silva, H. (2018, January 6\u20137). Towards Continuous User Recognition by Exploring Physiological Multimodality: Na Electrocardiogram (ECG) and Blood Volume Pulse (BVP) Approach. Proceedings of the 2018 International Symposium in Sensing and Instrumentation in IoT Era (ISSI), Shanghai, China.","DOI":"10.1109\/ISSI.2018.8538075"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Petersen, J., Carvalho, V., Oliveira, J.T., and Oliveira, E. (2023, January 16). A Serious Game Development and Usability Test for Blood Phobia Treatment\u2014PHOBOS. Proceedings of the 16th International Joint Conference on Biomedical Engineering Systems and Technologies\u2014WHC, Lisbon, Portugal.","DOI":"10.5220\/0011924900003414"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Brooks, A., Brooks, E., and Sylla, C. (2019). A Serious Game for Hemophobia Treatment Phobos: First Insights. Interactivity, Game Creation, Design, Learning, and Innovation. ArtsIT DLI 2018 2018. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, Springer.","DOI":"10.1007\/978-3-030-06134-0"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1049\/htl.2018.5037","article-title":"Benchmarking of the BITalino biomedical toolkit against an established gold standard","volume":"6","author":"Batista","year":"2019","journal-title":"Healthc. Technol. Lett."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/j.cmpb.2014.03.002","article-title":"BIT: Biosignal Igniter Toolkit","volume":"115","author":"Fred","year":"2014","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_61","unstructured":"(2022, September 06). Biosignalsplux 2020, Electrocardiography (ECG) User Manual, Einthoven Triangle Figure 5 [Image]. Available online: https:\/\/www.pluxbiosignals.com\/collections\/ecg-sensors-and-kits\/products\/electrocardiography-ecg-sensor-1."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"665","DOI":"10.1007\/s10055-020-00429-7","article-title":"Effects of voluntary heart rate control on user engagement and agency in a virtual reality game","volume":"24","author":"Houzangbe","year":"2020","journal-title":"Virtual Real."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/j.chb.2013.12.001","article-title":"Measuring engagement in video game-based environments: Investigation of the User Engagement Scale","volume":"32","author":"Wiebe","year":"2014","journal-title":"Comput. Hum. Behav."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"1217","DOI":"10.1177\/0018720816669646","article-title":"The Development and Validation of the Game User Experience Satisfaction Scale (GUESS)","volume":"58","author":"Phan","year":"2016","journal-title":"Hum. Factors"},{"key":"ref_65","first-page":"193","article-title":"Epidemiology of resting pulse rate of persons ages 25\u201374\u2014Data from NHANES 1971-74","volume":"107","author":"Gillum","year":"1992","journal-title":"Public Health Rep."}],"container-title":["Electronics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-9292\/13\/7\/1350\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:23:00Z","timestamp":1760106180000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-9292\/13\/7\/1350"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,3]]},"references-count":65,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2024,4]]}},"alternative-id":["electronics13071350"],"URL":"https:\/\/doi.org\/10.3390\/electronics13071350","relation":{},"ISSN":["2079-9292"],"issn-type":[{"type":"electronic","value":"2079-9292"}],"subject":[],"published":{"date-parts":[[2024,4,3]]}}}