{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,22]],"date-time":"2026-01-22T11:08:40Z","timestamp":1769080120624,"version":"3.49.0"},"reference-count":33,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2024,11,11]],"date-time":"2024-11-11T00:00:00Z","timestamp":1731283200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union through the Interreg Espana-Portugal\/POCTEP","award":["0043_NET4SLEEP_2_E"],"award-info":[{"award-number":["0043_NET4SLEEP_2_E"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>Background\/Objectives: Obstructive sleep apnea (OSA) classification relies on polysomnography (PSG) results. Current guidelines recommend the development of clinical prediction algorithms in screening prior to PSG. A recent intuitive and user-friendly tool (OSABayes), based on a Bayesian network model using six clinical variables, has been proposed to quantify the probability of OSA. Our aims are (1) to validate OSABayes prospectively, (2) to build a smartphone app based on the proposed model, and (3) to evaluate app usability. Methods: We prospectively included adult patients suspected of OSA, without suspicion of other sleep disorders, who underwent level I or III diagnostic PSG. Apnea\u2013hypopnea index (AHI) and OSABayes probabilities were obtained and compared using the area under the ROC curve (AUC [95%CI]) for OSA diagnosis (AHI \u2265 5\/h) and higher severity levels (AHI \u2265 15\/h) prediction. We built the OSABayes app on \u2018App Inventor 2\u2019, and the usability was assessed with a cognitive walkthrough method and a general evaluation. Results: 216 subjects were included in the validation cohort, performing PSG levels I (34%) and III (66%). OSABayes presented an AUC of 83.6% [77.3\u201390.0%] for OSA diagnosis and 76.3% [69.9\u201382.7%] for moderate\/severe OSA prediction, showing good response for both types of PSG. The OSABayes smartphone application allows one to calculate the probability of having OSA and consult information about OSA and the tool. In the usability evaluation, 96% of the proposed tasks were carried out. Conclusions: These results show the good discrimination power of OSABayes and validate its applicability in identifying patients with a high pre-test probability of OSA. The tool is available as an online form and as a smartphone app, allowing a quick and accessible calculation of OSA probability.<\/jats:p>","DOI":"10.3390\/diagnostics14222519","type":"journal-article","created":{"date-parts":[[2024,11,11]],"date-time":"2024-11-11T08:46:54Z","timestamp":1731314814000},"page":"2519","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Prospective Validation and Usability Evaluation of a Mobile Diagnostic App for Obstructive Sleep Apnea"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0408-4881","authenticated-orcid":false,"given":"Pedro","family":"Amorim","sequence":"first","affiliation":[{"name":"Sleep and Non-Invasive Ventilation Unit, S\u00e3o Jo\u00e3o University Hospital, 4200-319 Porto, Portugal"},{"name":"Center for Health Technology and Services Research (CINTESIS), 4200-450 Porto, Portugal"},{"name":"Faculty of Medicine, University of Porto (FMUP), 4200-319 Porto, Portugal"},{"name":"School of Health\u2014P.Porto, 4200-072 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0390-9944","authenticated-orcid":false,"given":"Daniela","family":"Ferreira-Santos","sequence":"additional","affiliation":[{"name":"INESC TEC\u2014Institute for Systems and Computer Engineering, Technology and Science, 4200-465 Porto, Portugal"}]},{"given":"Marta","family":"Drummond","sequence":"additional","affiliation":[{"name":"Sleep and Non-Invasive Ventilation Unit, S\u00e3o Jo\u00e3o University Hospital, 4200-319 Porto, Portugal"},{"name":"Faculty of Medicine, University of Porto (FMUP), 4200-319 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7867-6682","authenticated-orcid":false,"given":"Pedro Pereira","family":"Rodrigues","sequence":"additional","affiliation":[{"name":"Center for Health Technology and Services Research (CINTESIS), 4200-450 Porto, Portugal"},{"name":"Faculty of Medicine, University of Porto (FMUP), 4200-319 Porto, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2024,11,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"479","DOI":"10.5664\/jcsm.6506","article-title":"Clinical Practice Guideline for Diagnostic Testing for Adult Obstructive Sleep Apnea: An American Academy of Sleep Medicine Clinical Practice Guideline","volume":"13","author":"Kapur","year":"2017","journal-title":"J. Clin. Sleep Med."},{"key":"ref_2","first-page":"1","article-title":"Pathophysiological mechanisms and therapeutic approaches in obstructive sleep apnea syndrome","volume":"8","author":"Lv","year":"2023","journal-title":"Signal Transduct. Target. Ther."},{"key":"ref_3","first-page":"165","article-title":"Obstructive sleep apnoea: Definitions, epidemiology & natural history","volume":"131","author":"Lam","year":"2010","journal-title":"Indian J. Med. Res."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"101787","DOI":"10.1016\/j.smrv.2023.101787","article-title":"Nocturia and obstructive sleep apnea syndrome: A systematic review","volume":"69","author":"Napolitano","year":"2023","journal-title":"Sleep Med. Rev."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1016\/j.acvd.2020.01.003","article-title":"Obstructive sleep apnoea and cardiovascular consequences: Pathophysiological mechanisms","volume":"113","author":"Arnaud","year":"2020","journal-title":"Arch. Cardiovasc. Dis."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1016\/S2213-2600(19)30198-5","article-title":"Estimation of the global prevalence and burden of obstructive sleep apnoea: A literature-based analysis","volume":"7","author":"Benjafield","year":"2019","journal-title":"Lancet Respir. Med."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"263","DOI":"10.5664\/jcsm.27497","article-title":"Clinical Guideline for the Evaluation, Management and Long-term Care of Obstructive Sleep Apnea in Adults","volume":"5","author":"Epstein","year":"2009","journal-title":"J. Clin. Sleep Med."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2083","DOI":"10.1007\/s11325-023-02810-7","article-title":"Worldwide prevalence and associated risk factors of obstructive sleep apnea: A meta-analysis and meta-regression","volume":"27","author":"Martins","year":"2023","journal-title":"Sleep Breath."},{"key":"ref_9","unstructured":"American Academy of Sleep Medicine (2014). International Classification of Sleep Disorders, American Academy of Sleep Medicine. [3rd ed.]."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"101743","DOI":"10.1016\/j.smrv.2022.101743","article-title":"Portable evaluation of obstructive sleep apnea in adults: A systematic review","volume":"68","author":"Khor","year":"2023","journal-title":"Sleep Med. Rev."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1183\/09059180.00004213","article-title":"Ambulatory monitoring in the diagnosis and management of obstructive sleep apnoea syndrome","volume":"22","author":"Pepin","year":"2013","journal-title":"Eur. Respir. Rev."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"zsz295","DOI":"10.1093\/sleep\/zsz295","article-title":"Support vector machine prediction of obstructive sleep apnea in a large-scale Chinese clinical sample","volume":"43","author":"Huang","year":"2020","journal-title":"Sleep"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Maniaci, A., Riela, P.M., Iannella, G., Lechien, J.R., La Mantia, I., De Vincentiis, M., Cammaroto, G., Calvo-Henriquez, C., Di Luca, M., and Estomba, C.C. (2023). Machine Learning Identification of Obstructive Sleep Apnea Severity through the Patient Clinical Features: A Retrospective Study. Life, 13.","DOI":"10.3390\/life13030702"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"e47735","DOI":"10.2196\/47735","article-title":"The Role of Novel Digital Clinical Tools in the Screening or Diagnosis of Obstructive Sleep Apnea: Systematic Review","volume":"25","author":"Duarte","year":"2023","journal-title":"J. Med. Internet Res."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"101707","DOI":"10.1016\/j.artmed.2019.101707","article-title":"The role of medical smartphone apps in clinical decision-support: A literature review","volume":"100","author":"Watson","year":"2019","journal-title":"Artif. Intell. Med."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1016\/j.jval.2019.01.006","article-title":"Bayesian Networks for Risk Prediction Using Real-World Data: A Tool for Precision Medicine","volume":"22","author":"Arora","year":"2019","journal-title":"Value Health"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1016\/j.artmed.2003.11.001","article-title":"Bayesian networks in biomedicine and health-care","volume":"30","author":"Lucas","year":"2004","journal-title":"Artif. Intell. Med."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1007\/s41060-018-0118-x","article-title":"A clinical risk matrix for obstructive sleep apnea using Bayesian network approaches","volume":"8","author":"Rodrigues","year":"2019","journal-title":"Int. J. Data Sci. Anal."},{"key":"ref_19","unstructured":"(2021, October 22). OSABayes. Available online: http:\/\/servicosforms.gim.med.up.pt\/form_test\/osabayes.html."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"867","DOI":"10.2471\/BLT.07.045120","article-title":"The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: Guidelines for reporting observational studies","volume":"85","author":"Altman","year":"2007","journal-title":"Bull. World Health Organ."},{"key":"ref_21","unstructured":"Berry, R.B., Quan, S.F., Abreu, A.R., Bibbs, M.L., DelRosso, L., Harding, S.M., Mao, M.-M., Plante, D.T., Pressman, M.R., and Troester, M.T. (2018). The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications-Version 2.5, American Academy of Sleep Medicine."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Ruiz-Rube, I., Mota, J.M., Person, T., Corral, J.M., and Dodero, J.M. (2019). Block-Based Development of Mobile Learning Experiences for the Internet of Things. Sensors, 19.","DOI":"10.3390\/s19245467"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Farzandipour, M., Nabovati, E., and Jabali, M.S. (2022). Comparison of usability evaluation methods for a health information system: Heuristic evaluation versus cognitive walkthrough method. BMC Med. Inform. Decis. Mak., 22.","DOI":"10.1186\/s12911-022-01905-7"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1016\/j.procs.2015.09.273","article-title":"European Portuguese Validation of the System Usability Scale (SUS)","volume":"67","author":"Martins","year":"2015","journal-title":"Procedia Comput. Sci."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1080\/10447310802205776","article-title":"An Empirical Evaluation of the System Usability Scale","volume":"24","author":"Bangor","year":"2008","journal-title":"Int. J. Hum.\u2013Comput. Interact."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"00928","DOI":"10.1183\/23120541.00928-2020","article-title":"Evaluation of a multicomponent grading system for obstructive sleep apnoea: The Baveno classification","volume":"7","author":"Randerath","year":"2021","journal-title":"ERJ Open Res."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Sauro, J., and Lewis, J.R. (2016). Quantifying the User Experience Practical: Statistics for User Research, Morgan Kaufmann. [2nd ed.].","DOI":"10.1016\/B978-0-12-802308-2.00002-3"},{"key":"ref_28","first-page":"812","article-title":"STOP Questionnaire: A Tool to Screen Patients for Obstructive Sleep Apnea","volume":"108","author":"Chung","year":"2008","journal-title":"Anesthesiol. J. Am. Soc. Anesthesiol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"951","DOI":"10.5664\/jcsm.4022","article-title":"Alternative Scoring Models of STOP-Bang Questionnaire Improve Specificity To Detect Undiagnosed Obstructive Sleep Apnea","volume":"10","author":"Chung","year":"2014","journal-title":"J. Clin. Sleep Med."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"742","DOI":"10.1016\/S2213-2600(16)30075-3","article-title":"The NoSAS score for screening of sleep-disordered breathing: A derivation and validation study","volume":"4","author":"Hirotsu","year":"2016","journal-title":"Lancet Respir. Med."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1007\/s11325-007-0125-y","article-title":"The Berlin questionnaire for sleep apnea in a sleep clinic population: Relationship to polysomnographic measurement of respiratory disturbance","volume":"12","author":"Ahmadi","year":"2008","journal-title":"Sleep Breath."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"485","DOI":"10.7326\/0003-4819-131-7-199910050-00002","article-title":"Using the Berlin Questionnaire To Identify Patients at Risk for the Sleep Apnea Syndrome","volume":"131","author":"Netzer","year":"1999","journal-title":"Ann. Intern. Med."},{"key":"ref_33","first-page":"126","article-title":"Impact of Imputing Missing Data in Bayesian Network Structure Learning for Obstructive Sleep Apnea Diagnosis","volume":"247","author":"Rodrigues","year":"2018","journal-title":"Stud. Health Technol. Inform."}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/14\/22\/2519\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:30:08Z","timestamp":1760113808000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/14\/22\/2519"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,11]]},"references-count":33,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2024,11]]}},"alternative-id":["diagnostics14222519"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics14222519","relation":{},"ISSN":["2075-4418"],"issn-type":[{"value":"2075-4418","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,11]]}}}