{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T18:05:43Z","timestamp":1780423543100,"version":"3.54.1"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2023,11,1]],"date-time":"2023-11-01T00:00:00Z","timestamp":1698796800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,11,1]],"date-time":"2023-11-01T00:00:00Z","timestamp":1698796800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100019902","name":"Fakultet for medisin og helsevitenskap, Norges Teknisk-Naturvitenskapelige Universitet","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100019902","id-type":"DOI","asserted-by":"publisher"}]},{"name":"NTNU Norwegian University of Science and Technology"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Eur Arch Otorhinolaryngol"],"published-print":{"date-parts":[[2024,2]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Purpose<\/jats:title>\n                <jats:p>The aim of this study was to validate the Patient Reported Outcome Measure (PROM) in the Norwegian Tonsil Surgery Register (NTSR) and to examine whether any improvements to the questionnaire could be useful.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>This is a prospective, descriptive study. NTSR collects data from patients who undergo tonsil surgery and the intention of the register is to improve the quality of treatment and to contribute to research. The patients answers questions about admission due to postoperative haemorrhage, infection and pain 30\u00a0days after surgery. 305 patients were contacted on phone 1\u20132\u00a0weeks after answering the questionnaires electronically (ePROM) and asked the same questions. 180 of 305 patients we contacted had some kind of complications after surgery. They were asked additional questions to search for possible points for improvement of the questionnaire.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>When comparing the results on the ePROM with the answers on phone, we found that 12 out of 14 variables achieve <jats:italic>almost perfect<\/jats:italic> agreement (AC<jats:sub>1<\/jats:sub>\u2009\u2265\u20090.81). Two variables are categorized to be substantial agreement (AC<jats:sub>1<\/jats:sub>\u2009=\u20090.61\u20130.80). The additional questions showed us that the questionnaire can be improved with more detailed information regarding the severity of the postoperative haemorrhage and the need of better treatment against postoperative pain.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>This study shows that the information from the 30-day ePROM has high reliability. The questions were understood as they were intended, and the answers reflect what the patients had of complications. Some changes can be done to improve the questionnaire and to open up for more research around the tonsillectomy procedure.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s00405-023-08306-0","type":"journal-article","created":{"date-parts":[[2023,11,1]],"date-time":"2023-11-01T11:01:43Z","timestamp":1698836503000},"page":"977-984","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["A validation study of the 30-day questionnaire in the national Norwegian Tonsil Surgery Register: can we trust the data reported by the patients?"],"prefix":"10.1007","volume":"281","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1634-584X","authenticated-orcid":false,"given":"Siri","family":"Wennberg","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marit Furre","family":"Amundsen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4857-7648","authenticated-orcid":false,"given":"Vegard","family":"Bugten","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,11,1]]},"reference":[{"issue":"2","key":"8306_CR1","first-page":"142","volume":"106","author":"DJ Solomon","year":"1991","unstructured":"Solomon DJ, Henry RC, Hogan JG, Van Amburg GH, Taylor J (1991) Evaluation and implementation of public health registries. Public Health Rep 106(2):142\u2013150","journal-title":"Public Health Rep"},{"issue":"6","key":"8306_CR2","doi-asserted-by":"publisher","first-page":"1631","DOI":"10.1007\/s00405-018-4942-3","volume":"275","author":"E Odhagen","year":"2018","unstructured":"Odhagen E, Sunnergren O, S\u00f6derman AH, Thor J, Stalfors J (2018) Reducing post-tonsillectomy haemorrhage rates through a quality improvement project using a Swedish National quality register: a case study. Eur Arch Otorhinolaryngol 275(6):1631\u20131639","journal-title":"Eur Arch Otorhinolaryngol"},{"key":"8306_CR3","unstructured":"EyeNet Sweden (2015) Handbook-for_establishing-quality_registries_2005. Available from: http:\/\/rcsyd.se\/wp-content\/uploads\/2014\/12\/Handbook-for_establishing-quality_registries_2005_1st_Edition.pdf. Accessed 29 Aug 2023"},{"key":"8306_CR4","unstructured":"Nasjonalt servicemilj\u00f8 for medisinske kvalitetsregistre. Available from: https:\/\/www.kvalitetsregistre.no\/kontakt-nasjonalt-servicemiljo. Accessed 29 Aug 2023"},{"issue":"6","key":"8306_CR5","doi-asserted-by":"publisher","first-page":"1353","DOI":"10.1007\/s00405-018-4945-0","volume":"275","author":"J Ruohoalho","year":"2018","unstructured":"Ruohoalho J, \u00d8stvoll E, Bratt M, Bugten V, B\u00e4ck L, M\u00e4kitie A, Ovesen T, Stalfors J (2018) Systematic review of tonsil surgery quality registers and introduction of the Nordic Tonsil Surgery Register Collaboration. Eur Arch Otorhinolaryngol 275(6):1353\u20131363","journal-title":"Eur Arch Otorhinolaryngol"},{"issue":"10","key":"8306_CR6","doi-asserted-by":"publisher","first-page":"1096","DOI":"10.1080\/00016489.2017.1327122","volume":"137","author":"N Hallenst\u00e5l","year":"2017","unstructured":"Hallenst\u00e5l N, Sunnergren O, Ericsson E, Hemlin C, Hess\u00e9n S\u00f6derman AC, Nerfeldt P, Odhagen E, Ryding M, Stalfors J (2017) Tonsil surgery in Sweden 2013\u20132015. Indications, surgical methods and patient-reported outcomes from the National Tonsil Surgery Register. Acta Otolaryngol 137(10):1096\u20131103","journal-title":"Acta Otolaryngol"},{"issue":"3","key":"8306_CR7","doi-asserted-by":"publisher","first-page":"248","DOI":"10.1111\/coa.12361","volume":"40","author":"AC S\u00f6derman","year":"2015","unstructured":"S\u00f6derman AC, Odhagen E, Ericsson E, Hemlin C, Hultcrantz E, Sunnergren O, Stalfors J (2015) Post-tonsillectomy haemorrhage rates are related to technique for dissection and for haemostasis. An analysis of 15734 patients in the National Tonsil Surgery Register in Sweden. Clin Otolaryngol 40(3):248\u2013254","journal-title":"Clin Otolaryngol"},{"issue":"4","key":"8306_CR8","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2021-056551","volume":"12","author":"J Stalfors","year":"2022","unstructured":"Stalfors J, Ovesen T, Bertelsen JB, Bugten V, Wennberg S, Sunnergren O (2022) Comparison of clinical practice of tonsil surgery from quality register data from Sweden and Norway and one clinic in Denmark. BMJ Open 12(4):e056551","journal-title":"BMJ Open"},{"key":"8306_CR9","doi-asserted-by":"publisher","unstructured":"U.S. Department of Health and Human Services FDA Center for Drug Evaluation and Research., U.S. Department of Health and Human Services FDA Center for Biologics Evaluation and Research. & U.S. Department of Health and Human Services FDA Center for Devices and Radiological Health (2006) Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Health Qual Life Outcomes 4:79 https:\/\/doi.org\/10.1186\/1477-7525-4-79","DOI":"10.1186\/1477-7525-4-79"},{"issue":"Suppl 362","key":"8306_CR10","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1080\/17453674.2016.1181815","volume":"87","author":"O Rolfson","year":"2016","unstructured":"Rolfson O, Eresian Chenok K, Bohm E, L\u00fcbbeke A, Denissen G, Dunn J, Lyman S, Franklin P, Dunbar M, Overgaard S, Garellick G, Dawson J, Missing A (2016) Patient-reported outcome measures in arthroplasty registries. Acta Orthop 87(Suppl 362):3\u20138","journal-title":"Acta Orthop"},{"issue":"7","key":"8306_CR11","doi-asserted-by":"publisher","first-page":"1695","DOI":"10.1007\/s11136-018-1815-6","volume":"27","author":"M Hawkins","year":"2018","unstructured":"Hawkins M, Elsworth GR, Osborne RH (2018) Application of validity theory and methodology to patient-reported outcome measures (PROMs): building an argument for validity. Qual Life Res 27(7):1695\u20131710","journal-title":"Qual Life Res"},{"issue":"7","key":"8306_CR12","doi-asserted-by":"publisher","first-page":"jrm00217","DOI":"10.2340\/16501977-2858","volume":"53","author":"A Halvorsen","year":"2021","unstructured":"Halvorsen A, Pape K, Post MWM, Biering-S\u00f8rensen F, Mikalsen S, Hansen AN, Steinsbekk A (2021) Participation and quality of life in persons living with spinal cord injury in Norway. J Rehabil Med 53(7):jrm00217","journal-title":"J Rehabil Med"},{"key":"8306_CR13","doi-asserted-by":"publisher","unstructured":"Enden T, Bernklev T, Jelsness-J\u00f8rgensen LP, Amdal CD (2018) Patients know their own health best. Tidsskr Nor Laegeforen 138(8). https:\/\/doi.org\/10.4045\/tidsskr.17.1054","DOI":"10.4045\/tidsskr.17.1054"},{"issue":"6","key":"8306_CR14","doi-asserted-by":"publisher","first-page":"600","DOI":"10.1197\/jamia.M1087","volume":"9","author":"DG Arts","year":"2002","unstructured":"Arts DG, De Keizer NF, Scheffer GJ (2002) Defining and improving data quality in medical registries: a literature review, case study, and generic framework. J Am Med Inform Assoc 9(6):600\u2013611","journal-title":"J Am Med Inform Assoc"},{"issue":"Suppl 2","key":"8306_CR15","doi-asserted-by":"publisher","first-page":"S94","DOI":"10.1111\/j.1524-4733.2007.00272.x","volume":"10","author":"MH Frost","year":"2007","unstructured":"Frost MH, Reeve BB, Liepa AM, Stauffer JW, Hays RD (2007) What is sufficient evidence for the reliability and validity of patient-reported outcome measures? Value Health 10(Suppl 2):S94-s105","journal-title":"Value Health"},{"issue":"1","key":"8306_CR16","doi-asserted-by":"publisher","first-page":"220","DOI":"10.1377\/hlthaff.2011.0762","volume":"31","author":"S Larsson","year":"2012","unstructured":"Larsson S, Lawyer P, Garellick G, Lindahl B, Lundstr\u00f6m M (2012) Use of 13 disease registries in 5 countries demonstrates the potential to use outcome data to improve health care\u2019s value. Health Aff (Millwood) 31(1):220\u2013227","journal-title":"Health Aff (Millwood)"},{"key":"8306_CR17","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.g7818","volume":"350","author":"EC Nelson","year":"2015","unstructured":"Nelson EC, Eftimovska E, Lind C, Hager A, Wasson JH, Lindblad S (2015) Patient reported outcome measures in practice. BMJ 350:g7818","journal-title":"BMJ"},{"key":"8306_CR18","unstructured":"Norwegian Tonsil Surgery Register. Anual report 2021. Available from: https:\/\/www.kvalitetsregistre.no\/sites\/default\/files\/2022-06\/%C3%85rsrapport%202021%20Tonsilleregisteret.pdf. Accessed 29 Aug 2023"},{"key":"8306_CR19","unstructured":"Norwegian Tonsil Surgery Register. Official webpage. Available from: https:\/\/www.kvalitetsregistre.no\/register\/ore-nese-hals\/norsk-kvalitetsregister-ore-nese-hals-tonsilleregisteret. Accessed 29 Aug 2023"},{"issue":"1","key":"8306_CR20","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1186\/s12874-018-0651-2","volume":"19","author":"S Wennberg","year":"2019","unstructured":"Wennberg S, Karlsen LA, Stalfors J, Bratt M, Bugten V (2019) Providing quality data in health care\u2014almost perfect inter-rater agreement in the Norwegian tonsil surgery register. BMC Med Res Methodol 19(1):6","journal-title":"BMC Med Res Methodol"},{"issue":"1","key":"8306_CR21","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1186\/s12874-021-01467-8","volume":"22","author":"F Lundstr\u00f6m","year":"2022","unstructured":"Lundstr\u00f6m F, Odhagen E, Alm F, Hemlin C, Nerfeldt P, Sunnergren O (2022) A validation study of data in the National Tonsil Surgery Register in Sweden: high agreement with medical records ensures that data can be used to monitor clinical practices and outcomes. BMC Med Res Methodol 22(1):3","journal-title":"BMC Med Res Methodol"},{"key":"8306_CR22","unstructured":"PROM - 30 dagers skjema Available from: https:\/\/stolav.no\/seksjon\/norsk-tonsilleregister\/Documents\/Pasientskjema%20norsk%20blankt%2030dagerpostop.pdf. Accessed 29 Aug 2023"},{"key":"8306_CR23","unstructured":"SKDE. En liten h\u00e5ndbok om datakvalitet 2022. Available from: https:\/\/www.kvalitetsregistre.no\/sites\/default\/files\/2022-09\/H%C3%A5ndbok%20i%20datakvalitet%202022.pdf. Accessed 29 Aug 2023"},{"key":"8306_CR24","unstructured":"Intra-rater reliabilitet, relevans og \u00f8kt dekningsgrad for PROM-skjema- en datakvalitetsstudie 2020. Available from: https:\/\/www.kvalitetsregistre.no\/artikkel\/intra-rater-reliabilitet-relevans-og-okt-dekningsgrad-prom-skjema. Accessed 29 Aug 2023"},{"issue":"6","key":"8306_CR25","doi-asserted-by":"publisher","first-page":"543","DOI":"10.1016\/0895-4356(90)90158-L","volume":"43","author":"AR Feinstein","year":"1990","unstructured":"Feinstein AR, Cicchetti DV (1990) High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol 43(6):543\u2013549","journal-title":"J Clin Epidemiol"},{"issue":"5","key":"8306_CR26","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1016\/0895-4356(93)90018-V","volume":"46","author":"T Byrt","year":"1993","unstructured":"Byrt T, Bishop J, Carlin JB (1993) Bias, prevalence and kappa. J Clin Epidemiol 46(5):423\u2013429","journal-title":"J Clin Epidemiol"},{"issue":"4","key":"8306_CR27","doi-asserted-by":"publisher","first-page":"609","DOI":"10.1177\/0013164415596420","volume":"76","author":"KL Gwet","year":"2016","unstructured":"Gwet KL (2016) Testing the difference of correlated agreement coefficients for statistical significance. Educ Psychol Meas 76(4):609\u2013637","journal-title":"Educ Psychol Meas"},{"issue":"Pt 1","key":"8306_CR28","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1348\/000711006X126600","volume":"61","author":"KL Gwet","year":"2008","unstructured":"Gwet KL (2008) Computing inter-rater reliability and its variance in the presence of high agreement. Br J Math Stat Psychol 61(Pt 1):29\u201348","journal-title":"Br J Math Stat Psychol"},{"issue":"11","key":"8306_CR29","doi-asserted-by":"publisher","first-page":"1511","DOI":"10.1002\/sim.4780111109","volume":"11","author":"A Donner","year":"1992","unstructured":"Donner A, Eliasziw M (1992) A goodness-of-fit approach to inference procedures for the kappa statistic: confidence interval construction, significance-testing and sample size estimation. Stat Med 11(11):1511\u20131519","journal-title":"Stat Med"},{"key":"8306_CR30","volume-title":"Getting the most out of PROMS","author":"NJ Devlin","year":"2010","unstructured":"Devlin NJ, Appleby J (2010) Getting the most out of PROMS. The Kings Fund, London"},{"key":"8306_CR31","doi-asserted-by":"publisher","first-page":"584","DOI":"10.1186\/s13104-015-1556-3","volume":"8","author":"T Varmdal","year":"2015","unstructured":"Varmdal T, Ellekj\u00e6r H, Fj\u00e6rtoft H, Indredavik B, Lydersen S, Bonaa KH (2015) Inter-rater reliability of a national acute stroke register. BMC Res Notes 8:584","journal-title":"BMC Res Notes"}],"container-title":["European Archives of Oto-Rhino-Laryngology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00405-023-08306-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00405-023-08306-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00405-023-08306-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,18]],"date-time":"2024-01-18T20:03:58Z","timestamp":1705608238000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00405-023-08306-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,1]]},"references-count":31,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,2]]}},"alternative-id":["8306"],"URL":"https:\/\/doi.org\/10.1007\/s00405-023-08306-0","relation":{},"ISSN":["0937-4477","1434-4726"],"issn-type":[{"value":"0937-4477","type":"print"},{"value":"1434-4726","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,1]]},"assertion":[{"value":"31 August 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 October 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 November 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors report no conflicts of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and\/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. The study was submitted to the Regional Committee for Medical and Health Research Ethics (REC) as a remit assessment, since we were in doubt as to whether our study had to be approved by the REC. The committee concluded that this was a quality improvement study validating register data (REC Midt No. 2019\/555). The project was in accordance with The Norwegian Health Research Act \u00a7 2 and \u00a7 4 a and was not required for submission and could therefore be implemented and published without the approval of the REC. Written informed consent was obtained from all individual participants included in the study, and on behalf of the minors in this study (under the age of 16), parents have signed a written informed consent. Patients who were minors at the time of inclusion in the register are contacted upon turning 16 and given the option of withdrawing the consent given by their parents, and having the information concerning themselves deleted from the register.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}}]}}