{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,31]],"date-time":"2026-10-31T01:06:23Z","timestamp":1793408783978,"version":"4.5.0"},"reference-count":23,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Decision support systems (DSSs) for suggesting optimal treatments for individual patients with low back pain (LBP) are currently insufficiently accurate for clinical application. Most of the input provided to train these systems is based on patient-reported outcome measures. However, with the appearance of electronic health records (EHRs), additional qualitative data on reasons for referrals and patients\u2019 goals become available for DSSs. Currently, no decision support tools cover a wide range of biopsychosocial factors, including referral letter information to help clinicians triage patients to the optimal LBP treatment.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>The objective of this study was to investigate the added value of including qualitative data from EHRs and referral letters to the accuracy of a quantitative DSS for patients with LBP.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>A retrospective study was conducted in a clinical cohort of Dutch patients with LBP. Patients filled out a baseline questionnaire about demographics, pain, disability, work status, quality of life, medication, psychosocial functioning, comorbidity, history, and duration of pain. Referral reasons and patient requests for help (patient goals) were extracted via natural language processing (NLP) and enriched in the data set. For decision support, these data were considered independent factors for triage to neurosurgery, anesthesiology, rehabilitation, or minimal intervention. Support vector machine, k-nearest neighbor, and multilayer perceptron models were trained for 2 conditions: with and without consideration of the referral letter content. The models\u2019 accuracies were evaluated via F1-scores, and confusion matrices were used to predict the treatment path (out of 4 paths) with and without additional referral parameters.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Data from 1608 patients were evaluated. The evaluation indicated that 2 referral reasons from the referral letters (for anesthesiology and rehabilitation intervention) increased the F1-score accuracy by up to 19.5% for triaging. The confusion matrices confirmed the results.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>This study indicates that data enriching by adding NLP-based extraction of the content of referral letters increases the model accuracy of DSSs in suggesting optimal treatments for individual patients with LBP. Overall model accuracies were considered low and insufficient for clinical application.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2196\/46857","type":"journal-article","created":{"date-parts":[[2023,10,11]],"date-time":"2023-10-11T03:42:34Z","timestamp":1696995754000},"page":"e46857","source":"Crossref","is-referenced-by-count":19,"title":["Natural Language Processing of Referral Letters for Machine Learning\u2013Based Triaging of Patients With Low Back Pain to the Most Appropriate Intervention: Retrospective Study"],"prefix":"10.2196","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3553-5131","authenticated-orcid":false,"given":"Sebastian","family":"Fudickar","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1165-8081","authenticated-orcid":false,"given":"Carsten","family":"Bantel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-8713-7120","authenticated-orcid":false,"given":"Jannik","family":"Spieker","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-3422-3500","authenticated-orcid":false,"given":"Heinrich","family":"T\u00f6pfer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1632-2197","authenticated-orcid":false,"given":"Patrick","family":"Stegeman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9460-3459","authenticated-orcid":false,"given":"Henrica R","family":"Schiphorst Preuper","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4058-3437","authenticated-orcid":false,"given":"Michiel F","family":"Reneman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6240-3903","authenticated-orcid":false,"given":"Andr\u00e9 P","family":"Wolff","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4154-1711","authenticated-orcid":false,"given":"Remko","family":"Soer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2024,1,30]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","DOI":"10.1016\/s0140-6736(16)30970-9"},{"key":"ref2","doi-asserted-by":"publisher","DOI":"10.1016\/s0140-6736(18)30489-6"},{"key":"ref3","doi-asserted-by":"publisher","DOI":"10.1016\/j.berh.2013.10.005"},{"key":"ref4","doi-asserted-by":"publisher","DOI":"10.1097\/00002508-199809000-00007"},{"key":"ref5","doi-asserted-by":"publisher","DOI":"10.1002\/art.23563"},{"key":"ref6","doi-asserted-by":"publisher","DOI":"10.1002\/ejp.1308"},{"key":"ref7","doi-asserted-by":"publisher","DOI":"10.5220\/0008962101170124"},{"key":"ref8","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0104226"},{"key":"ref9","doi-asserted-by":"publisher","DOI":"10.1097\/BRS.0000000000003174"},{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.1016\/0168-8510(90)90421-9"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.1097\/brs.0000000000000434"},{"key":"ref12","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2458-13-305"},{"key":"ref13","doi-asserted-by":"publisher","DOI":"10.1177\/1403494809349858"},{"key":"ref14","doi-asserted-by":"publisher","DOI":"10.1613\/jair.953"},{"key":"ref15","unstructured":"Over-sampling methodsImbalanced learn2023-12-11https:\/\/imbalanced-learn.org\/stable\/references\/over_sampling.html#module-imblearn.over_sampling"},{"key":"ref16","unstructured":"BrayTSTD 90, RFC 8259: the JavaScript Object Notation (JSON) Data Interchange FormatRFC Editor2017122023-12-11https:\/\/www.rfc-editor.org\/info\/rfc8259"},{"key":"ref17","unstructured":"re \u2014 Regular expression operationsPython Software Foundation2023-12-11https:\/\/docs.python.org\/3\/library\/re.html"},{"key":"ref18","unstructured":"Robnik-\u0160ikonjaMKononenkoIAn adaptation of Relief for attribute estimation in regression1997ICML '97: Fourteenth International Conference on Machine LearningJuly 8-12, 1997Nashville, TN"},{"key":"ref19","doi-asserted-by":"publisher","DOI":"10.1023\/a:1025667309714"},{"key":"ref20","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-540-35488-8","author":"Guyon, I","year":"2006","journal-title":"Feature Extraction"},{"key":"ref21","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-57868-4_57"},{"key":"ref22","unstructured":"KiraKRendellLAThe feature selection problem: traditional methods and a new algorithm1992AAAI-92: Tenth National Conference on Artificial IntelligenceJuly 12-16, 1992San Jose, CA"},{"key":"ref23","unstructured":"NLP_Triaging Source CodeGitHub2023-12-11https:\/\/github.com\/fudickar-lab\/NLP_Triaging"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jmir.org\/2024\/1\/e46857","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:53:57Z","timestamp":1782842037000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jmir.org\/2024\/1\/e46857"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,30]]},"references-count":23,"URL":"https:\/\/doi.org\/10.2196\/46857","relation":{"has-preprint":[{"id-type":"doi","id":"10.2196\/preprints.46857","asserted-by":"object"}]},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,30]]}}}