{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T08:39:09Z","timestamp":1778056749111,"version":"3.51.4"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,10,31]],"date-time":"2019-10-31T00:00:00Z","timestamp":1572480000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,10,31]],"date-time":"2019-10-31T00:00:00Z","timestamp":1572480000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000025","name":"National Institute of Mental Health","doi-asserted-by":"crossref","award":["5R01MH109687"],"award-info":[{"award-number":["5R01MH109687"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Biomed Semant"],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Readmission after discharge from a hospital is disruptive and costly, regardless of the reason. However, it can be particularly problematic for psychiatric patients, so predicting which patients may be readmitted is critically important but also very difficult. Clinical narratives in psychiatric electronic health records (EHRs) span a wide range of topics and vocabulary; therefore, a psychiatric readmission prediction model must begin with a robust and interpretable topic extraction component.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We designed and evaluated multiple multilayer perceptron and radial basis function neural networks to predict the sentences in a patient\u2019s EHR that are associated with one or more of seven readmission risk factor domains that we identified. In contrast to our baseline cosine similarity model that is based on the methodologies of prior works, our deep learning approaches achieved considerably better F1 scores (0.83 vs 0.66) while also being more scalable and computationally efficient with large volumes of data. Additionally, we found that integrating clinically relevant multiword expressions during preprocessing improves the accuracy of our models and allows for identifying a wider scope of training data in a semi-supervised setting.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>We created a data pipeline for using document vector similarity metrics to perform topic extraction on psychiatric EHR data in service of our long-term goal of creating a readmission risk classifier. We show results for our topic extraction model and identify additional features we will be incorporating in the future.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s13326-019-0210-8","type":"journal-article","created":{"date-parts":[[2019,10,31]],"date-time":"2019-10-31T13:04:35Z","timestamp":1572527075000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Analysis of risk factor domains in psychosis patient health records"],"prefix":"10.1186","volume":"10","author":[{"given":"Eben","family":"Holderness","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicholas","family":"Miller","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Philip","family":"Cawkwell","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kirsten","family":"Bolton","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marie","family":"Meteer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James","family":"Pustejovsky","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4558-7023","authenticated-orcid":false,"given":"Mei-Hua","family":"Hall","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2019,10,31]]},"reference":[{"issue":"4","key":"210_CR1","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1097\/YCO.0b013e32816ebc8c","volume":"20","author":"RC Kessler","year":"2007","unstructured":"Kessler RC, Amminger GP, Aguilar-Gaxiola S, Alonso J, Lee S, Ustun TB. Age of onset of mental disorders: a review of recent literature. Curr Opin psychiatry. 2007; 20(4):359.","journal-title":"Curr Opin psychiatry"},{"issue":"3","key":"210_CR2","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1111\/j.1600-0447.1996.tb09847.x","volume":"94","author":"P Thomsen","year":"1996","unstructured":"Thomsen P. Schizophrenia with childhood and adolescent onset\u2014a nationwide register-based study. Acta Psychiatr Scand. 1996; 94(3):187\u201393.","journal-title":"Acta Psychiatr Scand"},{"issue":"1","key":"210_CR3","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1001\/archpsyc.64.1.19","volume":"64","author":"J Per\u00e4l\u00e4","year":"2007","unstructured":"Per\u00e4l\u00e4 J, Suvisaari J, Saarni SI, Kuoppasalmi K, Isomets\u00e4 E, Pirkola S, et al.Lifetime prevalence of psychotic and bipolar I disorders in a general population. Arch Gen Psychiatr. 2007; 64(1):19\u201328.","journal-title":"Arch Gen Psychiatr"},{"issue":"4","key":"210_CR4","doi-asserted-by":"publisher","first-page":"336","DOI":"10.1080\/08039480903009118","volume":"63","author":"M Bogren","year":"2009","unstructured":"Bogren M, Mattisson C, Isberg PE, Nettelbladt P. How common are psychotic and bipolar disorders? A 50-year follow-up of the Lundby population. Nord J Psychiatry. 2009; 63(4):336\u201346.","journal-title":"Nord J Psychiatry"},{"issue":"9995","key":"210_CR5","doi-asserted-by":"publisher","first-page":"743","DOI":"10.1016\/S0140-6736(15)60692-4","volume":"386","author":"T Vos","year":"2015","unstructured":"Vos T, Barber RM, Bell B, Bertozzi-Villa A, Biryukov S, Bolliger I, et al.Global, regional, and national incidence, prevalence, and years lived with disability for 301 acute and chronic diseases and injuries in 188 countries, 1990\u20132013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet. 2015; 386(9995):743\u2013800.","journal-title":"Lancet"},{"issue":"1","key":"210_CR6","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1093\/oxfordjournals.schbul.a033315","volume":"24","author":"D Wiersma","year":"1998","unstructured":"Wiersma D, Nienhuis FJ, Slooff CJ, Giel R. Natural course of schizophrenic disorders: a 15-year followup of a Dutch incidence cohort. Schizophr Bull. 1998; 24(1):75\u201385.","journal-title":"Schizophr Bull"},{"issue":"1","key":"210_CR7","first-page":"23","volume":"10","author":"R Mangalore","year":"2007","unstructured":"Mangalore R, Knapp M. Cost of schizophrenia in England. J Ment Health Policy Econ. 2007; 10(1):23\u201341.","journal-title":"J Ment Health Policy Econ"},{"issue":"9","key":"210_CR8","doi-asserted-by":"publisher","first-page":"1122","DOI":"10.4088\/JCP.v66n0906","volume":"66","author":"EQ Wu","year":"2005","unstructured":"Wu EQ, Birnbaum HG, Shi L, Ball DE, Kessler RC, Moulis M, et al.The economic burden of schizophrenia in the United States in 2002. J Clin Psychiatry. 2005; 66(9):1122\u20131129.","journal-title":"J Clin Psychiatry"},{"issue":"12","key":"210_CR9","doi-asserted-by":"publisher","first-page":"721","DOI":"10.1097\/00005053-199912000-00003","volume":"187","author":"M Olfson","year":"1999","unstructured":"Olfson M, Mechanic D, Boyer CA, Hansell S, Walkup J, Weiden PJ. Assessing clinical predictions of early rehospitalization in schizophrenia. J Nerv Ment Dis. 1999; 187(12):721\u20139.","journal-title":"J Nerv Ment Dis"},{"issue":"6","key":"210_CR10","doi-asserted-by":"publisher","first-page":"425","DOI":"10.1097\/NMD.0000000000000305","volume":"203","author":"K Lorine","year":"2015","unstructured":"Lorine K, Goenjian H, Kim S, Steinberg AM, Schmidt K, Goenjian AK. Risk factors associated with psychiatric readmission. J Nerv Ment Dis. 2015; 203(6):425\u2013430.","journal-title":"J Nerv Ment Dis"},{"issue":"8","key":"210_CR11","doi-asserted-by":"publisher","first-page":"848","DOI":"10.1001\/jama.2011.1204","volume":"306","author":"HJ Murff","year":"2011","unstructured":"Murff HJ, FitzHenry F, Matheny ME, Gentry N, Kotter KL, Crimin K, et al.Automated identification of postoperative complications within an electronic medical record using natural language processing. Jama. 2011; 306(8):848\u2013855.","journal-title":"Jama"},{"issue":"1-3","key":"210_CR12","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1016\/j.schres.2012.05.007","volume":"139","author":"M Alvarez-Jimenez","year":"2012","unstructured":"Alvarez-Jimenez M, Priede A, Hetrick S, Bendall S, Killackey E, Parker A, et al.Risk factors for relapse following treatment for first episode psychosis: a systematic review and meta-analysis of longitudinal studies. Schizophr Res. 2012; 139(1-3):116\u2013128.","journal-title":"Schizophr Res"},{"issue":"5","key":"210_CR13","doi-asserted-by":"publisher","first-page":"483","DOI":"10.1176\/ps.2010.61.5.483","volume":"61","author":"DE Addington","year":"2010","unstructured":"Addington DE, Beck C, Wang J, Adams B, Pryce C, Zhu H, et al.Predictors of admission in first-episode psychosis: developing a risk adjustment model for service comparisons. Psychiatr Serv. 2010; 61(5):483\u2013488.","journal-title":"Psychiatr Serv"},{"issue":"2","key":"210_CR14","doi-asserted-by":"publisher","first-page":"300","DOI":"10.1093\/schbul\/sbn171","volume":"35","author":"PD Harvey","year":"2009","unstructured":"Harvey PD, Bellack AS. Toward a terminology for functional recovery in schizophrenia: is functional remission a viable concept?. Schizophr Bull. 2009; 35(2):300\u2013306.","journal-title":"Schizophr Bull"},{"issue":"9","key":"210_CR15","doi-asserted-by":"publisher","first-page":"965","DOI":"10.1177\/0093854810374274","volume":"37","author":"JP Singh","year":"2010","unstructured":"Singh JP, Fazel S. Forensic risk assessment: A metareview. Crim Justice Behav. 2010; 37(9):965\u2013988.","journal-title":"Crim Justice Behav"},{"issue":"4","key":"210_CR16","doi-asserted-by":"publisher","first-page":"316","DOI":"10.1176\/appi.ajp.2014.14091177","volume":"172","author":"TH McCoy","year":"2015","unstructured":"McCoy TH, Castro VM, Rosenfield HR, Cagan A, Kohane IS, Perlis RH. A clinical perspective on the relevance of research domain criteria in electronic health records. Am J Psychiatr. 2015; 172(4):316\u2013320.","journal-title":"Am J Psychiatr"},{"key":"210_CR17","doi-asserted-by":"crossref","unstructured":"Insel T, Cuthbert B, Garvey M, Heinssen R, Pine DS, Quinn K, et al.Research domain criteria (RDoC): toward a new classification framework for research on mental disorders. Am J Psychiatry. 2010 Jul; 167(7):748\u201351.","DOI":"10.1176\/appi.ajp.2010.09091379"},{"issue":"10","key":"210_CR18","doi-asserted-by":"publisher","first-page":"e921","DOI":"10.1038\/tp.2015.182","volume":"6","author":"A Rumshisky","year":"2016","unstructured":"Rumshisky A, Ghassemi M, Naumann T, Szolovits P, Castro V, McCoy T, et al.Predicting early psychiatric readmission with natural language processing of narrative discharge summaries. Transl Psychiatr. 2016; 6(10):e921.","journal-title":"Transl Psychiatr"},{"issue":"5","key":"210_CR19","doi-asserted-by":"publisher","first-page":"378","DOI":"10.1037\/h0031619","volume":"76","author":"JL Fleiss","year":"1971","unstructured":"Fleiss JL. Measuring nominal scale agreement among many raters. Psychol Bull. 1971; 76(5):378.","journal-title":"Psychol Bull"},{"issue":"4","key":"210_CR20","doi-asserted-by":"publisher","first-page":"1047","DOI":"10.2307\/2529886","volume":"38","author":"M Davies","year":"1982","unstructured":"Davies M, Fleiss JL. Measuring agreement for multinomial data. Biometrics. 1982; 38(4):1047\u201351.","journal-title":"Biometrics"},{"issue":"1","key":"210_CR21","doi-asserted-by":"publisher","first-page":"159","DOI":"10.2307\/2529310","volume":"33","author":"JR Landis","year":"1977","unstructured":"Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977; 33(1):159\u201374.","journal-title":"Biometrics"},{"key":"210_CR22","doi-asserted-by":"crossref","unstructured":"Cer D, Yang Y, Kong Sy, Hua N, Limtiaco N, John RS, et al.Universal Sentence Encoder for English. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. System Demonstrations: 2018. p. 169\u2013174. arXiv:1803.11175.","DOI":"10.18653\/v1\/D18-2029"},{"key":"210_CR23","unstructured":"Bird S, Klein E, Loper E. Natural language processing with Python: analyzing text with the natural language toolkit by Loper E, Klein E, Bird S: O\u2019Reilly Media, Inc.; 2009."},{"key":"210_CR24","unstructured":"Chollet F, et al.Keras. 2015. \n                    https:\/\/keras.io\n                    \n                  ."},{"key":"210_CR25","volume-title":"Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation, OSDI\u201916","author":"M Abadi","year":"2016","unstructured":"Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, Devin M, Ghemawat S, Irving G, Isard M, Kudlur M, Levenberg J, Monga R, Moore S, Murray DG, Steiner B, Tucker P, Vasudevan V, Warden P, Wicke M, Yu Y, Zheng Xi. TensorFlow: A System for Large-scale Machine Learning. In: Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation, OSDI\u201916. Berkeley: USENIX Association: 2016. p. 265\u2013283. \n                    http:\/\/dl.acm.org\/citation.cfm?id=3026877.3026899\n                    \n                  ."},{"key":"210_CR26","volume-title":"Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, Volume 1: Statistics","author":"J MacQueen","year":"1967","unstructured":"MacQueen J. Some methods for classification and analysis of multivariate observations. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, Volume 1: Statistics. Berkeley: University of California Press: 1967. p. 281\u2013297. \n                    https:\/\/projecteuclid.org\/euclid.bsmsp\/1200512992\n                    \n                  ."},{"issue":"1","key":"210_CR27","first-page":"1929","volume":"15","author":"N Srivastava","year":"2014","unstructured":"Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R. Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res. 2014; 15(1):1929\u20131958.","journal-title":"J Mach Learn Res"},{"issue":"11","key":"210_CR28","doi-asserted-by":"publisher","first-page":"2317","DOI":"10.1109\/TPAMI.2014.2321392","volume":"36","author":"WJ Scheirer","year":"2014","unstructured":"Scheirer WJ, Jain LP, Boult TE. Probability models for open set recognition. IEEE Trans Pattern Anal Mach Intell. 2014; 36(11):2317\u20132324.","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"210_CR29","doi-asserted-by":"crossref","unstructured":"Jain LP, Scheirer WJ, Boult TE. Multi-class open set recognition using probability of inclusion. In: European Conference on Computer Vision. ECCV: 2014. p. 393\u2013409. Computer Vision - ECCV 2014.","DOI":"10.1007\/978-3-319-10578-9_26"},{"key":"210_CR30","doi-asserted-by":"crossref","unstructured":"Bendale A, Boult T. Towards open world recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition: 2015. p. 1893\u2013902. arXiv:1412.5687.","DOI":"10.1109\/CVPR.2015.7298799"},{"key":"210_CR31","doi-asserted-by":"crossref","unstructured":"Johnson RA, Wichern DW. Applied Multivariate Statistical Analysis. Upper Saddle River, NJ, USA: Prentice-Hall, Inc.: 1988.","DOI":"10.2307\/2531616"},{"key":"210_CR32","doi-asserted-by":"crossref","unstructured":"Holderness E, Cawkwell P, Bolton K, Pustejovsky J, Hall MH. Distinguishing Clinical Sentiment: The Importance of Domain Adaptation in Psychiatric Patient Health Records. In: Proceedings of the 2nd Clinical Natural Language Processing Workshop: 2019. p. 117\u2013123. arXiv:1904.03225.","DOI":"10.18653\/v1\/W19-1915"},{"key":"210_CR33","unstructured":"Kingma DP, Ba J. Adam: A Method for Stochastic Optimization. CoRR. 2014; abs\/1412.6980."},{"issue":"4","key":"210_CR34","doi-asserted-by":"publisher","first-page":"382","DOI":"10.1192\/bjp.134.4.382","volume":"134","author":"SA Montgomery","year":"1979","unstructured":"Montgomery SA, \u00c5sberg M. A new depression scale designed to be sensitive to change. The British journal of psychiatry. 1979; 134(4):382\u2013389.","journal-title":"The British journal of psychiatry"},{"key":"210_CR35","unstructured":"Costa P, McCrae RR. The NEO Personality Inventory: 3. Odessa, FL: Psychological assessment resources. 2010."},{"issue":"2","key":"210_CR36","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1093\/schbul\/13.2.261","volume":"13","author":"SR Kay","year":"1987","unstructured":"Kay SR, Fiszbein A, Opler LA. The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophrenia bulletin. 1987; 13(2):261\u2013276.","journal-title":"Schizophrenia bulletin"},{"key":"210_CR37","volume-title":"Proceedings of the 27th International Conference on International Conference on Machine Learning (ICML\u201910)","author":"V Nair","year":"2010","unstructured":"Nair V, Hinton GE. Rectified linear units improve restricted boltzmann machines In: F\u00fcrnkranz J, Joachims T, editors. Proceedings of the 27th International Conference on International Conference on Machine Learning (ICML\u201910). USA: Omnipress: 2010. p. 807\u2013814."},{"issue":"5","key":"210_CR38","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1192\/bjp.133.5.429","volume":"133","author":"R Young","year":"1978","unstructured":"Young R, Biggs J, Ziegler V, Meyer D. A rating scale for mania: reliability, validity and sensitivity. The British Journal of Psychiatry. 1978; 133(5):429\u2013435.","journal-title":"The British Journal of Psychiatry"}],"container-title":["Journal of Biomedical Semantics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13326-019-0210-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s13326-019-0210-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13326-019-0210-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,10,29]],"date-time":"2020-10-29T20:22:56Z","timestamp":1604002976000},"score":1,"resource":{"primary":{"URL":"https:\/\/jbiomedsem.biomedcentral.com\/articles\/10.1186\/s13326-019-0210-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,31]]},"references-count":38,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["210"],"URL":"https:\/\/doi.org\/10.1186\/s13326-019-0210-8","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/525816","asserted-by":"object"}]},"ISSN":["2041-1480"],"issn-type":[{"value":"2041-1480","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,10,31]]},"assertion":[{"value":"1 May 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 September 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 October 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Not applicable.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"19"}}