{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T16:08:40Z","timestamp":1762272520953,"version":"3.37.3"},"reference-count":25,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,3,10]],"date-time":"2020-03-10T00:00:00Z","timestamp":1583798400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2020,3,10]],"date-time":"2020-03-10T00:00:00Z","timestamp":1583798400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004359","name":"Swedish Research Council","doi-asserted-by":"crossref","award":["2015-00359"],"award-info":[{"award-number":["2015-00359"]}],"id":[{"id":"10.13039\/501100004359","id-type":"DOI","asserted-by":"crossref"}]},{"name":"NIHR Specialist Biomedical Research Centre for Mental Health at the South London and Maudsley NHS Foundation Trust and Institute of Psychiatry, King\u2019s College London"},{"name":"Medical Research Council","award":["Mental Health Data Pathfinder Award"],"award-info":[{"award-number":["Mental Health Data Pathfinder Award"]}]},{"name":"NIHR Senior Investigator Award"},{"DOI":"10.13039\/501100000691","name":"Academy of Medical Sciences","doi-asserted-by":"crossref","award":["SGL015\/1020"],"award-info":[{"award-number":["SGL015\/1020"]}],"id":[{"id":"10.13039\/501100000691","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Medical Research Council (MRC) Health Data Research UK Fellowship","award":["MR\/S003118\/1"],"award-info":[{"award-number":["MR\/S003118\/1"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Biomed Semant"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Duration of untreated psychosis (DUP) is an important clinical construct in the field of mental health, as longer DUP can be associated with worse intervention outcomes. DUP estimation requires knowledge about<jats:italic>when<\/jats:italic>psychosis symptoms first started (symptom onset), and when psychosis treatment was initiated. Electronic health records (EHRs) represent a useful resource for retrospective clinical studies on DUP, but the core information underlying this construct is most likely to lie in free text, meaning it is not readily available for clinical research. Natural Language Processing (NLP) is a means to addressing this problem by automatically extracting relevant information in a structured form. As a first step, it is important to identify appropriate documents, i.e., those that are likely to include the information of interest. Next, temporal information extraction methods are needed to identify time references for early psychosis symptoms. This NLP challenge requires solving three different tasks: time expression extraction, symptom extraction, and temporal \u201clinking\u201d. In this study, we focus on the first step, using two relevant EHR datasets.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>We applied a rule-based NLP system for time expression extraction that we had previously adapted to a corpus of mental health EHRs from patients with a diagnosis of schizophrenia (first referrals). We extended this work by applying this NLP system to a larger set of documents and patients, to identify additional texts that would be relevant for our long-term goal, and developed a new corpus from a subset of these new texts (early intervention services). Furthermore, we added normalized value annotations (\u201c2011\u201305\u201d) to the annotated time expressions (\u201cMay 2011\u201d) in both corpora. The finalized corpora were used for further NLP development and evaluation, with promising results (normalization accuracy 71\u201386%). To highlight the specificities of our annotation task, we also applied the final adapted NLP system to a different temporally annotated clinical corpus.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>Developing domain-specific methods is crucial to address complex NLP tasks such as symptom onset extraction and retrospective calculation of duration of a preclinical syndrome. To the best of our knowledge, this is the first clinical text resource annotated for temporal entities in the mental health domain.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s13326-020-00220-2","type":"journal-article","created":{"date-parts":[[2020,3,10]],"date-time":"2020-03-10T11:02:50Z","timestamp":1583838170000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Temporal information extraction from mental health records to identify duration of untreated psychosis"],"prefix":"10.1186","volume":"11","author":[{"given":"Natalia","family":"Viani","sequence":"first","affiliation":[]},{"given":"Joyce","family":"Kam","sequence":"additional","affiliation":[]},{"given":"Lucia","family":"Yin","sequence":"additional","affiliation":[]},{"given":"Andr\u00e9","family":"Bittar","sequence":"additional","affiliation":[]},{"given":"Rina","family":"Dutta","sequence":"additional","affiliation":[]},{"given":"Rashmi","family":"Patel","sequence":"additional","affiliation":[]},{"given":"Robert","family":"Stewart","sequence":"additional","affiliation":[]},{"given":"Sumithra","family":"Velupillai","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,3,10]]},"reference":[{"issue":"1","key":"220_CR1","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1192\/bjp.bp.105.019869","volume":"189","author":"S Kisely","year":"2006","unstructured":"Kisely S, Scott A, Denney J, Simon G. Duration of untreated symptoms in common mental disorders: association with outcomes. Br J Psychiatry. 2006;189(1):79\u201380.","journal-title":"Br J Psychiatry"},{"issue":"1\u20133","key":"220_CR2","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1016\/j.schres.2007.05.037","volume":"95","author":"JM Lappin","year":"2007","unstructured":"Lappin JM, Morgan KD, Morgan C, Dazzan P, Reichenberg A, Zanelli JW, et al. Duration of untreated psychosis and neuropsychological function in first episode psychosis. Schizophr Res. 2007;95(1\u20133):103\u201310.","journal-title":"Schizophr Res"},{"issue":"2\u20133","key":"220_CR3","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1016\/j.schres.2012.08.013","volume":"141","author":"M Hill","year":"2012","unstructured":"Hill M, Crumlish N, Clarke M, Whitty P, Owens E, Renwick L, et al. Prospective relationship of duration of untreated psychosis to psychopathology and functional outcome over 12 years. Schizophr Res. 2012;141(2\u20133):215\u201321.","journal-title":"Schizophr Res"},{"key":"220_CR4","doi-asserted-by":"crossref","unstructured":"Meystre SM, Savova GK, Kipper-Schuler KC, Hurdle JF. Extracting information from textual documents in the electronic health record: a review of recent research. Yearb Med Inform. 2008;17(01):128\u201344.","DOI":"10.1055\/s-0038-1638592"},{"key":"220_CR5","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1016\/j.jbi.2017.11.011","volume":"77","author":"Y Wang","year":"2018","unstructured":"Wang Y, Wang L, Rastegar-Mojarad M, Moon S, Shen F, Afzal N, et al. Clinical information extraction applications: a literature review. J Biomed Inform. 2018;77:34\u201349.","journal-title":"J Biomed Inform"},{"key":"220_CR6","first-page":"28","volume":"3","author":"J Pustejovsky","year":"2003","unstructured":"Pustejovsky J, Castano JM, Ingria R, Sauri R, Gaizauskas RJ, Setzer A, et al. TimeML: robust specification of event and temporal expressions in text. New Dir Quest Answering. 2003;3:28\u201334.","journal-title":"New Dir Quest Answering"},{"issue":"0","key":"220_CR7","doi-asserted-by":"publisher","first-page":"S5","DOI":"10.1016\/j.jbi.2013.07.004","volume":"46","author":"W Sun","year":"2013","unstructured":"Sun W, Rumshisky A, Uzuner O. Annotating temporal information in clinical narratives. J Biomed Inform. 2013;46(0):S5\u201312.","journal-title":"J Biomed Inform"},{"issue":"5","key":"220_CR8","doi-asserted-by":"publisher","first-page":"806","DOI":"10.1136\/amiajnl-2013-001628","volume":"20","author":"W Sun","year":"2013","unstructured":"Sun W, Rumshisky A, Uzuner O. Evaluating temporal relations in clinical text: 2012 i2b2 challenge. J Am Med Inform Assoc. 2013;20(5):806\u201313.","journal-title":"J Am Med Inform Assoc"},{"key":"220_CR9","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1162\/tacl_a_00172","volume":"2","author":"WF Styler IV","year":"2014","unstructured":"Styler WF IV, Bethard S, Finan S, Palmer M, Pradhan S, de Groen PC, et al. Temporal annotation in the clinical domain. Trans Assoc Comput Linguist. 2014;2:143\u201354.","journal-title":"Trans Assoc Comput Linguist"},{"key":"220_CR10","series-title":"Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015)","first-page":"806","volume-title":"SemEval-2015 Task 6: Clinical TempEval","author":"S Bethard","year":"2015","unstructured":"Bethard S, Derczynski L, Savova G, Pustejovsky J, Verhagen M. SemEval-2015 Task 6: Clinical TempEval, Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015); 2015. p. 806\u201314."},{"key":"220_CR11","series-title":"Proceedings of the 10th International Workshop on Semantic Evaluations (SemEval-2016)","first-page":"1052","volume-title":"Semeval-2016 task 12: Clinical TempEval","author":"S Bethard","year":"2016","unstructured":"Bethard S, Savova G, Chen W-T, Derczynski L, Pustejovsky J, Verhagen M. Semeval-2016 task 12: Clinical TempEval, Proceedings of the 10th International Workshop on Semantic Evaluations (SemEval-2016); 2016. p. 1052\u201362."},{"issue":"5","key":"220_CR12","doi-asserted-by":"publisher","first-page":"1001","DOI":"10.1093\/jamia\/ocu004","volume":"22","author":"W Sun","year":"2015","unstructured":"Sun W, Rumshisky A, Uzuner O. Normalization of relative and incomplete temporal expressions in clinical narratives. J Am Med Inform Assoc. 2015;22(5):1001\u20138.","journal-title":"J Am Med Inform Assoc"},{"key":"220_CR13","doi-asserted-by":"crossref","unstructured":"Tissot H, Del Fabro MD, Derczynski L, Roberts A. Normalisation of imprecise temporal expressions extracted from text. Knowl Inf Syst. 2019;61:1361\u201394.","DOI":"10.1007\/s10115-019-01338-1"},{"key":"220_CR14","unstructured":"Chang AX, Manning CD. SUTIME: a library for recognizing and normalizing time expressions. In: Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC 2012); 2012. p. 3735\u201340."},{"key":"220_CR15","first-page":"321","volume-title":"Proceedings of the 5th International Workshop on Semantic Evaluation","author":"J Str\u00f6tgen","year":"2010","unstructured":"Str\u00f6tgen J, Gertz M. Heideltime: High quality rule-based extraction and normalization of temporal expressions. In: Proceedings of the 5th International Workshop on Semantic Evaluation; 2010. p. 321\u20134."},{"issue":"5","key":"220_CR16","doi-asserted-by":"publisher","first-page":"836","DOI":"10.1136\/amiajnl-2013-001622","volume":"20","author":"S Sohn","year":"2013","unstructured":"Sohn S, Wagholikar KB, Li D, Jonnalagadda SR, Tao C, Komandur Elayavilli R, et al. Comprehensive temporal information detection from clinical text: medical events, time, and TLINK identification. J Am Med Inform Assoc. 2013;20(5):836\u201342.","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"220_CR17","doi-asserted-by":"publisher","first-page":"849","DOI":"10.1136\/amiajnl-2012-001607","volume":"20","author":"Y Xu","year":"2013","unstructured":"Xu Y, Wang Y, Liu T, Tsujii J, Chang EI-C. An end-to-end system to identify temporal relation in discharge summaries: 2012 i2b2 challenge. J Am Med Inform Assoc. 2013;20(5):849\u201358.","journal-title":"J Am Med Inform Assoc"},{"key":"220_CR18","first-page":"1","volume-title":"Second Joint Conference on Lexical and Computational Semantics (*SEM), Volume 2: Proceedings of the Seventh International Workshop on Semantic Evaluation (SemEval 2013)","author":"N UzZaman","year":"2013","unstructured":"UzZaman N, Llorens H, Derczynski L, Allen J, Verhagen M, Pustejovsky J. SemEval-2013 Task 1: TempEval-3: Evaluating Time Expressions, Events, and Temporal Relations. In: Second Joint Conference on Lexical and Computational Semantics (*SEM), Volume 2: Proceedings of the Seventh International Workshop on Semantic Evaluation (SemEval 2013); 2013. p. 1\u20139."},{"key":"220_CR19","first-page":"821","volume-title":"Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing","author":"S Bethard","year":"2013","unstructured":"Bethard S. A synchronous context free grammar for time normalization. In: Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing; 2013. p. 821\u20136."},{"key":"220_CR20","doi-asserted-by":"publisher","first-page":"183","DOI":"10.18653\/v1\/W18-5621","volume-title":"Proceedings of the Ninth International Workshop on health text mining and information analysis","author":"N Viani","year":"2018","unstructured":"Viani N, Yin L, Kam J, Alawi A, Bittar A, Dutta R, et al. Time expressions in mental health records for symptom onset extraction. In: Proceedings of the Ninth International Workshop on health text mining and information analysis; 2018. p. 183\u201392."},{"key":"220_CR21","first-page":"418","volume":"264","author":"N Viani","year":"2019","unstructured":"Viani N, Kam J, Yin L, Verma S, Stewart R, Patel R, et al. Annotating temporal relations to determine the onset of psychosis symptoms. Stud Health Technol Inform. 2019;264:418\u201322.","journal-title":"Stud Health Technol Inform"},{"issue":"3","key":"220_CR22","doi-asserted-by":"publisher","first-page":"e008721","DOI":"10.1136\/bmjopen-2015-008721","volume":"6","author":"G Perera","year":"2016","unstructured":"Perera G, Broadbent M, Callard F, Chang C-K, Downs J, Dutta R, et al. Cohort profile of the South London and Maudsley NHS Foundation Trust biomedical research Centre (SLaM BRC) case register: current status and recent enhancement of an electronic mental health record-derived data resource. BMJ Open. 2016;6(3):e008721.","journal-title":"BMJ Open"},{"key":"220_CR23","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1186\/1472-6947-13-71","volume":"13","author":"AC Fernandes","year":"2013","unstructured":"Fernandes AC, Cloete D, Broadbent MT, Hayes RD, Chang C-K, Jackson RG, et al. Development and evaluation of a de-identification procedure for a case register sourced from mental health electronic records. BMC Med Inform Decis Mak. 2013;13:71.","journal-title":"BMC Med Inform Decis Mak"},{"key":"220_CR24","unstructured":"Viani N, Velupillai S. Project repository. Available from: https:\/\/github.com\/medesto\/temporal-information-extraction-DUP."},{"key":"220_CR25","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1007\/978-3-030-21642-9_38","volume-title":"Proceedings of the 17th Conference on Artificial Intelligence in Medicine (AIME 2019)","author":"N Viani","year":"2019","unstructured":"Viani N, Patel R, Stewart R, Velupillai S. Generating positive Psychosis Symptom Keywords from Electronic Health Records. In: Proceedings of the 17th Conference on Artificial Intelligence in Medicine (AIME 2019); 2019. p. 298\u2013303."}],"container-title":["Journal of Biomedical Semantics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13326-020-00220-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s13326-020-00220-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13326-020-00220-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,28]],"date-time":"2023-09-28T11:45:59Z","timestamp":1695901559000},"score":1,"resource":{"primary":{"URL":"https:\/\/jbiomedsem.biomedcentral.com\/articles\/10.1186\/s13326-020-00220-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,10]]},"references-count":25,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["220"],"URL":"https:\/\/doi.org\/10.1186\/s13326-020-00220-2","relation":{},"ISSN":["2041-1480"],"issn-type":[{"type":"electronic","value":"2041-1480"}],"subject":[],"published":{"date-parts":[[2020,3,10]]},"assertion":[{"value":"29 May 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 March 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 March 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The database used in this study has ethical approval for secondary analysis (Oxford REC C, reference 18\/SC\/0372).","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"2"}}