{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T01:37:31Z","timestamp":1775871451538,"version":"3.50.1"},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"value":"9781643681764","type":"print"},{"value":"9781643681771","type":"electronic"}],"license":[{"start":{"date-parts":[[2021,5,24]],"date-time":"2021-05-24T00:00:00Z","timestamp":1621814400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,5,24]]},"abstract":"<jats:p>Introduction: The aim of this study is to evaluate the use of a natural language processing (NLP) software to extract medication statements from unstructured medical discharge letters. Methods: Ten randomly selected discharge letters were extracted from the data warehouse of the University Hospital Erlangen (UHE) and manually annotated to create a gold standard. The AHD NLP tool, provided by MIRACUM\u2019s industry partner was used to annotate these discharge letters. Annotations by the NLP tool where then compared to the gold standard on two levels: phrase precision (whether or not the whole medication statement has been identified correctly) and token precision (whether or not the medication name has been identified correctly within correctly discovered medication phrases). Results: The NLP tool detected medication related phrases with an overall F-measure of 0.852. The medication name has been identified correctly with an overall F-measure of 0.936. Discussion: This proof-of-concept study is a first step towards an automated scalable evaluation system for MIRACUM\u2019s industry partner\u2019s NLP tool by using a gold standard. Medication phrases and names have been correctly identified in most cases by the NLP system. Future effort needs to be put into extending and validating the gold standard.<\/jats:p>","DOI":"10.3233\/shti210073","type":"book-chapter","created":{"date-parts":[[2021,5,27]],"date-time":"2021-05-27T12:17:13Z","timestamp":1622117833000},"source":"Crossref","is-referenced-by-count":5,"title":["First Steps to Evaluate an NLP Tool\u2019s Medication Extraction Accuracy from Discharge Letters"],"prefix":"10.3233","author":[{"given":"Deniz","family":"Caliskan","sequence":"first","affiliation":[{"name":"Medical Center for Information and Communication Technology, Universit\u00e4tsklinikum Erlangen, Erlangen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jakob","family":"Zierk","sequence":"additional","affiliation":[{"name":"Medical Center for Information and Communication Technology, Universit\u00e4tsklinikum Erlangen, Erlangen, Germany"},{"name":"Department of Pediatrics and Adolescent Medicine, Universit\u00e4tsklinikum Erlangen, Erlangen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Detlef","family":"Kraska","sequence":"additional","affiliation":[{"name":"Medical Center for Information and Communication Technology, Universit\u00e4tsklinikum Erlangen, Erlangen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stefan","family":"Schulz","sequence":"additional","affiliation":[{"name":"Averbis GmbH, Freiburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Philipp","family":"Daumke","sequence":"additional","affiliation":[{"name":"Averbis GmbH, Freiburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hans-Ulrich","family":"Prokosch","sequence":"additional","affiliation":[{"name":"Medical Center for Information and Communication Technology, Universit\u00e4tsklinikum Erlangen, Erlangen, Germany"},{"name":"Chair of Medical Informatics, Friedrich-Alexander-University Erlangen-N\u00fcrnberg (FAU), Erlangen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lorenz A.","family":"Kapsner","sequence":"additional","affiliation":[{"name":"Medical Center for Information and Communication Technology, Universit\u00e4tsklinikum Erlangen, Erlangen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"7437","container-title":["Studies in Health Technology and Informatics","German Medical Data Sciences: Bringing Data to Life"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/SHTI210073","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,10,25]],"date-time":"2021-10-25T13:10:08Z","timestamp":1635167408000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/SHTI210073"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,24]]},"ISBN":["9781643681764","9781643681771"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/shti210073","relation":{},"ISSN":["0926-9630","1879-8365"],"issn-type":[{"value":"0926-9630","type":"print"},{"value":"1879-8365","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,24]]}}}