{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,9]],"date-time":"2025-12-09T15:37:53Z","timestamp":1765294673537},"reference-count":60,"publisher":"Oxford University Press (OUP)","issue":"e1","content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2015,4,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Objective We study the use of speech recognition and information extraction to generate drafts of Australian nursing-handover documents.<\/jats:p><jats:p>Methods Speech recognition correctness and clinicians\u2019 preferences were evaluated using 15 recorder\u2013microphone combinations, six documents, three speakers, Dragon Medical 11, and five survey\/interview participants. Information extraction correctness evaluation used 260 documents, six-class classification for each word, two annotators, and the CRF++ conditional random field toolkit.<\/jats:p><jats:p>Results A noise-cancelling lapel-microphone with a digital voice recorder gave the best correctness (79%). This microphone was also the most preferred option by all but one participant. Although the participants liked the small size of this recorder, their preference was for tablets that can also be used for document proofing and sign-off, among other tasks. Accented speech was harder to recognize than native language and a male speaker was detected better than a female speaker. Information extraction was excellent in filtering out irrelevant text (85% F1) and identifying text relevant to two classes (87% and 70% F1). Similarly to the annotators\u2019 disagreements, there was confusion between the remaining three classes, which explains the modest 62% macro-averaged F1.<\/jats:p><jats:p>Discussion We present evidence for the feasibility of speech recognition and information extraction to support clinicians\u2019 in entering text and unlock its content for computerized decision-making and surveillance in healthcare.<\/jats:p><jats:p>Conclusions The benefits of this automation include storing all information; making the drafts available and accessible almost instantly to everyone with authorized access; and avoiding information loss, delays, and misinterpretations inherent to using a ward clerk or transcription services.<\/jats:p>","DOI":"10.1136\/amiajnl-2014-002868","type":"journal-article","created":{"date-parts":[[2014,10,22]],"date-time":"2014-10-22T03:14:01Z","timestamp":1413947641000},"page":"e48-e66","update-policy":"http:\/\/dx.doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":25,"title":["Capturing patient information at nursing shift changes: methodological evaluation of speech recognition and information extraction"],"prefix":"10.1093","volume":"22","author":[{"given":"Hanna","family":"Suominen","sequence":"first","affiliation":[{"name":"Machine Learning Research Group, NICTA, College of Engineering and Computer Science, The Australian National University, Faculty of Health, University of Canberra, and Department of Information Technology, University of Turku, Canberra, Australian Capital Territory, Australia"}]},{"given":"Maree","family":"Johnson","sequence":"additional","affiliation":[{"name":"Research Faculty of Health Sciences, Australian Catholic University, Sydney, New South Wales, Australia"}]},{"given":"Liyuan","family":"Zhou","sequence":"additional","affiliation":[{"name":"Machine Learning Research Group, NICTA, Canberra, Australian Capital Territory, Australia"}]},{"given":"Paula","family":"Sanchez","sequence":"additional","affiliation":[{"name":"Centre for Applied Nursing Research (University of Western Sydney and South Western Sydney Local Health District), Sydney, New South Wales, Australia"}]},{"given":"Raul","family":"Sirel","sequence":"additional","affiliation":[{"name":"Institute of Estonian and General Linguistics, University of Tartu, Tartu, Estonia"}]},{"given":"Jim","family":"Basilakis","sequence":"additional","affiliation":[{"name":"School of Computing, Engineering and Mathematics, University of Western Sydney, Sydney, New South Wales, Australia"}]},{"given":"Leif","family":"Hanlen","sequence":"additional","affiliation":[{"name":"Machine Learning Research Group, NICTA, College of Engineering and Computer Science, The Australian National University, Faculty of Health, University of Canberra, Canberra, Australian Capital Territory, Australia"}]},{"given":"Dominique","family":"Estival","sequence":"additional","affiliation":[{"name":"The MARCS Institute, University of Western Sydney and Department of Linguistics, University of Sydney, Sydney, New South Wales, Australia"}]},{"given":"Linda","family":"Dawson","sequence":"additional","affiliation":[{"name":"Faculty of Social Sciences, University of Wollongong, Wollongong, New South Wales, Australia"}]},{"given":"Barbara","family":"Kelly","sequence":"additional","affiliation":[{"name":"School of Languages and Linguistics, The University of Melbourne, Melbourne, Victoria, Australia"}]}],"member":"286","published-online":{"date-parts":[[2014,10,21]]},"reference":[{"key":"2020110613020952100_R1","first-page":"173","article-title":"Measuring and interpreting organizational culture","volume":"1","author":"Glaser","year":"1987","journal-title":"MCQ"},{"key":"2020110613020952100_R2","author":"Windows into Safety and Quality in Health Care"},{"key":"2020110613020952100_R3","author":"Implementation Toolkit for Clinical Handover Improvement"},{"key":"2020110613020952100_R4","author":"The OSSIE Guide to Clinical Handover Improvement"},{"key":"2020110613020952100_R5","doi-asserted-by":"crossref","first-page":"454","DOI":"10.1111\/j.1466-7657.2010.00846.x","article-title":"Classifying nursing errors in clinical management within an Australian hospital","volume":"57","author":"Tran","year":"2010","journal-title":"Int Nurs Rev"},{"key":"2020110613020952100_R6","author":"Safe Handover: Safe Patients"},{"key":"2020110613020952100_R7","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1111\/inr.12072","article-title":"Comparing nursing handover and documentation: forming one set of patient information","volume":"61","author":"Johnson","year":"2014","journal-title":"Int Nurs Rev"},{"key":"2020110613020952100_R8","doi-asserted-by":"crossref","first-page":"1090","DOI":"10.12968\/bjon.2005.14.20.20053","article-title":"Pilot study to show the loss of important data in nursing handover","volume":"14","author":"Pothier","year":"2005","journal-title":"Br J Nurs"},{"key":"2020110613020952100_R9","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1111\/j.1365-2702.2010.03242.x","article-title":"Review: bringing patient safety to the forefront through structured computerisation during clinical handover","volume":"20","author":"Matic","year":"2011","journal-title":"J Clin Nurs"},{"key":"2020110613020952100_R10","doi-asserted-by":"crossref","first-page":"121","DOI":"10.11124\/jbisrir-2010-109","article-title":"A systematic review of nurses\u2019 inter-shift handoff reports in acute care hospitals","volume":"8","author":"Poletic","year":"2010","journal-title":"JBI Library Syst Rev"},{"key":"2020110613020952100_R11","article-title":"A systematic review on the transfer of information during nurse transitions in care","author":"Holly","year":"2013","journal-title":"J Clin Nurs"},{"key":"2020110613020952100_R12"},{"key":"2020110613020952100_R13","author":"National Safety and Quality Health Service Standards"},{"key":"2020110613020952100_R14","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1136\/jamia.2000.0070462","article-title":"Comparative evaluation of three continuous speech recognition software packages in the generation of medical reports","volume":"7","author":"Devine","year":"2000","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613020952100_R15","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1053\/ajem.2001.24487","article-title":"Voice recognition software versus a traditional transcription service for physician charting in the ED","volume":"19","author":"Zick","year":"2001","journal-title":"Am J Emerg Med"},{"key":"2020110613020952100_R16","doi-asserted-by":"crossref","first-page":"721","DOI":"10.5858\/2003-127-721-COVTAH","article-title":"Comparison of voice-automated transcription and human transcription in generating pathology reports","volume":"127","author":"Al-Aynati","year":"2003","journal-title":"Arch Pathol Lab Med"},{"key":"2020110613020952100_R17","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1016\/j.ijmedinf.2006.11.007","article-title":"Impact of noise and other factors on speech recognition in anaesthesia","volume":"77","author":"Alapetite","year":"2008","journal-title":"Int J Med Inform"},{"key":"2020110613020952100_R18","first-page":"128","article-title":"Extracting information from textual documents in the electronic health record: a review of recent research","author":"Meystre","year":"2008","journal-title":"Yearb Med Inform"},{"key":"2020110613020952100_R19","author":"OECD.StatsExtracts"},{"key":"2020110613020952100_R20","article-title":"The Stockholm EPR Corpus\u2014characteristics and some initial findings","author":"Dalianis","year":"2009"},{"key":"2020110613020952100_R21","first-page":"325","article-title":"Information flow in intensive care narratives","author":"Suominen","year":"2009"},{"key":"2020110613020952100_R22","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/j.jcrc.2007.06.003","article-title":"Quantifying the volume of documented clinical information in critical illness","volume":"23","author":"Manor-Shulman","year":"2008","journal-title":"J Crit Care"},{"key":"2020110613020952100_R23","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1197\/jamia.M1700","article-title":"The impact of electronic health records on time efficiency on physicians and nurses: a systematic review","volume":"12","author":"Poissant","year":"2005","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613020952100_R24","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1097\/01.NCN.0000304801.00628.ab","article-title":"Assessing the impact of an electronic medical record on nurse documentation time","volume":"26","author":"Hakes","year":"2008","journal-title":"Comput Inform Nurs"},{"key":"2020110613020952100_R25","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1097\/NCN.0b013e318197287d","article-title":"Automated clinical documentation: does it allow nurses more time for patient care?","volume":"27","author":"Banner","year":"2009","journal-title":"Comput Inform Nurs"},{"key":"2020110613020952100_R26","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1007\/BF03191902","article-title":"Speech recognition interface to a hospital information system using a self-designed visual basic program: initial experience","volume":"15","author":"Callaway","year":"2002","journal-title":"J Digit Imaging"},{"key":"2020110613020952100_R27","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1007\/s10278-008-9121-4","article-title":"Improvement of report workflow and productivity using speech recognition\u2014a follow-up study","volume":"21","author":"Koivikko","year":"2008","journal-title":"J Digit Imaging"},{"key":"2020110613020952100_R28","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1007\/s10278-002-0014-7","article-title":"Impact of speech recognition on radiologist productivity","volume":"15","author":"Langer","year":"2002","journal-title":"J Digit Imaging"},{"key":"2020110613020952100_R29","doi-asserted-by":"crossref","first-page":"1476","DOI":"10.5858\/arpa.2010-0714-OA","article-title":"Voice recognition technology implementation in surgical pathology: advantages and limitations","volume":"135","author":"Singh","year":"2011","journal-title":"Arch Pathol Lab Med"},{"key":"2020110613020952100_R30","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1145\/945546.945549","article-title":"Challenges in information retrieval and language modeling: report of a workshop held at the Center for Intelligent Information Retrieval, University of Massachusetts Amherst, September 2002","volume":"37","author":"Allan","year":"2003","journal-title":"SIGIR Forum"},{"key":"2020110613020952100_R31","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/S1386-5056(00)00079-4","article-title":"Power of expression in the electronic patient record: structured data or narrative text?","volume":"58\u201359","author":"Lovis","year":"2000","journal-title":"Int J Med Inform"},{"key":"2020110613020952100_R32","doi-asserted-by":"crossref","first-page":"1184","DOI":"10.1136\/bmj.328.7449.1184","article-title":"The clinician's perspective on electronic health records and how they can affect patient care","volume":"328","author":"Walsh","year":"2004","journal-title":"BMJ"},{"key":"2020110613020952100_R33","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/0020-7101(96)01178-6","article-title":"How to approach the structuring of the medical record? Towards a model for exible access to free text medical data","volume":"42","author":"Tange","year":"1996","journal-title":"Int J Biomed Comput"},{"key":"2020110613020952100_R34","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1016\/S1386-5056(97)00048-8","article-title":"Medical narratives in electronic medical records","volume":"46","author":"Tange","year":"1997","journal-title":"Int J Med Inform"},{"key":"2020110613020952100_R35","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1046\/j.1365-2702.2003.00727.x","article-title":"Evaluation of patient records as part of developing a nursing care classification","volume":"12","author":"K\u00e4rkk\u00e4inen","year":"2003","journal-title":"J Clin Nurs"},{"key":"2020110613020952100_R36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10916-014-0056-7","article-title":"The usability of speech recognition technologies in clinical handover: a pre-implementation study","volume":"38","author":"Dawson","year":"2014","journal-title":"J Med Syst"},{"key":"2020110613020952100_R37","first-page":"1447","article-title":"Guidelines for the use of multimedia in instruction","author":"Williams","year":"1998"},{"key":"2020110613020952100_R38","first-page":"568","article-title":"Patterns of entry and correction in large vocabulary continuous speech recognition systems","author":"Karat","year":"1999"},{"key":"2020110613020952100_R39","first-page":"41","article-title":"120 wpm for very skilled typist","author":"Ayres","year":"2005"},{"key":"2020110613020952100_R40","author":"Dragon NaturallySpeaking Speech Recognition: More speed"},{"key":"2020110613020952100_R41","article-title":"Preliminary Evaluation of speech recognition for capturing patient information at nursing shift changes: accuracy in speech to text and user preferences for recorders","author":"Suominen"},{"key":"2020110613020952100_R42","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1111\/j.1365-2702.2011.03891.x","article-title":"Developing a minimum data set for electronic nursing handover","volume":"31","author":"Johnson","year":"2012","journal-title":"J Clin Nurs"},{"key":"2020110613020952100_R43","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1111\/j.1440-172X.2012.02059.x","article-title":"Exploring the structure and organization of information within nursing clinical handovers","volume":"18","author":"Johnson","year":"2012","journal-title":"Int J Nurs Pract"},{"key":"2020110613020952100_R44","first-page":"273","article-title":"Knowtator: a Prot\u00e9g\u00e9 plugin for annotated corpus construction","author":"Ogren","year":"2006"},{"key":"2020110613020952100_R45","first-page":"282","article-title":"Conditional random fields: probabilistic models for segmenting and labeling sequence data","author":"Lafferty","year":"2001"},{"key":"2020110613020952100_R46","first-page":"9","article-title":"Critical points in assessing learning performance via cross-validation","author":"Suominen","year":"2008"},{"key":"2020110613020952100_R47","first-page":"34","article-title":"Noise in speech-to-text voice: analysis of errors and feasibility of phonetic similarity for their correction","author":"Suominen","year":"2013"},{"key":"2020110613020952100_R48","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1016\/j.ijmedinf.2012.04.006","article-title":"Detecting temporal expressions in medical narratives","volume":"82","author":"Reeves","year":"2013","journal-title":"Int J Med Inform"},{"key":"2020110613020952100_R49","author":"NANDA International","year":"2011","edition":"9th edn"},{"key":"2020110613020952100_R50","author":"Bulechek","year":"2008","edition":"5th edn"},{"key":"2020110613020952100_R51","author":"Moorhead","year":"2008","edition":"4th edn"},{"key":"2020110613020952100_R52","first-page":"195","article-title":"The KnowledgeMap project: development of a concept-based medical school curriculum database","volume-title":"AMIA Annu Symp Proc","author":"Denny","year":"2003"},{"key":"2020110613020952100_R53","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1197\/jamia.M1176","article-title":"\u201cUnderstanding\u201d medical school curriculum content using knowledgemap","volume":"10","author":"Denny","year":"2003","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613020952100_R54","first-page":"525","article-title":"Comparing natural language processing tools to extract medical problems from narrative text","volume":"2005","author":"Meystre","year":"2005","journal-title":"AMIA Annu Symp Proc"},{"issue":"(Suppl 9)","key":"2020110613020952100_R55","doi-asserted-by":"crossref","first-page":"S14","DOI":"10.1186\/1471-2105-10-S9-S14","article-title":"Comparison of concept recognizers for building the Open Biomedical Annotator","volume":"10","author":"Shah","year":"2009","journal-title":"BMC Bioinformatics"},{"key":"2020110613020952100_R56","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1136\/jamia.2009.002733","article-title":"An overview of MetaMap: historical perspective and recent advances","volume":"17","author":"Aronson","year":"2010","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613020952100_R57","article-title":"Comparing Metamap to MGrep as a tool for mapping free text to formal medical lexicons","author":"Stewart"},{"key":"2020110613020952100_R58","first-page":"485","article-title":"Query expansion using the UMLS Metathesaurus","author":"Aronson","year":"1997","journal-title":"Proc AMIA Annu Fall Symp"},{"key":"2020110613020952100_R59","doi-asserted-by":"crossref","first-page":"2059","DOI":"10.1093\/bioinformatics\/bti284","article-title":"Concept-based annotation of enzyme classes","volume":"21","author":"Hofmann","year":"2005","journal-title":"Bioinformatics"},{"key":"2020110613020952100_R60","author":"National Research Council","year":"2004"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/22\/e1\/e48\/34146031\/amiajnl-2014-002868.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/22\/e1\/e48\/34146031\/amiajnl-2014-002868.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,4,20]],"date-time":"2022-04-20T10:48:52Z","timestamp":1650451732000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/22\/e1\/e48\/702116"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,10,21]]},"references-count":60,"journal-issue":{"issue":"e1","published-online":{"date-parts":[[2014,10,21]]},"published-print":{"date-parts":[[2015,4,1]]}},"URL":"https:\/\/doi.org\/10.1136\/amiajnl-2014-002868","relation":{},"ISSN":["1527-974X","1067-5027"],"issn-type":[{"value":"1527-974X","type":"electronic"},{"value":"1067-5027","type":"print"}],"subject":[],"published-other":{"date-parts":[[2015,4]]},"published":{"date-parts":[[2014,10,21]]}}}