{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2022,4,4]],"date-time":"2022-04-04T23:58:08Z","timestamp":1649116688675},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"S5","license":[{"start":{"date-parts":[[2019,12,1]],"date-time":"2019-12-01T00:00:00Z","timestamp":1575158400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2019,12,5]],"date-time":"2019-12-05T00:00:00Z","timestamp":1575504000000},"content-version":"vor","delay-in-days":4,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>With the wide application of Electronic Medical Record (EMR) systems, it has become a daily work for doctors using keyboards to input clinical information into the EMR system. Chinese Input Method Engine (IME) is essential for doctors to convert pinyin to Chinese characters, and an efficient IME would improve doctors\u2019 healthcare work. We developed a tool (called TestIME) to evaluating the efficiency of the current IMEs used in doctors\u2019 working scenario.<\/jats:p>\n                <jats:p>The proposed TestIME consists of four major function modules: 1) Test tasks assignment, to ensure that participants using different IMEs to complete the same test task in a random order; 2) IME automatic switching, to automatically switch the input method engines without changing the experimental settings; 3) participants\u2019 behavior monitoring, to record the participants\u2019 keystrokes and timestamp during the typing process; 4) questionnaire, to collect the participants\u2019 subjective data. In addition, we designed a preliminary experiment to demonstrate the usability of TestIME. We selected three sentences from EMR corpus and news corpus as test texts respectively, and recruited four participants in a medical school to complete text entry tasks using the TestIME.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Our TestIME was able to generate 72 files that record the detailed participants\u2019 keyboard behavior while transcribing test texts, and 4 questionnaires that reflect participants\u2019 psychological states. These profiles can be downloaded in a structured format (CSV) from the TestIME for further analysis.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>We developed a tool (TestIME) to evaluate Chinese input methods in the EMR entry tasks. In the given text input scenario in healthcare, the TestIME is capable to record doctors\u2019 keyboard behavior, frequently used Chinese terms, IME usability feedback etc. These user profiles are important to improve current IME tools for doctors and further improve healthcare service.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12911-019-0932-7","type":"journal-article","created":{"date-parts":[[2019,12,5]],"date-time":"2019-12-05T01:02:23Z","timestamp":1575507743000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["TestIME: an application for evaluating the efficiency of Chinese input method engines in electronic medical record entry task"],"prefix":"10.1186","volume":"19","author":[{"given":"Feihong","family":"Yang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haihong","family":"Guo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiao","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2019,12,5]]},"reference":[{"key":"932_CR1","volume-title":"The national health service from January to November 2018","author":"SICO China","year":"2019","unstructured":"China SICO. The national health service from January to November 2018, vol. 2019; 2019."},{"issue":"1","key":"932_CR2","doi-asserted-by":"publisher","first-page":"17183","DOI":"10.1038\/s41598-018-35268-9","volume":"8","author":"WT Siok","year":"2018","unstructured":"Siok WT, Liu CY. Differential impacts of different keyboard inputting methods on reading and writing skills. SCI REP-UK. 2018;8(1):17183.","journal-title":"SCI REP-UK"},{"issue":"23","key":"932_CR3","first-page":"321","volume":"24","author":"J Pan","year":"2017","unstructured":"Pan J, Yao X. Application of Sogou input method in electronic medical record. Psychol Doct. 2017;24(23):321\u20133.","journal-title":"Psychol Doct"},{"key":"932_CR4","unstructured":"Sogou Pinyin. https:\/\/pinyin.sogou.com\/.Accessed 11 May 2019."},{"key":"932_CR5","unstructured":"Baidu Input Method Software. https:\/\/shurufa.baidu.com\/.Accessed 11 May 2019."},{"key":"932_CR6","unstructured":"Sogou Pinyin Doctor Edition.https:\/\/pinyin.sogou.com\/yisheng. Accessed 11 May 2019."},{"key":"932_CR7","volume-title":"Tracing a Loose Wordhood for Chinese Input Method Engine. CoRR","author":"X Zhang","year":"2017","unstructured":"Zhang X, Wei C, Zhao H: Tracing a Loose Wordhood for Chinese Input Method Engine. CoRR 2017, abs\/1712.04158."},{"key":"932_CR8","doi-asserted-by":"crossref","unstructured":"Huang Y, Zhao H. Chinese Pinyin aided IME, input what you have not keystroked yet. In: EMNLP: 2018, vol. 2018.","DOI":"10.18653\/v1\/D18-1321"},{"key":"932_CR9","volume-title":"ACL:2018","author":"Y Huang","year":"2018","unstructured":"Huang Y, Li Z, Zhang Z, Zhao H. Moon IME: Neural-based Chinese Pinyin Aided Input Method with Customizable Association. In: ACL:2018; 2018."},{"key":"932_CR10","volume-title":"CHI Extended Abstracts: 2001","author":"RW Soukoreff","year":"2001","unstructured":"Soukoreff RW, MacKenzie IS. Measuring errors in text entry tasks: an application of the Levenshtein string distance statistic. In: CHI Extended Abstracts: 2001; 2001."},{"key":"932_CR11","volume-title":"CHI:2003","author":"RW Soukoreff","year":"2003","unstructured":"Soukoreff RW, MacKenzie IS. Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric. In: CHI:2003; 2003."},{"key":"932_CR12","volume-title":"IJCNLP:2013","author":"Z Jia","year":"2013","unstructured":"Jia Z, Zhao H. KySS 1.0: a Framework for Automatic Evaluation of Chinese Input Method Engines. In: IJCNLP:2013; 2013."},{"key":"932_CR13","first-page":"209","volume-title":"2015-01-01 2015","author":"S Olaleye","year":"2015","unstructured":"Olaleye S, Suleman H. Xamobile: usability evaluation of text input methods on Mobile devices for historical African languages. In: 2015-01-01 2015. Cham: Springer International Publishing; 2015. p. 209\u201314."},{"key":"932_CR14","first-page":"136","volume-title":"An open source testing tool for evaluating handwriting input methods. 2015 13th International Conference on Document Analysis and Recognition (ICDAR)","author":"L Qiu","year":"2015","unstructured":"Qiu L, Jin L, Dai R, Zhang Y, Li L. An open source testing tool for evaluating handwriting input methods. 2015 13th International Conference on Document Analysis and Recognition (ICDAR); 2015. p. 136\u201340."},{"issue":"4","key":"932_CR15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3161187","volume":"1","author":"S Ruan","year":"2018","unstructured":"Ruan S, Wobbrock JO, Liou K, Ng A, Landay JA. Comparing speech and keyboard text entry for short messages in two languages on touchscreen phones. Proc. ACM interact. Mob. Wearable Ubiquitous Technol. 2018;1(4):1\u201323.","journal-title":"Wearable Ubiquitous Technol"},{"key":"932_CR16","volume-title":"Community","author":"Visual Studio","year":"2019","unstructured":"Visual Studio 2019 Community. https:\/\/visualstudio.microsoft.com\/zh-hans\/vs\/.Accessed 11 May 2019."},{"key":"932_CR17","unstructured":"Windows Presentation Foundation (WPF). https:\/\/docs.microsoft.com\/zh-cn\/dotnet\/framework\/wpf\/index . Accessed 11 May 2019."},{"key":"932_CR18","unstructured":"Wen\u2019juanxing. https:\/\/www.wjx.cn\/.Accessed 11 May, 2019."},{"key":"932_CR19","unstructured":"Microsoft\u2019s Text Services Framework (TSF).https:\/\/docs.microsoft.com\/en-us\/windows\/desktop\/tsf\/text-services-framework. Accessed 11 May 2019."},{"key":"932_CR20","unstructured":"NyaRuRu: TSF-TypeLib. In Type Library of Text Services Framework for .NET. 2013:"},{"key":"932_CR21","unstructured":"Dylan: Low Level Global Keyboard Hook \/ Sink in C# .NET. In.; 2014."},{"key":"932_CR22","unstructured":"Google: diff-match-patch. In.; 2018: Diff Match Patch is a high-performance library in multiple languages that manipulates plain text."},{"key":"932_CR23","volume-title":"Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In:1988","author":"SG Hart","year":"1988","unstructured":"Hart SG, Staveland LE. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In:1988; 1988."},{"key":"932_CR24","volume-title":"NASA-Task Load Index (NASA-TLX); 20 years later. In:2006","author":"SG Hart","year":"2006","unstructured":"Hart SG. NASA-Task Load Index (NASA-TLX); 20 years later. In:2006; 2006."},{"key":"932_CR25","volume-title":"The PHQ-9: A New Depression Diagnostic and Severity Measure. In:2002","author":"K Kroenke","year":"2002","unstructured":"Kroenke K, Spitzer RL. The PHQ-9: A New Depression Diagnostic and Severity Measure. In:2002; 2002."},{"issue":"10","key":"932_CR26","doi-asserted-by":"publisher","first-page":"1092","DOI":"10.1001\/archinte.166.10.1092","volume":"166","author":"RL Spitzer","year":"2006","unstructured":"Spitzer RL, Kroenke K, Williams JBW, Loewe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092\u20137.","journal-title":"Arch Intern Med"},{"key":"932_CR27","unstructured":"China Conference on Knowledge Graph and Semantic Computing. http:\/\/www.ccks2019.cn\/ .Accessed 19 May 2019."},{"key":"932_CR28","unstructured":"2014 News People Daily. http:\/\/www.unopencity.com\/project\/data-detail\/19\/.Accessed 19 May 2019."}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-019-0932-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12911-019-0932-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-019-0932-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,12,4]],"date-time":"2020-12-04T00:19:21Z","timestamp":1607041161000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-019-0932-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12]]},"references-count":28,"journal-issue":{"issue":"S5","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["932"],"URL":"https:\/\/doi.org\/10.1186\/s12911-019-0932-7","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12]]},"assertion":[{"value":"5 December 2019","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Our work was approved by the ethics committee of the institute of medical information, Chinese academy of medical sciences. Before the experiment, all participants had a detailed understanding of the experiment and signed an informed consent.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"237"}}