{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,6]],"date-time":"2025-11-06T20:03:34Z","timestamp":1762459414380},"reference-count":40,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2017,1,13]],"date-time":"2017-01-13T00:00:00Z","timestamp":1484265600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2017,7,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Objective. We propose 2 Medical Dictionary for Regulatory Activities\u2013enabled pharmacovigilance algorithms, MetaLAB and MetaNurse, powered by a per-year meta-analysis technique and improved subject sampling strategy.<\/jats:p>\n               <jats:p>Matrials and methods. This study developed 2 novel algorithms, MetaLAB for laboratory abnormalities and MetaNurse for standard nursing statements, as significantly improved versions of our previous electronic health record (EHR)\u2013based pharmacovigilance method, called CLEAR. Adverse drug reaction (ADR) signals from 117 laboratory abnormalities and 1357 standard nursing statements for all precautionary drugs (n\u2009\u2009=\u2009101) were comprehensively detected and validated against SIDER (Side Effect Resource) by MetaLAB and MetaNurse against 11\u2009817 and 76\u2009457 drug-ADR pairs, respectively.<\/jats:p>\n               <jats:p>Results. We demonstrate that MetaLAB (area under the curve, AUC\u2009=\u20090.61\u2009\u00b1\u20090.18) outperformed CLEAR (AUC\u2009=\u20090.55\u2009\u00b1\u20090.06) when we applied the same 470 drug-event pairs as the gold standard, as in our previous research. Receiver operating characteristic curves for 101 precautionary terms in the Medical Dictionary for Regulatory Activities Preferred Terms were obtained for MetaLAB and MetaNurse (0.69\u2009\u00b1\u20090.11; 0.62\u2009\u00b1\u20090.07), which complemented each other in terms of ADR signal coverage. Novel ADR signals discovered by MetaLAB and MetaNurse were successfully validated against spontaneous reports in the US Food and Drug Administration Adverse Event Reporting System database.<\/jats:p>\n               <jats:p>Discussion. The present study demonstrates the symbiosis of laboratory test results and nursing statements for ADR signal detection in terms of their system organ class coverage and performance profiles.<\/jats:p>\n               <jats:p>Conclusion. Systematic discovery and evaluation of the wide spectrum of ADR signals using standard-based observational electronic health record data across many institutions will affect drug development and use, as well as postmarketing surveillance and regulation.<\/jats:p>","DOI":"10.1093\/jamia\/ocw168","type":"journal-article","created":{"date-parts":[[2016,11,21]],"date-time":"2016-11-21T12:05:47Z","timestamp":1479729947000},"page":"697-708","source":"Crossref","is-referenced-by-count":21,"title":["Standard-based comprehensive detection of adverse drug reaction signals from nursing statements and laboratory results in electronic health records"],"prefix":"10.1093","volume":"24","author":[{"given":"Suehyun","family":"Lee","sequence":"first","affiliation":[{"name":"Division of Biomedical Informatics, Seoul National University College of Medicine, Seoul, Korea"}]},{"given":"Jiyeob","family":"Choi","sequence":"additional","affiliation":[{"name":"Department of Biomedical Sciences, Seoul National University Graduate School, Seoul, Korea"}]},{"given":"Hun-Sung","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Medical Informatics and Internal Medicine, St. Mary Hospital, Catholic University, Seoul, Korea"}]},{"given":"Grace Juyun","family":"Kim","sequence":"additional","affiliation":[{"name":"Division of Biomedical Informatics, Seoul National University College of Medicine, Seoul, Korea"}]},{"given":"Kye Hwa","family":"Lee","sequence":"additional","affiliation":[{"name":"Division of Biomedical Informatics, Seoul National University College of Medicine, Seoul, Korea"}]},{"given":"Chan Hee","family":"Park","sequence":"additional","affiliation":[{"name":"Division of Biomedical Informatics, Seoul National University College of Medicine, Seoul, Korea"}]},{"given":"Jongsoo","family":"Han","sequence":"additional","affiliation":[{"name":"Division of Biomedical Informatics, Seoul National University College of Medicine, Seoul, Korea"},{"name":"Cipherome Inc., Seoul, Korea"}]},{"given":"Dukyong","family":"Yoon","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Ajou University School of Medicine, Suwon, Korea"}]},{"given":"Man Young","family":"Park","sequence":"additional","affiliation":[{"name":"Mibyeong Research Center, Korea Institute of Oriental Medicine, Daejeon, South Korea"}]},{"given":"Rae Woong","family":"Park","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Ajou University School of Medicine, Suwon, Korea"}]},{"given":"Hye-Ryun","family":"Kang","sequence":"additional","affiliation":[{"name":"Department of Internal Medicine, Seoul National University Hospital, Seoul, Korea"}]},{"given":"Ju Han","family":"Kim","sequence":"additional","affiliation":[{"name":"Division of Biomedical Informatics, Seoul National University College of Medicine, Seoul, Korea"}]}],"member":"286","published-online":{"date-parts":[[2017,1,13]]},"reference":[{"issue":"12","key":"2020110612374961300_ocw168-B1","doi-asserted-by":"crossref","first-page":"1363","DOI":"10.1001\/archinte.165.12.1363","article-title":"Adverse drug event surveillance and drug withdrawals in the United States, 1969\u20132002: the importance of reporting suspected reactions","volume":"165","author":"Wysowski","year":"2005","journal-title":"Arch Int Med."},{"issue":"15","key":"2020110612374961300_ocw168-B2","doi-asserted-by":"crossref","first-page":"1200","DOI":"10.1001\/jama.279.15.1200","article-title":"Incidence of adverse drug reactions in hospitalized patients: a meta-analysis of prospective studies","volume":"279","author":"Lazarou","year":"1998","journal-title":"JAMA."},{"issue":"21","key":"2020110612374961300_ocw168-B3","doi-asserted-by":"crossref","first-page":"2211","DOI":"10.1056\/NEJMra032424","article-title":"Drug metabolism and variability among patients in drug response","volume":"352","author":"Wilkinson","year":"2005","journal-title":"New Engl J Med."},{"key":"2020110612374961300_ocw168-B4","first-page":"1","article-title":"The U.S. Food and Drug Administration's Mini-Sentinel program: status and direction","volume":"21","author":"Platt","year":"2012","journal-title":"Pharmacoepidemiol Drug Safety."},{"issue":"5","key":"2020110612374961300_ocw168-B5","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1002\/pds.3375","article-title":"The EU-ADR Web Platform: delivering advanced pharmacovigilance tools","volume":"22","author":"Oliveira","year":"2013","journal-title":"Pharmacoepidemiol Drug Safety."},{"issue":"4","key":"2020110612374961300_ocw168-B6","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1007\/s40264-015-0283-y","article-title":"The monitoring medicines project: a multinational pharmacovigilance and public health project","volume":"38","author":"Pal","year":"2015","journal-title":"Drug Safety."},{"key":"2020110612374961300_ocw168-B7","first-page":"e76","article-title":"Medication-wide association studies","volume":"2","author":"Ryan","year":"2013","journal-title":"CPT: Pharmacometrics Syst Pharmacol."},{"issue":"6","key":"2020110612374961300_ocw168-B8","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1038\/clpt.2013.47","article-title":"Pharmacovigilance using clinical notes","volume":"93","author":"LePendu","year":"2013","journal-title":"Clin Pharmacol Therapeutics."},{"issue":"8","key":"2020110612374961300_ocw168-B9","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1002\/pds.753","article-title":"Spontaneous reporting of adverse drug reactions by nurses","volume":"11","author":"Backstrom","year":"2002","journal-title":"Pharmacoepidemiol Drug Safety."},{"issue":"6","key":"2020110612374961300_ocw168-B10","doi-asserted-by":"crossref","first-page":"658","DOI":"10.1046\/j.1365-2125.2003.01903.x","article-title":"The involvement of nurses in reporting suspected adverse drug reactions: experience with the meningococcal vaccination scheme","volume":"56","author":"Ranganathan","year":"2003","journal-title":"Brit J Clin Pharmacol."},{"issue":"1","key":"2020110612374961300_ocw168-B11","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1097\/NXN.0b013e318270106e","article-title":"Adverse-drug-event surveillance using narrative nursing records in electronic nursing records","volume":"31","author":"Ahn","year":"2013","journal-title":"Comp Inform Nursing."},{"issue":"6","key":"2020110612374961300_ocw168-B12","doi-asserted-by":"crossref","first-page":"597","DOI":"10.1002\/pds.3225","article-title":"Adverse drug reaction reporting by nurses: analysis of Italian pharmacovigilance database","volume":"21","author":"Conforti","year":"2012","journal-title":"Pharmacoepidemiol Drug Safety."},{"issue":"3","key":"2020110612374961300_ocw168-B13","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1038\/clpt.2011.248","article-title":"Detection of adverse drug reaction signals using an electronic health records database: comparison of the Laboratory Extreme Abnormality Ratio (CLEAR) algorithm","volume":"91","author":"Yoon","year":"2012","journal-title":"Clin Pharmacol Therapeutics."},{"issue":"8","key":"2020110612374961300_ocw168-B14","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1007\/s40264-014-0189-0","article-title":"Bridging islands of information to establish an integrated knowledge base of drugs and health outcomes of interest","volume":"37","author":"Boyce","year":"2014","journal-title":"Drug Safety."},{"key":"2020110612374961300_ocw168-B15","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1038\/msb.2009.98","article-title":"A side effect resource to capture phenotypic effects of drugs","volume":"6","author":"Kuhn","year":"2010","journal-title":"Mol Syst Biol."},{"key":"2020110612374961300_ocw168-B16","doi-asserted-by":"crossref","first-page":"2716","DOI":"10.1001\/archinte.163.22.2716","article-title":"Updating the Beers criteria for potentially inappropriate medication use in older adults: results of a US consensus panel of experts","volume":"163","author":"Fick","year":"2003","journal-title":"Arch Int Med."},{"issue":"22","key":"2020110612374961300_ocw168-B17","doi-asserted-by":"crossref","first-page":"2823","DOI":"10.1001\/jama.286.22.2823","article-title":"Potentially inappropriate medication use in the community-dwelling elderly: findings from the 1996 Medical Expenditure Panel Survey","volume":"286","author":"Zhan","year":"2001","journal-title":"JAMA."},{"key":"2020110612374961300_ocw168-B18","volume-title":"Clinical Investigation of Medicinal Products in the Paediatric Population European Medicines Agency"},{"key":"2020110612374961300_ocw168-B19","first-page":"3","volume-title":"Pediatric Dosage Handbook","author":"Taketomo","year":"2009","edition":"16th ed."},{"key":"2020110612374961300_ocw168-B20","first-page":"2293","volume-title":"Nelson Textbook of Pediatrics","author":"Kliegman","year":"2003","edition":"17th ed."},{"key":"2020110612374961300_ocw168-B21","volume-title":"Consolidated List of Products Whose Consumption and\/or Sale Have Been Banned, Withdrawn, Severely Restricted or not Approved by Governments","year":"2009"},{"key":"2020110612374961300_ocw168-B22","volume-title":"Withdrawing Drugs in the US Versus Other Countries","author":"Ninan","year":"2012"},{"issue":"6","key":"2020110612374961300_ocw168-B23","doi-asserted-by":"crossref","first-page":"598","DOI":"10.1002\/pds.2139","article-title":"A novel algorithm for detection of adverse drug reaction signals using a hospital electronic medical record database","volume":"20","author":"Park","year":"2011","journal-title":"Pharmacoepidemiol Drug Safety."},{"issue":"1","key":"2020110612374961300_ocw168-B24","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1007\/s40264-012-0002-x","article-title":"A reference standard for evaluation of methods for drug safety signal detection using electronic healthcare record databases","volume":"36","author":"Coloma","year":"2013","journal-title":"Drug Safety."},{"key":"2020110612374961300_ocw168-B25","volume-title":"Meta-regression Approaches: What, Why, When, and How?","author":"Morton","year":"2004"},{"issue":"3","key":"2020110612374961300_ocw168-B26","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1590\/S0066-782X2009000300013","article-title":"Systematic review and meta-analysis of diagnostic and prognostic studies: a tutorial","volume":"92","author":"Sousa","year":"2009","journal-title":"Arq Bras Cardiol."},{"key":"2020110612374961300_ocw168-B27","volume-title":"DrugInformer: Side Effect Search","year":"2015"},{"key":"2020110612374961300_ocw168-B28","volume-title":"Bisacodyl\u2019s common ADRs","year":"2015"},{"key":"2020110612374961300_ocw168-B29","volume-title":"FAERS for bisacodyl\u2019s ADR reports","year":"2015"},{"key":"2020110612374961300_ocw168-B30","volume-title":"Prazosin's common ADRs","year":"2015"},{"key":"2020110612374961300_ocw168-B31","volume-title":"FAERS for Prazosin's ADR Reports","year":"2015"},{"key":"2020110612374961300_ocw168-B32","volume-title":"Phenylephrine's common ADRs","year":"2015"},{"key":"2020110612374961300_ocw168-B33","volume-title":"FAERS for phenylephrine's ADR Reports","year":"2015"},{"key":"2020110612374961300_ocw168-B34","volume-title":"Sucralfate's common ADRs"},{"key":"2020110612374961300_ocw168-B35","volume-title":"FAERS for Sucralfate's ADR Reports","year":"2015"},{"key":"2020110612374961300_ocw168-B36","doi-asserted-by":"crossref","first-page":"D907","DOI":"10.1093\/nar\/gku1066","article-title":"ADReCS: an ontology database for aiding standardization and hierarchical classification of adverse drug reaction terms","volume":"43","author":"Cai","year":"2015","journal-title":"Nucleic Acids Res."},{"issue":"3","key":"2020110612374961300_ocw168-B37","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1016\/j.anai.2012.01.012","article-title":"Surveillance of contrast-media-induced hypersensitivity reactions using signals from an electronic medical recording system","volume":"108","author":"Kim","year":"2012","journal-title":"Ann Allergy, Asthma Immunol."},{"issue":"3","key":"2020110612374961300_ocw168-B38","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1136\/amiajnl-2012-000930","article-title":"Combing signals from spontaneous reports and electronic health records for detection of adverse drug reactions","volume":"20","author":"Harpaz","year":"2013","journal-title":"J Am Med Inform Assoc."},{"issue":"e1","key":"2020110612374961300_ocw168-B39","doi-asserted-by":"crossref","first-page":"e28","DOI":"10.1136\/amiajnl-2011-000699","article-title":"Large-scale prediction of adverse drug reactions using chemical, biological, and phenotypic properties of drugs","volume":"19","author":"Liu","year":"2012","journal-title":"J Am Med Inform Assoc."},{"issue":"1","key":"2020110612374961300_ocw168-B40","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1038\/clpt.2011.81","article-title":"Predicting adverse drug reactions using publicly available PubChem BioAssay data","volume":"90","author":"Pouliot","year":"2011","journal-title":"Clin Pharmacol Therapeutics."}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/24\/4\/697\/34148702\/ocw168.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/24\/4\/697\/34148702\/ocw168.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T17:53:24Z","timestamp":1604685204000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/24\/4\/697\/2903872"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,1,13]]},"references-count":40,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2017,1,13]]},"published-print":{"date-parts":[[2017,7,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocw168","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2017,7]]},"published":{"date-parts":[[2017,1,13]]}}}