{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,30]],"date-time":"2026-10-30T03:52:33Z","timestamp":1793332353656,"version":"4.5.0"},"reference-count":49,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Public Health Surveill"],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Adverse events associated with vaccination have been evaluated by epidemiological studies and more recently have gained additional attention with the emergency use authorization of several COVID-19 vaccines. As part of its responsibility to conduct postmarket surveillance, the US Food and Drug Administration continues to monitor several adverse events of special interest (AESIs) to ensure vaccine safety, including for COVID-19.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>This study is part of the Biologics Effectiveness and Safety Initiative, which aims to improve the Food and Drug Administration\u2019s postmarket surveillance capabilities while minimizing public burden. This study aimed to enhance active surveillance efforts through a rules-based, computable phenotype algorithm to identify 5 AESIs being monitored by the Center for Disease Control and Prevention for COVID-19 or other vaccines: anaphylaxis, Guillain-Barr\u00e9 syndrome, myocarditis\/pericarditis, thrombosis with thrombocytopenia syndrome, and febrile seizure. This study examined whether these phenotypes have sufficiently high positive predictive value (PPV) to ensure that the cases selected for surveillance are reasonably likely to be a postbiologic adverse event. This allows patient privacy, and security concerns for the data sharing of patients who had nonadverse events can be properly accounted for when evaluating the cost-benefit aspect of our approach.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>AESI phenotype algorithms were developed to apply to electronic health record data at health provider organizations across the country by querying for standard and interoperable codes. The codes queried in the rules represent symptoms, diagnoses, or treatments of the AESI sourced from published case definitions and input from clinicians. To validate the performance of the algorithms, we applied them to electronic health record data from a US academic health system and provided a sample of cases for clinicians to evaluate. Performance was assessed using PPV.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>With a PPV of 93.3%, our anaphylaxis algorithm performed the best. The PPVs for our febrile seizure, myocarditis\/pericarditis, thrombocytopenia syndrome, and Guillain-Barr\u00e9 syndrome algorithms were 89%, 83.5%, 70.2%, and 47.2%, respectively.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Given our algorithm design and performance, our results support continued research into using interoperable algorithms for widespread AESI postmarket detection.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2196\/49811","type":"journal-article","created":{"date-parts":[[2024,5,26]],"date-time":"2024-05-26T00:43:35Z","timestamp":1716684215000},"page":"e49811","source":"Crossref","is-referenced-by-count":3,"title":["Development of Interoperable Computable Phenotype Algorithms for Adverse Events of Special Interest to Be Used for Biologics Safety Surveillance: Validation Study"],"prefix":"10.2196","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-0170-3300","authenticated-orcid":false,"given":"Ashley A","family":"Holdefer","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-9507-7185","authenticated-orcid":false,"given":"Jeno","family":"Pizarro","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3602-0842","authenticated-orcid":false,"given":"Patrick","family":"Saunders-Hastings","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5363-0434","authenticated-orcid":false,"given":"Jeffrey","family":"Beers","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-5784-9572","authenticated-orcid":false,"given":"Arianna","family":"Sang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0483-5788","authenticated-orcid":false,"given":"Aaron Zachary","family":"Hettinger","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-6877-9039","authenticated-orcid":false,"given":"Joseph","family":"Blumenthal","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-4598-1645","authenticated-orcid":false,"given":"Erik","family":"Martinez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4924-0123","authenticated-orcid":false,"given":"Lance Daniel","family":"Jones","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-1761-8058","authenticated-orcid":false,"given":"Matthew","family":"Deady","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7375-6456","authenticated-orcid":false,"given":"Hussein","family":"Ezzeldin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2517-0271","authenticated-orcid":false,"given":"Steven A","family":"Anderson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2024,7,15]]},"reference":[{"key":"ref1","unstructured":"CBER vision and missionU.S. Food and Drug Administration20199252024-02-22https:\/\/www.fda.gov\/about-fda\/center-biologics-evaluation-and-research-cber\/cber-vision-mission"},{"key":"ref2","unstructured":"Vaccine adverse event reporting system (VAERS)Centers for Disease Control and Prevention2024-02-22https:\/\/www.cdc.gov\/vaccinesafety\/ensuringsafety\/monitoring\/vaers\/index.html#anchor_1616772696807"},{"key":"ref3","unstructured":"CBER biologics effectiveness and safety (BEST) systemU.S. Food and Drug Administration2024-02-22https:\/\/www.fda.gov\/vaccines-blood-biologics\/safety-availability-biologics\/cber-biologics-effectiveness-and-safety-best-system"},{"key":"ref4","unstructured":"Corrigan-CurayJFramework for FDA\u2019s real-world evidence programU.S. Food and Drug Administration20193152024-02-22https:\/\/www.fda.gov\/media\/123160\/download"},{"key":"ref5","doi-asserted-by":"publisher","DOI":"10.1093\/cid\/civ430"},{"key":"ref6","doi-asserted-by":"publisher","DOI":"10.1093\/aje\/kwt051"},{"key":"ref7","doi-asserted-by":"publisher","DOI":"10.1007\/s40264-013-0051-9"},{"key":"ref8","doi-asserted-by":"publisher","DOI":"10.1136\/jcp.2006.037457"},{"key":"ref9","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2022.5134"},{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-022-31401-5"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2022.8879"},{"key":"ref12","doi-asserted-by":"publisher","DOI":"10.3389\/fneur.2021.820723"},{"key":"ref13","doi-asserted-by":"publisher","DOI":"10.1016\/j.vaccine.2021.07.013"},{"key":"ref14","unstructured":"Selected adverse events reported after COVID-19 vaccinationCenters for Disease Control and Prevention2024-02-22https:\/\/www.cdc.gov\/coronavirus\/2019-ncov\/vaccines\/safety\/adverse-events.html"},{"key":"ref15","unstructured":"COVID-19 vaccine safety in children and teensCenters for Disease Control and Prevention2024-02-22https:\/\/www.cdc.gov\/coronavirus\/2019-ncov\/vaccines\/vaccine-safety-children-teens.html"},{"key":"ref16","unstructured":"Preventing and managing adverse reactions: general best practice guidelines for immunizationCenters for Disease Control and Prevention2024-02-22https:\/\/www.cdc.gov\/vaccines\/hcp\/acip-recs\/general-recs\/adverse-reactions.html"},{"key":"ref17","unstructured":"Guillain-Barr\u00e9 syndrome and vaccinesCenters for Disease Control and Prevention2024-02-22https:\/\/www.cdc.gov\/vaccinesafety\/concerns\/guillain-barre-syndrome.html"},{"key":"ref18","unstructured":"Febrile seizures and childhood vaccinesCenters for Disease Control and Prevention2024-02-22https:\/\/www.cdc.gov\/vaccinesafety\/concerns\/febrile-seizures.html"},{"key":"ref19","unstructured":"Standards-based application programming interface (API) certification criterionThe Office of the National Coordinator for Health Information Technology20202024-02-22https:\/\/www.healthit.gov\/sites\/default\/files\/page2\/2020-03\/APICertificationCriterion.pdf"},{"key":"ref20","unstructured":"US core data for interoperability USCDIHealth Level 7 Fast Health Interoperability Resources2024-02-22https:\/\/build.fhir.org\/ig\/HL7\/US-Core\/uscdi.html"},{"key":"ref21","doi-asserted-by":"publisher","DOI":"10.1086\/524747"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.1016\/j.vaccine.2007.02.064"},{"key":"ref23","doi-asserted-by":"publisher","DOI":"10.1016\/j.vaccine.2010.06.003"},{"key":"ref24","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa2104840"},{"key":"ref25","unstructured":"ChenRButtery MonashmJDRAFT - TTS: case definition and guidelines for data collection, analysis, and presentation of immunization safety dataZenodo202111112024-07-01https:\/\/zenodo.org\/records\/6697333"},{"key":"ref26","doi-asserted-by":"publisher","DOI":"10.1016\/j.vaccine.2003.09.007"},{"key":"ref27","doi-asserted-by":"publisher","DOI":"10.1016\/j.vaccine.2003.09.008"},{"key":"ref28","doi-asserted-by":"publisher","DOI":"10.1016\/j.vaccine.2023.06.014"},{"key":"ref29","doi-asserted-by":"publisher","DOI":"10.2147\/IJGM.S407683"},{"key":"ref30","unstructured":"KostkaKChapter 10: defining cohortsThe Book of OHDSI20212024-02-22https:\/\/ohdsi.github.io\/TheBookOfOhdsi\/Cohorts.html"},{"key":"ref31","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocz105"},{"key":"ref32","doi-asserted-by":"publisher","DOI":"10.1016\/j.vaccine.2019.05.042"},{"key":"ref33","doi-asserted-by":"publisher","DOI":"10.1002\/pds.3505"},{"key":"ref34","doi-asserted-by":"publisher","DOI":"10.1097\/EDE.0000000000001330"},{"key":"ref35","doi-asserted-by":"publisher","DOI":"10.1016\/j.vaccine.2013.02.009"},{"key":"ref36","unstructured":"SchuemieMDeFalcoF8.3 ATLASThe Book of OHDSI20212024-02-22https:\/\/ohdsi.github.io\/TheBookOfOhdsi\/OhdsiAnalyticsTools.html#atlas"},{"key":"ref37","unstructured":"Value set authority centerNational Institute for Health National Library of Medicine2024-02-22https:\/\/vsac.nlm.nih.gov\/"},{"key":"ref38","doi-asserted-by":"publisher","DOI":"10.1111\/trf.17069"},{"key":"ref39","doi-asserted-by":"publisher","DOI":"10.3389\/fdgth.2021.777905"},{"key":"ref40","unstructured":"Standardized data: the OMOP common data modelObservational Health Data Sciences and Informatics2024-02-22https:\/\/www.ohdsi.org\/data-standardization\/"},{"key":"ref41","doi-asserted-by":"publisher","DOI":"10.1080\/00031305.1998.10480550"},{"key":"ref42","doi-asserted-by":"publisher","DOI":"10.1214\/ss\/1009213286"},{"issue":"3","key":"ref43","doi-asserted-by":"crossref","first-page":"276","DOI":"10.11613\/BM.2012.031","volume":"22","author":"McHugh, ML","year":"2012","journal-title":"Biochem Med (Zagreb)"},{"key":"ref44","doi-asserted-by":"publisher","DOI":"10.1097\/00000539-200212000-00046"},{"key":"ref45","doi-asserted-by":"publisher","DOI":"10.1016\/j.vaccine.2013.08.074"},{"key":"ref46","unstructured":"CQL - clinical quality languageeCQI Resource Center2024-02-22https:\/\/ecqi.healthit.gov\/cql?qt-tabs_cql=0"},{"key":"ref47","doi-asserted-by":"publisher","DOI":"10.1161\/jaha.120.016648"},{"key":"ref48","doi-asserted-by":"publisher","DOI":"10.1145\/3514500"},{"key":"ref49","unstructured":"Manual for the surveillance of vaccine-preventable diseasesCenters for Disease Control and Prevention2024-02-22https:\/\/www.cdc.gov\/vaccines\/pubs\/surv-manual\/chpt21-surv-adverse-events.html"}],"container-title":["JMIR Public Health and Surveillance"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/publichealth.jmir.org\/2024\/1\/e49811","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:31:45Z","timestamp":1782840705000},"score":1,"resource":{"primary":{"URL":"https:\/\/publichealth.jmir.org\/2024\/1\/e49811"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,15]]},"references-count":49,"URL":"https:\/\/doi.org\/10.2196\/49811","relation":{"has-preprint":[{"id-type":"doi","id":"10.2196\/preprints.49811","asserted-by":"object"}]},"ISSN":["2369-2960"],"issn-type":[{"value":"2369-2960","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,15]]}}}