{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T18:41:07Z","timestamp":1778870467454,"version":"3.51.4"},"reference-count":49,"publisher":"Public Library of Science (PLoS)","issue":"9","license":[{"start":{"date-parts":[[2021,9,14]],"date-time":"2021-09-14T00:00:00Z","timestamp":1631577600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"SENACYT, Panama","award":["COVID19-223"],"award-info":[{"award-number":["COVID19-223"]}]},{"name":"SENACYT, Panama","award":["IDR10-067"],"award-info":[{"award-number":["IDR10-067"]}]},{"name":"SENACYT, Panama","award":["ITE-020"],"award-info":[{"award-number":["ITE-020"]}]},{"name":"SNI, Panama","award":["SNI206-2017"],"award-info":[{"award-number":["SNI206-2017"]}]},{"name":"SNI, Panama","award":["SNI167-2017"],"award-info":[{"award-number":["SNI167-2017"]}]},{"name":"SNI, Panama","award":["SNI09-2020"],"award-info":[{"award-number":["SNI09-2020"]}]},{"name":"SNI, Panama","award":["SNI142-2018"],"award-info":[{"award-number":["SNI142-2018"]}]},{"name":"SNI, Panama","award":["SNI22-2020"],"award-info":[{"award-number":["SNI22-2020"]}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>\n                    COVID-19 is the name of the acute respiratory disease caused by the new coronavirus SARS-CoV-2, a close relative of those that caused the severe outbreaks of SARS and MERS several years ago. Since first appearance on December of 2019, the COVID-19 pandemic has cause extremely high levels of mortality, morbidity, global economic breakdown, and the consequent human suffering. The main diagnostic test for the confirmation of symptomatic individuals is the detection of viral RNA by reverse transcriptase\u2013quantitative real time PCR (RT-PCR). Additionally, serology techniques, such as ELISA are useful to measure the antibodies produced in humans after contact with the virus, as well as the direct presence of viral antigens. In this study we aim to assemble and evaluate four ELISA assays to measure the presence of IgG or IgM specific for the viral Spike protein in COVID-19 patients, using either the full recombinant SARS-CoV-2 Spike protein or the fragment corresponding to the receptor binding domain. As a control, we analyzed a group of pre-pandemic serum samples obtained before 2017. Strong reactivity was observed against both antigens. A few pre-pandemic samples displayed high OD values, suggesting the possibility of some cross reactivity. All four assays show very good repeatability, both intra- and inter-assay. Receiver operating characteristic analysis allowed the definition of cutoffs and evaluation of performance for each ELISA by estimation of the area under the curve. This performance parameter was high for all tests (AUC range: 0.98\u20130.99). Multiple comparisons between tests revealed no significant difference between each other (\n                    <jats:italic>P<\/jats:italic>\n                    values: 0.24\u20130.95). Our results show that both antigens are effective to detect both specific IgG and IgM antibodies, with high sensitivity (range 0.92\u20130.99), specificity (range 0.93\u20130.97) and congruence with the RT-PCR test (Cohen\u00b4s Kappa range 0.87\u20130.93). These assays will allow health authorities to have a new tool to estimate seroprevalence, in order to manage and improve the severe sanitary situation caused by this virus.\n                  <\/jats:p>","DOI":"10.1371\/journal.pone.0257351","type":"journal-article","created":{"date-parts":[[2021,9,14]],"date-time":"2021-09-14T13:25:10Z","timestamp":1631625910000},"page":"e0257351","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":7,"title":["Development of in-house, indirect ELISAs for the detection of SARS-CoV-2 spike protein-associated serology in COVID-19 patients in Panama"],"prefix":"10.1371","volume":"16","author":[{"given":"Carolina","family":"de la Guardia","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6825-3803","authenticated-orcid":true,"given":"Giselle","family":"Rangel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alcibiades","family":"Villarreal","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3910-0482","authenticated-orcid":true,"given":"Amador","family":"Goodridge","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0762-0566","authenticated-orcid":true,"given":"Patricia L.","family":"Fern\u00e1ndez","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5830-6315","authenticated-orcid":true,"given":"Ricardo","family":"Lleonart","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2021,9,14]]},"reference":[{"key":"pone.0257351.ref001","volume-title":"Novel Coronavirus Situation Report -10 [Internet]","author":"WHO","year":"2020"},{"issue":"6 June","key":"pone.0257351.ref002","article-title":"The prevalence of symptoms in 24,410 adults infected by the novel coronavirus (SARS-CoV-2; COVID-19): A systematic review and meta-analysis of 148 studies from 9 countries","volume":"15","author":"MC Grant","year":"2020","journal-title":"PLoS One [Internet]"},{"issue":"11","key":"pone.0257351.ref003","article-title":"Clinical Course and Molecular Viral Shedding among Asymptomatic and Symptomatic Patients with SARS-CoV-2 Infection in a Community Treatment Center in the Republic of Korea","volume":"180","author":"S Lee","year":"2020","journal-title":"JAMA Intern Med"},{"key":"pone.0257351.ref004","first-page":"157","article-title":"WHO declares COVID-19 a pandemic [Internet]","volume":"91","author":"D Cucinotta","year":"2020","journal-title":"Acta Biomedica. Mattioli 1885"},{"key":"pone.0257351.ref005","volume-title":"WHO Weekly epidemiological update on COVID-19\u20136 April 2021. [Internet]","author":"WHO","year":"2021"},{"key":"pone.0257351.ref006","volume-title":"PAHO COVID-19 Informe de situaci\u00f3n de Panam\u00e1 No.51 - Abril 6, 2021 [Internet]","author":"PAHO","year":"2021"},{"key":"pone.0257351.ref007","volume-title":"PAHO COVID-19 Daily Update: 11 April 2021 [Internet]","author":"PAHO","year":"2021"},{"issue":"3","key":"pone.0257351.ref008","volume":"25","author":"VM Corman","year":"2020","journal-title":"Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. Eurosurveillance [Internet]"},{"key":"pone.0257351.ref009","first-page":"747","volume-title":"Emerging Microbes and Infections","author":"MJ Loeffelholz","year":"2020"},{"key":"pone.0257351.ref010","first-page":"1843","article-title":"Detection of SARS-CoV-2 in Different Types of Clinical Specimens [Internet]","volume":"323","author":"W Wang","year":"2020","journal-title":"JAMA\u2014Journal of the American Medical Association. American Medical Association"},{"issue":"6","key":"pone.0257351.ref011","first-page":"423","article-title":"A case of imported COVID-19 diagnosed by PCR-positive lower respiratory specimen but with PCR-negative throat swabs","volume":"52","author":"R Hase","year":"2020","journal-title":"Infect Dis (Auckl) [Internet]"},{"key":"pone.0257351.ref012","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1016\/j.cca.2020.03.009","article-title":"Positive rate of RT-PCR detection of SARS-CoV-2 infection in 4880 cases from one hospital in Wuhan, China, from Jan to Feb 2020","volume":"505","author":"R Liu","year":"2020","journal-title":"Clin Chim Acta [Internet]"},{"issue":"12","key":"pone.0257351.ref013","doi-asserted-by":"crossref","first-page":"2131","DOI":"10.1515\/cclm-2020-0978","article-title":"Frequency of serological non-responders and false-negative RT-PCR results in SARS-CoV-2 testing: A population-based study","volume":"58","author":"RC Baron","year":"2020","journal-title":"Clin Chem Lab Med [Internet]"},{"key":"pone.0257351.ref014","doi-asserted-by":"crossref","first-page":"262","DOI":"10.7326\/M20-1495","article-title":"Variation in False-Negative Rate of Reverse Transcriptase Polymerase Chain Reaction-Based SARS-CoV-2 Tests by Time Since Exposure [Internet]","volume":"173","author":"LM Kucirka","year":"2020","journal-title":"Annals of internal medicine. NLM (Medline)"},{"key":"pone.0257351.ref015","first-page":"126","article-title":"Diagnosis of the Coronavirus disease (COVID-19): rRT-PCR or CT?","author":"C Long","year":"2020","journal-title":"Eur J Radiol [Internet]"},{"key":"pone.0257351.ref016","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/j.jpha.2020.02.010","article-title":"Recent advances and perspectives of nucleic acid detection for coronavirus [Internet]","volume":"10","author":"M Shen","year":"2020","journal-title":"Journal of Pharmaceutical Analysis. Xi\u2019an Jiaotong University"},{"key":"pone.0257351.ref017","first-page":"260","volume-title":"International Journal of Infectious Diseases","author":"CE Ferreira","year":"2021"},{"key":"pone.0257351.ref018","first-page":"8","article-title":"Performance of a Point of Care Test for Detecting IgM and IgG Antibodies Against SARS-CoV-2 and Seroprevalence in Blood Donors and Health Care Workers in Panama","author":"A Villarreal","year":"2021","journal-title":"Front Med [Internet]"},{"key":"pone.0257351.ref019","first-page":"370","article-title":"Diagnostic accuracy of serological tests for covid-19: Systematic review and meta-analysis","author":"M Lisboa Bastos","year":"2020","journal-title":"BMJ [Internet]"},{"key":"pone.0257351.ref020","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1373\/clinchem.2009.127803","article-title":"The ELISA, enzyme-linked immunosorbent assay [Internet]","volume":"56","author":"E Engvall","year":"2010","journal-title":"Clinical Chemistry. Clin Chem"},{"key":"pone.0257351.ref021","first-page":"144","volume-title":"Journal of Medical Virology","author":"A Liu","year":"2021"},{"issue":"1","key":"pone.0257351.ref022","article-title":"SARS-CoV-2 Seroconversion in Humans: A Detailed Protocol for a Serological Assay, Antigen Production, and Test Setup","volume":"57","author":"D Stadlbauer","year":"2020","journal-title":"Curr Protoc Microbiol [Internet]"},{"issue":"7844","key":"pone.0257351.ref023","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1038\/s41586-020-2912-6","article-title":"Repeated cross-sectional sero-monitoring of SARS-CoV-2 in New York City","volume":"590","author":"D Stadlbauer","year":"2021","journal-title":"Nature [Internet]"},{"issue":"7","key":"pone.0257351.ref024","doi-asserted-by":"crossref","first-page":"1033","DOI":"10.1038\/s41591-020-0913-5","article-title":"A serological assay to detect SARS-CoV-2 seroconversion in humans","volume":"26","author":"F Amanat","year":"2020","journal-title":"Nat Med [Internet]"},{"issue":"8","key":"pone.0257351.ref025","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v061.i08","article-title":"OptimalCutpoints: An R package for selecting optimal cutpoints in diagnostic tests","volume":"61","author":"M Lopez-Raton","year":"2014","journal-title":"J Stat Softw"},{"issue":"2","key":"pone.0257351.ref026","doi-asserted-by":"crossref","first-page":"213","DOI":"10.32614\/RJ-2016-042","article-title":"easyROC: An Interactive Web-tool for ROC Curve Analysis Using R Language Environment","volume":"8","author":"D Goksuluk","year":"2016","journal-title":"R J"},{"key":"pone.0257351.ref027","doi-asserted-by":"crossref","DOI":"10.1002\/0471445428","volume-title":"Statistical methods for rates and proportions","author":"JL Fleiss","year":"2003","edition":"3"},{"issue":"1","key":"pone.0257351.ref028","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The Measurement of Observer Agreement for Categorical Data","volume":"33","author":"JR Landis","year":"1977","journal-title":"Biometrics"},{"key":"pone.0257351.ref029","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/j.ijid.2020.09.1451","article-title":"Serological cross-reactivity using a SARS-CoV-2 ELISA test in acute Zika virus infection, Colombia","volume":"101","author":"\u00c1A Faccini-Mart\u00ednez","year":"2020","journal-title":"Int J Infect Dis [Internet]"},{"issue":"6522","key":"pone.0257351.ref030","doi-asserted-by":"crossref","first-page":"1339","DOI":"10.1126\/science.abe1107","article-title":"Preexisting and de novo humoral immunity to SARS-CoV-2 in humans","volume":"370","author":"KW Ng","year":"2020","journal-title":"Science (80-) [Internet]"},{"key":"pone.0257351.ref031","first-page":"29","article-title":"Multi-center nationwide comparison of seven serology assays reveals a SARS-CoV-2 non-responding seronegative subpopulation.","author":"K Oved","year":"2020","journal-title":"EClinicalMedicine [Internet]"},{"key":"pone.0257351.ref032","article-title":"Viral Kinetics and Antibody Responses in Patients with COVID-19.","author":"W Tan","year":"2020","journal-title":"medRxiv [Internet]"},{"issue":"1","key":"pone.0257351.ref033","doi-asserted-by":"crossref","first-page":"e28","DOI":"10.1016\/j.jinf.2020.03.051","article-title":"Serological immunochromatographic approach in diagnosis with SARS-CoV-2 infected COVID-19 patients.","volume":"81","author":"Y Pan","year":"2020","journal-title":"J Infect [Internet]"},{"issue":"3","key":"pone.0257351.ref034","article-title":"Rapid Generation of Neutralizing Antibody Responses in COVID-19 Patients","volume":"1","author":"MS Suthar","year":"2020","journal-title":"Cell Reports Med [Internet]"},{"issue":"6","key":"pone.0257351.ref035","doi-asserted-by":"crossref","first-page":"845","DOI":"10.1038\/s41591-020-0897-1","article-title":"Antibody responses to SARS-CoV-2 in patients with COVID-19","volume":"26","author":"QX Long","year":"2020","journal-title":"Nat Med [Internet]"},{"issue":"5","key":"pone.0257351.ref036","first-page":"1","article-title":"S protein-reactive IGG and memory B cell production after human SARS-CoV-2 infection includes broad reactivity to the S2 subunit","volume":"11","author":"P Nguyen-Contant","year":"2020","journal-title":"MBio [Internet]"},{"key":"pone.0257351.ref037","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1016\/j.jpeds.2020.08.037","article-title":"Pediatric Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2): Clinical Presentation, Infectivity, and Immune Responses","volume":"227","author":"LM Yonker","year":"2020","journal-title":"J Pediatr [Internet]"},{"issue":"1","key":"pone.0257351.ref038","article-title":"Epitope-resolved profiling of the SARS-CoV-2 antibody response identifies cross-reactivity with endemic human coronaviruses","volume":"2","author":"JT Ladner","year":"2021","journal-title":"Cell Reports Med [Internet]"},{"key":"pone.0257351.ref039","first-page":"35","article-title":"Coronavirus infections reported by ProMED, February 2000\u2013January 2020","author":"DK Bonilla-Aldana","year":"2020","journal-title":"Travel Med Infect Dis [Internet]"},{"key":"pone.0257351.ref040","first-page":"181","volume-title":"Nature Reviews Microbiology","author":"J Cui","year":"2019"},{"issue":"1","key":"pone.0257351.ref041","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/j.jinf.2016.09.003","article-title":"Respiratory viruses and influenza-like illness: Epidemiology and outcomes in children aged 6 months to 10 years in a multi-country population sample.","volume":"74","author":"S Taylor","year":"2017","journal-title":"J Infect [Internet]"},{"issue":"1","key":"pone.0257351.ref042","first-page":"1","article-title":"High neutralizing antibody titer in intensive care unit patients with COVID-19","volume":"9","author":"L Liu","year":"2020","journal-title":"Emerg Microbes Infect [Internet]"},{"key":"pone.0257351.ref043","first-page":"130","article-title":"SARS-CoV-2-IgG response is different in COVID-19 outpatients and asymptomatic contact persons.","author":"N Wellinghausen","year":"2020","journal-title":"J Clin Virol [Internet]"},{"issue":"2","key":"pone.0257351.ref044","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1093\/cid\/ciaa979","article-title":"Magnitude and Kinetics of Anti-Severe Acute Respiratory Syndrome Coronavirus 2 Antibody Responses and Their Relationship to Disease Severity","volume":"72","author":"KL Lynch","year":"2021","journal-title":"Clin Infect Dis [Internet]"},{"issue":"1","key":"pone.0257351.ref045","doi-asserted-by":"crossref","first-page":"109","DOI":"10.4049\/jimmunol.2000898","article-title":"SARS-CoV-2 Antibody Responses Are Correlated to Disease Severity in COVID-19 Convalescent Individuals","volume":"206","author":"CB Hansen","year":"2021","journal-title":"J Immunol [Internet]"},{"issue":"1","key":"pone.0257351.ref046","article-title":"SARS-CoV-2 specific antibody and neutralization assays reveal the wide range of the humoral immune response to virus.","volume":"4","author":"M Dogan","year":"2021","journal-title":"Commun Biol [Internet]"},{"issue":"7","key":"pone.0257351.ref047","doi-asserted-by":"crossref","first-page":"1478","DOI":"10.3201\/eid2607.200841","article-title":"Severe Acute Respiratory Syndrome Coronavirus 2-Specific Antibody Responses in Coronavirus Disease Patients","volume":"26","author":"NMA Okba","year":"2020","journal-title":"Emerg Infect Dis [Internet]"},{"issue":"16","key":"pone.0257351.ref048","article-title":"Serological assays for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), March 2020","volume":"25","author":"RAPM Perera","year":"2020","journal-title":"Eurosurveillance [Internet]"},{"issue":"1","key":"pone.0257351.ref049","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1007\/s15010-020-01503-7","article-title":"A highly specific and sensitive serological assay detects SARS-CoV-2 antibody levels in COVID-19 patients that correlate with neutralization.","volume":"49","author":"D Peterhoff","year":"2021","journal-title":"Infection [Internet]"}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0257351","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,14]],"date-time":"2021-09-14T13:26:26Z","timestamp":1631625986000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0257351"}},"subtitle":[],"editor":[{"given":"Etsuro","family":"Ito","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2021,9,14]]},"references-count":49,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2021,9,14]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0257351","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2021.04.30.21256406","asserted-by":"object"}]},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,14]]}}}