{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,22]],"date-time":"2026-10-22T06:32:43Z","timestamp":1792650763899,"version":"4.5.0"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,1,13]],"date-time":"2021-01-13T00:00:00Z","timestamp":1610496000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2021,1,13]],"date-time":"2021-01-13T00:00:00Z","timestamp":1610496000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000865","name":"Bill & Melinda Gates Foundation","doi-asserted-by":"publisher","award":["INV-008108"],"award-info":[{"award-number":["INV-008108"]}],"id":[{"id":"10.13039\/100000865","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Malar J"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>The World Health Organization recommends confirmatory diagnosis by microscopy or malaria rapid diagnostic test (RDT) in patients with suspected malaria. In recent years, mobile medical applications (MMAs), which can interpret RDT test results have entered the market. To evaluate the performance of commercially available MMAs, an evaluation was conducted by comparing RDT results read by MMAs to RDT results read by the human eye.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>\n                      Five different MMAs were evaluated on six different RDT products using cultured\n                      <jats:italic>Plasmodium falciparum<\/jats:italic>\n                      blood samples at five dilutions ranging from 20 to 1000 parasites (p)\/microlitre (\u00b5l) and malaria negative blood samples. The RDTs were performed in a controlled, laboratory setting by a trained operator who visually read the RDT results. A second trained operator then used the MMAs to read the RDT results. Sensitivity (Sn) and specificity (Sp) for the RDTs were calculated in a Bayesian framework using mixed models.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      The RDT Sn of the\n                      <jats:italic>P. falciparum<\/jats:italic>\n                      (Pf) test line, when read by the trained human eye was significantly higher compared to when read by MMAs (74% vs. average 47%) at samples of 20 p\/\u00b5l. In higher density samples, the Sn was comparable to the human eye (97%) for three MMAs. The RDT Sn of test lines that detect all\n                      <jats:italic>Plasmodium<\/jats:italic>\n                      species (Pan line), when read by the trained human eye was significantly higher compared to when read by MMAs (79% vs. average 56%) across all densities. The RDT Sp, when read by the human eye or MMAs was 99% for both the Pf and Pan test lines across all densities.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>The study results show that in a laboratory setting, most MMAs produced similar results interpreting the Pf test line of RDTs at parasite densities typically found in patients that experience malaria symptoms (&gt;\u2009100 p\/\u00b5l) compared to the human eye. At low parasite densities for the Pf line and across all parasite densities for the Pan line, MMAs were less accurate than the human eye. Future efforts should focus on improving the band\/line detection at lower band intensities and evaluating additional MMA functionalities like the ability to identify and classify RDT errors or anomalies.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12936-020-03573-2","type":"journal-article","created":{"date-parts":[[2021,1,12]],"date-time":"2021-01-12T22:04:35Z","timestamp":1610489075000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["A comparative evaluation of mobile medical APPS (MMAS) for reading and interpreting malaria rapid diagnostic tests"],"prefix":"10.1186","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5669-027X","authenticated-orcid":false,"given":"Theodoor","family":"Visser","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sumedh","family":"Ramachandra","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emilie","family":"Pothin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jan","family":"Jacobs","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jane","family":"Cunningham","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arnaud Le","family":"Menach","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michelle L.","family":"Gatton","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Samaly","family":"dos Santos Souza","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sydney","family":"Nelson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Luke","family":"Rooney","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Aidoo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,1,13]]},"reference":[{"key":"3573_CR1","volume-title":"Universal access to malaria diagnostic testing: an operational manual","author":"WHO","year":"2011","unstructured":"WHO. Universal access to malaria diagnostic testing: an operational manual. Geneva: World Health Organization; 2011."},{"key":"3573_CR2","volume-title":"A framework for malaria elimination","author":"WHO","year":"2017","unstructured":"WHO. A framework for malaria elimination. Geneva: World Health Organization; 2017."},{"key":"3573_CR3","unstructured":"WHO. World Malaria Report 2019. Geneva WH, Organization. 2019.\u00a0\u00a0https:\/\/www.who.int\/publications-detail\/world-malaria-report-2019."},{"key":"3573_CR4","volume-title":"World Malaria Report 2017","author":"WHO","year":"2017","unstructured":"WHO. World Malaria Report 2017. Geneva: World Health Organization; 2017."},{"key":"3573_CR5","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1186\/1475-2875-13-229","volume":"13","author":"E Ruizendaal","year":"2014","unstructured":"Ruizendaal E, Dierickx S, Peeters Grietens K, Schallig HDFH, Pagnoni F, Mens PF. Success or failure of critical steps in community case management of malaria with rapid diagnostic tests: a systematic review. Malar J. 2014;13:229.","journal-title":"Malar J"},{"key":"3573_CR6","doi-asserted-by":"publisher","first-page":"399","DOI":"10.1111\/1469-0691.12151","volume":"19","author":"J Maltha","year":"2013","unstructured":"Maltha J, Gillet P, Jacobs J. Malaria rapid diagnostic tests in endemic settings. Clin Microbiol Infect. 2013;19:399\u2013407.","journal-title":"Clin Microbiol Infect"},{"key":"3573_CR7","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1186\/s12936-014-0535-9","volume":"14","author":"P Mukadi","year":"2015","unstructured":"Mukadi P, Gillet P, Barb\u00e9 B, Luamba J, Lukuka A, Likwela J, et al. SMS photograph-based external quality assessment of reading and interpretation of malaria rapid diagnostic tests in the Democratic Republic of the Congo. Malar J. 2015;14:26.","journal-title":"Malar J"},{"key":"3573_CR8","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1186\/s12936-015-0585-7","volume":"14","author":"M Sudhinaraset","year":"2015","unstructured":"Sudhinaraset M, Briegleb C, Aung M, Khin HSS, Aung T. Motivation and challenges for use of malaria rapid diagnostic tests among informal providers in Myanmar: a qualitative study. Malar J. 2015;14:61.","journal-title":"Malar J"},{"key":"3573_CR9","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1186\/1475-2875-9-359","volume":"9","author":"P Gillet","year":"2010","unstructured":"Gillet P, Mukadi P, Vernelen K, Van Esbroeck M, Muyembe J-J, Bruggeman C, et al. External quality assessment on the use of malaria rapid diagnostic tests in a non-endemic setting. Malar J. 2010;9:359.","journal-title":"Malar J"},{"key":"3573_CR10","doi-asserted-by":"publisher","first-page":"240","DOI":"10.1186\/1475-2875-12-240","volume":"12","author":"Y Ndiaye","year":"2013","unstructured":"Ndiaye Y, Ndiaye JL, Cisse B, Blanas D, Bassene J, Manga IA, et al. Community case management in malaria: review and perspectives after four years of operational experience in Saraya district, south-east Senegal. Malar J. 2013;12:240.","journal-title":"Malar J"},{"key":"3573_CR11","doi-asserted-by":"publisher","first-page":"e48296","DOI":"10.1371\/journal.pone.0048296","volume":"7","author":"J Cohen","year":"2012","unstructured":"Cohen J, Fink G, Berg K, Aber F, Jordan M, Maloney K, et al. Feasibility of distributing rapid diagnostic tests for malaria in the retail sector: evidence from an implementation study in Uganda. PLoS One. 2012;7:e48296.","journal-title":"PLoS One"},{"key":"3573_CR12","doi-asserted-by":"publisher","first-page":"e71442","DOI":"10.1371\/journal.pone.0071442","volume":"8","author":"P Mukadi","year":"2013","unstructured":"Mukadi P, Gillet P, Lukuka A, Mbatshi J, Otshudiema J, Muyembe J-J, et al. External quality assessment of reading and interpretation of malaria rapid diagnostic tests among 1849 end-users in the Democratic Republic of the Congo through short message service (SMS). PLoS One. 2013;8:e71442.","journal-title":"PLoS One"},{"key":"3573_CR13","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1179\/1364859411Y.0000000042","volume":"106","author":"DH Hamer","year":"2012","unstructured":"Hamer DH, Brooks ET, Semrau K, Pilingana P, MacLeod WB, Siazeele K, et al. Quality and safety of integrated community case management of malaria using rapid diagnostic tests and pneumonia by community health workers. Pathog Glob Health. 2012;106:32\u20139.","journal-title":"Pathog Glob Health"},{"key":"3573_CR14","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1186\/s12936-018-2493-0","volume":"17","author":"K Torres","year":"2018","unstructured":"Torres K, Bachman CM, Delahunt CB, Alarcon Baldeon J, Alava F, Gamboa Vilela D, et al. Automated microscopy for routine malaria diagnosis: a field comparison on Giemsa-stained blood films in Peru. Malar J. 2018;17:339.","journal-title":"Malar J"},{"key":"3573_CR15","doi-asserted-by":"publisher","first-page":"214","DOI":"10.1186\/s12936-018-2363-9","volume":"17","author":"AK Kalinga","year":"2018","unstructured":"Kalinga AK, Mwanziva C, Chiduo S, Mswanya C, Ishengoma DI, Francis F, et al. Comparison of visual and automated Deki Reader interpretation of malaria rapid diagnostic tests in rural Tanzanian military health facilities. Malar J. 2018;17:214.","journal-title":"Malar J"},{"key":"3573_CR16","unstructured":"Food and Drug Administration. Mobile medical applications: guidance for industry and Food and Drug Administration Staff . 2015. http:\/\/www.fda.gov\/downloads\/MedicalDevices\/...\/UCM263366.pdf."},{"key":"3573_CR17","unstructured":"Food and Drug Administration. Medical device data systems, medical image storage devices, and medical guidance for industry and food and drug administration staff. 2015."},{"key":"3573_CR18","unstructured":"European Commission. Guidelines on the qualification and classification of stand alone software used in healthcare within the regulatory framework of medical devices. 2016."},{"key":"3573_CR19","unstructured":"Medicines & Healthcare products Regulatory Authority. Guidance: Medical device stand-alone software including apps (including IVDMDs). 2017."},{"key":"3573_CR20","unstructured":"Australian Government Department of Health Therapeutic Goods Administration. Regulation of medical software and mobile medical \u2019 apps \u2019. 2016. p.\u00a01\u20134.\u00a0\u00a0https:\/\/www.tga.gov.au\/regulation-medical-software-and-mobile-medical-apps."},{"key":"3573_CR21","unstructured":"The African Strategies for Health Project. Fionet: Mobile diagnostics integrated with cloud information services. 2013."},{"key":"3573_CR22","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1186\/1475-2875-13-87","volume":"13","author":"S Herrera","year":"2014","unstructured":"Herrera S, Vallejo AF, Quintero JP, Ar\u00e9valo-Herrera M, Cancino M, Ferro S. Field evaluation of an automated RDT reader and data management device for Plasmodium falciparum\/Plasmodium vivax malaria in endemic areas of Colombia. Malar J. 2014;13:87.","journal-title":"Malar J"},{"key":"3573_CR23","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1186\/1475-2875-12-141","volume":"12","author":"S Shekalaghe","year":"2013","unstructured":"Shekalaghe S, Cancino M, Mavere C, Juma O, Mohammed A, Abdulla S, et al. Clinical performance of an automated reader in interpreting malaria rapid diagnostic tests in Tanzania. Malar J. 2013;12:141.","journal-title":"Malar J"},{"key":"3573_CR24","doi-asserted-by":"publisher","first-page":"430","DOI":"10.1186\/s12936-015-0965-z","volume":"14","author":"DO Soti","year":"2015","unstructured":"Soti DO, Kinoti SN, Omar AH, Logedi J, Mwendwa TK, Hirji Z, et al. Feasibility of an innovative electronic mobile system to assist health workers to collect accurate, complete and timely data in a malaria control programme in a remote setting in Kenya. Malar J. 2015;14:430.","journal-title":"Malar J"},{"key":"3573_CR25","unstructured":"Chemonics. Improving Malaria Diagnosis and Care in the Democratic Republic of Congo.\u00a0http:\/\/www.chemonics.com\/OurWork\/OurProjects\/Pages\/DRC-Fionet.aspx."},{"key":"3573_CR26","unstructured":"Corporation F. No Title. p. http:\/\/fio.com\/rapid-testing\/."},{"key":"3573_CR27","unstructured":"WHO. Malaria Rapid Diagnostic Tests. Geneva, World Health Organization. 2017. p.\u00a08\u201317.\u00a0\u00a0http:\/\/www.who.int\/malaria\/areas\/diagnosis\/rapid_diagnostic_tests\/en\/."},{"key":"3573_CR28","unstructured":"UNITAID. Malaria diagnostics technology and market landscape: 3rd Edn. 2016."},{"key":"3573_CR29","unstructured":"WHO. Malaria Rapid Diagnostic Test Performance Round. 8 (2016\u20132018). Geneva, World Health Organization, 2018. http:\/\/www.who.int\/malaria\/publications\/atoz\/9789241510035\/en\/."},{"key":"3573_CR30","doi-asserted-by":"publisher","first-page":"276","DOI":"10.11613\/BM.2012.031","volume":"22","author":"ML McHugh","year":"2012","unstructured":"McHugh ML. Lessons in biostatistics Interrater reliability: the kappa statistic. Biochem Med (Zagreb). 2012;22:276\u201382.","journal-title":"Biochem Med (Zagreb)"},{"key":"3573_CR31","unstructured":"Amumpaire JM, Ii YB. Evaluation of the Deki Reader \u2122, an automated RDT reader and data management device, in a household survey setting in low malaria endemic southwestern Uganda. Malar J. 2017;449."},{"key":"3573_CR32","doi-asserted-by":"publisher","first-page":"e0191968","DOI":"10.1371\/journal.pone.0191968","volume":"13","author":"J Laktabai","year":"2018","unstructured":"Laktabai J, Platt A, Menya D, Turner EL, Aswa D, Kinoti S, et al. A mobile health technology platform for quality assurance and quality improvement of malaria diagnosis by community health workers. PLoS One. 2018;13:e0191968.","journal-title":"PLoS One"}],"container-title":["Malaria Journal"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12936-020-03573-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12936-020-03573-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12936-020-03573-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,1,12]],"date-time":"2021-01-12T22:07:44Z","timestamp":1610489264000},"score":1,"resource":{"primary":{"URL":"https:\/\/malariajournal.biomedcentral.com\/articles\/10.1186\/s12936-020-03573-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,13]]},"references-count":32,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["3573"],"URL":"https:\/\/doi.org\/10.1186\/s12936-020-03573-2","relation":{},"ISSN":["1475-2875"],"issn-type":[{"value":"1475-2875","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,13]]},"assertion":[{"value":"3 October 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 December 2020","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 December 2020","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 January 2021","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Not applicable.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"39"}}