{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,4]],"date-time":"2026-02-04T20:50:53Z","timestamp":1770238253381,"version":"3.49.0"},"reference-count":27,"publisher":"Springer Science and Business Media LLC","issue":"S1","license":[{"start":{"date-parts":[[2021,2,1]],"date-time":"2021-02-01T00:00:00Z","timestamp":1612137600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2021,2,8]],"date-time":"2021-02-08T00:00:00Z","timestamp":1612742400000},"content-version":"vor","delay-in-days":7,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Popul Health Metrics"],"published-print":{"date-parts":[[2021,2]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Paradata are (timestamped) records tracking the process of (electronic) data collection. We analysed paradata from a large household survey of questions capturing pregnancy outcomes to assess performance (timing and correction processes). We examined how paradata can be used to inform and improve questionnaire design and survey implementation in nationally representative household surveys, the major source for maternal and newborn health data worldwide.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>The EN-INDEPTH cross-sectional population-based survey of women of reproductive age in five Health and Demographic Surveillance System sites (in Bangladesh, Guinea-Bissau, Ethiopia, Ghana, and Uganda) randomly compared two modules to capture pregnancy outcomes: full pregnancy history (FPH) and the standard DHS-7 full birth history (FBH+). We used paradata related to answers recorded on tablets using the Survey Solutions platform. We evaluated the difference in paradata entries between the two reproductive modules and assessed which question characteristics (type, nature, structure) affect answer correction rates, using regression analyses. We also proposed and tested a new classification of answer correction types.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>We analysed 3.6 million timestamped entries from 65,768 interviews. 83.7% of all interviews had at least one corrected answer to a question. Of 3.3 million analysed questions, 7.5% had at least one correction. Among corrected questions, the median number of corrections was one, regardless of question characteristics. We classified answer corrections into eight types (no correction, impulsive, flat (simple), zigzag, flat zigzag, missing after correction, missing after flat (zigzag) correction, missing\/incomplete). 84.6% of all corrections were judged not to be problematic with a flat (simple) mistake correction. Question characteristics were important predictors of probability to make answer corrections, even after adjusting for respondent\u2019s characteristics and location, with interviewer clustering accounted as a fixed effect. Answer correction patterns and types were similar between FPH and FBH+, as well as the overall response duration. Avoiding corrections has the potential to reduce interview duration and reproductive module completion by 0.4\u2009min.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>The use of questionnaire paradata has the potential to improve measurement and the resultant quality of electronic data. Identifying sections or specific questions with multiple corrections sheds light on typically hidden challenges in the survey\u2019s content, process, and administration, allowing for earlier real-time intervention (e.g.,, questionnaire content revision or additional staff training). Given the size and complexity of paradata, additional time, data management, and programming skills are required to realise its potential.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s12963-020-00241-0","type":"journal-article","created":{"date-parts":[[2021,2,8]],"date-time":"2021-02-08T17:39:42Z","timestamp":1612805982000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Paradata analyses to inform population-based survey capture of pregnancy outcomes: EN-INDEPTH study"],"prefix":"10.1186","volume":"19","author":[{"name":"the Every Newborn-INDEPTH Study Collaborative Group","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vladimir Sergeevich","family":"Gordeev","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joseph","family":"Akuze","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Angela","family":"Baschieri","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sanne M.","family":"Thysen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Francis","family":"Dzabeng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"M. Moinuddin","family":"Haider","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Melanie","family":"Smuk","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Wild","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael M.","family":"Lokshin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Temesgen Azemeraw","family":"Yitayew","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Solomon Mokonnen","family":"Abebe","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Davis","family":"Natukwatsa","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Collins","family":"Gyezaho","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Seeba","family":"Amenga-Etego","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joy E.","family":"Lawn","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hannah","family":"Blencowe","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,2,8]]},"reference":[{"key":"241_CR1","volume-title":"Keeping promises, measuring results: commission on information and accountability for women\u2019s and children\u2019s health","author":"Commission on Information Accountability for Women\u2019s and Children\u2019s Health","year":"2011","unstructured":"Commission on Information Accountability for Women\u2019s and Children\u2019s Health. Keeping promises, measuring results: commission on information and accountability for women\u2019s and children\u2019s health. Geneva: Commission on information and accountability for Women\u2019s and Children\u2019s Health, World Health Organization; 2011."},{"key":"241_CR2","volume-title":"Monitoring maternal, newborn and child health: understanding key progress indicators","author":"Countdown to 2015 & Health Metrics Network","year":"2011","unstructured":"Countdown to 2015 & Health Metrics Network. Monitoring maternal, newborn and child health: understanding key progress indicators. Geneva: World Health Organization; 2011."},{"key":"241_CR3","volume-title":"Guidelines for best practice in cross-cultural surveys","author":"SE Hansen","year":"2016","unstructured":"Hansen SE, Benson G, Bowers A, Pennell B-E, Lin Y-cJ, Duffey B, Hu M, Hibben KC. Survey quality. In: Guidelines for best practice in cross-cultural surveys. Ann Arbor: Survey Research Center, Institute for Social Research, University of Michigan; 2016."},{"key":"241_CR4","doi-asserted-by":"publisher","first-page":"e1001391","DOI":"10.1371\/journal.pmed.1001391","volume":"10","author":"A Hancioglu","year":"2013","unstructured":"Hancioglu A, Arnold F. Measuring coverage in MNCH: tracking progress in health for women and children using DHS and MICS household surveys. PLoS Med. 2013;10:e1001391.","journal-title":"PLoS Med"},{"key":"241_CR5","doi-asserted-by":"publisher","first-page":"264","DOI":"10.3390\/socsci3020264","volume":"3","author":"C Leisher","year":"2014","unstructured":"Leisher C. A comparison of tablet-based and paper-based survey data collection in conservation projects. Soc Sci. 2014;3:264\u201371.","journal-title":"Soc Sci"},{"key":"241_CR6","volume-title":"Improving surveys with paradata: analytic uses of process information","year":"2013","unstructured":"Kreuter F, editor. Improving surveys with paradata: analytic uses of process information. Hoboken: Wiley; 2013."},{"key":"241_CR7","volume-title":"Survey paradata: a review","author":"G Nicolaas","year":"2011","unstructured":"Nicolaas G: Survey paradata: a review. 2011. http:\/\/eprints.ncrm.ac.uk\/1719\/1\/Nicolaas_review_paper_jan11.pdf. [Accessed June 2020]."},{"key":"241_CR8","doi-asserted-by":"publisher","first-page":"598","DOI":"10.1111\/rode.12583","volume":"23","author":"J Choumert-Nkolo","year":"2019","unstructured":"Choumert-Nkolo J, Cust H, Taylor C. Using paradata to collect better survey data: evidence from a household survey in Tanzania. Rev Dev Econ. 2019;23:598\u2013618.","journal-title":"Rev Dev Econ"},{"key":"241_CR9","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1111\/j.1467-985X.2012.01041.x","volume":"176","author":"MP Couper","year":"2013","unstructured":"Couper MP, Kreuter F. Using paradata to explore item level response times in surveys. J R Stat Soc Ser A Stat Soc. 2013;176:271\u201386.","journal-title":"J R Stat Soc Ser A Stat Soc"},{"key":"241_CR10","doi-asserted-by":"publisher","first-page":"010901","DOI":"10.7189\/jogh.09.010901","volume":"9","author":"A Baschieri","year":"2019","unstructured":"Baschieri A, Gordeev VS, Akuze J, Kwesiga D, Blencowe H, Cousens S, Waiswa P, Fisker AB, Thysen SM, Rodrigues A, et al. \u201cEvery Newborn-INDEPTH\u201d (EN-INDEPTH) study protocol for a randomised comparison of household survey modules for measuring stillbirths and neonatal deaths in five Health and Demographic Surveillance sites. J Glob Health. 2019;9:010901.","journal-title":"J Glob Health"},{"key":"241_CR11","doi-asserted-by":"publisher","first-page":"e555","DOI":"10.1016\/S2214-109X(20)30044-9","volume":"8","author":"J Akuze","year":"2020","unstructured":"Akuze J, Blencowe H, Waiswa P, Baschieri A, Gordeev VS, Kwesiga D, Fisker AB, Thysen SM, Rodrigues A, Biks GA, et al. Randomised comparison of two household survey modules for measuring stillbirths and neonatal deaths in five countries: the Every Newborn-INDEPTH study. Lancet Glob Health. 2020;8:e555\u201366.","journal-title":"Lancet Glob Health"},{"key":"241_CR12","volume-title":"Survey solutions CAPI\/CAWI platform: release 5.26","author":"The World Bank","year":"2018","unstructured":"The World Bank. Survey solutions CAPI\/CAWI platform: release 5.26. Washington DC: The World Bank; 2018."},{"key":"241_CR13","doi-asserted-by":"crossref","unstructured":"Thysen SM, Tawiah C, Blencowe H, Manu G, Akuze J, Haider MM, Alam N, Azemeraw T, Baschieri A, Biks GA, et al. Electronic data collection in a multi-site population-based survey: EN-INDEPTH study. BMC Population Health Metrics. 2021:19(Supplement 1).","DOI":"10.1186\/s12963-020-00226-z"},{"key":"241_CR14","volume-title":"R: a language and environment for statistical computing","author":"R Core Team","year":"2019","unstructured":"R Core Team. R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2019."},{"key":"241_CR15","volume-title":"Stata Statistical Software: release 16","author":"StataCorp","year":"2019","unstructured":"StataCorp. Stata Statistical Software: release 16. College Station: StataCorp LLC; 2019."},{"key":"241_CR16","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1002\/9781118596869.ch4","volume-title":"Improving surveys with paradata: analytic uses of process information","author":"T Yan","year":"2013","unstructured":"Yan T, Olson K. Analysing paradata to investigate measurement error. In: Kreuter F, editor. Improving surveys with paradata: analytic uses of process information. Hoboken: Wiley; 2013. p. 73\u201395."},{"key":"241_CR17","doi-asserted-by":"publisher","first-page":"435","DOI":"10.1177\/1536867X0600600401","volume":"6","author":"C Brzinsky-Fay","year":"2006","unstructured":"Brzinsky-Fay C, Kohler U, Luniak M. Sequence analysis with Stata. Stata J. 2006;6:435\u201360.","journal-title":"Stata J"},{"key":"241_CR18","doi-asserted-by":"publisher","unstructured":"von Elm E, Altman DG, Egger M, Pocock SJ, G\u00f8tzsche PC, Vandenbroucke JP; STROBE Initiative. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. BMJ. 2007;335(7624):806\u20138. https:\/\/doi.org\/10.1136\/bmj.39335.541782.AD. PMID: 17947786; PMCID: PMC2034723.","DOI":"10.1136\/bmj.39335.541782.AD"},{"key":"241_CR19","volume-title":"The wave principle","author":"RN Elliott","year":"1938","unstructured":"Elliott RN. The wave principle. Los Angeles: Alanpuri Trading; 1938."},{"key":"241_CR20","doi-asserted-by":"publisher","first-page":"e101","DOI":"10.2196\/resprot.5187","volume":"5","author":"MF Romano","year":"2016","unstructured":"Romano MF, Sardella MV, Alboni F. Web health monitoring survey: a new approach to enhance the effectiveness of telemedicine systems. JMIR Res Protoc. 2016;5:e101.","journal-title":"JMIR Res Protoc"},{"key":"241_CR21","doi-asserted-by":"publisher","first-page":"e10246","DOI":"10.2196\/10246","volume":"3","author":"I Oakley-Girvan","year":"2019","unstructured":"Oakley-Girvan I, Lavista JM, Miller Y, Davis S, Acle C, Hancock J, Nelson LM. Evaluation of a mobile device survey system for behavioral risk factors (SHAPE): app development and usability study. JMIR Form Res. 2019;3:e10246.","journal-title":"JMIR Form Res"},{"key":"241_CR22","volume-title":"Incorporating level of effort paradata in the NSDUH nonresponse adjustment process","author":"Substance Abuse and Mental Health Services Administration (US)","year":"2013","unstructured":"Substance Abuse and Mental Health Services Administration (US). CBHSQ methodology report. In: Incorporating level of effort paradata in the NSDUH nonresponse adjustment process. Rockville: Substance Abuse and Mental Health Services Administration (US); 2013."},{"key":"241_CR23","doi-asserted-by":"publisher","first-page":"964","DOI":"10.3945\/jn.116.240697","volume":"147","author":"M Hu","year":"2017","unstructured":"Hu M, Gremel GW, Kirlin JA, West BT. Nonresponse and underreporting errors increase over the data collection week based on paradata from the National Household Food Acquisition and Purchase Survey. J Nutr. 2017;147:964\u201375.","journal-title":"J Nutr"},{"key":"241_CR24","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1016\/j.jval.2014.11.005","volume":"18","author":"BM Craig","year":"2015","unstructured":"Craig BM, Runge SK, Rand-Hendriksen K, Ramos-Goni JM, Oppe M. Learning and satisficing: an analysis of sequence effects in health valuation. Value Health. 2015;18:217\u201323.","journal-title":"Value Health"},{"key":"241_CR25","doi-asserted-by":"publisher","DOI":"10.3768\/rtipress.2019.op.0061.1905","volume-title":"Interactive visualization to facilitate monitoring longitudinal survey data and paradata","author":"JJ Murphy","year":"2019","unstructured":"Murphy JJ, Duprey MA, Chew RF, Biemer PP, Harris KM, Halpern CT. RTI press occasional papers. In: Interactive visualization to facilitate monitoring longitudinal survey data and paradata. Research Triangle Park: Research Triangle Institute (RTI) Press; 2019."},{"key":"241_CR26","doi-asserted-by":"publisher","first-page":"3168","DOI":"10.1111\/jan.13381","volume":"73","author":"C Helms","year":"2017","unstructured":"Helms C, Gardner A, McInnes E. The use of advanced web-based survey design in Delphi research. J Adv Nurs. 2017;73:3168\u201377.","journal-title":"J Adv Nurs"},{"key":"241_CR27","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1111\/ppe.12328","volume":"31","author":"M Langeheine","year":"2017","unstructured":"Langeheine M, Pohlabeln H, Ahrens W, Rach S. Consequences of an extended recruitment on participation in the follow-up of a child study: results from the German IDEFICS cohort. Paediatr Perinat Epidemiol. 2017;31:76\u201386.","journal-title":"Paediatr Perinat Epidemiol"}],"container-title":["Population Health Metrics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12963-020-00241-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12963-020-00241-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12963-020-00241-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,4,24]],"date-time":"2021-04-24T09:09:02Z","timestamp":1619255342000},"score":1,"resource":{"primary":{"URL":"https:\/\/pophealthmetrics.biomedcentral.com\/articles\/10.1186\/s12963-020-00241-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2]]},"references-count":27,"journal-issue":{"issue":"S1","published-print":{"date-parts":[[2021,2]]}},"alternative-id":["241"],"URL":"https:\/\/doi.org\/10.1186\/s12963-020-00241-0","relation":{},"ISSN":["1478-7954"],"issn-type":[{"value":"1478-7954","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2]]},"assertion":[{"value":"8 February 2021","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The EN-INDEPTH study was granted ethical approval by the Institutional Review Boards in all operating countries, as well as, from the Institutional Ethical Review Committee of the London School of Hygiene & Tropical Medicine (Additional file). Respondents of every successful interview gave written consent\/ascent after being informed of the objective and data use, the procedure of the interview, risks and benefits of participating in the study, right to withdraw from interview anytime point of time, and not responding to questions where they feel discomfort. The study ensures the respondent\u2019s privacy at data collection and confidentiality at data use.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"10"}}