{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,28]],"date-time":"2026-07-28T18:01:21Z","timestamp":1785261681498,"version":"3.55.0"},"reference-count":35,"publisher":"Public Library of Science (PLoS)","issue":"7","license":[{"start":{"date-parts":[[2026,7,28]],"date-time":"2026-07-28T00:00:00Z","timestamp":1785196800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000865","name":"Bill and Melinda Gates Foundation","doi-asserted-by":"publisher","award":["INV-047542"],"award-info":[{"award-number":["INV-047542"]}],"id":[{"id":"10.13039\/100000865","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000865","name":"Bill and Melinda Gates Foundation","doi-asserted-by":"publisher","award":["INV-048126"],"award-info":[{"award-number":["INV-048126"]}],"id":[{"id":"10.13039\/100000865","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS One"],"abstract":"<jats:p>Access to and use of mobile phones are increasingly a prerequisite for full participation in modern society. Yet, a significant digital gender gap persists in India, where women are less likely than men to own phones or access the internet. To measure and understand this gap, survey questions must be both comprehensible to the respondents and contextually appropriate. We conducted 101 cognitive interviews with men (n\u2009=\u200944) and women (n\u2009=\u200957) in rural Uttar Pradesh to test 118 draft survey questions developed for an upcoming survey on digital access and use. These draft questions were drawn primarily from validated global instruments, with some additional questions newly\u00a0developed by our team, and were all translated into Hindi. Through team debriefs and systematic analysis of the interview transcripts, we identified seven categories of question problems: (1) inappropriate terminology, (2) overly complex wording, (3) low resonance of digital concepts (e.g., personal data, online tracking, privacy policies, hacking), (4) confusion when asking about permission and supervision of mobile phone use due to phone sharing and overlap with concept of help or support, (5) problematic question structures and response options (especially Likert scales), (6) self-practice bias, and (7) unclear time frames and recall expectations. Overall, we found that many draft survey questions were incomprehensible to respondents despite our research team\u2019s efforts to develop clear and simple translations. Revisions were required for almost all questions. Our findings highlight the critical role of cognitive interviewing in improving data quality, particularly when conducting surveys across languages and sociocultural contexts, and amid rapidly changing digital landscapes.<\/jats:p>","DOI":"10.1371\/journal.pone.0354874","type":"journal-article","created":{"date-parts":[[2026,7,28]],"date-time":"2026-07-28T17:32:19Z","timestamp":1785259939000},"page":"e0354874","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":0,"title":["\u201cPlease speak in Hindi\u201d: Cognitive interviews to improve measurement of digital access in North India"],"prefix":"10.1371","volume":"21","author":[{"given":"Zenia","family":"Taluja","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-6702-7202","authenticated-orcid":true,"given":"Anjora","family":"Sarangi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3966-2792","authenticated-orcid":true,"given":"Pankaj","family":"Mishra","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8094-7493","authenticated-orcid":true,"given":"Chandrika Prasad","family":"Verma","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Manjula","family":"Sharma","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4189-5328","authenticated-orcid":true,"given":"Osama","family":"Ummer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0804-4617","authenticated-orcid":true,"given":"Arjun","family":"Khanna","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sara","family":"Chamberlain","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Priyadarshini","family":"Krishnaraj","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Megha S.","family":"Hudda","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amnesty E.","family":"LeFevre","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3597-9637","authenticated-orcid":true,"given":"Kerry","family":"Scott","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2026,7,28]]},"reference":[{"key":"pone.0354874.ref001","unstructured":"GSMA. The mobile gender gap report 2023. 2023."},{"key":"pone.0354874.ref002","doi-asserted-by":"crossref","DOI":"10.1136\/bmjgh-2021-005355","article-title":"Connecting the dots: Kerala\u2019s use of digital technology during the COVID-19 response","volume":"6","author":"O Ummer","year":"2021","journal-title":"BMJ Glob Health"},{"issue":"1","key":"pone.0354874.ref003","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1186\/s12905-021-01225-4","article-title":"Technology as the key to women\u2019s empowerment: a scoping review","volume":"21","author":"A Mackey","year":"2021","journal-title":"BMC Womens Health"},{"issue":"7","key":"pone.0354874.ref004","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0236078","article-title":"Does having a mobile phone matter? Linking phone access among women to health in India: An exploratory analysis of the National Family Health Survey","volume":"15","author":"D Mohan","year":"2020","journal-title":"PLoS One"},{"issue":"24","key":"pone.0354874.ref005","doi-asserted-by":"crossref","first-page":"13413","DOI":"10.1073\/pnas.1909326117","article-title":"Leveraging mobile phones to attain sustainable development","volume":"117","author":"V Rotondi","year":"2020","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"5","key":"pone.0354874.ref006","doi-asserted-by":"crossref","DOI":"10.1136\/bmjgh-2020-002524","article-title":"Does women\u2019s mobile phone ownership matter for health? Evidence from 15 countries","volume":"5","author":"AE LeFevre","year":"2020","journal-title":"BMJ Glob Health"},{"key":"pone.0354874.ref007","article-title":"Defining and measuring phone ownership and access in low- and middle-income countries","author":"AE Lefevre","year":"2023","journal-title":"Bulletin of the World Health Organisation"},{"issue":"2","key":"pone.0354874.ref008","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1093\/poq\/nfm006","article-title":"Research synthesis: The practice of cognitive interviewing","volume":"71","author":"PC Beatty","year":"2007","journal-title":"Public Opinion Quarterly"},{"issue":"1","key":"pone.0354874.ref009","doi-asserted-by":"crossref","first-page":"1","DOI":"10.5539\/gjhs.v5n1p1","article-title":"Translation and validation of the Farage Quality of Life (FQoL\u2122) instrument for consumer products into traditional Chinese","volume":"5","author":"MA Farage","year":"2012","journal-title":"Glob J Health Sci"},{"key":"pone.0354874.ref010","doi-asserted-by":"crossref","first-page":"200","DOI":"10.1186\/1471-2393-13-200","article-title":"Understanding pregnancy planning in a low-income country setting: validation of the London measure of unplanned pregnancy in Malawi","volume":"13","author":"J Hall","year":"2013","journal-title":"BMC Pregnancy Childbirth"},{"issue":"8","key":"pone.0354874.ref011","doi-asserted-by":"crossref","first-page":"1917","DOI":"10.1007\/s11136-012-0333-1","article-title":"Cognitive testing of the WHOQOL-BREF Bangladesh tool in a northern rural Bangladeshi population with lymphatic filariasis","volume":"22","author":"L Zeldenryk","year":"2013","journal-title":"Qual Life Res"},{"issue":"1","key":"pone.0354874.ref012","first-page":"67","article-title":"Yes, no, maybe so: the importance of cognitive interviewing to enhance structured surveys on respectful maternity care in northern India","volume":"35","author":"K Scott","year":"2020","journal-title":"Health Policy Plan"},{"key":"pone.0354874.ref013","volume-title":"Cognitive interviewing - cross-cultural survey guidelines","author":"KC Hibben","year":"2016"},{"issue":"6","key":"pone.0354874.ref014","doi-asserted-by":"crossref","first-page":"982","DOI":"10.1093\/heapol\/czab048","article-title":"The devil is in the detail: reflections on the value and application of cognitive interviewing to strengthen quantitative surveys in global health","volume":"36","author":"K Scott","year":"2021","journal-title":"Health Policy Plan"},{"key":"pone.0354874.ref015","doi-asserted-by":"crossref","first-page":"100008","DOI":"10.1016\/j.ymecc.2024.100008","article-title":"Enhancing validity through cognitive interviewing: A methodological example using the registered nursing forecasting nurse survey","volume":"2","author":"Z Bao","year":"2024","journal-title":"Measurement and Evaluations in Cancer Care"},{"issue":"1","key":"pone.0354874.ref016","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1177\/1525822X05279903","article-title":"How many interviews are enough? An experiment with data saturation and variability","volume":"18","author":"G Guest","year":"2006","journal-title":"Field Methods"},{"key":"pone.0354874.ref017","first-page":"117","article-title":"The Trust Approach to Research with Human Subjects","volume-title":"The Ethics of Research with Human Subjects: Protecting People, Advancing Science, Promoting Trust","author":"DB Resnik","year":"2025"},{"key":"pone.0354874.ref018","volume-title":"Annual Status of Education Report (Rural) 2022","author":"ASER Centre","year":"2022"},{"key":"pone.0354874.ref019","volume-title":"National Family Health Survey (NFHS-5), 2019-21","author":"International Institute for Population Sciences (IIPS), ICF","year":"2021"},{"key":"pone.0354874.ref020","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1186\/s12966-016-0357-y","article-title":"NEWS for Africa: adaptation and reliability of a built environment questionnaire for physical activity in seven African countries","volume":"13","author":"AL Oyeyemi","year":"2016","journal-title":"Int J Behav Nutr Phys Act"},{"issue":"1","key":"pone.0354874.ref021","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1186\/s12978-017-0381-7","article-title":"Development of a tool to measure person-centered maternity care in developing settings: validation in a rural and urban Kenyan population","volume":"14","author":"PA Afulani","year":"2017","journal-title":"Reprod Health"},{"issue":"4","key":"pone.0354874.ref022","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0175021","article-title":"A mixed methods approach to adapting and evaluating the functional assessment of HIV infection (FAHI), Swahili version, for use with low literacy populations","volume":"12","author":"MK Nyongesa","year":"2017","journal-title":"PLoS One"},{"issue":"4","key":"pone.0354874.ref023","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1093\/poq\/nfl027","article-title":"The Impact of Question and Respondent Characteristics on Comprehension and Mapping Difficulties","volume":"70","author":"A Holbrook","year":"2006","journal-title":"Public Opinion Quarterly"},{"key":"pone.0354874.ref024","article-title":"Factors influencing healthcare provider respondent fatigue answering a globally administered in-app survey","volume":"5","author":"VN O\u2019Reilly-Shah","year":"2017","journal-title":"PeerJ"},{"key":"pone.0354874.ref025","unstructured":"Whelan TJ. In: 2008."},{"key":"pone.0354874.ref026","unstructured":"Ben-Nun P. Respondent fatigue. Encyclopedia of survey research methods. 2008. p. 742\u20133."},{"issue":"20","key":"pone.0354874.ref027","doi-asserted-by":"crossref","first-page":"10858","DOI":"10.3390\/ijerph182010858","article-title":"The Effect of Rapport on Data Quality in Face-to-Face Interviews: Beneficial or Detrimental?","volume":"18","author":"M Horsfall","year":"2021","journal-title":"Int J Environ Res Public Health"},{"key":"pone.0354874.ref028","article-title":"Wellbeing and data quality in the American time use survey (Atus) from a total survey error perspective","author":"AL C\u00f3rdova Cazar","year":"2016","journal-title":"Wellbeing and data quality in the American time use survey (Atus) from a total survey error perspective"},{"key":"pone.0354874.ref029","unstructured":"BBCMA. Gender and digital access in India: measurement considerations. 2024."},{"key":"pone.0354874.ref030","unstructured":"GSMA. Triggering mobile internet use among men and women in India. 2017."},{"key":"pone.0354874.ref031","first-page":"66","article-title":"The Attitudes toward Women Scale: An objective instrument to measure attitudes toward the rights and roles of women in contemporary society","author":"JT Spence","year":"1972","journal-title":"Catalog of Selected Documents in Psychology"},{"key":"pone.0354874.ref032","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1007\/s11199-006-9018-y","article-title":"The Social Roles Questionnaire: A New Approach to Measuring Attitudes Toward Gender","volume":"54","author":"KM Baber","year":"2006","journal-title":"Sex Roles"},{"key":"pone.0354874.ref033","unstructured":"Levine RN. A Geography of Time: On Tempo, Culture, and the Pace of Life. 2008."},{"key":"pone.0354874.ref034","unstructured":"Plocher T, Goonetilleke RS, Zhang Y, Liang SFM. Time orientation across cultures. In: Proceedings of the 4th Annual International Workshop on Internationalisation of Products and Systems (IWIPS) - Designing for Global Markets 4, 2002."},{"key":"pone.0354874.ref035","unstructured":"UN. Gender-based data crucial for developing intersectional digital spheres reflecting women\u2019s, girls\u2019 identities, lives, speakers tell commission. United Nations Meeting Coverage and Press Releases. WOM\/2227. 2023. https:\/\/press.un.org\/en\/2023\/wom2227.doc.htm"}],"container-title":["PLOS One"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0354874","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,28]],"date-time":"2026-07-28T17:32:27Z","timestamp":1785259947000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0354874"}},"subtitle":[],"editor":[{"given":"Annesha","family":"Sil","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2026,7,28]]},"references-count":35,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2026,7,28]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0354874","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,28]]}}}