{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,23]],"date-time":"2026-01-23T06:45:11Z","timestamp":1769150711655,"version":"3.49.0"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW","license":[{"start":{"date-parts":[[2019,11,7]],"date-time":"2019-11-07T00:00:00Z","timestamp":1573084800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2019,11,7]]},"abstract":"<jats:p>Community health programs in low-resource settings (like rural Kenya) aim to provide essential health services to vulnerable populations. However, to date, there has been limited research that explores the design of mechanisms that enable care recipients to provide feedback regarding their satisfaction with the services they receive. Such feedback has the potential to increase the motivation of community health workers (CHWs), enhance training procedures, detect fraudulent behavior, and inform key performance indicators for health programs. Our paper explores the design and deployment of a USSD-based system that allows anyone who possesses a basic mobile phone to provide feedback regarding the health services and quality of care they received from a CHW or during a hospital visit. Our system was designed through iterative fieldwork in rural Kenya that engaged with multiple stakeholder groups, including care recipients, CHWs, and high-level decision makers. After designing and testing the system, we deployed it for seven weeks in Siaya, Kenya, collecting both quantitative system usage data and qualitative data from six focus groups with 42 participants. Findings from our deployment show that 168 care recipients engaged with the system, submitting 495 reports via USSD. We discuss the broader factors impacting deployment, including the feasibility of USSD, actionability of feedback, scalability, and sustainability. Taken together, our findings suggest that USSD is a promising approach for enabling care recipients to submit feedback in a way that balances privacy, equity, and sustainability.<\/jats:p>","DOI":"10.1145\/3359173","type":"journal-article","created":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T13:40:21Z","timestamp":1573220421000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":15,"title":["Including the Voice of Care Recipients in Community Health Feedback Loops in Rural Kenya"],"prefix":"10.1145","volume":"3","author":[{"given":"Fabian","family":"Okeke","sequence":"first","affiliation":[{"name":"Cornell Tech, New York, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Beatrice","family":"Wasunna","sequence":"additional","affiliation":[{"name":"Medic Mobile, Nairobi, Kenya"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mercy","family":"Amulele","sequence":"additional","affiliation":[{"name":"Medic Mobile, Nairobi, Kenya"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Isaac","family":"Holeman","sequence":"additional","affiliation":[{"name":"Medic Mobile, Seattle, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicola","family":"Dell","sequence":"additional","affiliation":[{"name":"Cornell Tech, New York, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,11,7]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1057\/s41271-016-0015-2"},{"key":"e_1_2_1_2_1","doi-asserted-by":"crossref","unstructured":"Michael S Bernstein Andr\u00e9s Monroy-Hern\u00e1ndez Drew Harry Paul Andr\u00e9 Katrina Panovich and Gregory G Vargas. 2011. 4chan and\/b: An Analysis of Anonymity and Ephemerality in a Large Online Community. In ICWSM. 50--57.  Michael S Bernstein Andr\u00e9s Monroy-Hern\u00e1ndez Drew Harry Paul Andr\u00e9 Katrina Panovich and Gregory G Vargas. 2011. 4chan and\/b: An Analysis of Anonymity and Ephemerality in a Large Online Community. In ICWSM. 50--57.","DOI":"10.1609\/icwsm.v5i1.14134"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2016-013821"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2444776.2444790"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2737856.2738027"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.2196\/10422"},{"key":"e_1_2_1_7_1","unstructured":"Community Health Toolkit. 2019. Retrieved April 4 2019 from https:\/\/communityhealthtoolkit.org\/.  Community Health Toolkit. 2019. Retrieved April 4 2019 from https:\/\/communityhealthtoolkit.org\/."},{"key":"e_1_2_1_8_1","volume-title":"Retrieved","author":"Dahir Abdi Latif","year":"2019","unstructured":"Abdi Latif Dahir . 2019 . Airtel and Telkom are uniting to take on Safaricom in Kenya . Retrieved March 26, 2019 fromhttps:\/\/qz.com\/africa\/1548281\/airtel-and-telkom-are-uniting-to-take-on-safaricom-in-kenya\/. Abdi Latif Dahir. 2019. Airtel and Telkom are uniting to take on Safaricom in Kenya. Retrieved March 26, 2019 fromhttps:\/\/qz.com\/africa\/1548281\/airtel-and-telkom-are-uniting-to-take-on-safaricom-in-kenya\/."},{"key":"e_1_2_1_9_1","volume-title":"Retrieved","author":"Reem Rahman David Bonbright Sophie Sahaf","year":"2015","unstructured":"Sophie Sahaf Reem Rahman David Bonbright , Britt Lake and Renee Ho . 2015 . Net Promoter Score for the Nonprofit Sector: What We've Learned So Far . Retrieved March 18, 2019 from https:\/\/feedbacklabs.org\/blog\/net-promoter-score-for-the-nonprofit-sector-what-weve-learned-so-far\/. Sophie Sahaf Reem Rahman David Bonbright, Britt Lake and Renee Ho. 2015. Net Promoter Score for the Nonprofit Sector: What We've Learned So Far. Retrieved March 18, 2019 from https:\/\/feedbacklabs.org\/blog\/net-promoter-score-for-the-nonprofit-sector-what-weve-learned-so-far\/."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675145"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208589"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025514"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2160673.2160677"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2909609.2909652"},{"key":"e_1_2_1_15_1","volume-title":"District Health Information Software 2. Retrieved","year":"2019","unstructured":"DHIS2. 2019. District Health Information Software 2. Retrieved April 4, 2019 from https:\/\/www.dhis2.org\/. DHIS2. 2019. District Health Information Software 2. Retrieved April 4, 2019 from https:\/\/www.dhis2.org\/."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025943"},{"key":"e_1_2_1_17_1","volume-title":"Protocol fora mixed-methods realist evaluation of a health service user feedback system in Bangladesh. BMJ Open 7, 6","author":"Ebenso Bassey","year":"2017","unstructured":"Bassey Ebenso , Rumana Huque , Zunayed Azdi , Helen Elsey , Shammi Nasreen , and Tolib Mirzoev . 2017. Protocol fora mixed-methods realist evaluation of a health service user feedback system in Bangladesh. BMJ Open 7, 6 ( 2017 ).https:\/\/doi.org\/10.1136\/bmjopen-2017-017743 arXiv:https:\/\/bmjopen.bmj.com\/content\/7\/6\/e017743.full.pdf Bassey Ebenso, Rumana Huque, Zunayed Azdi, Helen Elsey, Shammi Nasreen, and Tolib Mirzoev. 2017. Protocol fora mixed-methods realist evaluation of a health service user feedback system in Bangladesh. BMJ Open 7, 6 (2017).https:\/\/doi.org\/10.1136\/bmjopen-2017-017743 arXiv:https:\/\/bmjopen.bmj.com\/content\/7\/6\/e017743.full.pdf"},{"key":"e_1_2_1_18_1","volume-title":"Effects of questionnaire length on participation and indicators of response quality in a web survey. Public opinion quarterly 73, 2","author":"Galesic Mirta","year":"2009","unstructured":"Mirta Galesic and Michael Bosnjak . 2009. Effects of questionnaire length on participation and indicators of response quality in a web survey. Public opinion quarterly 73, 2 ( 2009 ), 349--360. Mirta Galesic and Michael Bosnjak. 2009. Effects of questionnaire length on participation and indicators of response quality in a web survey. Public opinion quarterly 73, 2 (2009), 349--360."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858476"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1302\/0301-620X.96B5.32434"},{"key":"e_1_2_1_21_1","volume-title":"Tara Patricia Cookson, and Claudia Pagliari","author":"Holeman Isaac","year":"2016","unstructured":"Isaac Holeman , Tara Patricia Cookson, and Claudia Pagliari . 2016 . Digital technology for health sector governance in low and middle income countries: a scoping review. Journal of global health6, 2 (2016). Isaac Holeman, Tara Patricia Cookson, and Claudia Pagliari. 2016. Digital technology for health sector governance in low and middle income countries: a scoping review. Journal of global health6, 2 (2016)."},{"key":"e_1_2_1_22_1","unstructured":"Isaac Holeman and Dianna Kane. forthcoming. Human-Centered Design for Global Health Equity. Information Technology for Development(forthcoming).  Isaac Holeman and Dianna Kane. forthcoming. Human-Centered Design for Global Health Equity. Information Technology for Development(forthcoming)."},{"key":"e_1_2_1_23_1","volume-title":"Healthcare complaints handling systems: a comparison between Britain, Australia and Taiwan. Health services management research 24, 2","author":"Hsieh Sophie Yahui","year":"2011","unstructured":"Sophie Yahui Hsieh . 2011. Healthcare complaints handling systems: a comparison between Britain, Australia and Taiwan. Health services management research 24, 2 ( 2011 ), 91--95. Sophie Yahui Hsieh. 2011. Healthcare complaints handling systems: a comparison between Britain, Australia and Taiwan. Health services management research 24, 2 (2011), 91--95."},{"key":"e_1_2_1_24_1","volume-title":"M-PESA: mobile money for the 'Junbanked' turning cellphones into 24-hourtellers in Kenya. Innovations: technology, governance, globalization2, 1--2","author":"Hughes Nick","year":"2007","unstructured":"Nick Hughes and Susie Lonie . 2007. M-PESA: mobile money for the 'Junbanked' turning cellphones into 24-hourtellers in Kenya. Innovations: technology, governance, globalization2, 1--2 ( 2007 ), 63--81. Nick Hughes and Susie Lonie. 2007. M-PESA: mobile money for the 'Junbanked' turning cellphones into 24-hourtellers in Kenya. Innovations: technology, governance, globalization2, 1--2 (2007), 63--81."},{"key":"e_1_2_1_25_1","volume-title":"A survey of trust and reputation systems for online service provision. Decision support systems 43, 2","author":"J\u00f8sang Audun","year":"2007","unstructured":"Audun J\u00f8sang , Roslan Ismail , and Colin Boyd . 2007. A survey of trust and reputation systems for online service provision. Decision support systems 43, 2 ( 2007 ), 618--644. Audun J\u00f8sang, Roslan Ismail, and Colin Boyd. 2007. A survey of trust and reputation systems for online service provision. Decision support systems 43, 2 (2007), 618--644."},{"key":"e_1_2_1_26_1","volume-title":"The Net Promoter Score (NPS) for insight into client experiences in sexual and reproductive health clinics. Global Health: Science and Practice6, 3","author":"Koladycz Rebecca","year":"2018","unstructured":"Rebecca Koladycz , Gwendolyn Fernandez , Kate Gray , and Heidi Marriott . 2018. The Net Promoter Score (NPS) for insight into client experiences in sexual and reproductive health clinics. Global Health: Science and Practice6, 3 ( 2018 ),413--424. Rebecca Koladycz, Gwendolyn Fernandez, Kate Gray, and Heidi Marriott. 2018. The Net Promoter Score (NPS) for insight into client experiences in sexual and reproductive health clinics. Global Health: Science and Practice6, 3 (2018),413--424."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2685553.2699011"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858414"},{"key":"e_1_2_1_29_1","volume-title":"Does a seller's ecommerce reputation matter? Evidence from eBay auctions. The journal of industrial economics 50, 3","author":"Melnik Mikhail I","year":"2002","unstructured":"Mikhail I Melnik and James Alm . 2002. Does a seller's ecommerce reputation matter? Evidence from eBay auctions. The journal of industrial economics 50, 3 ( 2002 ), 337--349. Mikhail I Melnik and James Alm. 2002. Does a seller's ecommerce reputation matter? Evidence from eBay auctions. The journal of industrial economics 50, 3 (2002), 337--349."},{"key":"e_1_2_1_30_1","volume-title":"Retrieved","author":"Mobile Medic","year":"2018","unstructured":"Medic Mobile . 2018 . Medic Mobile . Retrieved June 25, 2018 from https:\/\/medicmobile.org\/. Medic Mobile. 2018. Medic Mobile. Retrieved June 25, 2018 from https:\/\/medicmobile.org\/."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2516604.2516622"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3001913.3001922"},{"key":"e_1_2_1_33_1","volume-title":"Syed Ishtiaque Ahmed, and Neha Kumar","author":"Morshed Mehrab Bin","year":"2017","unstructured":"Mehrab Bin Morshed , Michaelanne Dye , Syed Ishtiaque Ahmed, and Neha Kumar . 2017 . When the Internet Goes Down in Bangladesh. In CSCW. 1591--1604. Mehrab Bin Morshed, Michaelanne Dye, Syed Ishtiaque Ahmed, and Neha Kumar. 2017. When the Internet Goes Down in Bangladesh. In CSCW. 1591--1604."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272973.3274066"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287098.3287111"},{"key":"e_1_2_1_36_1","volume-title":"2009 International Conference on Information and Communication Technologies and Development (ICTD). IEEE, 74--84","author":"Patnaik Somani","year":"2009","unstructured":"Somani Patnaik , Emma Brunskill , and William Thies . 2009 . Evaluating the accuracy of data collection on mobile phones:A study of forms, SMS, and voice . In 2009 International Conference on Information and Communication Technologies and Development (ICTD). IEEE, 74--84 . Somani Patnaik, Emma Brunskill, and William Thies. 2009. Evaluating the accuracy of data collection on mobile phones:A study of forms, SMS, and voice. In 2009 International Conference on Information and Communication Technologies and Development (ICTD). IEEE, 74--84."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702124"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2830629.2830645"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2737856.2737877"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209811.3209817"},{"key":"e_1_2_1_41_1","volume-title":"E-governance services through telecenters: The role of human intermediary and issues of trust. Information Technologies & International Development 4, 1","author":"Rajalekshmi Kiran Gopakumar","year":"2007","unstructured":"Kiran Gopakumar Rajalekshmi . 2007. E-governance services through telecenters: The role of human intermediary and issues of trust. Information Technologies & International Development 4, 1 ( 2007 ), pp--19. Kiran Gopakumar Rajalekshmi. 2007. E-governance services through telecenters: The role of human intermediary and issues of trust. Information Technologies & International Development 4, 1 (2007), pp--19."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1108\/17506161211246890"},{"key":"e_1_2_1_43_1","volume-title":"The ultimate question","author":"Reichheld Fred","year":"2006","unstructured":"Fred Reichheld . 2006. The ultimate question . Harvard Business School Press , Boston , MA( 2006 ). Fred Reichheld. 2006. The ultimate question.Harvard Business School Press, Boston, MA(2006)."},{"key":"e_1_2_1_44_1","unstructured":"Frederick F Reichheld and Rob Markey. 2011. The Ultimate Question 2.0: How net promoter companies thrive in a customer-driven world. Harvard business press.  Frederick F Reichheld and Rob Markey. 2011. The Ultimate Question 2.0: How net promoter companies thrive in a customer-driven world. Harvard business press."},{"key":"e_1_2_1_45_1","volume-title":"Guerino Chalamilla, and Ana Langer.","author":"Sando David","year":"2016","unstructured":"David Sando , Hannah Ratcliffe , Kathleen McDonald , Donna Spiegelman , Goodluck Lyatuu , Mary Mwanyika-Sando , Faida Emil , Mary Nell Wegner , Guerino Chalamilla, and Ana Langer. 2016 . The prevalence of disrespect and abuseduring facility-based childbirth in urban Tanzania. BMC pregnancy and childbirth 16, 1 (2016), 236. David Sando, Hannah Ratcliffe, Kathleen McDonald, Donna Spiegelman, Goodluck Lyatuu, Mary Mwanyika-Sando, Faida Emil, Mary Nell Wegner, Guerino Chalamilla, and Ana Langer. 2016. The prevalence of disrespect and abuseduring facility-based childbirth in urban Tanzania. BMC pregnancy and childbirth 16, 1 (2016), 236."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998231"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2517899.2517937"},{"key":"e_1_2_1_48_1","volume-title":"Basics of qualitative research: Grounded theory procedures and techniques","author":"Strauss Anselm","unstructured":"Anselm Strauss and Juliet M Corbin . 1990. Basics of qualitative research: Grounded theory procedures and techniques . Sage Publications, Inc. Anselm Strauss and Juliet M Corbin. 1990. Basics of qualitative research: Grounded theory procedures and techniques.Sage Publications, Inc."},{"key":"e_1_2_1_49_1","volume-title":"Retrieved","author":"Talking Africa's","year":"2019","unstructured":"Africa's Talking . 2019 . Africa's Talking . Retrieved March 26, 2019 from https:\/\/africastalking.com\/. Africa's Talking. 2019. Africa's Talking. Retrieved March 26, 2019 from https:\/\/africastalking.com\/."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2466206"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702191"},{"key":"e_1_2_1_52_1","unstructured":"Aditya Vashistha and William Thies. 2012. IVR Junction: Building Scalable and Distributed Voice Forums in the Developing World. In NSDR.  Aditya Vashistha and William Thies. 2012. IVR Junction: Building Scalable and Distributed Voice Forums in the Developing World. In NSDR."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998242"},{"key":"e_1_2_1_54_1","volume-title":"Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18)","author":"Weld Galen","unstructured":"Galen Weld , Trevor Perrier , Jenny Aker , Joshua E. Blumenstock , Brian Dillon , Adalbertus Kamanzi , Editha Kokushubira , Jennifer Webster , and Richard J. Anderson . 2018. eKichabi: Information Access Through Basic Mobile Phones in Rural Tanzania . In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18) . ACM, NewYork, NY, USA, Article 133, 12 pages. https:\/\/doi.org\/10.1145\/3173574.3173707 Galen Weld, Trevor Perrier, Jenny Aker, Joshua E. Blumenstock, Brian Dillon, Adalbertus Kamanzi, Editha Kokushubira, Jennifer Webster, and Richard J. Anderson. 2018. eKichabi: Information Access Through Basic Mobile Phones in Rural Tanzania. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, NewYork, NY, USA, Article 133, 12 pages. https:\/\/doi.org\/10.1145\/3173574.3173707"},{"key":"e_1_2_1_55_1","doi-asserted-by":"crossref","unstructured":"Caroline Whidden Kassoum Kayentao Jenny X Liu Scott Lee Youssouf Keita Djoum\u00e9 Diakit\u00e9 Alexander Keita Samba Diarra Jacqueline Edwards Amanda Yembrick etal 2018. Improving Community Health Worker performance by using a personalised feedback dashboard for supervision: a randomised controlled trial. Journal of global health8 2(2018).  Caroline Whidden Kassoum Kayentao Jenny X Liu Scott Lee Youssouf Keita Djoum\u00e9 Diakit\u00e9 Alexander Keita Samba Diarra Jacqueline Edwards Amanda Yembrick et al. 2018. Improving Community Health Worker performance by using a personalised feedback dashboard for supervision: a randomised controlled trial. Journal of global health8 2(2018).","DOI":"10.7189\/jogh.08.020418"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441783"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3359173","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3359173","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:12:53Z","timestamp":1750201973000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3359173"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,7]]},"references-count":56,"journal-issue":{"issue":"CSCW","published-print":{"date-parts":[[2019,11,7]]}},"alternative-id":["10.1145\/3359173"],"URL":"https:\/\/doi.org\/10.1145\/3359173","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,7]]},"assertion":[{"value":"2019-11-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}