{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T14:56:47Z","timestamp":1767970607828,"version":"3.49.0"},"reference-count":57,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2018,3,26]],"date-time":"2018-03-26T00:00:00Z","timestamp":1522022400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"NSF National Robotics Institute","award":["1637927"],"award-info":[{"award-number":["1637927"]}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DGE 1745016"],"award-info":[{"award-number":["DGE 1745016"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"name":"JST CREST","award":["JPMJCR14E1"],"award-info":[{"award-number":["JPMJCR14E1"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2018,3,26]]},"abstract":"<jats:p>Indoor navigation systems can make unfamiliar buildings more accessible for people with vision impairments, but their adoption is hampered by the effort of installing infrastructure and maintaining it over time. Most solutions in this space require augmenting the environment with add-ons, such as Bluetooth beacons. Installing and calibrating such infrastructure requires time and expertise. Once installed, localization accuracy often degrades over time as batteries die, beacons go missing, or otherwise stop working. Even localization systems installed by experts can become unreliable weeks, months, or years after the installation. To address this problem, we created LuzDeploy: a physical crowdsourcing system that organizes non-experts for the installation and long-term maintenance of a Bluetooth-based navigation system. LuzDeploy simplifies the tasks required to install and maintain the localization infrastructure, thus making a crowdsourcing approach feasible for non-experts. We report on a field deployment where 127 participants installed and maintained a blind navigation system over several months in a 7-story building, completing 455 tasks in total. We compare the accuracy of the system installed by participants to an installation completed by experts with specialized equipment. LuzDeploy aims to improve the sustainability of indoor navigation systems to encourage widespread adoption outside of research settings.<\/jats:p>","DOI":"10.1145\/3191741","type":"journal-article","created":{"date-parts":[[2018,3,27]],"date-time":"2018-03-27T12:06:45Z","timestamp":1522152405000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":31,"title":["Crowdsourcing the Installation and Maintenance of Indoor Localization Infrastructure to Support Blind Navigation"],"prefix":"10.1145","volume":"2","author":[{"given":"Cole","family":"Gleason","sequence":"first","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}]},{"given":"Dragan","family":"Ahmetovic","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}]},{"given":"Saiph","family":"Savage","sequence":"additional","affiliation":[{"name":"West Virginia University, Morgantown, WV, USA"}]},{"given":"Carlos","family":"Toxtli","sequence":"additional","affiliation":[{"name":"West Virginia University, Morgantown, WV, USA"}]},{"given":"Carl","family":"Posthuma","sequence":"additional","affiliation":[{"name":"National Autonomus University of Mexico, Ciudad Universitaria, Mexico City, Distrito Federal, Mexico"}]},{"given":"Chieko","family":"Asakawa","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA, IBM Research Tokyo, Nihonbashi Hakozaki-cho, Tokyo, Japan"}]},{"given":"Kris M.","family":"Kitani","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}]},{"given":"Jeffrey P.","family":"Bigham","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}]}],"member":"320","published-online":{"date-parts":[[2018,3,26]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2935334.2935361"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2700648.2809847"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3058555.3058560"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFCOM.2000.832252"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441955.2441979"},{"key":"e_1_2_2_6_1","unstructured":"Jeffrey. P. Bigham Michael Bernstein and Eytan Adar. 2015. Human-Computer Interaction and Collective Intelligence. (2015). https:\/\/docs.google.com\/file\/d\/0B4-bDrtyS3lXdFJIRXk2bGdpQzg\/edit"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1866029.1866080"},{"key":"e_1_2_2_8_1","volume-title":"AGU Fall Meeting Abstracts.","author":"Borne KD","year":"2011","unstructured":"KD Borne and Zooniverse Team. 2011. The Zooniverse: A framework for knowledge discovery from citizen science data. In AGU Fall Meeting Abstracts."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2809904.2809910"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702329"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531635"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025495"},{"key":"e_1_2_2_13_1","volume-title":"Predicting protein structures with a multiplayer online game. Nature","author":"Cooper Seth","year":"2010","unstructured":"Seth Cooper, Firas Khatib, Adrien Treuille, Janos Barbero, Jeehyung Lee, Michael Beenen, Andrew Leaver-Fay, David Baker, Zoran Popovi\u0107, and others. 2010. Predicting protein structures with a multiplayer online game. Nature (2010)."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2145204.2145355"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.21307\/ijssis-2019-062"},{"key":"e_1_2_2_16_1","first-page":"21","article-title":"Indoor Human Navigation Systems: A Survey","volume":"25","author":"Fallah Navid","year":"2013","unstructured":"Navid Fallah, Ilias Apostolopoulos, Kostas Bekris, and Eelke Folmer. 2013. Indoor Human Navigation Systems: A Survey. Interacting with Computers 25, 1 (2013), 21.","journal-title":"Interacting with Computers"},{"key":"e_1_2_2_17_1","volume-title":"Proceedings of the 8th International Semantic Web Conference.","author":"Fazel-Zarandi Maryam","year":"2009","unstructured":"Maryam Fazel-Zarandi and Mark S Fox. 2009. Semantic matchmaking for job recruitment: an ontology-based hybrid approach. In Proceedings of the 8th International Semantic Web Conference."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/IEMBS.2010.5627670"},{"key":"e_1_2_2_19_1","volume-title":"The construction of cognitive maps","author":"Golledge Reginald G","unstructured":"Reginald G Golledge, Roberta L Klatzky, and Jack M Loomis. 1996. Cognitive mapping and wayfinding by adults without vision. In The construction of cognitive maps. Springer, 215--246."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2493432.2493481"},{"key":"e_1_2_2_21_1","volume-title":"Combining crowdsourcing and google street view to identify street-level accessibility problems. ACM","author":"Hara Kotaro","unstructured":"Kotaro Hara, Vicki Le, and Jon Froehlich. 2013. Combining crowdsourcing and google street view to identify street-level accessibility problems. ACM, New York, New York, USA."},{"key":"e_1_2_2_22_1","article-title":"Ontology matching approaches for erecruitment","volume":"51","author":"Hassan Fuad Mire","year":"2012","unstructured":"Fuad Mire Hassan, Imran Ghani, Muhammad Faheem, and Abdirahman Ali Hajji. 2012. Ontology matching approaches for erecruitment. International Journal of Computer Applications 51, 2 (2012).","journal-title":"International Journal of Computer Applications"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208619"},{"key":"e_1_2_2_24_1","volume-title":"Almost Wikipedia: What eight early online collaborative encyclopedia projects reveal about the mechanisms of collective action. In Working Paper. ACM.","author":"Hill Benjamin Mako","year":"2014","unstructured":"Benjamin Mako Hill. 2014. Almost Wikipedia: What eight early online collaborative encyclopedia projects reveal about the mechanisms of collective action. In Working Paper. ACM."},{"key":"e_1_2_2_25_1","volume-title":"Pebbles: User-Configurable Device Network for Robot Navigation. In 14th International Conference on Human-Computer Interaction (INTERACT) (Human-Computer Interaction -- INTERACT","volume":"8118","author":"Ishii Kentaro","year":"2013","unstructured":"Kentaro Ishii, Haipeng Mi, Lei Ma, Natsuda Laokulrat, Masahiko Inami, and Takeo Igarashi. 2013. Pebbles: User-Configurable Device Network for Robot Navigation. In 14th International Conference on Human-Computer Interaction (INTERACT) (Human-Computer Interaction -- INTERACT 2013), Paula Kotz\u00e9, Gary Marsden, Gitte Lindgaard, Janet Wesson, and Marco Winckler (Eds.), Vol. LNCS-8118. Springer, Cape Town, South Africa, 420--436. Part 9: Humans and Robots."},{"key":"e_1_2_2_26_1","volume-title":"Toward white wave - Story of Seiichi Miyake (in Japanese)","author":"Iwahashi Hideyuki","unstructured":"Hideyuki Iwahashi. 1983. Toward white wave - Story of Seiichi Miyake (in Japanese). Traffic Safety Research Center."},{"key":"e_1_2_2_27_1","volume-title":"A campus-scale mobile crowd-tasking platform. ACM","author":"Jaiman Nikita","unstructured":"Nikita Jaiman, Randy Tandriansyah, Thivya Kandappu, and Archan Misra. 2016. A campus-scale mobile crowd-tasking platform. ACM, New York, New York, USA."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2982142.2982178"},{"key":"e_1_2_2_29_1","volume-title":"Introducing game elements in crowdsourced video captioning by non-experts. ACM","author":"Kacorri Hernisa","unstructured":"Hernisa Kacorri, Kaoru Shinkawa, and Shin Saito. 2014. Introducing game elements in crowdsourced video captioning by non-experts. ACM, New York, New York, USA."},{"key":"e_1_2_2_30_1","volume-title":"Deepthi Chander, and Koustuv Dasgupta.","author":"Kandappu Thivya","year":"2016","unstructured":"Thivya Kandappu, Nikita Jaiman, Randy Tandriansyah, Archan Misra, Shih-Fen Cheng, Cen Chen, Hoong Chuin Lau, Deepthi Chander, and Koustuv Dasgupta. 2016. TASKer: behavioral insights via campus-based experimental mobile crowd-sourcing. ACM, New York, New York, USA."},{"key":"e_1_2_2_31_1","volume-title":"Can distributed volunteers accomplish massive data analysis tasks. Lunar and Planetary Science 1","author":"Kanefsky Bob","year":"2001","unstructured":"Bob Kanefsky, Nadine G Barlow, and Virginia C Gulick. 2001. Can distributed volunteers accomplish massive data analysis tasks. Lunar and Planetary Science 1 (2001)."},{"key":"e_1_2_2_32_1","volume-title":"More than fun and money. Worker Motivation in Crowdsourcing-A Study on Mechanical Turk. AMCIS","author":"Kaufmann N","year":"2011","unstructured":"N Kaufmann, T Schulze, and D Veit. 2011. More than fun and money. Worker Motivation in Crowdsourcing-A Study on Mechanical Turk. AMCIS (2011)."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v3i1.13252"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675255"},{"key":"e_1_2_2_35_1","volume-title":"Robust indoor localization on a commercial smart phone. Procedia Computer Science","author":"Kothari Nisarg","year":"2012","unstructured":"Nisarg Kothari, Balajee Kannan, Evan D Glasgwow, and M Bernardine Dias. 2012. Robust indoor localization on a commercial smart phone. Procedia Computer Science (2012)."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2984511.2984553"},{"key":"e_1_2_2_37_1","volume-title":"ALPS: A Bluetooth and Ultrasound Platform for Mapping and Localization. ACM","author":"Lazik Patrick","year":"2015","unstructured":"Patrick Lazik, Niranjini Rajagopal, Oliver Shih, Bruno Sinopoli, and Anthony Rowe. 2015. ALPS: A Bluetooth and Ultrasound Platform for Mapping and Localization. ACM, New York, New York, USA."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CAIDCD.2006.329389"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-31534-3_2"},{"key":"e_1_2_2_40_1","unstructured":"Malgorzata Mochol Radoslaw Oldakowski and Ralf Heese. 2004. Ontology based Recruitment Process.. In GI Jahrestagung (2). 198--202."},{"key":"e_1_2_2_41_1","volume-title":"3rd workshop on positioning, navigation and communication. 209--218","author":"Modsching Marko","year":"2006","unstructured":"Marko Modsching, Ronny Kramer, and Klaus ten Hagen. 2006. Field trial on GPS Accuracy in a medium size city: The influence of built-up. In 3rd workshop on positioning, navigation and communication. 209--218."},{"key":"e_1_2_2_42_1","volume-title":"Proceedings of the 6th","author":"Rajam\u00e4ki J","year":"2007","unstructured":"J Rajam\u00e4ki, P Viinikainen, and J Tuomisto. 2007. LaureaPOP indoor navigation service for the visually impaired in a WLAN environment. In Proceedings of the 6th"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.5555\/977406.978696"},{"key":"e_1_2_2_44_1","first-page":"44","article-title":"Factors associated with assistive technology discontinuance among individuals with disabilities","volume":"66","author":"Riemer-Reiss Marti L","year":"2000","unstructured":"Marti L Riemer-Reiss and Robbyn R Wacker. 2000. Factors associated with assistive technology discontinuance among individuals with disabilities. Journal of Rehabilitation 66, 3 (2000), 44.","journal-title":"Journal of Rehabilitation"},{"key":"e_1_2_2_45_1","volume-title":"Crowdphysics: Planned and opportunistic crowdsourcing for physical tasks. SEA","author":"Sadilek Adam","year":"2013","unstructured":"Adam Sadilek, John Krumm, and Eric Horvitz. 2013. Crowdphysics: Planned and opportunistic crowdsourcing for physical tasks. SEA (2013)."},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/VR.2007.352465"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132525.3132535"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819985"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2576875"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/1639642.1639677"},{"key":"e_1_2_2_51_1","volume-title":"Retrieved","year":"2016","unstructured":"TaskRabbit. 2016. TaskRabbit connects you to safe and reliable help in your neighborhood. Website. (20 September 2016). Retrieved September 20, 2016 from https:\/\/www.taskrabbit.com\/."},{"key":"e_1_2_2_52_1","volume-title":"The motivations and experiences of the on-demand mobile workforce. ACM","author":"Teodoro Rannie","unstructured":"Rannie Teodoro, Pinar Ozturk, Mor Naaman, Winter Mason, and Janne Lindqvist. 2014. The motivations and experiences of the on-demand mobile workforce. ACM, New York, New York, USA."},{"key":"e_1_2_2_53_1","unstructured":"D W Tuttle and N R Tuttle. 2004. Self-esteem and adjusting with blindness: The process of responding to life's demands."},{"key":"e_1_2_2_54_1","volume-title":"Games with a purpose. Computer","author":"Ahn Luis Von","year":"2006","unstructured":"Luis Von Ahn. 2006. Games with a purpose. Computer (2006)."},{"key":"e_1_2_2_55_1","volume-title":"Foundations of orientation and mobility","author":"Wiener William R","unstructured":"William R Wiener, Richard L Welsh, and Bruce B Blasch. 2010. Foundations of orientation and mobility. American Foundation for the Blind."},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2005.46"},{"key":"e_1_2_2_57_1","volume-title":"Peter Kinnaird, Shelly Diane Farnham, and Patrick Minder.","author":"Zhang Haoqi","year":"2014","unstructured":"Haoqi Zhang, Andr\u00e9s Monroy-Hern\u00e1ndez, Aaron D Shaw, Sean A Munson, Elizabeth M Gerber, Benjamin Mako Hill, Peter Kinnaird, Shelly Diane Farnham, and Patrick Minder. 2014. WeDo: End-To-End Computer Supported Collective Action.. In ICWSM."}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3191741","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3191741","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3191741","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:26:42Z","timestamp":1750213602000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3191741"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,3,26]]},"references-count":57,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2018,3,26]]}},"alternative-id":["10.1145\/3191741"],"URL":"https:\/\/doi.org\/10.1145\/3191741","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,3,26]]},"assertion":[{"value":"2017-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-01-01","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-03-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}