{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,1]],"date-time":"2025-11-01T13:52:15Z","timestamp":1762005135164,"version":"3.41.0"},"reference-count":58,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW","license":[{"start":{"date-parts":[[2019,11,7]],"date-time":"2019-11-07T00:00:00Z","timestamp":1573084800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2019,11,7]]},"abstract":"<jats:p>The Walk Score is a patented algorithm for measuring the walkability of a given geographic area. In addition to its use in real estate, the accompanying API is used in a range of research in public health and urban development. This study explores how neighborhood residents differently understand the notion of walkability as well as the extent to which their personal definitions of neighborhood walkability are reflected in the Walk Score's underlying algorithm. We find that, while the Walk Score generally aligns with residents' priorities around walkability, significant subjective aspects that influence walking behavior are not reflected in the score, raising the need to consider implications for using algorithmic tools like the Walk Score in certain research contexts. We discuss the challenge of measuring subjective experience and how designers might begin to address it. We call for qualitative evaluations of algorithmic tools to help determine appropriate contexts of use.<\/jats:p>","DOI":"10.1145\/3359228","type":"journal-article","created":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T13:40:21Z","timestamp":1573220421000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Whose Walkability?"],"prefix":"10.1145","volume":"3","author":[{"given":"Mark","family":"Diaz","sequence":"first","affiliation":[{"name":"Northwestern University, Evanston, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicholas","family":"Diakopoulos","sequence":"additional","affiliation":[{"name":"Northwestern University, Evanston, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,11,7]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173860"},{"key":"e_1_2_1_2_1","volume-title":"Crowdsourcing Subjective Tasks: The Case Study of Understanding Toxicity in Online Discussions. In Companion Proceedings of The 2019 World Wide Web Conference (WWW '19)","author":"Aroyo Lora","year":"2019","unstructured":"Lora Aroyo , Lucas Dixon , Nithum Thain , Olivia Redfield , and Rachel Rosen . 2019 . Crowdsourcing Subjective Tasks: The Case Study of Understanding Toxicity in Online Discussions. In Companion Proceedings of The 2019 World Wide Web Conference (WWW '19) . ACM, New York, NY, USA, 1100--1105. https:\/\/doi.org\/10.1145\/3308560.3317083 Lora Aroyo, Lucas Dixon, Nithum Thain, Olivia Redfield, and Rachel Rosen. 2019. Crowdsourcing Subjective Tasks: The Case Study of Understanding Toxicity in Online Discussions. In Companion Proceedings of The 2019 World Wide Web Conference (WWW '19). ACM, New York, NY, USA, 1100--1105. https:\/\/doi.org\/10.1145\/3308560.3317083"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ccs.2018.08.002"},{"key":"e_1_2_1_4_1","volume-title":"Want to be on the top? Algorithmic power and the threat of invisibility on Facebook. New media & society","author":"Bucher Taina","year":"2012","unstructured":"Taina Bucher . 2012. Want to be on the top? Algorithmic power and the threat of invisibility on Facebook. New media & society , Vol. 14 , 7 ( 2012 ), 1164--1180. Taina Bucher. 2012. Want to be on the top? Algorithmic power and the threat of invisibility on Facebook. New media & society, Vol. 14, 7 (2012), 1164--1180."},{"key":"e_1_2_1_5_1","volume-title":"Science","volume":"356","author":"Caliskan Aylin","year":"2017","unstructured":"Aylin Caliskan , Joanna J Bryson , and Arvind Narayanan . 2017 . Semantics derived automatically from language corpora contain human-like biases . Science , Vol. 356 , 6334 (2017), 183--186. Aylin Caliskan, Joanna J Bryson, and Arvind Narayanan. 2017. Semantics derived automatically from language corpora contain human-like biases. Science, Vol. 356, 6334 (2017), 183--186."},{"key":"e_1_2_1_6_1","volume-title":"Walk score? as a global estimate of neighborhood walkability. American journal of preventive medicine","author":"Carr Lucas J","year":"2010","unstructured":"Lucas J Carr , Shira I Dunsiger , and Bess H Marcus . 2010. Walk score? as a global estimate of neighborhood walkability. American journal of preventive medicine , Vol. 39 , 5 ( 2010 ), 460--463. Lucas J Carr, Shira I Dunsiger, and Bess H Marcus. 2010. Walk score? as a global estimate of neighborhood walkability. American journal of preventive medicine, Vol. 39, 5 (2010), 460--463."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1136\/bjsm.2009.069609"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300510"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1080\/21670811.2014.976411"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173986"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1037\/xge0000033"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3278721.3278729"},{"key":"e_1_2_1_14_1","volume-title":"Online harassment","author":"Duggan Maeve","year":"2017","unstructured":"Maeve Duggan . 2017. Online harassment 2017 . (2017). Maeve Duggan. 2017. Online harassment 2017. (2017)."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.3390\/ijerph8114160"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2685553.2702690"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0003975609000150"},{"volume-title":"Automating inequality: How high-tech tools profile, police, and punish the poor","author":"Eubanks Virginia","key":"e_1_2_1_18_1","unstructured":"Virginia Eubanks . 2018. Automating inequality: How high-tech tools profile, police, and punish the poor . St. Martin's Press . Virginia Eubanks. 2018. Automating inequality: How high-tech tools profile, police, and punish the poor .St. Martin's Press."},{"volume-title":"Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18)","author":"Fox Sarah E.","key":"e_1_2_1_19_1","unstructured":"Sarah E. Fox , Meredith Lampe , and Daniela K. Rosner . 2018. Parody in Place: Exposing Socio-spatial Exclusions in Data-Driven Maps with Design Parody . In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18) . ACM, New York, NY, USA, Article 322, 13 pages. https:\/\/doi.org\/10.1145\/3173574.3173896 Sarah E. Fox, Meredith Lampe, and Daniela K. Rosner. 2018. Parody in Place: Exposing Socio-spatial Exclusions in Data-Driven Maps with Design Parody. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 322, 13 pages. https:\/\/doi.org\/10.1145\/3173574.3173896"},{"volume-title":"Human values and the design of computer technology. Number 72","author":"Friedman Batya","key":"e_1_2_1_20_1","unstructured":"Batya Friedman . 1997. Human values and the design of computer technology. Number 72 . Cambridge University Press . Batya Friedman. 1997. Human values and the design of computer technology. Number 72. Cambridge University Press."},{"key":"e_1_2_1_21_1","unstructured":"Batya Friedman Peter Kahn and Alan Borning. 2002. Value sensitive design: Theory and methods. University of Washington technical report 02--12 (2002). Batya Friedman Peter Kahn and Alan Borning. 2002. Value sensitive design: Theory and methods. University of Washington technical report 02--12 (2002)."},{"key":"e_1_2_1_22_1","volume-title":"Value sensitive design and information systems. The handbook of information and computer ethics","author":"Friedman Batya","year":"2008","unstructured":"Batya Friedman , Peter H Kahn , and Alan Borning . 2008. Value sensitive design and information systems. The handbook of information and computer ethics ( 2008 ), 69--101. Batya Friedman, Peter H Kahn, and Alan Borning. 2008. Value sensitive design and information systems. The handbook of information and computer ethics (2008), 69--101."},{"key":"e_1_2_1_23_1","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/9780262525374.001.0001","volume-title":"The relevance of algorithms. Media technologies: Essays on communication, materiality, and society","author":"Gillespie Tarleton","year":"2014","unstructured":"Tarleton Gillespie . 2014. The relevance of algorithms. Media technologies: Essays on communication, materiality, and society , Vol. 167 ( 2014 ). Tarleton Gillespie. 2014. The relevance of algorithms. Media technologies: Essays on communication, materiality, and society, Vol. 167 (2014)."},{"volume-title":"Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18)","author":"Hamidi Foad","key":"e_1_2_1_24_1","unstructured":"Foad Hamidi , Morgan Klaus Scheuerman , and Stacy M. Branham . 2018. Gender Recognition or Gender Reductionism?: The Social Implications of Embedded Gender Recognition Systems . In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18) . ACM, New York, NY, USA, Article 8, 13 pages. https:\/\/doi.org\/10.1145\/3173574.3173582 Foad Hamidi, Morgan Klaus Scheuerman, and Stacy M. Branham. 2018. Gender Recognition or Gender Reductionism?: The Social Implications of Embedded Gender Recognition Systems. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 8, 13 pages. https:\/\/doi.org\/10.1145\/3173574.3173582"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2850440.2850442"},{"key":"e_1_2_1_26_1","volume-title":"Talking about pictures: A case for photo elicitation. Visual studies","author":"Harper Douglas","year":"2002","unstructured":"Douglas Harper . 2002. Talking about pictures: A case for photo elicitation. Visual studies , Vol. 17 , 1 ( 2002 ), 13--26. Douglas Harper. 2002. Talking about pictures: A case for photo elicitation. Visual studies, Vol. 17, 1 (2002), 13--26."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.landurbplan.2015.05.007"},{"key":"e_1_2_1_28_1","volume-title":"Walk Score\u00ae and Transit Score\u00ae and walking in the multi-ethnic study of atherosclerosis. American journal of preventive medicine","author":"Hirsch Jana A","year":"2013","unstructured":"Jana A Hirsch , Kari A Moore , Kelly R Evenson , Daniel A Rodriguez , and Ana V Diez Roux . 2013. Walk Score\u00ae and Transit Score\u00ae and walking in the multi-ethnic study of atherosclerosis. American journal of preventive medicine , Vol. 45 , 2 ( 2013 ), 158--166. Jana A Hirsch, Kari A Moore, Kelly R Evenson, Daniel A Rodriguez, and Ana V Diez Roux. 2013. Walk Score\u00ae and Transit Score\u00ae and walking in the multi-ethnic study of atherosclerosis. American journal of preventive medicine, Vol. 45, 2 (2013), 158--166."},{"key":"e_1_2_1_29_1","volume-title":"The influence of walkability on broader mobility for Canadian middle aged and older adults: An examination of Walk Score? and the Mobility Over Varied Environments Scale (MOVES). Preventive medicine","author":"Hirsch Jana A","year":"2017","unstructured":"Jana A Hirsch , Meghan Winters , Philippa J Clarke , Nathalie Ste-Marie , and Heather A McKay . 2017. The influence of walkability on broader mobility for Canadian middle aged and older adults: An examination of Walk Score? and the Mobility Over Varied Environments Scale (MOVES). Preventive medicine , Vol. 95 ( 2017 ), S60--S67. Jana A Hirsch, Meghan Winters, Philippa J Clarke, Nathalie Ste-Marie, and Heather A McKay. 2017. The influence of walkability on broader mobility for Canadian middle aged and older adults: An examination of Walk Score? and the Mobility Over Varied Environments Scale (MOVES). Preventive medicine, Vol. 95 (2017), S60--S67."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1177\/0263276405051666"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274357"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858402"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.4159\/9780674039681"},{"key":"e_1_2_1_35_1","first-page":"3","article-title":"Is there an ethics of algorithms","volume":"13","author":"Kraemer Felicitas","year":"2010","unstructured":"Felicitas Kraemer , Kees van Overveld , and Martin Peterson . 2010 . Is there an ethics of algorithms ? Ethics and Information Technology , Vol. 13 , 3 (July 2010), 251--260. Felicitas Kraemer, Kees van Overveld, and Martin Peterson. 2010. Is there an ethics of algorithms? Ethics and Information Technology, Vol. 13, 3 (July 2010), 251--260.","journal-title":"Ethics and Information Technology"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998321"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518875"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3234695.3241000"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/HICSS.2015.95"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2851581.2886426"},{"key":"e_1_2_1_41_1","volume-title":"Validating walkability indices: How do different households respond to the walkability of their neighborhood? Transportation research part D: transport and environment","author":"Manaugh Kevin","year":"2011","unstructured":"Kevin Manaugh and Ahmed El-Geneidy . 2011. Validating walkability indices: How do different households respond to the walkability of their neighborhood? Transportation research part D: transport and environment , Vol. 16 , 4 ( 2011 ), 309--315. Kevin Manaugh and Ahmed El-Geneidy. 2011. Validating walkability indices: How do different households respond to the walkability of their neighborhood? Transportation research part D: transport and environment, Vol. 16, 4 (2011), 309--315."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287596"},{"key":"e_1_2_1_43_1","volume-title":"The ethics of algorithms: Mapping the debate","author":"Mittelstadt Brent Daniel","year":"2016","unstructured":"Brent Daniel Mittelstadt , Patrick Allo , Mariarosaria Taddeo , Sandra Wachter , and Luciano Floridi . 2016. The ethics of algorithms: Mapping the debate . Big Data and Society , Vol . 3, 2 ( 2016 ). Brent Daniel Mittelstadt, Patrick Allo, Mariarosaria Taddeo, Sandra Wachter, and Luciano Floridi. 2016. The ethics of algorithms: Mapping the debate. Big Data and Society, Vol. 3, 2 (2016)."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.5555\/619061.621683"},{"volume-title":"Algorithms of oppression: How search engines reinforce racism","author":"Noble Safiya Umoja","key":"e_1_2_1_45_1","unstructured":"Safiya Umoja Noble . 2018. Algorithms of oppression: How search engines reinforce racism . NYU Press . Safiya Umoja Noble. 2018. Algorithms of oppression: How search engines reinforce racism .NYU Press."},{"volume-title":"Weapons of math destruction: How big data increases inequality and threatens democracy","author":"O'Neil Cathy","key":"e_1_2_1_46_1","unstructured":"Cathy O'Neil . 2017. Weapons of math destruction: How big data increases inequality and threatens democracy . Broadway Books . Cathy O'Neil. 2017. Weapons of math destruction: How big data increases inequality and threatens democracy .Broadway Books."},{"key":"e_1_2_1_47_1","unstructured":"Michael Prescott. 2014. Using Social Topography to Understand the Active Mobility Networks (AMNs) of People with Disabilities (PWDs). http:\/\/hdl.handle.net\/10012\/8250 Michael Prescott. 2014. Using Social Topography to Understand the Active Mobility Networks (AMNs) of People with Disabilities (PWDs). http:\/\/hdl.handle.net\/10012\/8250"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2145204.2145350"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173677"},{"key":"e_1_2_1_50_1","volume-title":"Civic Tech: Making Technology Work for People.","author":"Schrock Andrew","year":"2018","unstructured":"Andrew Schrock . 2018 . Civic Tech: Making Technology Work for People. Andrew Schrock. 2018. Civic Tech: Making Technology Work for People."},{"key":"e_1_2_1_51_1","volume-title":"Accessed April","volume":"24","author":"Score Walk","year":"2014","unstructured":"Walk Score . 2014 . Walk score methodology . Accessed April , Vol. 24 (2014). Walk Score. 2014. Walk score methodology. Accessed April, Vol. 24 (2014)."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531625"},{"volume-title":"Basics of qualitative research: Grounded theory procedures and techniques","author":"Strauss A","key":"e_1_2_1_53_1","unstructured":"A Strauss and J M Corbin . 1990. Basics of qualitative research: Grounded theory procedures and techniques . Sage Publications, Inc. A Strauss and J M Corbin. 1990. Basics of qualitative research: Grounded theory procedures and techniques. Sage Publications, Inc."},{"key":"e_1_2_1_54_1","volume-title":"A cross-sectional survey of the relationship between walking, biking, and the built environment for adults aged over 70 years. Risk management and healthcare policy","author":"Takahashi Paul Y","year":"2012","unstructured":"Paul Y Takahashi , Mitzi A Baker , Stephan Cha , and Paul V Targonski . 2012. A cross-sectional survey of the relationship between walking, biking, and the built environment for adults aged over 70 years. Risk management and healthcare policy , Vol. 5 ( 2012 ), 35. Paul Y Takahashi, Mitzi A Baker, Stephan Cha, and Paul V Targonski. 2012. A cross-sectional survey of the relationship between walking, biking, and the built environment for adults aged over 70 years. Risk management and healthcare policy, Vol. 5 (2012), 35."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3058499"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10900-016-0180-z"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2851581.2886436"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-5618"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858445"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174230"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3359228","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3359228","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:12:54Z","timestamp":1750201974000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3359228"}},"subtitle":["Challenges in Algorithmically Measuring Subjective Experience"],"short-title":[],"issued":{"date-parts":[[2019,11,7]]},"references-count":58,"journal-issue":{"issue":"CSCW","published-print":{"date-parts":[[2019,11,7]]}},"alternative-id":["10.1145\/3359228"],"URL":"https:\/\/doi.org\/10.1145\/3359228","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2019,11,7]]},"assertion":[{"value":"2019-11-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}