{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,13]],"date-time":"2026-07-13T15:27:19Z","timestamp":1783956439407,"version":"3.55.0"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,8,12]],"date-time":"2020-08-12T00:00:00Z","timestamp":1597190400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,8,12]],"date-time":"2020-08-12T00:00:00Z","timestamp":1597190400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000054","name":"National Cancer Institute","doi-asserted-by":"publisher","award":["R21 CA188481"],"award-info":[{"award-number":["R21 CA188481"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000054","name":"National Cancer Institute","doi-asserted-by":"publisher","award":["R01 CA164137"],"award-info":[{"award-number":["R01 CA164137"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Eunice Kennedy Shriver National Institute of Child Health and Human Development","award":["F31HD098870"],"award-info":[{"award-number":["F31HD098870"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Health Geogr"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n<jats:title>Background<\/jats:title>\n<jats:p>Although previous research has highlighted the association between the built environment and individual health, methodological challenges in assessing the built environment remain. In particular, many researchers have demonstrated the high inter-rater reliability of assessing large or objective built environment features and the low inter-rater reliability of assessing small or subjective built environment features using Google Street View. New methods for auditing the built environment must be evaluated to understand if there are alternative tools through which researchers can assess all types of built environment features with high agreement. This paper investigates measures of inter-rater reliability of GigaPan\u00ae, a tool that assists with capturing high-definition panoramic images, relative to Google Street View.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Methods<\/jats:title>\n<jats:p>Street segments (n\u2009=\u2009614) in Pittsburgh, Pennsylvania in the United States were randomly selected to audit using GigaPan\u00ae and Google Street View. Each audit assessed features related to land use, traffic and safety, and public amenities. Inter-rater reliability statistics, including percent agreement, Cohen\u2019s kappa, and the prevalence-adjusted bias-adjusted kappa (PABAK) were calculated for 106 street segments that were coded by two, different, human auditors.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Results<\/jats:title>\n<jats:p>Most large-scale, objective features (e.g. bus stop presence or stop sign presence) demonstrated at least substantial inter-rater reliability for both methods, but significant differences emerged across finely detailed features (e.g. trash) and features at segment endpoints (e.g. sidewalk continuity). After adjusting for the effects of bias and prevalence, the inter-rater reliability estimates were consistently higher for almost all built environment features across GigaPan\u00ae and Google Street View.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Conclusion<\/jats:title>\n<jats:p>GigaPan\u00ae is a reliable, alternative audit tool to Google Street View for studying the built environment. GigaPan\u00ae may be particularly well-suited for built environment projects with study settings in areas where Google Street View imagery is nonexistent or updated infrequently. The potential for enhanced, detailed imagery using GigaPan\u00ae will be most beneficial in studies in which current, time sensitive data are needed or microscale built environment features would be challenging to see in Google Street View. Furthermore, to better understand the effects of prevalence and bias in future reliability studies, researchers should consider using PABAK to supplement or expand upon Cohen\u2019s kappa findings.<\/jats:p>\n<\/jats:sec>","DOI":"10.1186\/s12942-020-00226-0","type":"journal-article","created":{"date-parts":[[2020,8,12]],"date-time":"2020-08-12T08:03:57Z","timestamp":1597219437000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Virtual audits of the urban streetscape: comparing the inter-rater reliability of GigaPan\u00ae to Google Street View"],"prefix":"10.1186","volume":"19","author":[{"given":"Katherine N.","family":"Bromm","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ian-Marshall","family":"Lang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Erica E.","family":"Twardzik","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cathy L.","family":"Antonakos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tamara","family":"Dubowitz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7951-9475","authenticated-orcid":false,"given":"Natalie","family":"Colabianchi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,8,12]]},"reference":[{"issue":"1","key":"226_CR1","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1111\/obr.12759","volume":"20","author":"M Chandrabose","year":"2019","unstructured":"Chandrabose M, Rachele JN, Gunn L, Kavanagh A, Owen N, Turrell G, et al. Built environment and cardio-metabolic health: systematic review and meta-analysis of longitudinal studies. Obes Rev. 2019;20(1):41\u2013544.","journal-title":"Obes Rev"},{"issue":"9","key":"226_CR2","doi-asserted-by":"publisher","first-page":"1546","DOI":"10.2105\/AJPH.93.9.1546","volume":"93","author":"KM Leyden","year":"2003","unstructured":"Leyden KM. Social capital and the built environment: the importance of walkable neighborhoods. Am J Public Health. 2003;93(9):1546\u201351.","journal-title":"Am J Public Health"},{"key":"226_CR3","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1016\/j.envint.2016.08.019","volume":"96","author":"Y Gong","year":"2016","unstructured":"Gong Y, Palmer S, Gallacher J, Marsden T, Fone D. A systematic review of the relationship between objective measurements of the urban environment and psychological distress. Environ Int. 2016;96:48\u201357.","journal-title":"Environ Int"},{"issue":"4 Suppl","key":"226_CR4","doi-asserted-by":"publisher","first-page":"S99","DOI":"10.1016\/j.amepre.2009.01.005","volume":"36","author":"RC Brownson","year":"2009","unstructured":"Brownson RC, Hoehner CM, Day K, Forsyth A, Sallis JF. Measuring the built environment for physical activity: state of the science. Am J Prev Med. 2009;36(4 Suppl):S99\u2013123.e12.","journal-title":"Am J Prev Med"},{"issue":"6","key":"226_CR5","doi-asserted-by":"publisher","first-page":"1274","DOI":"10.1016\/j.healthplace.2011.02.006","volume":"17","author":"JF Sallis","year":"2011","unstructured":"Sallis JF, Slymen DJ, Conway TL, Frank LD, Saelens BE, Cain K, et al. Income disparities in perceived neighborhood built and social environment attributes. Health Place. 2011;17(6):1274\u201383.","journal-title":"Health Place"},{"issue":"6","key":"226_CR6","doi-asserted-by":"publisher","first-page":"1224","DOI":"10.1016\/j.healthplace.2010.08.007","volume":"16","author":"P Clarke","year":"2010","unstructured":"Clarke P, Ailshire J, Melendez R, Bader M, Morenoff J. Using Google Earth to conduct a neighborhood audit: reliability of a virtual audit instrument. Health Place. 2010;16(6):1224\u20139.","journal-title":"Health Place"},{"key":"226_CR7","doi-asserted-by":"publisher","first-page":"138","DOI":"10.1016\/j.healthplace.2012.11.001","volume":"19","author":"E Ben-Joseph","year":"2013","unstructured":"Ben-Joseph E, Lee JS, Cromley EK, Laden F, Troped PJ. Virtual and actual: relative accuracy of on-site and web-based instruments in auditing the environment for physical activity. Health Place. 2013;19:138\u201350.","journal-title":"Health Place"},{"issue":"2","key":"226_CR8","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1016\/j.amepre.2010.10.024","volume":"40","author":"BT Taylor","year":"2011","unstructured":"Taylor BT, Fernando P, Bauman AE, Williamson A, Craig JC, Redman S. Measuring the quality of public open space using Google Earth. Am J Prev Med. 2011;40(2):105\u201312.","journal-title":"Am J Prev Med"},{"key":"226_CR9","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1016\/j.apgeog.2016.09.024","volume":"76","author":"L Yin","year":"2016","unstructured":"Yin L, Wang Z. Measuring visual enclosure for street walkability: using machine learning algorithms and Google Street View imagery. Appl Geogr. 2016;76:147\u201353.","journal-title":"Appl Geogr"},{"key":"226_CR10","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1016\/j.buildenv.2018.02.042","volume":"134","author":"F-Y Gong","year":"2018","unstructured":"Gong F-Y, Zeng Z-C, Zhang F, Li X, Ng E, Norford LK. Mapping sky, tree, and building view factors of street canyons in a high-density urban environment. Build Environ. 2018;134:155\u201367.","journal-title":"Build Environ"},{"key":"226_CR11","doi-asserted-by":"publisher","first-page":"288","DOI":"10.1016\/j.compenvurbsys.2017.04.001","volume":"64","author":"L Yin","year":"2017","unstructured":"Yin L. Street level urban design qualities for walkability: combining 2D and 3D GIS measures. Comput Environ Urban Syst. 2017;64:288\u201396.","journal-title":"Comput Environ Urban Syst"},{"key":"226_CR12","doi-asserted-by":"publisher","first-page":"240","DOI":"10.1016\/j.healthplace.2018.07.001","volume":"52","author":"A Rzotkiewicz","year":"2018","unstructured":"Rzotkiewicz A, Pearson AL, Dougherty BV, Shortridge A, Wilson N. Systematic review of the use of Google Street View in health research: major themes, strengths, weaknesses and possibilities for future research. Health Place. 2018;52:240\u20136.","journal-title":"Health Place"},{"issue":"1","key":"226_CR13","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1186\/1476-072X-12-53","volume":"12","author":"JW Curtis","year":"2013","unstructured":"Curtis JW, Curtis A, Mapes J, Szell AB, Cinderich A. Using Google Street View for systematic observation of the built environment: analysis of spatio-temporal instability of imagery dates. Int J Health Geogr. 2013;12(1):53.","journal-title":"Int J Health Geogr"},{"issue":"2","key":"226_CR14","doi-asserted-by":"publisher","first-page":"268","DOI":"10.1016\/j.actaastro.2012.01.002","volume":"90","author":"SY Lee","year":"2013","unstructured":"Lee SY, Lees D, Cohen T, Allan M, Deans M, Morse T, et al. Reusable science tools for analog exploration missions: xGDS web tools, VERVE, and Gigapan\u00ae voyage. Acta Astronaut. 2013;90(2):268\u201388.","journal-title":"Acta Astronaut"},{"issue":"6","key":"226_CR15","doi-asserted-by":"publisher","first-page":"579","DOI":"10.2111\/.1\/REM-D-09-00017.1","volume":"62","author":"MH Nichols","year":"2009","unstructured":"Nichols MH, Ruyle GB, Nourbakhsh IR. Very-high-resolution panoramic photography to improve conventional rangeland monitoring. Rangel Ecol Manag. 2009;62(6):579\u201382.","journal-title":"Rangel Ecol Manag"},{"issue":"8","key":"226_CR16","doi-asserted-by":"publisher","first-page":"720","DOI":"10.1111\/j.1600-0587.2013.00631.x","volume":"37","author":"MA Smith","year":"2014","unstructured":"Smith MA, Hallwachs W, Janzen DH. Diversity and phylogenetic community structure of ants along a costa rican elevational gradient. Ecography. 2014;37(8):720\u201331.","journal-title":"Ecography"},{"key":"226_CR17","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1016\/j.pmedr.2019.01.011","volume":"13","author":"DS Nelson","year":"2019","unstructured":"Nelson DS, Nezich T, Antonakos CL, Dubowitz T, Clarke P, Colabianchi N. Reliability and validity of environmental audits using GigaPan\u00ae technology in parks. Prev Med Rep. 2019;13:293\u20137.","journal-title":"Prev Med Rep"},{"issue":"1","key":"226_CR18","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1186\/s12942-018-0147-7","volume":"17","author":"E Twardzik","year":"2018","unstructured":"Twardzik E, Antonakos C, Baiers R, Dubowitz T, Clarke P, Colabianchi N. Validity of environmental audits using GigaPan\u00ae and Google Earth technology. Int J Health Geogr. 2018;17(1):26.","journal-title":"Int J Health Geogr"},{"issue":"1 Suppl","key":"226_CR19","doi-asserted-by":"publisher","first-page":"87S","DOI":"10.1177\/1090198115570048","volume":"42","author":"T Dubowitz","year":"2015","unstructured":"Dubowitz T, Ncube C, Leuschner K, Tharp-Gilliam S. A natural experiment opportunity in two low-income urban food desert communities: research design, community engagement methods, and baseline results. Health Educ Behav. 2015;42(1 Suppl):87S\u201396S.","journal-title":"Health Educ Behav"},{"key":"226_CR20","unstructured":"GigaPan\u00ae. Gigapans. 2020. https:\/\/gigapan.com\/gigapans. Accessed 4 Aug 2020."},{"key":"226_CR21","unstructured":"Google. Street view. 2017. https:\/\/goo.gl\/maps\/guTdwAQ2yCjEu2oZ7. Accessed 4 Aug 2020."},{"key":"226_CR22","unstructured":"Bridging the Gap Community Obesity Measures Project. Street segment observation form. 2012. https:\/\/www.bridgingthegapresearch.org\/_asset\/xp3b0f\/BTGCOMP_StreetSegment_2012.pdf. Accessed 4 Aug 2020."},{"key":"226_CR23","doi-asserted-by":"publisher","first-page":"421","DOI":"10.1002\/9781118594629.ch16","volume-title":"Health survey methods","author":"SN Zenk","year":"2014","unstructured":"Zenk SN, Slater S, Rashid S. Collecting contextual health survey data using systematic observation. In: Johnson TP, editor. Health survey methods. Hoboken: John Wiley & Sons Inc; 2014. p. 421\u2013445."},{"issue":"5","key":"226_CR24","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1016\/0895-4356(93)90018-V","volume":"46","author":"T Byrt","year":"1993","unstructured":"Byrt T, Bishop J, Carlin JB. Bias, prevalence and kappa. J Clin Epidemiol. 1993;46(5):423\u20139.","journal-title":"J Clin Epidemiol"},{"issue":"6","key":"226_CR25","doi-asserted-by":"publisher","first-page":"543","DOI":"10.1016\/0895-4356(90)90158-L","volume":"43","author":"AR Feinstein","year":"1990","unstructured":"Feinstein AR, Cicchetti DV. High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol. 1990;43(6):543\u20139.","journal-title":"J Clin Epidemiol."},{"key":"226_CR26","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1186\/1471-2288-9-5","volume":"9","author":"G Chen","year":"2009","unstructured":"Chen G, Faris P, Hemmelgarn B, Walker RL, Quan H. Measuring agreement of administrative data with chart data using prevalence unadjusted and adjusted kappa. BMC Med Res Methodol. 2009;9:5.","journal-title":"BMC Med Res Methodol"},{"issue":"3","key":"226_CR27","doi-asserted-by":"publisher","first-page":"276","DOI":"10.11613\/BM.2012.031","volume":"22","author":"ML McHugh","year":"2012","unstructured":"McHugh ML. Interrater reliability: the kappa statistic. Biochem Med. 2012;22(3):276\u201382.","journal-title":"Biochem Med"},{"issue":"1","key":"226_CR28","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1177\/001316446002000104","volume":"20","author":"J Cohen","year":"1960","unstructured":"Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Measur. 1960;20(1):37\u201346.","journal-title":"Educ Psychol Measur"},{"issue":"1","key":"226_CR29","doi-asserted-by":"publisher","first-page":"159","DOI":"10.2307\/2529310","volume":"33","author":"JR Landis","year":"1977","unstructured":"Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159\u201374.","journal-title":"Biometrics"},{"issue":"3","key":"226_CR30","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1093\/ptj\/85.3.257","volume":"85","author":"J Sim","year":"2005","unstructured":"Sim J, Wright CC. The kappa statistic in reliability studies: use, interpretation, and sample size requirements. Phys Ther. 2005;85(3):257\u201368.","journal-title":"Phys Ther"},{"issue":"4","key":"226_CR31","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1177\/1090198104265598","volume":"31","author":"A Schulz","year":"2004","unstructured":"Schulz A, Northridge ME. Social determinants of health: implications for environmental health promotion. Health Educ Behav. 2004;31(4):455\u201371.","journal-title":"Health Educ Behav"},{"issue":"6","key":"226_CR32","doi-asserted-by":"publisher","first-page":"686","DOI":"10.5993\/AJHB.33.6.6","volume":"33","author":"KC Hergenrather","year":"2009","unstructured":"Hergenrather KC, Rhodes SD, Cowan CA, Bardhoshi G, Pula S. Photovoice as community-based participatory research: a qualitative review. Am J Health Behav. 2009;33(6):686\u201398.","journal-title":"Am J Health Behav"},{"issue":"5","key":"226_CR33","doi-asserted-by":"publisher","first-page":"1126","DOI":"10.1007\/s10903-015-0241-x","volume":"18","author":"SJ Winter","year":"2016","unstructured":"Winter SJ, Goldman Rosas L, Padilla Romero P, Sheats JL, Buman MP, Baker C, et al. Using citizen scientists to gather, analyze, and disseminate information about neighborhood features that affect active living. J Immigr Minor Health. 2016;18(5):1126\u201338.","journal-title":"J Immigr Minor Health"},{"key":"226_CR34","doi-asserted-by":"publisher","first-page":"115","DOI":"10.3897\/zookeys.209.3083","volume":"209","author":"MA Bertone","year":"2012","unstructured":"Bertone MA, Blinn RL, Stanfield TM, Dew KJ, Seltmann KC, Deans AR. Results and insights from the NCSU insect museum GigaPan\u00ae project. Zookeys. 2012;209:115\u201332.","journal-title":"Zookeys"},{"key":"226_CR35","doi-asserted-by":"publisher","first-page":"340","DOI":"10.1016\/j.enbuild.2014.10.001","volume":"86","author":"R Carrasco-Hernandez","year":"2015","unstructured":"Carrasco-Hernandez R, Smedley ARD, Webb AR. Using urban canyon geometries obtained from Google Street View for atmospheric studies: potential applications in the calculation of street level total shortwave irradiances. Energy Build. 2015;86:340\u20138.","journal-title":"Energy Build"},{"key":"226_CR36","doi-asserted-by":"publisher","first-page":"547","DOI":"10.1016\/j.buildenv.2018.10.025","volume":"148","author":"F-Y Gong","year":"2019","unstructured":"Gong F-Y, Zeng Z-C, Ng E, Norford LK. Spatiotemporal patterns of street-level solar radiation estimated using Google Street View in a high-density urban environment. Build Environ. 2019;148:547\u201366.","journal-title":"Build Environ"},{"issue":"50","key":"226_CR37","doi-asserted-by":"publisher","first-page":"13108","DOI":"10.1073\/pnas.1700035114","volume":"114","author":"T Gebru","year":"2017","unstructured":"Gebru T, Krause J, Wang Y, Chen D, Deng J, Aiden EL, et al. Using deep learning and Google Street View to estimate the demographic makeup of neighborhoods across the United States. Proc Natl Acad Sci. 2017;114(50):13108.","journal-title":"Proc Natl Acad Sci"},{"issue":"12","key":"226_CR38","doi-asserted-by":"publisher","first-page":"6999","DOI":"10.1021\/acs.est.7b00891","volume":"51","author":"JS Apte","year":"2017","unstructured":"Apte JS, Messier KP, Gani S, Brauer M, Kirchstetter TW, Lunden MM, et al. High-resolution air pollution mapping with Google Street View cars: exploiting big data. Environ Sci Technol. 2017;51(12):6999\u20137008.","journal-title":"Environ Sci Technol"}],"container-title":["International Journal of Health Geographics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12942-020-00226-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12942-020-00226-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12942-020-00226-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,8,11]],"date-time":"2021-08-11T23:49:09Z","timestamp":1628725749000},"score":1,"resource":{"primary":{"URL":"https:\/\/ij-healthgeographics.biomedcentral.com\/articles\/10.1186\/s12942-020-00226-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,12]]},"references-count":38,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["226"],"URL":"https:\/\/doi.org\/10.1186\/s12942-020-00226-0","relation":{},"ISSN":["1476-072X"],"issn-type":[{"value":"1476-072X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,12]]},"assertion":[{"value":"27 April 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 August 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 August 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"This study was reviewed by the University of Michigan institutional review board and deemed exempt from further review.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"31"}}