{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T04:17:10Z","timestamp":1772165830594,"version":"3.50.1"},"reference-count":63,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,10,7]],"date-time":"2020-10-07T00:00:00Z","timestamp":1602028800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,10,7]],"date-time":"2020-10-07T00:00:00Z","timestamp":1602028800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000009","name":"Foundation for the National Institutes of Health","doi-asserted-by":"publisher","award":["R01CA149105"],"award-info":[{"award-number":["R01CA149105"]}],"id":[{"id":"10.13039\/100000009","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000050","name":"National Heart, Lung, and Blood Institute","doi-asserted-by":"publisher","award":["R01HL1122460"],"award-info":[{"award-number":["R01HL1122460"]}],"id":[{"id":"10.13039\/100000050","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000050","name":"National Heart, Lung, and Blood Institute","doi-asserted-by":"publisher","award":["R01HL131531"],"award-info":[{"award-number":["R01HL131531"]}],"id":[{"id":"10.13039\/100000050","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Public Health"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Improving the neighborhood environment may help address chronic disease and mortality. To identify neighborhood features that are predictors of health, objective assessments of the environment are used. Multiple studies have reported on cross-sectional assessments of health-related neighborhood features using direct observation. As study designs expand to better understand causation and predictors of change, there is a need to test whether direct observation methods are adequate for longitudinal assessment. To our knowledge, this is the first study to report on the reliability of repeated measurements of the neighborhood environment, and their stability, over time.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>The Pittsburgh Hill\/Homewood Research on Neighborhood Change and Health (PHRESH) study conducted longitudinal assessments in two low-income, African American neighborhoods at three waves (years 2012, 2015, 2017). The PHRESH audit tool is a modification of earlier validated tools, with an emphasis on environment features relevant for physical activity, sleep, and obesogenic behaviors. Trained data-collector pairs conducted direct observations of a 25% sample of street segments in each neighborhood. At each wave, we audited a sub-sample of street segments twice and assessed reliability using percentage inter-observer agreement and krippendorf\u2019s alpha statistics. Stability of these items was assessed as exhibiting moderate or high agreement at every time point.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Across waves, a majority (81%) of the items consistently demonstrated moderate to high agreement except for items such as public\/communal space, amount of shade, sidewalk features, number of traffic lanes, garden\/flower bed\/planter, art\/statue\/monument, amount of trash, and physical disorder. The list of items with poor agreement includes features that are easy to miss (e.g. flower bed\/planter), hard to assess from outside (e.g. public\/communal space), or may change quickly (e.g. amount of trash).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>In this paper, we have described implementation methods, reliability results and lessons learned to inform future studies of change. We found the use of consistent methods allowed us to conduct reliable, replicable longitudinal assessments of the environment. Items that did not exhibit stability are less useful for detecting real change over time. Overall, the PHRESH direct observation tool is an effective and practical instrument to detect change in the neighborhood environment.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12889-020-09424-8","type":"journal-article","created":{"date-parts":[[2020,10,7]],"date-time":"2020-10-07T09:03:57Z","timestamp":1602061437000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["An audit tool for longitudinal assessment of the health-related characteristics of urban neighborhoods: implementation methods and reliability results"],"prefix":"10.1186","volume":"20","author":[{"given":"Madhumita","family":"Ghosh-Dastidar","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gerald P.","family":"Hunter","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jennifer C.","family":"Sloan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rebecca L.","family":"Collins","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrea S.","family":"Richardson","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wendy","family":"Troxel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Natalie","family":"Colabianchi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tamara","family":"Dubowitz","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,10,7]]},"reference":[{"issue":"5","key":"9424_CR1","doi-asserted-by":"publisher","first-page":"1172","DOI":"10.1016\/j.healthplace.2012.05.006","volume":"18","author":"CE Caspi","year":"2012","unstructured":"Caspi CE, Sorensen G, Subramanian S, Kawachi I. The local food environment and diet: a systematic review. Health Place. 2012;18(5):1172\u201387.","journal-title":"Health Place."},{"issue":"5","key":"9424_CR2","doi-asserted-by":"publisher","first-page":"e95","DOI":"10.1111\/j.1467-789X.2010.00769.x","volume":"12","author":"K Giskes","year":"2011","unstructured":"Giskes K, van Lenthe F, Avendano-Pabon M, Brug J. A systematic review of environmental factors and obesogenic dietary intakes among adults: are we getting closer to understanding obesogenic environments? Obes Rev. 2011;12(5):e95\u2013e106.","journal-title":"Obes Rev."},{"key":"9424_CR3","first-page":"42","volume":"20","author":"S Macintyre","year":"2003","unstructured":"Macintyre S, Ellaway A. Neighborhoods and health: an overview. Neighborhoods Health. 2003;20:42.","journal-title":"Neighborhoods Health."},{"issue":"1","key":"9424_CR4","doi-asserted-by":"publisher","first-page":"443","DOI":"10.1146\/annurev.soc.28.110601.141114","volume":"28","author":"RJ Sampson","year":"2002","unstructured":"Sampson RJ, Morenoff JD, Gannon-Rowley T. Assessing \u201cneighborhood effects\u201d: social processes and new directions in research. Annu Rev Social. 2002;28(1):443\u201378.","journal-title":"Annu Rev Social."},{"issue":"2","key":"9424_CR5","doi-asserted-by":"publisher","first-page":"398","DOI":"10.1093\/ije\/dyh063","volume":"33","author":"LN Borrell","year":"2004","unstructured":"Borrell LN, Diez Roux AV, Rose K, Catellier D, Clark BL. Neighbourhood characteristics and mortality in the atherosclerosis risk in communities study. Int J Epidemiol. 2004;33(2):398\u2013407.","journal-title":"Int J Epidemiol."},{"issue":"3","key":"9424_CR6","doi-asserted-by":"publisher","first-page":"353","DOI":"10.1016\/j.gheart.2016.08.002","volume":"11","author":"AV Diez Roux","year":"2016","unstructured":"Diez Roux AV, Mujahid MS, Hirsch JA, Moore K, Moore LV. The impact of neighborhoods on CV risk. Glob Heart. 2016;11(3):353\u201363.","journal-title":"Glob Heart."},{"issue":"3","key":"9424_CR7","doi-asserted-by":"publisher","first-page":"471","DOI":"10.1289\/ehp.1103578","volume":"120","author":"ML Miranda","year":"2011","unstructured":"Miranda ML, Messer LC, Kroeger GL. Associations between the quality of the residential built environment and pregnancy outcomes among women in North Carolina. Environ Health Perspect. 2011;120(3):471\u20137.","journal-title":"Environ Health Perspect."},{"key":"9424_CR8","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1016\/j.healthplace.2017.03.002","volume":"45","author":"WM Troxel","year":"2017","unstructured":"Troxel WM, Shih RA, Ewing B, Tucker JS, Nugroho A, D\u2019Amico EJ. Examination of neighborhood disadvantage and sleep in a multi-ethnic cohort of adolescents. Health Place. 2017;45:39\u201345.","journal-title":"Health Place."},{"key":"9424_CR9","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1016\/j.healthplace.2017.09.002","volume":"48","author":"L Wood","year":"2017","unstructured":"Wood L, Hooper P, Foster S, Bull F. Public green spaces and positive mental health\u2013investigating the relationship between access, quantity and types of parks and mental wellbeing. Health Place. 2017;48:63\u201371.","journal-title":"Health Place."},{"issue":"9838","key":"9424_CR10","doi-asserted-by":"publisher","first-page":"258","DOI":"10.1016\/S0140-6736(12)60735-1","volume":"380","author":"AE Bauman","year":"2012","unstructured":"Bauman AE, Reis RS, Sallis JF, Wells JC, Loos RJ, Martin BW, et al. Correlates of physical activity: why are some people physically active and others not? Lancet. 2012;380(9838):258\u201371.","journal-title":"Lancet."},{"issue":"6","key":"9424_CR11","doi-asserted-by":"publisher","first-page":"816","DOI":"10.1016\/j.socscimed.2009.11.020","volume":"70","author":"E Coombes","year":"2010","unstructured":"Coombes E, Jones AP, Hillsdon M. The relationship of physical activity and overweight to objectively measured green space accessibility and use. Soc Sci Med. 2010;70(6):816\u201322.","journal-title":"Soc Sci Med."},{"issue":"s1","key":"9424_CR12","doi-asserted-by":"publisher","first-page":"S55","DOI":"10.1123\/jpah.3.s1.s55","volume":"3","author":"GW Heath","year":"2006","unstructured":"Heath GW, Brownson RC, Kruger J, Miles R, Powell KE, Ramsey LT, et al. The effectiveness of urban design and land use and transport policies and practices to increase physical activity: a systematic review. J Phys Act Health. 2006;3(s1):S55\u201376.","journal-title":"J Phys Act Health."},{"issue":"12","key":"9424_CR13","doi-asserted-by":"publisher","first-page":"1514","DOI":"10.1161\/CIR.0b013e318260a20b","volume":"126","author":"D Mozaffarian","year":"2012","unstructured":"Mozaffarian D, Afshin A, Benowitz NL, Bittner V, Daniels SR, Franch HA, et al. Population approaches to improve diet, physical activity, and smoking habits: a scientific statement from the American Heart Association. Circulation. 2012;126(12):1514\u201363.","journal-title":"Circulation."},{"issue":"9","key":"9424_CR14","doi-asserted-by":"publisher","first-page":"1552","DOI":"10.2105\/AJPH.93.9.1552","volume":"93","author":"BE Saelens","year":"2003","unstructured":"Saelens BE, Sallis JF, Black JB, Chen D. Neighborhood-based differences in physical activity: an environment scale evaluation. Am J Public Health. 2003;93(9):1552\u20138.","journal-title":"Am J Public Health."},{"issue":"2","key":"9424_CR15","doi-asserted-by":"publisher","first-page":"458","DOI":"10.1016\/j.healthplace.2010.11.010","volume":"17","author":"J Van Cauwenberg","year":"2011","unstructured":"Van Cauwenberg J, De Bourdeaudhuij I, De Meester F, Van Dyck D, Salmon J, Clarys P, et al. Relationship between the physical environment and physical activity in older adults: a systematic review. Health Place. 2011;17(2):458\u201369.","journal-title":"Health Place."},{"key":"9424_CR16","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780198778240.001.0001","volume-title":"Sleep, health, and society: From aetiology to public health, Second edition: Oxford University Press","author":"FP Capppuccio","year":"2018","unstructured":"Capppuccio FP, Miller MA, Lockley SW, Rajaratnam SMW. Sleep, health, and society: From aetiology to public health, Second edition: Oxford University Press; 2018. https:\/\/doi.org\/10.1093\/oso\/9780198778240.001.0001."},{"issue":"5","key":"9424_CR17","doi-asserted-by":"publisher","first-page":"941","DOI":"10.1093\/aje\/kwx302","volume":"187","author":"DA Johnson","year":"2018","unstructured":"Johnson DA, Hirsch JA, Moore KA, Redline S, Diez Roux AV. Associations between the built environment and objective measures of sleep: the multi-ethnic study of atherosclerosis. Am J Epidemiol. 2018;187(5):941\u201350.","journal-title":"Am J Epidemiol."},{"key":"9424_CR18","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780198778240.003.0023","volume-title":"The built environment and sleep. Sleep, health, and society: From Aetiology to public health, Second edition: Oxford University Press","author":"JGC Laurent","year":"2018","unstructured":"Laurent JGC, Allen JG, Spengler JD. The built environment and sleep. Sleep, health, and society: From Aetiology to public health, Second edition: Oxford University Press; 2018. https:\/\/doi.org\/10.1093\/oso\/9780198778240.003.0023."},{"issue":"6","key":"9424_CR19","doi-asserted-by":"publisher","first-page":"801","DOI":"10.1503\/cmaj.051351","volume":"174","author":"DE Warburton","year":"2006","unstructured":"Warburton DE, Nicol CW, Bredin SS. Health benefits of physical activity: the evidence. Can Med Assoc J. 2006;174(6):801\u20139.","journal-title":"Can Med Assoc J."},{"issue":"5","key":"9424_CR20","doi-asserted-by":"publisher","first-page":"541","DOI":"10.1097\/HCO.0000000000000437","volume":"32","author":"DER Warburton","year":"2017","unstructured":"Warburton DER, Bredin SSD. Health benefits of physical activity: a systematic review of current systematic reviews. Curr Opin Cardiol. 2017;32(5):541\u201356.","journal-title":"Curr Opin Cardiol."},{"issue":"11","key":"9424_CR21","doi-asserted-by":"publisher","first-page":"2667","DOI":"10.2337\/db11-1118","volume":"60","author":"JA Levine","year":"2011","unstructured":"Levine JA. Poverty and obesity in the U.S. Diabetes. 2011;60(11):2667\u20138.","journal-title":"Diabetes."},{"issue":"2","key":"9424_CR22","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1207\/S15324796ABM2502_05","volume":"25","author":"PA Estabrooks","year":"2003","unstructured":"Estabrooks PA, Lee RE, Gyurcsik NC. Resources for physical activity participation: does availability and accessibility differ by neighborhood socioeconomic status? Ann Behav Med. 2003;25(2):100\u20134.","journal-title":"Ann Behav Med."},{"issue":"2","key":"9424_CR23","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1542\/peds.2005-0058","volume":"117","author":"P Gordon-Larsen","year":"2006","unstructured":"Gordon-Larsen P, Nelson MC, Page P, Popkin BM. Inequality in the built environment underlies key health disparities in physical activity and obesity. Pediatrics. 2006;117(2):417\u201324.","journal-title":"Pediatrics."},{"issue":"3","key":"9424_CR24","doi-asserted-by":"publisher","first-page":"zsy250","DOI":"10.1093\/sleep\/zsy250","volume":"42","author":"WM Troxel","year":"2019","unstructured":"Troxel WM, DeSantis A, Richardson AS, Beckman R, Ghosh-Dastidar B, Nugroho A, et al. Neighborhood disadvantage is associated with actigraphy-assessed sleep continuity and short sleep duration. Sleep. 2019;42(3):zsy250.","journal-title":"Sleep"},{"issue":"4","key":"9424_CR25","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1016\/S0749-3797(98)00076-2","volume":"15","author":"JF Sallis","year":"1998","unstructured":"Sallis JF, Bauman A, Pratt M. Environmental and policy interventions to promote physical activity. Am J Prev Med. 1998;15(4):379\u201397.","journal-title":"Am J Prev Med."},{"issue":"6","key":"9424_CR26","doi-asserted-by":"publisher","first-page":"735","DOI":"10.1177\/0013916510379760","volume":"43","author":"MG Boarnet","year":"2011","unstructured":"Boarnet MG, Forsyth A, Day K, Oakes JM. The street level built environment and physical activity and walking: results of a predictive validity study for the Irvine Minnesota inventory. Environ Behav. 2011;43(6):735\u201375.","journal-title":"Environ Behav."},{"issue":"4 Suppl","key":"9424_CR27","doi-asserted-by":"publisher","first-page":"S99","DOI":"10.1016\/j.amepre.2009.01.005","volume":"36","author":"RC Brownson","year":"2009","unstructured":"Brownson RC, Hoehner CM, Day K, Forsyth A, Sallis JF. Measuring the built environment for physical activity: state of the science. Am J Prev Med. 2009;36(4 Suppl):S99\u2013123 e12.","journal-title":"Am J Prev Med."},{"issue":"1","key":"9424_CR28","doi-asserted-by":"publisher","first-page":"21","DOI":"10.4278\/0890-1171-18.1.21","volume":"18","author":"AV Moudon","year":"2003","unstructured":"Moudon AV, Lee C. Walking and bicycling: an evaluation of environmental audit instruments. Am J Health Promot. 2003;18(1):21\u201337.","journal-title":"Am J Health Promot."},{"issue":"3","key":"9424_CR29","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1016\/S1353-8292(01)00012-0","volume":"7","author":"MO Caughy","year":"2001","unstructured":"Caughy MO, O'Campo PJ, Patterson J. A brief observational measure for urban neighborhoods. Health Place. 2001;7(3):225\u201336.","journal-title":"Health Place."},{"issue":"1","key":"9424_CR30","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1186\/1476-072X-5-11","volume":"5","author":"BA Laraia","year":"2006","unstructured":"Laraia BA, Messer L, Kaufman JS, Dole N, Caughy M, O'Campo P, et al. Direct observation of neighborhood attributes in an urban area of the US south: characterizing the social context of pregnancy. Int J Health Geogr. 2006;5(1):11.","journal-title":"Int J Health Geogr."},{"issue":"1","key":"9424_CR31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1111\/0081-1750.00059","volume":"29","author":"SW Raudenbush","year":"1999","unstructured":"Raudenbush SW, Sampson RJ. Ecometrics: toward a science of assessing ecological settings, with application to the systematic social observation of neighborhoods. Sociol Methodol. 1999;29(1):1\u201341.","journal-title":"Sociol Methodol."},{"issue":"3","key":"9424_CR32","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1123\/jpah.1.3.191","volume":"1","author":"RC Brownson","year":"2004","unstructured":"Brownson RC, Hoehner CM, Brennan LK, Cook RA, Elliott MB, McMullen KM. Reliability of 2 instruments for auditing the environment for physical activity. J Phys Act Health. 2004;1(3):191\u2013208.","journal-title":"J Phys Act Health."},{"issue":"suppl_1","key":"9424_CR33","first-page":"S108","volume":"45","author":"CM Kelly","year":"2012","unstructured":"Kelly CM, Wilson JS, Baker EA, Miller DK, Schootman M. Using Google Street View to audit the built environment: inter-rater reliability results. Ann Behav Med. 2012;45(suppl_1):S108\u2013S12.","journal-title":"Ann Behav Med"},{"issue":"1","key":"9424_CR34","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1186\/s12942-018-0147-7","volume":"17","author":"E Twardzik","year":"2018","unstructured":"Twardzik E, Antonakos C, Baiers R, Dubowitz T, Clarke P, Colabianchi N. Validity of environmental audits using GigaPan\u00ae and Google earth technology. Int J Health Geogr. 2018;17(1):26.","journal-title":"Int J Health Geogr."},{"issue":"6","key":"9424_CR35","doi-asserted-by":"publisher","first-page":"1224","DOI":"10.1016\/j.healthplace.2010.08.007","volume":"16","author":"P Clarke","year":"2010","unstructured":"Clarke P, Ailshire J, Melendez R, Bader M, Morenoff J. Using Google earth to conduct a neighborhood audit: reliability of a virtual audit instrument. Health Place. 2010;16(6):1224\u20139.","journal-title":"Health Place."},{"issue":"2","key":"9424_CR36","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1016\/j.amepre.2010.10.024","volume":"40","author":"BT Taylor","year":"2011","unstructured":"Taylor BT, Fernando P, Bauman AE, Williamson A, Craig JC, Redman S. Measuring the quality of public open space using Google earth. Am J Prev Med. 2011;40(2):105\u201312.","journal-title":"Am J Prev Med."},{"key":"9424_CR37","volume-title":"PHRESH: Pittsburgh Hill\/Homewood Researach on Neighborhood Change and Health no date","author":"PHRESH","year":"2020","unstructured":"PHRESH. PHRESH: Pittsburgh Hill\/Homewood Researach on Neighborhood Change and Health no date. 2020. Available from: https:\/\/www.rand.org\/well-being\/community-health-and-environmental-policy\/projects\/phresh.html."},{"issue":"3","key":"9424_CR38","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1016\/S0749-3797(02)00498-1","volume":"23","author":"TJ Pikora","year":"2002","unstructured":"Pikora TJ, Bull FC, Jamrozik K, Knuiman M, Giles-Corti B, Donovan RJ. Developing a reliable audit instrument to measure the physical environment for physical activity. Am J Prev Med. 2002;23(3):187\u201394.","journal-title":"Am J Prev Med."},{"issue":"3","key":"9424_CR39","doi-asserted-by":"publisher","first-page":"473","DOI":"10.2105\/AJPH.94.3.473","volume":"94","author":"RC Brownson","year":"2004","unstructured":"Brownson RC, Chang JJ, Eyler AA, Ainsworth BE, Kirtland KA, Saelens BE, et al. Measuring the environment for friendliness toward physical activity: a comparison of the reliability of 3 questionnaires. Am J Public Health. 2004;94(3):473\u201383.","journal-title":"Am J Public Health."},{"issue":"6","key":"9424_CR40","doi-asserted-by":"publisher","first-page":"534","DOI":"10.4278\/0890-1171-21.6.534","volume":"21","author":"CM Hoehner","year":"2007","unstructured":"Hoehner CM, Ivy A, Ramirez LK, Handy S, Brownson RC. Active neighborhood checklist: a user-friendly and reliable tool for assessing activity friendliness. Am J Health Promot. 2007;21(6):534\u20137.","journal-title":"Am J Health Promot."},{"issue":"1\u20132","key":"9424_CR41","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1016\/j.landurbplan.2006.06.008","volume":"80","author":"KJ Clifton","year":"2007","unstructured":"Clifton KJ, Smith ADL, Rodriguez D. The development and testing of an audit for the pedestrian environment. Landsc Urban Plan. 2007;80(1\u20132):95\u2013110.","journal-title":"Landsc Urban Plan."},{"key":"9424_CR42","volume-title":"Measures of interobserver agreement and reliability, Second edition. Chapman & Hall\/CRC press","author":"MM Shoukri","year":"2011","unstructured":"Shoukri MM. Measures of interobserver agreement and reliability, Second edition. Chapman & Hall\/CRC press; 2011."},{"issue":"1_suppl","key":"9424_CR43","doi-asserted-by":"publisher","first-page":"87S","DOI":"10.1177\/1090198115570048","volume":"42","author":"T Dubowitz","year":"2015","unstructured":"Dubowitz T, Ncube C, Leuschner K, Tharp-Gilliam S. A natural experiment opportunity in two low-income urban food desert communities: research design, community engagement methods, and baseline results. Health Educ Behav. 2015;42(1_suppl):87S\u201396S.","journal-title":"Health Educ Behav"},{"issue":"12","key":"9424_CR44","doi-asserted-by":"publisher","first-page":"2220","DOI":"10.1017\/S1368980014002742","volume":"18","author":"T Dubowitz","year":"2015","unstructured":"Dubowitz T, Zenk SN, Ghosh-Dastidar B, Cohen DA, Beckman R, Hunter G, et al. Healthy food access for urban food desert residents: examination of the food environment, food purchasing practices, diet and BMI. Public Health Nutr. 2015;18(12):2220\u201330.","journal-title":"Public Health Nutr."},{"issue":"11","key":"9424_CR45","doi-asserted-by":"publisher","first-page":"978","DOI":"10.1136\/jech.2006.054775","volume":"61","author":"CM Kelly","year":"2007","unstructured":"Kelly CM, Schootman M, Baker EA, Barnidge EK, Lemes A. The association of sidewalk walkability and physical disorder with area-level race and poverty. J Epidemiol Community Health. 2007;61(11):978\u201383.","journal-title":"J Epidemiol Community Health."},{"issue":"2","key":"9424_CR46","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1016\/j.amepre.2012.10.015","volume":"44","author":"SJ Slater","year":"2013","unstructured":"Slater SJ, Nicholson L, Chriqui J, Barker DC, Chaloupka FJ, Johnston LD. Walkable communities and adolescent weight. Am J Prev Med. 2013;44(2):164\u20138.","journal-title":"Am J Prev Med."},{"key":"9424_CR47","first-page":"421","volume-title":"Handbook of Health Survey Methods John Wiley and Sons, Inc","author":"SN Zenk","year":"2015","unstructured":"Zenk SN, Slater S, Rashid S. Collecting contextual health survey data using systematic observation. In:  Handbook of Health Survey Methods John Wiley and Sons, Inc; 2015. p. 421\u201345."},{"issue":"2","key":"9424_CR48","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1016\/j.amepre.2005.09.017","volume":"30","author":"K Day","year":"2006","unstructured":"Day K, Boarnet M, Alfonzo M, Forsyth A. The Irvine\u2013Minnesota inventory to measure built environments: development. Am J Prev Med. 2006;30(2):144\u201352.","journal-title":"Am J Prev Med."},{"issue":"1","key":"9424_CR49","doi-asserted-by":"publisher","first-page":"38","DOI":"10.4278\/0890-1171-18.1.38","volume":"18","author":"J Emery","year":"2003","unstructured":"Emery J, Crump C, Bors P. Reliability and validity of two instruments designed to assess the walking and bicycling suitability of sidewalks and roads. Am J Health Promot. 2003;18(1):38\u201346.","journal-title":"Am J Health Promot."},{"issue":"5","key":"9424_CR50","doi-asserted-by":"publisher","first-page":"496","DOI":"10.1016\/j.jadohealth.2010.03.017","volume":"47","author":"SJ Slater","year":"2010","unstructured":"Slater SJ, Ewing R, Powell LM, Chaloupka FJ, Johnston LD, O'Malley PM. The association between community physical activity settings and youth physical activity, obesity, and body mass index. J Adolesc Health. 2010;47(5):496\u2013503.","journal-title":"J Adolesc Health."},{"key":"9424_CR51","volume-title":"Analytic audit tool and checklist audit tool","author":"RC Brownson","year":"2003","unstructured":"Brownson RC, Brennan Ramirez LK, Hoehner CM, Cook RA. Analytic audit tool and checklist audit tool; 2003."},{"key":"9424_CR52","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1016\/j.socscimed.2012.11.030","volume":"80","author":"CE Caspi","year":"2013","unstructured":"Caspi CE, Kawachi I, Subramanian S, Tucker-Seeley R, Sorensen G. The social environment and walking behavior among low-income housing residents. Soc Sci Med. 2013;80:76\u201384.","journal-title":"Soc Sci Med."},{"issue":"3","key":"9424_CR53","doi-asserted-by":"publisher","first-page":"603","DOI":"10.1086\/210356","volume":"105","author":"RJ Sampson","year":"1999","unstructured":"Sampson RJ, Raudenbush SW. Systematic social observation of public spaces: a new look at disorder in urban neighborhoods. Am J Sociol. 1999;105(3):603\u201351.","journal-title":"Am J Sociol."},{"issue":"1","key":"9424_CR54","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1186\/1479-5868-7-20","volume":"7","author":"TE McMillan","year":"2010","unstructured":"McMillan TE, Cubbin C, Parmenter B, Medina AV, Lee RE. Neighborhood sampling: how many streets must an auditor walk? Int J Behav Nutr Phys Act. 2010;7(1):20.","journal-title":"Int J Behav Nutr Phys Act."},{"issue":"6","key":"9424_CR55","doi-asserted-by":"publisher","first-page":"543","DOI":"10.1016\/0895-4356(90)90158-L","volume":"43","author":"AR Feinstein","year":"1990","unstructured":"Feinstein AR, Cicchetti DV. High agreement but low kappa: I. the problems of two paradoxes. J Clin Epidemiol. 1990;43(6):543\u20139.","journal-title":"J Clin Epidemiol."},{"issue":"6","key":"9424_CR56","doi-asserted-by":"publisher","first-page":"551","DOI":"10.1016\/0895-4356(90)90159-M","volume":"43","author":"DV Cicchetti","year":"1990","unstructured":"Cicchetti DV, Feinstein AR. High agreement but low kappa: II. Resolving the paradoxes. J Clin Epidemiol. 1990;43(6):551\u20138.","journal-title":"J Clin Epidemiol"},{"issue":"1","key":"9424_CR57","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1080\/19312450709336664","volume":"1","author":"AF Hayes","year":"2007","unstructured":"Hayes AF, Krippendorff K. Answering the call for a standard reliability measure for coding data. Commun Methods Meas. 2007;1(1):77\u201389.","journal-title":"Commun Methods Meas."},{"issue":"1","key":"9424_CR58","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1177\/001316447003000105","volume":"30","author":"K Krippendorff","year":"1970","unstructured":"Krippendorff K. Estimating the reliability, systematic error and random error of interval data. Educ Psychol Meas. 1970;30(1):61\u201370.","journal-title":"Educ Psychol Meas."},{"key":"9424_CR59","volume-title":"Content analysis. An introduction to its methodology, Third edition","author":"K Krippendorff","year":"2013","unstructured":"Krippendorff K. Content analysis. An introduction to its methodology, Third edition. Thousand Oaks: Sage Publications; 2013."},{"key":"9424_CR60","first-page":"142","volume":"34","author":"K Krippendorff","year":"1978","unstructured":"Krippendorff K. Reliability of binary attribute data. Biometrika. 1978;34:142\u20134.","journal-title":"Biometrika."},{"issue":"1","key":"9424_CR61","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1901\/jaba.1977.10-103","volume":"10","author":"DP Hartmann","year":"1977","unstructured":"Hartmann DP. Considerations in the choice of interobserver reliability estimates. J Appl Behav Anal. 1977;10(1):103\u201316.","journal-title":"J Appl Behav Anal."},{"issue":"4","key":"9424_CR62","first-page":"1","volume":"9","author":"SE Stemler","year":"2004","unstructured":"Stemler SE. A comparison of consensus, consistency, and measurement approaches to estimating interrater reliability. Pract Assess Res Eval. 2004;9(4):1\u201319.","journal-title":"Pract Assess Res Eval."},{"issue":"1","key":"9424_CR63","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1177\/014662168100500115","volume":"5","author":"JL Fleiss","year":"1981","unstructured":"Fleiss JL. Balanced incomplete block designs for inter-rater reliability studies. Appl Psychol Meas. 1981;5(1):105\u201312.","journal-title":"Appl Psychol Meas."}],"container-title":["BMC Public Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12889-020-09424-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12889-020-09424-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12889-020-09424-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,10,6]],"date-time":"2021-10-06T22:01:05Z","timestamp":1633557665000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcpublichealth.biomedcentral.com\/articles\/10.1186\/s12889-020-09424-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,7]]},"references-count":63,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["9424"],"URL":"https:\/\/doi.org\/10.1186\/s12889-020-09424-8","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.2.23465\/v2","asserted-by":"object"},{"id-type":"doi","id":"10.21203\/rs.2.23465\/v1","asserted-by":"object"},{"id-type":"doi","id":"10.21203\/rs.2.23465\/v3","asserted-by":"object"}]},"ISSN":["1471-2458"],"issn-type":[{"value":"1471-2458","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10,7]]},"assertion":[{"value":"5 February 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 August 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 October 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Not applicable.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors have indicated they have no financial relationships relevant to this article to disclose.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"1519"}}