{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T16:10:43Z","timestamp":1772122243625,"version":"3.50.1"},"reference-count":51,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2020,11,3]],"date-time":"2020-11-03T00:00:00Z","timestamp":1604361600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["POCI-01-0145-FEDER-030766"],"award-info":[{"award-number":["POCI-01-0145-FEDER-030766"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJERPH"],"abstract":"<jats:p>Ambulatory care sensitive conditions (ACSCs) are conditions for which hospitalizations are thought to be avoidable if effective and accessible primary health care is available. However, to define which conditions are considered ACSCs, there is a considerable number of different lists. Our aim was to compare the impact of using different ACSC lists considering mainland Portugal hospitalizations. A retrospective study with inpatient data from Portuguese public hospital discharges between 2011 and 2015 was conducted. Four ACSC list sources were considered: Agency for Healthcare Research and Quality (AHRQ), Canadian Institute for Health Information (CIHI), the Victorian Ambulatory Care Sensitive Conditions study, and Sarmento et al. Age\u2013sex-adjusted rates of ACSCs were calculated by district (hospitalizations per 100,000 inhabitants). Spearman\u2019s rho, the intraclass correlation coefficient (ICC), the information-based measure of disagreement (IBMD), and Bland and Altman plots were computed. Results showed that by applying the four lists, different age\u2013sex-adjusted rates are obtained. However, the lists that seemed to demonstrate greater agreement and consistency were the list proposed by Sarmento et al. compared to AHRQ and the AHRQ method compared to the Victorian list. It is important to state that we should compare comparable indicators and ACSC lists cannot be used interchangeably.<\/jats:p>","DOI":"10.3390\/ijerph17218121","type":"journal-article","created":{"date-parts":[[2020,11,3]],"date-time":"2020-11-03T09:09:32Z","timestamp":1604394572000},"page":"8121","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Comparison and Impact of Four Different Methodologies for Identification of Ambulatory Care Sensitive Conditions"],"prefix":"10.3390","volume":"17","author":[{"given":"Andreia","family":"Pinto","sequence":"first","affiliation":[{"name":"Department of Community Medicine, Information and Health Decision Sciences (MEDCIDS), Faculty of Medicine, University of Porto, 4200-450 Porto, Portugal"},{"name":"CINTESIS\u2013Center for Health Technology and Services Research, 4200-450 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4696-1002","authenticated-orcid":false,"given":"Jo\u00e3o Vasco","family":"Santos","sequence":"additional","affiliation":[{"name":"Department of Community Medicine, Information and Health Decision Sciences (MEDCIDS), Faculty of Medicine, University of Porto, 4200-450 Porto, Portugal"},{"name":"CINTESIS\u2013Center for Health Technology and Services Research, 4200-450 Porto, Portugal"},{"name":"Public Health Unit, ACES Grande Porto VIII\u2013Espinho\/Gaia, 4500-330 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8576-1903","authenticated-orcid":false,"given":"J\u00falio","family":"Souza","sequence":"additional","affiliation":[{"name":"Department of Community Medicine, Information and Health Decision Sciences (MEDCIDS), Faculty of Medicine, University of Porto, 4200-450 Porto, Portugal"},{"name":"CINTESIS\u2013Center for Health Technology and Services Research, 4200-450 Porto, Portugal"}]},{"given":"Jo\u00e3o","family":"Viana","sequence":"additional","affiliation":[{"name":"Department of Community Medicine, Information and Health Decision Sciences (MEDCIDS), Faculty of Medicine, University of Porto, 4200-450 Porto, Portugal"},{"name":"CINTESIS\u2013Center for Health Technology and Services Research, 4200-450 Porto, Portugal"}]},{"given":"Cristina","family":"Costa Santos","sequence":"additional","affiliation":[{"name":"Department of Community Medicine, Information and Health Decision Sciences (MEDCIDS), Faculty of Medicine, University of Porto, 4200-450 Porto, Portugal"},{"name":"CINTESIS\u2013Center for Health Technology and Services Research, 4200-450 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3890-7735","authenticated-orcid":false,"given":"Mariana","family":"Lobo","sequence":"additional","affiliation":[{"name":"Department of Community Medicine, Information and Health Decision Sciences (MEDCIDS), Faculty of Medicine, University of Porto, 4200-450 Porto, Portugal"},{"name":"CINTESIS\u2013Center for Health Technology and Services Research, 4200-450 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2113-9653","authenticated-orcid":false,"given":"Alberto","family":"Freitas","sequence":"additional","affiliation":[{"name":"Department of Community Medicine, Information and Health Decision Sciences (MEDCIDS), Faculty of Medicine, University of Porto, 4200-450 Porto, Portugal"},{"name":"CINTESIS\u2013Center for Health Technology and Services Research, 4200-450 Porto, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1377\/hlthaff.12.1.162","article-title":"Impact of socioeconomic status on hospital use in New York City","volume":"12","author":"Billings","year":"1993","journal-title":"Health Aff. (Millwood)"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"e029592","DOI":"10.1136\/bmjopen-2019-029592","article-title":"Regional variation of avoidable hospitalisations in a universal health care system: A register-based cohort study from Finland 1996\u20132013","volume":"9","author":"Manderbacka","year":"2019","journal-title":"BMJ Open"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1093\/eurpub\/14.3.246","article-title":"The role of primary care in preventing ambulatory care sensitive conditions","volume":"14","author":"Caminal","year":"2004","journal-title":"Eur. J. Public Health"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"356","DOI":"10.1093\/eurpub\/cks053","article-title":"The relationship between avoidable hospitalization and accessibility to primary care: A systematic review","volume":"23","author":"Rosano","year":"2013","journal-title":"Eur. J. Public Health"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Rizza, P., Bianco, A., Pavia, M., and Angelillo, I.F. (2007). Preventable hospitalization and access to primary health care in an area of Southern Italy. BMC Health Serv. Res., 7.","DOI":"10.1186\/1472-6963-7-134"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1071\/PY07043","article-title":"The Concept and Usefulness of Ambulatory Care Sensitive Conditions as Indicators of Quality and Access to Primary Health Care","volume":"13","author":"Ansari","year":"2007","journal-title":"Aust. J. Prim. Health"},{"key":"ref_7","first-page":"359","article-title":"The Minnesota project: A focused approach to ambulatory quality assessment","volume":"27","author":"Solberg","year":"1990","journal-title":"Inquiry (Oslo)"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2388","DOI":"10.1001\/jama.1992.03490170060026","article-title":"Rates of avoidable hospitalization by insurance status in Massachusetts and Maryland","volume":"268","author":"Weissman","year":"1992","journal-title":"JAMA"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1016\/S0213-9111(01)71532-4","article-title":"Las hospitalizaciones por ambulatory care sensitive conditions: Selecci\u00f3n del listado de c\u00f3digos de diagn\u00f3stico v\u00e1lidos para Espa\u00f1a","volume":"15","author":"Caminal","year":"2001","journal-title":"Gac. Sanit."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/j.puhe.2008.11.001","article-title":"Ambulatory care sensitive conditions: Terminology and disease coding need to be more specific to aid policy makers and clinicians","volume":"123","author":"Purdy","year":"2009","journal-title":"Public Health"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1415","DOI":"10.1016\/j.healthpol.2015.08.007","article-title":"Which hospitalisations are ambulatory care-sensitive, to what degree, and how could the rates be reduced? Results of a group consensus study in Germany","volume":"119","author":"Sundmacher","year":"2015","journal-title":"Health Policy"},{"key":"ref_12","unstructured":"Canadian Insititute for Health Information (2020, May 01). Health Indicators 2008. Ottawa, ON, Canada, Available online: http:\/\/indicatorlibrary.cihi.ca\/display\/HSPIL\/Ambulatory+Care+Sensitive+Conditions."},{"key":"ref_13","unstructured":"Agency for Healthcare Research and Quality (2020, May 01). Prevention Quality Indicators Overview 2018, Available online: https:\/\/www.qualityindicators.ahrq.gov\/Archive\/PQI_TechSpec_ICD09_v60.aspx."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ansari, Z., Haider, S.I., Ansari, H., de Gooyer, T., and Sindall, C. (2012). Patient characteristics associated with hospitalisations for ambulatory care sensitive conditions in Victoria, Australia. BMC Health Serv. Res., 12.","DOI":"10.1186\/1472-6963-12-475"},{"key":"ref_15","first-page":"169","article-title":"Potentially avoidable hospitalisation in Bologna, 1997-2000: Temporal trend and differences by income level","volume":"30","author":"Pirani","year":"2006","journal-title":"Epidemiol. Prev."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1093\/eurpub\/cku227","article-title":"Potentially avoidable hospitalizations in five European countries in 2009 and time trends from 2002 to 2009 based on administrative data","volume":"25","author":"Thygesen","year":"2015","journal-title":"Eur. J. Public Health"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1337","DOI":"10.1590\/S0102-311X2009000600016","article-title":"Interna\u00e7\u00f5es por condi\u00e7\u00f5es sens\u00edveis \u00e0 aten\u00e7\u00e3o prim\u00e1ria: A constru\u00e7\u00e3o da lista brasileira como ferramenta para medir o desempenho do sistema de sa\u00fade (Projeto ICSAP-Brasil)","volume":"25","author":"Alfradique","year":"2009","journal-title":"Cad. Saude Publica"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1007\/s10198-015-0692-y","article-title":"Rates of admission for ambulatory care sensitive conditions in France in 2009\u20132010: Trends, geographic variation, costs, and an international comparison","volume":"17","author":"Weeks","year":"2016","journal-title":"Eur. J. Health Econ."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Busby, J., Purdy, S., and Hollingworth, W. (2015). A systematic review of the magnitude and cause of geographic variation in unplanned hospital admission rates and length of stay for ambulatory care sensitive conditions. BMC Health Serv. Res., 15.","DOI":"10.1186\/s12913-015-0964-3"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Satokangas, M., Lumme, S., Arffman, M., and Keskim\u00e4ki, I. (2019). Trajectory modelling of ambulatory care sensitive conditions in Finland in 1996-2013: Assessing the development of equity in primary health care through clustering of geographic areas-an observational retrospective study. BMC Health Serv. Res., 19.","DOI":"10.1186\/s12913-019-4449-7"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Agabiti, N., Pirani, M., Schifano, P., Cesaroni, G., Davoli, M., Bisanti, L., Caranci, N., Costa, G., Forastiere, F., and Marinacci, C. (2009). Income level and chronic ambulatory care sensitive conditions in adults: A multicity population-based study in Italy. BMC Public Health, 9.","DOI":"10.1186\/1471-2458-9-457"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/BF03404951","article-title":"Hospitalization for Ambulatory Care\u2013Sensitive Conditions: A Method for Comparative Access and Quality Studies Using Routinely Collected Statistics","volume":"92","author":"Brown","year":"2001","journal-title":"Can. J. Public Health"},{"key":"ref_23","first-page":"6","article-title":"Hospitalizations preventable by timely and effective primary health care","volume":"31","year":"2003","journal-title":"Aten. Primaria"},{"key":"ref_24","first-page":"655","article-title":"How to use the nominal group and Delphi techniques","volume":"38","author":"McMillan","year":"2016","journal-title":"Int. J. Clin. Pharm."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1375","DOI":"10.1590\/1413-81232020254.13502019","article-title":"Comparative research aspects on hospitalizations for ambulatory care sensitive conditions: The case of Brazil and Portugal","volume":"25","author":"Rocha","year":"2020","journal-title":"Cien. Saude Colet."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"590","DOI":"10.20344\/amp.6324","article-title":"Characterization and Evolution of Avoidable Admissions in Portugal: The Impact of Two Methodologic Approaches","volume":"28","author":"Sarmento","year":"2015","journal-title":"Acta Med. Port."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Bourret, R., Mercier, G., Mercier, J., Jonquet, O., De La Coussaye, J.E., Bousquet, P.J., Robine, J.M., and Bousquet, J. (2015). Comparison of two methods to report potentially avoidable hospitalizations in France in 2012: A cross-sectional study. BMC Health Serv. Res., 15.","DOI":"10.1186\/s12913-014-0661-7"},{"key":"ref_28","unstructured":"Instituto Nacional de Estat\u00edstica (2020, May 11). Popula\u00e7\u00e3o Residente (N.\u00ba) por Local de Resid\u00eancia (NUTS-2013), Sexo e Grupo Et\u00e1rio; Anual. Available online: https:\/\/www.ine.pt\/xportal\/xmain?xpid=INE&xpgid=ine_indicadores&indOcorrCod=0008273&contexto=bd&selTab=tab2."},{"key":"ref_29","unstructured":"Public Health Rural and Regional Health and Aged Care Services Division, Victorian Government Department of Human Services (2004). The Victorian Ambulatory Care Sensitive Conditions Study Report 2001\u20132002."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Sarmento, J., Rocha, J.V.M., and Santana, R. (2020). Defining ambulatory care sensitive conditions for adults in Portugal. BMC Health Serv. Res., 20.","DOI":"10.1186\/s12913-020-05620-9"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Rocha, J.V.M., Nunes, C., and Santana, R. (2019). Avoidable hospitalizations in Brazil and Portugal: Identifying and comparing critical areas through spatial analysis. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0219262"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1186\/s12939-017-0642-7","article-title":"Evolution and financial cost of socioeconomic inequalities in ambulatory care sensitive conditions: An ecological study for Portugal, 2000\u20132014","volume":"16","author":"Dimitrovova","year":"2017","journal-title":"Int. J. Equity Health"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1353\/hpu.2015.0068","article-title":"Cost Burden of Potentially Preventable Hospitalizations for Cardiovascular Disease and Diabetes for Asian Americans, Pacific Islanders, and Whites in Hawai\u2019i","volume":"26","author":"Sentell","year":"2015","journal-title":"J. Health Care Poor Underserved"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"745","DOI":"10.1093\/eurpub\/ckt203","article-title":"AHRQ prevention quality indicators to assess the quality of primary care of local providers: A pilot study from Italy","volume":"24","author":"Manzoli","year":"2014","journal-title":"Eur. J. Public Health"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1111\/acem.12579","article-title":"Costs associated with ambulatory care sensitive conditions across hospital-based settings","volume":"22","author":"Galarraga","year":"2015","journal-title":"Acad. Emerg. Med."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Schiotz, M., Price, M., Frolich, A., Sogaard, J., Kristensen, J.K., Krasnik, A., Ross, M.N., Diderichsen, F., and Hsu, J. (2011). Something is amiss in Denmark: A comparison of preventable hospitalisations and readmissions for chronic medical conditions in the Danish Healthcare system and Kaiser Permanente. BMC Health Serv. Res., 11.","DOI":"10.1186\/1472-6963-11-347"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Santos, J.V., Viana, J., Devleeschauwer, B., Haagsma, J., Santos, C., Ricciardi, W., and Freitas, A. (2020). Health expectancies in the European Union: Same concept, different methods, different results. J. Epidemiol. Community Health, in peer review.","DOI":"10.1136\/jech-2020-213791"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.tjem.2018.08.001","article-title":"User\u2019s guide to correlation coefficients","volume":"18","author":"Akoglu","year":"2018","journal-title":"Turk. J. Emerg. Med."},{"key":"ref_39","unstructured":"Field, A. (2009). Discovering Statistics Using IBM SPSS Statistics, SAGE Publications."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","article-title":"A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research","volume":"15","author":"Koo","year":"2016","journal-title":"J. Chiropr. Med."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Henriques, T., Antunes, L., Bernardes, J., Matias, M., Sato, D., and Costa-Santos, C. (2013). Information-based measure of disagreement for more than two observers: A useful tool to compare the degree of observer disagreement. BMC Med. Res. Methodol., 13.","DOI":"10.1186\/1471-2288-13-47"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"571","DOI":"10.1080\/10543400701329422","article-title":"Agreement between methods of measurement with multiple observations per individual","volume":"17","author":"Bland","year":"2007","journal-title":"J. Biopharm. Stat."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1016\/j.jclinepi.2010.03.002","article-title":"Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed","volume":"64","author":"Kottner","year":"2011","journal-title":"J. Clin. Epidemiol."},{"key":"ref_44","first-page":"261","article-title":"An\u00e1lise de Concord\u00e2ncia entre M\u00e9todos de Bland-Altman","volume":"29","author":"Hirakata","year":"2009","journal-title":"Rev. HCPA"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1145","DOI":"10.1590\/S1413-81232011000700046","article-title":"Conceptual and methodological aspects in the study of hospitalizations for ambulatory care sensitive conditions","volume":"16","author":"Nedel","year":"2011","journal-title":"Cien. Saude Colet."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1007\/s10389-013-0563-x","article-title":"Preventable hospitalization and the role of primary care: A comparison between Italy and Germany","volume":"21","author":"Rosano","year":"2013","journal-title":"J. Public Health (Oxf.)"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"422","DOI":"10.1258\/jrsm.2012.120178","article-title":"Defining primary care sensitive conditions: A necessity for effective primary care delivery?","volume":"105","author":"Gibbons","year":"2012","journal-title":"J. R. Soc. Med."},{"key":"ref_48","unstructured":"World Health Organization (2016). Assessing Health Services Delivery Performance with Hospitalizations for Ambulatory Care Sensitive Conditions, WHO Regional Office for Europe."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"e002007","DOI":"10.1136\/bmjopen-2012-002007","article-title":"Is secondary preventive care improving? Observational study of 10-year trends in emergency admissions for conditions amenable to ambulatory care","volume":"3","author":"Bardsley","year":"2013","journal-title":"BMJ Open"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"e742","DOI":"10.3399\/bjgp13X674422","article-title":"The strength of primary care in Europe: An international comparative study","volume":"63","author":"Kringos","year":"2013","journal-title":"Br. J. Gen. Pract."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/j.puhe.2018.09.019","article-title":"Hospitalisation of ambulatory care sensitive conditions and access to primary care in Portugal","volume":"165","author":"Carneiro","year":"2018","journal-title":"Public Health"}],"container-title":["International Journal of Environmental Research and Public Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1660-4601\/17\/21\/8121\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:28:46Z","timestamp":1760178526000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1660-4601\/17\/21\/8121"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,3]]},"references-count":51,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2020,11]]}},"alternative-id":["ijerph17218121"],"URL":"https:\/\/doi.org\/10.3390\/ijerph17218121","relation":{},"ISSN":["1660-4601"],"issn-type":[{"value":"1660-4601","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,3]]}}}