{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T22:38:28Z","timestamp":1778279908997,"version":"3.51.4"},"reference-count":36,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2024,12,28]],"date-time":"2024-12-28T00:00:00Z","timestamp":1735344000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2024,12,28]],"date-time":"2024-12-28T00:00:00Z","timestamp":1735344000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["AI & Soc"],"published-print":{"date-parts":[[2025,6]]},"DOI":"10.1007\/s00146-024-02168-8","type":"journal-article","created":{"date-parts":[[2024,12,28]],"date-time":"2024-12-28T15:49:36Z","timestamp":1735400976000},"page":"3941-3951","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Out of dataset, out of algorithm, out of mind: a critical evaluation of AI bias against disabled people"],"prefix":"10.1007","volume":"40","author":[{"given":"Rohan","family":"Manzoor","sequence":"first","affiliation":[]},{"given":"Wajahat","family":"Hussain","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3525-1956","authenticated-orcid":false,"given":"Muhammad Latif","family":"Anjum","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,12,28]]},"reference":[{"key":"2168_CR1","doi-asserted-by":"crossref","unstructured":"Andriluka M., L. Pishchulin P. Gehler and B. Schiele (2014) 2d human pose estimation: New benchmark and state of the art analysis. In Proceedings of the CVPR","DOI":"10.1109\/CVPR.2014.471"},{"key":"2168_CR2","unstructured":"Azizi S., S. Kornblith C. Saharia M. Norouzi and D.J. Fleet. (2023) Synthetic data from dif- fusion models improves imagenet classification. arXiv preprint arXiv:2304.08466 ."},{"key":"2168_CR3","unstructured":"Betker J., G. Goh L. Jing T. Brooks J. Wang L. Li L. Ouyang J. Zhuang J. Lee Y. Guo et al. (2023) Improving image generation with better captions. Computer Science. https:\/\/www.google.com\/search?q=https%3A%2F%2Fcdn.+openai.+com%2Fpapers%2Fdall-e-3.+pdf+2%3A+3&rlz=1C1GCEU_en-GBIN1102IN1102&oq=https%3A%2F%2Fcdn.+openai.+com%2Fpapers%2Fdall-e-3.+pdf+2%3A+3&gs_lcrp=EgZjaHJvbWUyBggAEEUYOTIGCAEQRRg60gEHOTE2ajBqOagCAbACAQ&sourceid=chrome&ie=UTF-8"},{"key":"2168_CR4","unstructured":"Brandao M. (2019) Age and gender bias in pedestrian detection algorithms. arXiv preprint arXiv:1906.10490"},{"key":"2168_CR8","doi-asserted-by":"crossref","unstructured":"Deng J., W. Dong R. Socher L.J. Li K. Li and L. Fei-Fei 2009. Imagenet: A large-scale hierarchical image database. In 2009 CVPR. Ieee.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"2168_CR9","unstructured":"Everingham M., L. Van Gool C.K.I. Williams J. Winn and A. Zisserman. The PAS- CAL Visual Object Classes Challenge (2007) (VOC2007) Results"},{"key":"2168_CR11","doi-asserted-by":"crossref","unstructured":"Feng Y. and C. Shah (2022) Has ceo gender bias really been fixed? adversarial attacking and improving gender fairness in image search. In Proceedings of the AAAI Conference on Artifi- cial Intelligence.","DOI":"10.1609\/aaai.v36i11.21445"},{"issue":"2","key":"2168_CR12","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1109\/MIS.2009.36","volume":"24","author":"A Halevy","year":"2009","unstructured":"Halevy A, Norvig P, Pereira F (2009) The unreasonable effectiveness of data. IEEE Intell Syst 24(2):8\u201312","journal-title":"IEEE Intell Syst"},{"issue":"1","key":"2168_CR13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-019-0278-0","volume":"7","author":"M Hashemi","year":"2020","unstructured":"Hashemi M, Hall M (2020) Retracted article: Criminal tendency detection from facial images and the gender bias effect. J Big Data 7(1):1\u201316","journal-title":"J Big Data"},{"key":"2168_CR14","unstructured":"Hu E.J., Y. Shen P. Wallis Z. Allen-Zhu Y. Li S. Wang L. Wang and W. Chen (2021) Lora: Low-rank adaptation of large language models. arXiv preprint arXiv:2106.09685"},{"key":"2168_CR16","unstructured":"Jocher G. (2020) May. YOLOv5 by Ultralytics."},{"key":"2168_CR17","doi-asserted-by":"crossref","unstructured":"Karkkainen K. and J. Joo (2021) Fairface: Face attribute dataset for balanced race, gender, and age for bias measurement and mitigation. In Proceedings of the IEEE\/CVF WACV","DOI":"10.1109\/WACV48630.2021.00159"},{"key":"2168_CR18","first-page":"12104","volume":"33","author":"T Karras","year":"2020","unstructured":"Karras T, Aittala M, Hellsten J, Laine S, Lehtinen J, Aila T (2020) Training gen- erative adversarial networks with limited data. Adv Neural Inf Process Syst 33:12104\u201312114","journal-title":"Adv Neural Inf Process Syst"},{"issue":"7","key":"2168_CR20","doi-asserted-by":"publisher","first-page":"1956","DOI":"10.1007\/s11263-020-01316-z","volume":"128","author":"A Kuznetsova","year":"2020","unstructured":"Kuznetsova A, Rom H, Alldrin N, Uijlings J, Krasin I, Pont-Tuset J, Kamali S, Popov S, Malloci M, Kolesnikov A et al (2020) The open images dataset v4: Unified image classification, object detection, and visual relationship detection at scale. IJCV 128(7):1956\u20131981","journal-title":"IJCV"},{"key":"2168_CR22","volume-title":"Microsoft coco: Common objects in context","author":"TY Lin","year":"2014","unstructured":"Lin TY, Maire M, Belongie S, Hays J, Per- ona P, Ramanan D, Doll\u00b4ar P, Zitnick CL (2014) Microsoft coco: Common objects in context. Springer, In ECCV"},{"key":"2168_CR23","doi-asserted-by":"crossref","unstructured":"Meister N., D. Zhao A. Wang V.V. Ramaswamy R. Fong and O. Russakovsky (2023) Gender artifacts in visual datasets. In Proceedings of the IEEE\/CVF ICCV","DOI":"10.1109\/ICCV51070.2023.00446"},{"issue":"11","key":"2168_CR24","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1145\/219717.219748","volume":"38","author":"GA Miller","year":"1995","unstructured":"Miller GA (1995) Wordnet: a lexical database for english. Commun ACM 38(11):39\u201341","journal-title":"Commun ACM"},{"key":"2168_CR25","doi-asserted-by":"crossref","unstructured":"Naik R. and B. Nushi (2023) Social biases through the text-to-image generation lens. arXiv preprint arXiv:2304.06034","DOI":"10.1145\/3600211.3604711"},{"key":"2168_CR26","doi-asserted-by":"publisher","DOI":"10.18574\/nyu\/9781479833641.001.0001","volume-title":"Algorithms of oppression","author":"SU Noble","year":"2018","unstructured":"Noble SU (2018) Algorithms of oppression. Algorithms of oppression, New York University Press"},{"key":"2168_CR27","doi-asserted-by":"crossref","unstructured":"Perera M.V. and V.M. Patel (2023) Analyzing bias in diffusion-based face generation models. arXiv preprint arXiv:2305.06402","DOI":"10.1109\/IJCB57857.2023.10449200"},{"key":"2168_CR28","unstructured":"Planner 5D (2024) Ai room design. Accessed Dec 14 2024"},{"key":"2168_CR29","unstructured":"Podell D., Z. English K. Lacey A. Blattmann T. Dockhorn J. Mu\u00a8ller J. Penna and R. Rom- bach (2023. Sdxl: Improving latent diffusion models for high-resolution image synthesis. arXiv preprint arXiv:2307.01952"},{"key":"2168_CR30","unstructured":"Prabhu V.U. and A. Birhane (2020) Large image datasets: A pyrrhic win for computer vision? arXiv preprint arXiv:2006.16923"},{"key":"2168_CR31","doi-asserted-by":"crossref","unstructured":"Quattoni A. and A. Torralba (2009) Recognizing indoor scenes. In 2009 CVPR. IEEE.","DOI":"10.1109\/CVPRW.2009.5206537"},{"key":"2168_CR32","first-page":"25278","volume":"35","author":"C Schuhmann","year":"2022","unstructured":"Schuhmann C, Beaumont R, Vencu R, Gordon C, Wightman R, Cherti M, Coombes T, Katta A, Mullis C, Wortsman M et al (2022) Laion-5b: An open large scale dataset for training next generation image-text models. Adv Neural Inf Process Syst 35:25278\u201325294","journal-title":"Adv Neural Inf Process Syst"},{"key":"2168_CR33","doi-asserted-by":"crossref","unstructured":"Serengil S.I. and A. Ozpinar (2020) Lightface: A hybrid deep face recognition framework. In 2020 Innovations in Intelligent Systems and Applications Conference (ASYU), pp. 23\u201327. IEEE.","DOI":"10.1109\/ASYU50717.2020.9259802"},{"key":"2168_CR34","doi-asserted-by":"crossref","unstructured":"Sun C., A. Shrivastava S. Singh and A. Gupta (2017) Revisiting unreasonable effectiveness of data in deep learning era. In Proceedings of the IEEE ICCV.","DOI":"10.1109\/ICCV.2017.97"},{"issue":"11","key":"2168_CR35","doi-asserted-by":"publisher","first-page":"1958","DOI":"10.1109\/TPAMI.2008.128","volume":"30","author":"A Torralba","year":"2008","unstructured":"Torralba A, Fergus R, Freeman WT (2008) 80 million tiny images: A large data set for non- parametric object and scene recognition. IEEE TPAMI 30(11):1958\u20131970","journal-title":"IEEE TPAMI"},{"key":"2168_CR36","unstructured":"Veit A., T. Matera L. Neumann J. Matas and S. Belongie (2016) Coco-text: Dataset and benchmark for text detection and recog- nition in natural images. arXiv preprint arXiv:1601.07140"},{"issue":"7","key":"2168_CR37","doi-asserted-by":"publisher","first-page":"1790","DOI":"10.1007\/s11263-022-01625-5","volume":"130","author":"A Wang","year":"2022","unstructured":"Wang A, Liu A, Zhang R, Kleiman A, Kim L, Zhao D, Shirai I, Narayanan A, Russakovsky O (2022) Revise: a tool for measuring and mitigating bias in visual datasets. IJCV 130(7):1790\u20131810","journal-title":"IJCV"},{"key":"2168_CR38","doi-asserted-by":"crossref","unstructured":"Xiao J., J. Hays K.A. Ehinger A. Oliva and A. Torralba (2010) Sun database: Large-scale scene recognition from abbey to zoo. In 2010 IEEE computer society CVPR. IEEE","DOI":"10.1109\/CVPR.2010.5539970"},{"key":"2168_CR39","doi-asserted-by":"crossref","unstructured":"Yang K., K. Qinami L. Fei-Fei J. Deng and O. Russakovsky (2020) Towards fairer datasets: Filtering and balancing the distribution of the people subtree in the imagenet hierarchy. In Proceedings of the 2020 conference on fairness, accountability, and transparency","DOI":"10.1145\/3351095.3375709"},{"key":"2168_CR40","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1162\/tacl_a_00166","volume":"2","author":"P Young","year":"2014","unstructured":"Young P, Lai A, Hodosh M, Hocken- maier J (2014) From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions. Trans- Actions Association Comput Linguistics 2:67\u201378","journal-title":"Trans- Actions Association Comput Linguistics"},{"key":"2168_CR41","doi-asserted-by":"crossref","unstructured":"Zhang L. and M. Agrawala (2023) Adding conditional control to text-to-image diffusion models. arXiv preprint arXiv:2302.05543 .","DOI":"10.1109\/ICCV51070.2023.00355"},{"key":"2168_CR43","doi-asserted-by":"crossref","unstructured":"Zhao D., A. Wang and O. Russakovsky (2021) Understanding and evaluating racial biases in image captioning. In Proceedings of the IEEE\/CVF ICCV.","DOI":"10.1109\/ICCV48922.2021.01456"},{"issue":"6","key":"2168_CR44","doi-asserted-by":"publisher","first-page":"1452","DOI":"10.1109\/TPAMI.2017.2723009","volume":"40","author":"B Zhou","year":"2017","unstructured":"Zhou B, Lapedriza A, Khosla A, Oliva A, Torralba A (2017) Places: A 10 million image database for scene recognition. IEEE TPAMI 40(6):1452\u20131464","journal-title":"IEEE TPAMI"}],"container-title":["AI & SOCIETY"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-024-02168-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00146-024-02168-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-024-02168-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,10]],"date-time":"2025-06-10T04:19:19Z","timestamp":1749529159000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00146-024-02168-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,28]]},"references-count":36,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2025,6]]}},"alternative-id":["2168"],"URL":"https:\/\/doi.org\/10.1007\/s00146-024-02168-8","relation":{},"ISSN":["0951-5666","1435-5655"],"issn-type":[{"value":"0951-5666","type":"print"},{"value":"1435-5655","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,28]]},"assertion":[{"value":"19 June 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 December 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 December 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no competing interests to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"The work did not use any human or animal during studies, and therefore required no approval from ethical committee.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}}]}}