{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,3]],"date-time":"2026-03-03T05:55:15Z","timestamp":1772517315631,"version":"3.50.1"},"reference-count":73,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,2,28]],"date-time":"2025-02-28T00:00:00Z","timestamp":1740700800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,2,28]],"date-time":"2025-02-28T00:00:00Z","timestamp":1740700800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100021856","name":"Ministero dell\u2019Universit\u00e1 e della Ricerca","doi-asserted-by":"publisher","award":["2020W3A5FY"],"award-info":[{"award-number":["2020W3A5FY"]}],"id":[{"id":"10.13039\/501100021856","id-type":"DOI","asserted-by":"publisher"}]},{"name":"European Union - NextGenerationEU - National Recovery and Resilience Plan","award":["IR0000013"],"award-info":[{"award-number":["IR0000013"]}]},{"name":"European Union - NextGenerationEU - National Recovery and Resilience Plan","award":["P2022553SL"],"award-info":[{"award-number":["P2022553SL"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Softw Syst Model"],"published-print":{"date-parts":[[2026,2]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Fairness is a critical concept in ethics and social domains, but it is also a challenging property to engineer in software systems. With the increasing use of machine learning in software systems, researchers have been developing techniques to assess the fairness of software systems automatically. Nonetheless, many of these techniques rely upon pre-established fairness definitions, metrics, and criteria, which may fail to encompass the wide-ranging needs and preferences of users and stakeholders. To overcome this limitation, we propose a novel approach, called MODNESS, that enables users to customize and define their fairness concepts using a dedicated modeling environment. Our approach guides the user through the definition of new fairness concepts also in emerging domains, and the specification and composition of metrics for its evaluation through a dedicated domain-specific language. Ultimately, MODNESS generates the source code to implement fair assessment based on these custom definitions. In addition, we elucidate the process we followed to collect and analyze relevant literature on fairness assessment in software engineering (SE). We compare MODNESS with the selected approaches and evaluate how they support the distinguishing features identified by our study. Our findings reveal that i) most of the current approaches do not support user-defined fairness concepts; ii) our approach can cover additional application domains not addressed by currently available tools, e.g., mitigating bias in recommender systems for software engineering and Arduino software component recommendations; iii) MODNESS demonstrates the capability to overcome the limitations of the only two other model-driven engineering-based approaches for fairness assessment.<\/jats:p>","DOI":"10.1007\/s10270-025-01277-2","type":"journal-article","created":{"date-parts":[[2025,2,27]],"date-time":"2025-02-27T23:46:58Z","timestamp":1740700018000},"page":"189-215","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["How fair are we? From conceptualization to automated assessment of fairness definitions"],"prefix":"10.1007","volume":"25","author":[{"given":"Giordano","family":"d\u2019 Aloisio","sequence":"first","affiliation":[]},{"given":"Claudio","family":"Di Sipio","sequence":"additional","affiliation":[]},{"given":"Antinisca","family":"Di Marco","sequence":"additional","affiliation":[]},{"given":"Davide","family":"Di Ruscio","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,2,28]]},"reference":[{"key":"1277_CR1","doi-asserted-by":"publisher","unstructured":"Aggarwal, A., Shaikh, S., Hans, S., Haldar, S., Ananthanarayanan, R., Saha, D.: Testing Framework for Black-box AI Models. In: 2021 IEEE\/ACM 43rd International Conference on Software Engineering: Companion Proceedings (ICSE-Companion), pp. 81\u201384 (2021). https:\/\/doi.org\/10.1109\/ICSE-Companion52605.2021.00041. Issn: 2574-1926","DOI":"10.1109\/ICSE-Companion52605.2021.00041"},{"key":"1277_CR2","doi-asserted-by":"publisher","unstructured":"Angell, R., Johnson, B., Brun, Y., Meliou, A.: Themis: automatically testing software for discrimination. In: Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Esec\/fse 2018, pp. 871\u2013875. Association for Computing Machinery, New York (2018). https:\/\/doi.org\/10.1145\/3236024.3264590","DOI":"10.1145\/3236024.3264590"},{"key":"1277_CR3","unstructured":"Angwin, J., Larson, J., Mattu, S., Kirchner, L.: Machine bias. ProPublica, May 23(2016), 139\u2013159 (2016)"},{"issue":"12","key":"1277_CR4","doi-asserted-by":"publisher","first-page":"5087","DOI":"10.1109\/tse.2021.3136169","volume":"48","author":"MH Asyrofi","year":"2022","unstructured":"Asyrofi, M.H., Yang, Z., Yusuf, I.N.B., Kang, H.J., Thung, F., Lo, D.: Biasfinder: metamorphic test generation to uncover bias for sentiment analysis systems. IEEE Trans. Softw. Eng. 48(12), 5087\u20135101 (2022). https:\/\/doi.org\/10.1109\/tse.2021.3136169","journal-title":"IEEE Trans. Softw. Eng."},{"key":"1277_CR5","doi-asserted-by":"crossref","unstructured":"Austin, K.A., Christopher, C.M., Dickerson, D.: Will I Pass the Bar Exam: Predicting Student Success Using LSAT Scores and Law School Performance. HofstrA l. Rev. 45, 753 (2016). Publisher: HeinOnline","DOI":"10.2139\/ssrn.2832835"},{"key":"1277_CR6","doi-asserted-by":"publisher","unstructured":"Bellamy, R.K.E., Dey, K., Hind, M., Hoffman, S.C., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., Mojsilovi?, A., Nagar, S., Ramamurthy, K.N., Richards, J., Saha, D., Sattigeri, P., Singh, M., Varshney, K.R., Zhang, Y.: AI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias. IBM J. Res. Dev. 63(4\/5), 4:1\u20134:15 (2019). https:\/\/doi.org\/10.1147\/jrd.2019.2942287. Conference Name: IBM Journal of Research and Development","DOI":"10.1147\/jrd.2019.2942287"},{"key":"1277_CR7","doi-asserted-by":"publisher","unstructured":"Berk, R., Heidari, H., Jabbari, S., Kearns, M., Roth, A.: Fairness in Criminal Justice Risk Assessments: The State of the Art 50(1), 3\u201344 (2018). https:\/\/doi.org\/10.1177\/0049124118782533. Publisher: SAGE PublicationsSage CA: Los Angeles, CA","DOI":"10.1177\/0049124118782533"},{"key":"1277_CR8","unstructured":"Bertoa, M.F., Vallecillo, A.: Quality attributes for software metamodels (2010). https:\/\/api.semanticscholar.org\/CorpusID:15268921"},{"key":"1277_CR9","unstructured":"Bird, S., Dud\u00edk, M., Edgar, R., Horn, B., Lutz, R., Milan, V., Sameki, M., Wallach, H., Walker, K.: Fairlearn: A toolkit for assessing and improving fairness in AI. Tech. Rep. Msr-tr-2020-32, Microsoft (2020)"},{"key":"1277_CR10","doi-asserted-by":"publisher","unstructured":"Biswas, S., Rajan, H.: Fair preprocessing: towards understanding compositional fairness of data transformers in machine learning pipeline. In: Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Esec\/fse 2021, pp. 981\u2013993. Association for Computing Machinery, New York, NY, USA (2021). https:\/\/doi.org\/10.1145\/3468264.3468536","DOI":"10.1145\/3468264.3468536"},{"key":"1277_CR11","doi-asserted-by":"publisher","unstructured":"Biswas, S., Rajan, H.: Fairify: Fairness Verification of Neural Networks. In: Proceedings of the 45th International Conference on Software Engineering, ICSE \u201923, pp. 1546\u20131558. IEEE Press, Melbourne, Victoria, Australia (2023). https:\/\/doi.org\/10.1109\/ICSE48619.2023.00134. Read_Status: New Read_Status_Date: 2024-05-06T09:55:33.001Z","DOI":"10.1109\/ICSE48619.2023.00134"},{"key":"1277_CR12","doi-asserted-by":"publisher","unstructured":"Brun, Y., Meliou, A.: Software fairness. In: Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, pp. 754\u2013759. Acm, Lake Buena Vista FL USA (2018). https:\/\/doi.org\/10.1145\/3236024.3264838","DOI":"10.1145\/3236024.3264838"},{"issue":"1","key":"1277_CR13","doi-asserted-by":"publisher","first-page":"4209","DOI":"10.1038\/s41598-022-07939-1","volume":"12","author":"A Castelnovo","year":"2022","unstructured":"Castelnovo, A., Crupi, R., Greco, G., Regoli, D., Penco, I.G., Cosentini, A.C.: A clarification of the nuances in the fairness metrics landscape. Sci. Rep. 12(1), 4209 (2022)","journal-title":"Sci. Rep."},{"key":"1277_CR14","doi-asserted-by":"publisher","unstructured":"Caton, S., Haas, C.: Fairness in machine learning: a survey. ACM Comput. Surv. (2023). https:\/\/doi.org\/10.1145\/3616865. Just Accepted","DOI":"10.1145\/3616865"},{"key":"1277_CR15","doi-asserted-by":"publisher","unstructured":"Chakraborty, J., Majumder, S., Menzies, T.: Bias in machine learning software: Why? how? what to do? In: Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Esec\/fse 2021, pp. 429\u2013440. Association for Computing Machinery, New York (2021). https:\/\/doi.org\/10.1145\/3468264.3468537","DOI":"10.1145\/3468264.3468537"},{"key":"1277_CR16","doi-asserted-by":"publisher","unstructured":"Chakraborty, J., Majumder, S., Yu, Z., Menzies, T.: Fairway: a way to build fair ML software. In: Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Esec\/fse 2020, pp. 654\u2013665. Association for Computing Machinery, New York (2020). https:\/\/doi.org\/10.1145\/3368089.3409697","DOI":"10.1145\/3368089.3409697"},{"key":"1277_CR17","unstructured":"Chen, Z., Zhang, J.M., Hort, M., Sarro, F., Harman, M.: Fairness Testing: A Comprehensive Survey and Analysis of Trends (2022). http:\/\/arxiv.org\/abs\/2207.10223. ArXiv:2207.10223 [cs]"},{"key":"1277_CR18","doi-asserted-by":"publisher","unstructured":"Chen, Z., Zhang, J.M., Sarro, F., Harman, M.: MAAT: a novel ensemble approach to addressing fairness and performance bugs for machine learning software. In: Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Esec\/fse 2022, pp. 1122\u20131134. Association for Computing Machinery, New York (2022). https:\/\/doi.org\/10.1145\/3540250.3549093","DOI":"10.1145\/3540250.3549093"},{"key":"1277_CR19","doi-asserted-by":"crossref","unstructured":"Chen, Z., Zhang, J.M., Sarro, F., Harman, M.: Fairness Improvement with Multiple Protected Attributes: How Far Are We? In: 46th International Conference on Software Engineering (ICSE 2024). ACM (2023)","DOI":"10.1145\/3597503.3639083"},{"key":"1277_CR20","doi-asserted-by":"publisher","unstructured":"Chen, Z., Zhang, J.M., Sarro, F., Harman, M.: Fairness improvement with multiple protected attributes: How far are we? In: Proceedings of the IEEE\/ACM 46th International Conference on Software Engineering, ICSE \u201924. Association for Computing Machinery, New York (2024). https:\/\/doi.org\/10.1145\/3597503.3639083","DOI":"10.1145\/3597503.3639083"},{"key":"1277_CR21","doi-asserted-by":"publisher","first-page":"88","DOI":"10.1007\/978-3-031-30826-0_5","volume-title":"Fundamental Approaches to Software Engineering","author":"G d\u2019Aloisio","year":"2023","unstructured":"d\u2019Aloisio, G., Di Marco, A., Stilo, G.: Democratizing quality-based machine learning development through extended feature models. In: Lambers, L., Uchitel, S. (eds.) Fundamental Approaches to Software Engineering, pp. 88\u2013110. Springer Nature Switzerland, Cham (2023)"},{"key":"1277_CR22","unstructured":"d\u2019Aloisio, G., Di\u00a0Sipio, C., Di\u00a0Marco, A., Di\u00a0Ruscio, D.: MODNESS (2024). https:\/\/github.com\/giordanoDaloisio\/MODNESS"},{"key":"1277_CR23","unstructured":"Deldjoo, Y., Anelli, V.W., Zamani, H., Bellog\u00edn, A., Di\u00a0Noia, T.: Recommender systems fairness evaluation via generalized cross entropy. arXiv preprint arXiv:1908.06708 (2019)"},{"key":"1277_CR24","doi-asserted-by":"crossref","unstructured":"Deldjoo, Y., Jannach, D., Bellogin, A., Difonzo, A., Zanzonelli, D.: Fairness in recommender systems: Research landscape and future directions (2022)","DOI":"10.1007\/s11257-023-09364-z"},{"key":"1277_CR25","doi-asserted-by":"crossref","unstructured":"Di\u00a0Rocco, J., Di\u00a0Sipio, C.: Resyduo: Combining data models and cf-based recommender systems to develop arduino projects. In: 2023 ACM\/IEEE International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C), pp. 539\u2013548. IEEE (2023)","DOI":"10.1109\/MODELS-C59198.2023.00091"},{"key":"1277_CR26","doi-asserted-by":"publisher","unstructured":"Dwork, C., Hardt, M., Pitassi, T., Reingold, O., Zemel, R.: Fairness through awareness. In: Proceedings of the 3rd Innovations in Theoretical Computer Science Conference, Itcs \u201912, pp. 214\u2013226. Association for Computing Machinery, New York (2012). https:\/\/doi.org\/10.1145\/2090236.2090255","DOI":"10.1145\/2090236.2090255"},{"key":"1277_CR27","doi-asserted-by":"publisher","unstructured":"d\u2019Aloisio, G., D\u2019Angelo, A., Di Marco, A., Stilo, G.: Debiaser for Multiple Variables to enhance fairness in classification tasks. Inf. Process. Manag. 60(2), 103226 (2023). https:\/\/doi.org\/10.1016\/j.ipm.2022.103226. https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0306457322003272","DOI":"10.1016\/j.ipm.2022.103226"},{"key":"1277_CR28","doi-asserted-by":"publisher","unstructured":"Fan, M., Wei, W., Jin, W., Yang, Z., Liu, T.: Explanation-guided fairness testing through genetic algorithm. In: Proceedings of the 44th International Conference on Software Engineering, Icse \u201922, p. 871-882. Association for Computing Machinery, New York (2022). https:\/\/doi.org\/10.1145\/3510003.3510137","DOI":"10.1145\/3510003.3510137"},{"key":"1277_CR29","doi-asserted-by":"publisher","unstructured":"Feldman, M., Friedler, S.A., Moeller, J., Scheidegger, C., Venkatasubramanian, S.: Certifying and Removing Disparate Impact. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 259\u2013268. Acm, Sydney NSW Australia (2015). https:\/\/doi.org\/10.1145\/2783258.2783311","DOI":"10.1145\/2783258.2783311"},{"key":"1277_CR30","doi-asserted-by":"publisher","unstructured":"Ge, M., Delgado-Battenfeld, C., Jannach, D.: Beyond accuracy: evaluating recommender systems by coverage and serendipity. In: Proceedings of the Fourth ACM Conference on Recommender Systems, RecSys \u201910, pp. 257\u2013260. Association for Computing Machinery, New York (2010). https:\/\/doi.org\/10.1145\/1864708.1864761","DOI":"10.1145\/1864708.1864761"},{"key":"1277_CR31","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2021.111031","volume":"180","author":"G Giray","year":"2021","unstructured":"Giray, G.: A software engineering perspective on engineering machine learning systems: state of the art and challenges. J. Syst. Softw. 180, 111031 (2021). https:\/\/doi.org\/10.1016\/j.jss.2021.111031","journal-title":"J. Syst. Softw."},{"key":"1277_CR32","unstructured":"Hardt, M., Price, E., Price, E., Srebro, N.: Equality of Opportunity in Supervised Learning. In: Advances in Neural Information Processing Systems, vol.\u00a029. Curran Associates, Inc. (2016). https:\/\/proceedings.neurips.cc\/paper\/2016\/hash\/9d2682367c3935defcb1f9e247a97c0d-Abstract.html"},{"key":"1277_CR33","unstructured":"Hofmann, H.: Uci machine learning repository: Statlog (german credit data) data set (2013)"},{"key":"1277_CR34","doi-asserted-by":"publisher","DOI":"10.1145\/3631326","author":"M Hort","year":"2023","unstructured":"Hort, M., Chen, Z., Zhang, J.M., Harman, M., Sarro, F.: Bias mitigation for machine learning classifiers: a comprehensive survey. ACM J. Responsible Comput. (2023). https:\/\/doi.org\/10.1145\/3631326","journal-title":"ACM J. Responsible Comput."},{"key":"1277_CR35","doi-asserted-by":"publisher","unstructured":"Hort, M., Zhang, J.M., Sarro, F., Harman, M.: Fairea: A model behaviour mutation approach to benchmarking bias mitigation methods. In: Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Esec\/fse 2021, pp. 994\u20131006. Association for Computing Machinery, New York (2021). https:\/\/doi.org\/10.1145\/3468264.3468565","DOI":"10.1145\/3468264.3468565"},{"key":"1277_CR36","doi-asserted-by":"publisher","unstructured":"Johnson, B., Brun, Y.: Fairkit-learn: A fairness evaluation and comparison toolkit. In: 2022 IEEE\/ACM 44th International Conference on Software Engineering: Companion Proceedings (ICSE-Companion), pp. 70\u201374 (2022). https:\/\/doi.org\/10.1145\/3510454.3516830","DOI":"10.1145\/3510454.3516830"},{"issue":"1","key":"1277_CR37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10115-011-0463-8","volume":"33","author":"F Kamiran","year":"2012","unstructured":"Kamiran, F., Calders, T.: Data preprocessing techniques for classification without discrimination. Knowl. Inf. Syst. 33(1), 1\u201333 (2012). https:\/\/doi.org\/10.1007\/s10115-011-0463-8","journal-title":"Knowl. Inf. Syst."},{"key":"1277_CR38","unstructured":"Kohavi, R.: Scaling Up the Accuracy of Naive-Bayes Classifiers: a Decision-Tree Hybrid p.\u00a06"},{"issue":"4","key":"1277_CR39","doi-asserted-by":"publisher","first-page":"463","DOI":"10.3233\/idt-190160","volume":"13","author":"F Kumeno","year":"2020","unstructured":"Kumeno, F.: Sofware engineering challenges for machine learning applications: a literature review. Intell. Decision Techn 13(4), 463\u2013476 (2020). https:\/\/doi.org\/10.3233\/idt-190160","journal-title":"Intell. Decision Techn"},{"key":"1277_CR40","unstructured":"Kusner, M.J., Loftus, J., Russell, C., Silva, R.: Counterfactual Fairness. In: Advances in Neural Information Processing Systems, vol.\u00a030. Curran Associates, Inc. (2017). https:\/\/proceedings.neurips.cc\/paper\/2017\/hash\/a486cd07e4ac3d270571622f4f316ec5-Abstract.html"},{"key":"1277_CR41","doi-asserted-by":"publisher","unstructured":"Lee, M.S.A., Singh, J.: The landscape and gaps in open source fairness toolkits. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Chi \u201921, pp. 1\u201313. Association for Computing Machinery, New York (2021). https:\/\/doi.org\/10.1145\/3411764.3445261","DOI":"10.1145\/3411764.3445261"},{"key":"1277_CR42","doi-asserted-by":"publisher","unstructured":"Li, Y., Meng, L., Chen, L., Yu, L., Wu, D., Zhou, Y., Xu, B.: Training data debugging for the fairness of machine learning software. In: Proceedings of the 44th International Conference on Software Engineering, Icse \u201922, p. 2215-2227. Association for Computing Machinery, New York (2022). https:\/\/doi.org\/10.1145\/3510003.3510091","DOI":"10.1145\/3510003.3510091"},{"key":"1277_CR43","doi-asserted-by":"publisher","unstructured":"McKinney, W.: Data Structures for Statistical Computing in Python. In: St\u00e9fan van\u00a0der Walt, Jarrod Millman (eds.) Proceedings of the 9th Python in Science Conference, pp. 56\u201361 (2010). https:\/\/doi.org\/10.25080\/Majora-92bf1922-00a","DOI":"10.25080\/Majora-92bf1922-00a"},{"issue":"6","key":"1277_CR44","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3457607","volume":"54","author":"N Mehrabi","year":"2021","unstructured":"Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., Galstyan, A.: A survey on bias and fairness in machine learning. ACM Comput. Surv. 54(6), 1\u201335 (2021). https:\/\/doi.org\/10.1145\/3457607","journal-title":"ACM Comput. Surv."},{"key":"1277_CR45","doi-asserted-by":"publisher","unstructured":"Monjezi, V., Trivedi, A., Tan, G., Tizpaz-Niari, S.: Information-Theoretic Testing and Debugging of Fairness Defects in Deep Neural Networks. In: Proceedings of the 45th International Conference on Software Engineering, ICSE \u201923, pp. 1571\u20131582. IEEE Press, Melbourne, Victoria, Australia (2023). https:\/\/doi.org\/10.1109\/ICSE48619.2023.00136. Read_Status: New Read_Status_Date: 2024-05-06T10:05:16.607Z","DOI":"10.1109\/ICSE48619.2023.00136"},{"key":"1277_CR46","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1016\/j.dss.2014.03.001","volume":"62","author":"S Moro","year":"2014","unstructured":"Moro, S., Cortez, P., Rita, P.: A data-driven approach to predict the success of bank telemarketing. Decis. Support Syst. 62, 22\u201331 (2014)","journal-title":"Decis. Support Syst."},{"key":"1277_CR47","doi-asserted-by":"publisher","unstructured":"Muccini, H., Vaidhyanathan, K.: Software Architecture for ML-based Systems: What Exists and What Lies Ahead. In: 2021 IEEE\/ACM 1st Workshop on AI Engineering - Software Engineering for AI (WAIN), pp. 121\u2013128 (2021). https:\/\/doi.org\/10.1109\/wain52551.2021.00026","DOI":"10.1109\/wain52551.2021.00026"},{"key":"1277_CR48","doi-asserted-by":"publisher","unstructured":"Nahar, N., Zhang, H., Lewis, G., Zhou, S., K\u00e4stner, C.: A Meta-Summary of Challenges in Building Products with ML Components\u2014Collecting Experiences from 4758+ Practitioners (2023). https:\/\/doi.org\/10.48550\/arXiv.2304.00078. ArXiv:2304.00078 [cs]","DOI":"10.48550\/arXiv.2304.00078"},{"key":"1277_CR49","doi-asserted-by":"publisher","unstructured":"Nguyen, P.T., Di Rocco, J., Di Ruscio, D., Di Penta, M.: CrossRec: Supporting Software Developers by Recommending Third-party Libraries. Journal of Systems and Software p. 110460 (2019). https:\/\/doi.org\/10.1016\/j.jss.2019.110460. http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0164121219302341","DOI":"10.1016\/j.jss.2019.110460"},{"key":"1277_CR50","doi-asserted-by":"crossref","unstructured":"Nguyen, P.T., Rubei, R., Rocco, J.D., Sipio, C.D., Ruscio, D.D., Penta, M.D.: Dealing with popularity bias in recommender systems for third-party libraries: How far are we? (2023)","DOI":"10.1109\/MSR59073.2023.00016"},{"key":"1277_CR51","doi-asserted-by":"publisher","first-page":"13","DOI":"10.3389\/fdata.2019.00013","volume":"2","author":"A Olteanu","year":"2019","unstructured":"Olteanu, A., Castillo, C., Diaz, F., K\u0131c\u0131man, E.: Social data: biases, methodological pitfalls, and ethical boundaries. Front. Big Data 2, 13 (2019)","journal-title":"Front. Big Data"},{"key":"1277_CR52","doi-asserted-by":"publisher","unstructured":"Peng, K., Chakraborty, J., Menzies, T.: FairMask: Better Fairness via Model-Based Rebalancing of Protected Attributes. IEEE Trans. Softw. Eng. 49(4), 2426\u20132439 (2023). https:\/\/doi.org\/10.1109\/tse.2022.3220713. Conference Name: IEEE Transactions on Software Engineering","DOI":"10.1109\/tse.2022.3220713"},{"issue":"3","key":"1277_CR53","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1007\/s10664-022-10116-7","volume":"27","author":"A Perera","year":"2022","unstructured":"Perera, A., Aleti, A., Tantithamthavorn, C., Jiarpakdee, J., Turhan, B., Kuhn, L., Walker, K.: Search-based fairness testing for regression-based machine learning systems. Empir. Softw. Eng. 27(3), 79 (2022). https:\/\/doi.org\/10.1007\/s10664-022-10116-7","journal-title":"Empir. Softw. Eng."},{"key":"1277_CR54","doi-asserted-by":"publisher","unstructured":"Rajan, S.S., Udeshi, S., Chattopadhyay, S.: AequeVox: Automated Fairness Testing of Speech Recognition Systems. In: Johnsen, E.B., Wimmer, M. (eds.) Fundamental Approaches to Software Engineering, pp. 245\u2013267. Springer International Publishing, Cham (2022). https:\/\/doi.org\/10.1007\/978-3-030-99429-7_14. Read_Status: New Read_Status_Date: 2024-05-06T10:06:55.523Z","DOI":"10.1007\/978-3-030-99429-7_14"},{"issue":"4","key":"1277_CR55","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1109\/MS.2009.161","volume":"27","author":"M Robillard","year":"2009","unstructured":"Robillard, M., Walker, R., Zimmermann, T.: Recommendation systems for software engineering. IEEE Softw. 27(4), 80\u201386 (2009)","journal-title":"IEEE Softw."},{"key":"1277_CR56","unstructured":"Saleiro, P., Kuester, B., Hinkson, L., London, J., Stevens, A., Anisfeld, A., Rodolfa, K.T., Ghani, R.: Aequitas: A Bias and Fairness Audit Toolkit. arXiv:1811.05577 [cs] (2019)"},{"key":"1277_CR57","doi-asserted-by":"publisher","unstructured":"Sharma, A., Wehrheim, H.: Testing Machine Learning Algorithms for Balanced Data Usage. In: 2019 12th IEEE Conference on Software Testing, Validation and Verification (ICST), pp. 125\u2013135 (2019).https:\/\/doi.org\/10.1109\/icst.2019.00022. Issn: 2159-4848","DOI":"10.1109\/icst.2019.00022"},{"key":"1277_CR58","doi-asserted-by":"publisher","unstructured":"Soremekun, E., Udeshi, S., Chattopadhyay, S.: Astraea: Grammar-Based Fairness Testing. IEEE Trans. Softw. Eng. 48(12), 5188\u20135211 (2022). https:\/\/doi.org\/10.1109\/tse.2022.3141758. Conference Name: IEEE Transactions on Software Engineering","DOI":"10.1109\/tse.2022.3141758"},{"key":"1277_CR59","unstructured":"Steinberg, D., Budinsky, F., Merks, E., Paternostro, M.: EMF: eclipse modeling framework. Pearson Education (2008)"},{"key":"1277_CR60","doi-asserted-by":"publisher","unstructured":"Sundberg, L., Holmstr\u00f6m, J.: Democratizing artificial intelligence: How no-code AI can leverage machine learning operations. Business Horizons (2023). https:\/\/doi.org\/10.1016\/j.bushor.2023.04.003. https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0007681323000502","DOI":"10.1016\/j.bushor.2023.04.003"},{"key":"1277_CR61","doi-asserted-by":"publisher","unstructured":"Tian, Y., Zhong, Z., Ordonez, V., Kaiser, G., Ray, B.: Testing dnn image classifiers for confusion and bias errors. In: Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering, Icse \u201920, pp. 1122-1134. Association for Computing Machinery, New York (2020). https:\/\/doi.org\/10.1145\/3377811.3380400","DOI":"10.1145\/3377811.3380400"},{"key":"1277_CR62","doi-asserted-by":"publisher","unstructured":"Tizpaz-Niari, S., Kumar, A., Tan, G., Trivedi, A.: Fairness-aware configuration of machine learning libraries. In: Proceedings of the 44th International Conference on Software Engineering, Icse \u201922, pp. 909\u2013920. Association for Computing Machinery, New York (2022). https:\/\/doi.org\/10.1145\/3510003.3510202","DOI":"10.1145\/3510003.3510202"},{"key":"1277_CR63","doi-asserted-by":"publisher","unstructured":"Udeshi, S., Arora, P., Chattopadhyay, S.: Automated directed fairness testing. In: Proceedings of the 33rd ACM\/IEEE International Conference on Automated Software Engineering, Ase \u201918, pp. 98\u2013108. Association for Computing Machinery, New York (2018). https:\/\/doi.org\/10.1145\/3238147.3238165","DOI":"10.1145\/3238147.3238165"},{"key":"1277_CR64","doi-asserted-by":"publisher","unstructured":"Verma, S., Rubin, J.: Fairness definitions explained. In: Proceedings of the International Workshop on Software Fairness, pp. 1\u20137. Acm, Gothenburg Sweden (2018). https:\/\/doi.org\/10.1145\/3194770.3194776","DOI":"10.1145\/3194770.3194776"},{"key":"1277_CR65","doi-asserted-by":"publisher","unstructured":"Villamizar, H., Escovedo, T., Kalinowski, M.: Requirements Engineering for Machine Learning: A Systematic Mapping Study. In: 2021 47th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), pp. 29\u201336. IEEE, Palermo (2021). https:\/\/doi.org\/10.1109\/seaa53835.2021.00013","DOI":"10.1109\/seaa53835.2021.00013"},{"issue":"3","key":"1277_CR66","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3487571","volume":"31","author":"J Wang","year":"2022","unstructured":"Wang, J., Yang, Y., Wang, S., Hu, J., Wang, Q.: Context- and fairness-aware in-process crowdworker recommendation. ACM Trans. Softw. Eng. Methodol 31(3), 1\u201335 (2022). https:\/\/doi.org\/10.1145\/3487571","journal-title":"ACM Trans. Softw. Eng. Methodol"},{"issue":"3","key":"1277_CR67","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3547333","volume":"41","author":"Y Wang","year":"2023","unstructured":"Wang, Y., Ma, W., Zhang, M., Liu, Y., Ma, S.: A survey on the fairness of recommender systems. ACM Trans. Inf. Syst. 41(3), 1\u201343 (2023). https:\/\/doi.org\/10.1145\/3547333","journal-title":"ACM Trans. Inf. Syst."},{"key":"1277_CR68","doi-asserted-by":"publisher","unstructured":"Yohannis, A., Kolovos, D.: Towards model-based bias mitigation in machine learning. In: Proceedings of the 25th International Conference on Model Driven Engineering Languages and Systems, Models \u201922, pp. 143\u2013153. Association for Computing Machinery, New York (2022). https:\/\/doi.org\/10.1145\/3550355.3552401","DOI":"10.1145\/3550355.3552401"},{"issue":"6","key":"1277_CR69","doi-asserted-by":"publisher","first-page":"625","DOI":"10.1016\/j.infsof.2010.12.010","volume":"53","author":"H Zhang","year":"2011","unstructured":"Zhang, H., Babar, M.A., Tell, P.: Identifying relevant studies in software engineering. Inf. Softw. Technol. 53(6), 625\u2013637 (2011). https:\/\/doi.org\/10.1016\/j.infsof.2010.12.010","journal-title":"Inf. Softw. Technol."},{"key":"1277_CR70","doi-asserted-by":"publisher","DOI":"10.1109\/tse.2019.2962027","author":"JM Zhang","year":"2020","unstructured":"Zhang, J.M., Harman, M., Ma, L., Liu, Y.: Machine learning testing: survey, landscapes and horizons. IEEE Trans. Softw. Eng. (2020). https:\/\/doi.org\/10.1109\/tse.2019.2962027","journal-title":"IEEE Trans. Softw. Eng."},{"key":"1277_CR71","doi-asserted-by":"crossref","unstructured":"Zhang, L., Zhang, Y., Zhang, M.: Efficient white-box fairness testing through gradient search. In: Proceedings of the 30th ACM SIGSOFT International Symposium on Software Testing and Analysis, pp. 103\u2013114 (2021)","DOI":"10.1145\/3460319.3464820"},{"key":"1277_CR72","doi-asserted-by":"publisher","unstructured":"Zhang, P., Wang, J., Sun, J., Wang, X., Dong, G., Wang, X., Dai, T., Dong, J.S.: Automatic Fairness Testing of Neural Classifiers Through Adversarial Sampling. IEEE Trans. Softw. Eng. 48(9), 3593\u20133612 (2022). https:\/\/doi.org\/10.1109\/tse.2021.3101478. Conference Name: IEEE Transactions on Software Engineering","DOI":"10.1109\/tse.2021.3101478"},{"key":"1277_CR73","doi-asserted-by":"publisher","unstructured":"Zheng, H., Chen, Z., Du, T., Zhang, X., Cheng, Y., Ti, S., Wang, J., Yu, Y., Chen, J.: Neuronfair: Interpretable white-box fairness testing through biased neuron identification. In: 2022 IEEE\/ACM 44th International Conference on Software Engineering (ICSE), pp. 1519\u20131531 (2022). https:\/\/doi.org\/10.1145\/3510003.3510123","DOI":"10.1145\/3510003.3510123"}],"container-title":["Software and Systems Modeling"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10270-025-01277-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10270-025-01277-2","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10270-025-01277-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,3]],"date-time":"2026-03-03T05:01:31Z","timestamp":1772514091000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10270-025-01277-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,28]]},"references-count":73,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,2]]}},"alternative-id":["1277"],"URL":"https:\/\/doi.org\/10.1007\/s10270-025-01277-2","relation":{},"ISSN":["1619-1366","1619-1374"],"issn-type":[{"value":"1619-1366","type":"print"},{"value":"1619-1374","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,28]]},"assertion":[{"value":"20 October 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 January 2025","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 January 2025","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 February 2025","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}