{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T23:58:17Z","timestamp":1774655897867,"version":"3.50.1"},"reference-count":42,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2019,7,29]],"date-time":"2019-07-29T00:00:00Z","timestamp":1564358400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Fairness, through its many forms and definitions, has become an important issue facing the machine learning community. In this work, we consider how to incorporate group fairness constraints into kernel regression methods, applicable to Gaussian processes, support vector machines, neural network regression and decision tree regression. Further, we focus on examining the effect of incorporating these constraints in decision tree regression, with direct applications to random forests and boosted trees amongst other widespread popular inference techniques. We show that the order of complexity of memory and computation is preserved for such models and tightly binds the expected perturbations to the model in terms of the number of leaves of the trees. Importantly, the approach works on trained models and hence can be easily applied to models in current use and group labels are only required on training data.<\/jats:p>","DOI":"10.3390\/e21080741","type":"journal-article","created":{"date-parts":[[2019,7,29]],"date-time":"2019-07-29T11:20:18Z","timestamp":1564399218000},"page":"741","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["A General Framework for Fair Regression"],"prefix":"10.3390","volume":"21","author":[{"given":"Jack","family":"Fitzsimons","sequence":"first","affiliation":[{"name":"Department of Engineering Science, University of Oxford, Oxford OX13PJ, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"AbdulRahman","family":"Al Ali","sequence":"additional","affiliation":[{"name":"Faculty of Business and Law, Northampton University, Northampton NN15PH, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1959-012X","authenticated-orcid":false,"given":"Michael","family":"Osborne","sequence":"additional","affiliation":[{"name":"Department of Engineering Science, University of Oxford, Oxford OX13PJ, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stephen","family":"Roberts","sequence":"additional","affiliation":[{"name":"Department of Engineering Science, University of Oxford, Oxford OX13PJ, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,7,29]]},"reference":[{"key":"ref_1","unstructured":"The Executive Office of the President of the United States, and Podesta, J. (2014). Big Data: Seizing Opportunities, Preserving Values."},{"key":"ref_2","unstructured":"Gajane, P. (2017). On formalizing fairness in prediction with machine learning. arXiv."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Weisskopf, T.E. (2004). Affirmative action in the United States and India. A Comparative Perspective, Routledge.","DOI":"10.4324\/9780203799970"},{"key":"ref_4","unstructured":"Dumont, L. (1980). Homo Hierarchicus: The Caste System and Its Implications, University of Chicago Press."},{"key":"ref_5","unstructured":"Deshpande, A. (2017). Affirmative action in India. Race and Inequality, Routledge."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10115-007-0114-2","article-title":"Top 10 algorithms in data mining","volume":"14","author":"Wu","year":"2008","journal-title":"Knowl. Inf. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Luong, B.T., Ruggieri, S., and Turini, F. (2011, January 21\u201324). k-NN as an implementation of situation testing for discrimination discovery and prevention. Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Diego, CA, USA.","DOI":"10.1145\/2020408.2020488"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Kamiran, F., and Calders, T. (2009, January 17\u201318). Classifying without discriminating. Proceedings of the 2009 2nd International Conference on Computer, Control and Communication, Karachi, Pakistan.","DOI":"10.1109\/IC4.2009.4909197"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Kamishima, T., Akaho, S., and Sakuma, J. (2011, January 11). Fairness-aware learning through regularization approach. Proceedings of the 2011 IEEE 11th International Conference on Data Mining Workshops, Vancouver, BC, Canada.","DOI":"10.1109\/ICDMW.2011.83"},{"key":"ref_10","unstructured":"Berk, R., Heidari, H., Jabbari, S., Joseph, M., Kearns, M., Morgenstern, J., Neel, S., and Roth, A. (2017). A convex framework for fair regression. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Calders, T., Karim, A., Kamiran, F., Ali, W., and Zhang, X. (2013, January 7\u201310). Controlling attribute effect in linear regression. Proceedings of the 2013 IEEE 13th International Conference on Data Mining, Dallas, TX, USA.","DOI":"10.1109\/ICDM.2013.114"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1007\/s10618-010-0190-x","article-title":"Three naive Bayes approaches for discrimination-free classification","volume":"21","author":"Calders","year":"2010","journal-title":"Data Min. Knowl. Discov."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Raff, E., Sylvester, J., and Mills, S. (2017). Fair Forests: Regularized Tree Induction to Minimize Model Bias. arXiv.","DOI":"10.1145\/3278721.3278742"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Kamiran, F., Karim, A., and Zhang, X. (2012, January 10\u201313). Decision theory for discrimination-aware classification. Proceedings of the 2012 IEEE 12th International Conference on Data Mining, Brussels, Belgium.","DOI":"10.1109\/ICDM.2012.45"},{"key":"ref_15","unstructured":"Pleiss, G., Raghavan, M., Wu, F., Kleinberg, J., and Weinberger, K.Q. (2017, January 4\u20139). On fairness and calibration. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_16","first-page":"22","article-title":"Algorithmic fairness","volume":"108","author":"Kleinberg","year":"2018","journal-title":"Am. Econ. Assoc. Pap. Proc."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Dwork, C., Hardt, M., Pitassi, T., Reingold, O., and Zemel, R. (2012, January 8\u201310). Fairness through awareness. Proceedings of the 3rd Innovations in Theoretical Computer Science Conference, Cambridge, MA, USA.","DOI":"10.1145\/2090236.2090255"},{"key":"ref_18","unstructured":"Kilbertus, N., Carulla, M.R., Parascandolo, G., Hardt, M., Janzing, D., and Sch\u00f6lkopf, B. (2017, January 4\u20139). Avoiding discrimination through causal reasoning. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_19","unstructured":"Kusner, M.J., Loftus, J., Russell, C., and Silva, R. (2017, January 4\u20139). Counterfactual fairness. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_20","unstructured":"Kilbertus, N., Ball, P.J., Kusner, M.J., Weller, A., and Silva, R. (2019). The Sensitivity of Counterfactual Fairness to Unmeasured Confounding. arXiv."},{"key":"ref_21","unstructured":"Zafar, M.B., Valera, I., Rodriguez, M., Gummadi, K., and Weller, A. (2017, January 4\u20139). From parity to preference-based notions of fairness in classification. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_22","unstructured":"Dwork, C., Immorlica, N., Kalai, A.T., and Leiserson, M. (2018, January 23\u201324). Decoupled classifiers for group-fair and efficient machine learning. Proceedings of the Conference on Fairness, Accountability and Transparency, New York, NY, USA."},{"key":"ref_23","unstructured":"Donini, M., Oneto, L., Ben-David, S., Shawe-Taylor, J.S., and Pontil, M. (2018, January 3\u20138). Empirical risk minimization under fairness constraints. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Raff, E., Sylvester, J., and Mills, S. (2018, January 13). Fair forests: Regularized tree induction to minimize model bias. Proceedings of the 2018 AAAI\/ACM Conference on AI, Ethics, and Society, New Orleans, LA, USA.","DOI":"10.1145\/3278721.3278742"},{"key":"ref_25","unstructured":"Balcan, M.F., Dick, T., Noothigattu, R., and Procaccia, A.D. (2018). Envy-Free Classification. arXiv."},{"key":"ref_26","unstructured":"Joseph, M., Kearns, M., Morgenstern, J., Neel, S., and Roth, A. (2016). Rawlsian fairness for machine learning. arXiv."},{"key":"ref_27","unstructured":"Bechavod, Y., Ligett, K., Roth, A., Waggoner, B., and Wu, Z.S. (2019). Equal Opportunity in Online Classification with Partial Feedback. arXiv."},{"key":"ref_28","unstructured":"Hardt, M., Price, E., and Srebro, N. (2016, January 5\u201310). Equality of opportunity in supervised learning. Proceedings of the Advances in Neural Information Processing Systems, Barcelona, Spain."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zafar, M.B., Valera, I., Gomez Rodriguez, M., and Gummadi, K.P. (2017, January 3\u20137). Fairness beyond disparate treatment & disparate impact: Learning classification without disparate mistreatment. Proceedings of the 26th International Conference on World Wide Web, Perth, Australia.","DOI":"10.1145\/3038912.3052660"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Kamiran, F., Calders, T., and Pechenizkiy, M. (2010, January 13\u201317). Discrimination aware decision tree learning. Proceedings of the 2010 IEEE International Conference on Data Mining, Sydney, NSW, Australia.","DOI":"10.1109\/ICDM.2010.50"},{"key":"ref_31","unstructured":"Jidling, C., Wahlstr\u00f6m, N., Wills, A., and Sch\u00f6n, T.B. (2017, January 4\u20139). Linearly constrained Gaussian processes. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Rasmussen, C.E. (2004). Gaussian processes in machine learning. Advanced Lectures on Machine Learning, Springer.","DOI":"10.7551\/mitpress\/3206.001.0001"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/0378-3758(91)90002-V","article-title":"Bayes-Hermite quadrature","volume":"29","year":"1991","journal-title":"J. Stat. Plan. Inference"},{"key":"ref_34","unstructured":"Osborne, M., Garnett, R., Ghahramani, Z., Duvenaud, D.K., Roberts, S.J., and Rasmussen, C.E. (2012, January 3\u20136). Active learning of model evidence using Bayesian quadrature. Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Rokach, L., and Maimon, O.Z. (2008). Data Mining with Decision Trees: Theory and Applications, World Scientific.","DOI":"10.1142\/9789812771728"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s10994-006-6226-1","article-title":"Extremely randomized trees","volume":"63","author":"Geurts","year":"2006","journal-title":"Mach. Learn."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/BF00058655","article-title":"Bagging predictors","volume":"24","author":"Breiman","year":"1996","journal-title":"Mach. Learn."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"802","DOI":"10.1111\/j.1365-2656.2008.01390.x","article-title":"A working guide to boosted regression trees","volume":"77","author":"Elith","year":"2008","journal-title":"J. Anim. Ecol."},{"key":"ref_40","unstructured":"Damianou, A., and Lawrence, N. (May, January 29). Deep Gaussian processes. Proceedings of the Artificial Intelligence and Statistics, Scottsdale, AZ, USA."},{"key":"ref_41","unstructured":"Dieterich, W., Mendoza, C., and Brennan, T. (2016). COMPAS Risk Scales: Demonstrating Accuracy Equity and Predictive Parity, Northpoint Inc."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"eaao5580","DOI":"10.1126\/sciadv.aao5580","article-title":"The accuracy, fairness, and limits of predicting recidivism","volume":"4","author":"Dressel","year":"2018","journal-title":"Sci. Adv."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/8\/741\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:10:47Z","timestamp":1760188247000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/8\/741"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,29]]},"references-count":42,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2019,8]]}},"alternative-id":["e21080741"],"URL":"https:\/\/doi.org\/10.3390\/e21080741","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,7,29]]}}}