{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,2]],"date-time":"2026-02-02T09:00:56Z","timestamp":1770022856095,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":40,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,6,12]],"date-time":"2023-06-12T00:00:00Z","timestamp":1686528000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,6,12]]},"DOI":"10.1145\/3593013.3594028","type":"proceedings-article","created":{"date-parts":[[2023,6,12]],"date-time":"2023-06-12T14:40:46Z","timestamp":1686580846000},"page":"604-614","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["Runtime Monitoring of Dynamic Fairness Properties"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2985-7724","authenticated-orcid":false,"given":"Thomas","family":"Henzinger","sequence":"first","affiliation":[{"name":"IST Austria, Austria"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-0820-1696","authenticated-orcid":false,"given":"Mahyar","family":"Karimi","sequence":"additional","affiliation":[{"name":"IST Austria, Austria"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8974-2542","authenticated-orcid":false,"given":"Konstantin","family":"Kueffner","sequence":"additional","affiliation":[{"name":"IST Austria, Austria"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9864-7475","authenticated-orcid":false,"given":"Kaushik","family":"Mallik","sequence":"additional","affiliation":[{"name":"IST Austria, Austria"}]}],"member":"320","published-online":{"date-parts":[[2023,6,12]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"International Conference on Machine Learning. PMLR, 60\u201369","author":"Agarwal Alekh","year":"2018","unstructured":"Alekh Agarwal , Alina Beygelzimer , Miroslav Dud\u00edk , John Langford , and Hanna Wallach . 2018 . A reductions approach to fair classification . In International Conference on Machine Learning. PMLR, 60\u201369 . Alekh Agarwal, Alina Beygelzimer, Miroslav Dud\u00edk, John Langford, and Hanna Wallach. 2018. A reductions approach to fair classification. In International Conference on Machine Learning. PMLR, 60\u201369."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287588"},{"key":"e_1_3_2_1_3_1","volume-title":"Lectures on Runtime Verification","author":"Bartocci Ezio","unstructured":"Ezio Bartocci and Yli\u00e8s Falcone . 2018. Lectures on Runtime Verification . Springer . Ezio Bartocci and Yli\u00e8s Falcone. 2018. Lectures on Runtime Verification. Springer."},{"key":"e_1_3_2_1_4_1","volume-title":"A convex framework for fair regression. arXiv preprint arXiv:1706.02409","author":"Berk Richard","year":"2017","unstructured":"Richard Berk , Hoda Heidari , Shahin Jabbari , Matthew Joseph , Michael Kearns , Jamie Morgenstern , Seth Neel , and Aaron Roth . 2017. A convex framework for fair regression. arXiv preprint arXiv:1706.02409 ( 2017 ). Richard Berk, Hoda Heidari, Shahin Jabbari, Matthew Joseph, Michael Kearns, Jamie Morgenstern, Seth Neel, and Aaron Roth. 2017. A convex framework for fair regression. arXiv preprint arXiv:1706.02409 (2017)."},{"key":"e_1_3_2_1_5_1","volume-title":"Tools and Algorithms for the Construction and Analysis of Systems: 21st International Conference, TACAS","author":"Bloem Roderick","year":"2015","unstructured":"Roderick Bloem , Bettina K\u00f6nighofer , Robert K\u00f6nighofer , and Chao Wang . 2015. Shield synthesis: Runtime enforcement for reactive systems . In Tools and Algorithms for the Construction and Analysis of Systems: 21st International Conference, TACAS 2015 , Held as Part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2015, London, UK, April 11-18, 2015, Proceedings 21. Springer , 533\u2013548. Roderick Bloem, Bettina K\u00f6nighofer, Robert K\u00f6nighofer, and Chao Wang. 2015. Shield synthesis: Runtime enforcement for reactive systems. In Tools and Algorithms for the Construction and Analysis of Systems: 21st International Conference, TACAS 2015, Held as Part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2015, London, UK, April 11-18, 2015, Proceedings 21. Springer, 533\u2013548."},{"key":"e_1_3_2_1_6_1","volume-title":"Why unbiased computational processes can lead to discriminative decision procedures. Discrimination and Privacy in the Information Society: Data mining and profiling in large databases","author":"Calders Toon","year":"2013","unstructured":"Toon Calders and Indr\u0117 \u017dliobait\u0117 . 2013. Why unbiased computational processes can lead to discriminative decision procedures. Discrimination and Privacy in the Information Society: Data mining and profiling in large databases ( 2013 ), 43\u201357. Toon Calders and Indr\u0117 \u017dliobait\u0117. 2013. Why unbiased computational processes can lead to discriminative decision procedures. Discrimination and Privacy in the Information Society: Data mining and profiling in large databases (2013), 43\u201357."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3240323.3240370"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/3398761.3398990"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372878"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2090236.2090255"},{"key":"e_1_3_2_1_11_1","volume-title":"Proceedings of the Conference on Fairness, Accountability, and Transparency. 170\u2013179","author":"Elzayn Hadi","year":"2019","unstructured":"Hadi Elzayn , Shahin Jabbari , Christopher Jung , Michael Kearns , Seth Neel , Aaron Roth , and Zachary Schutzman . 2019 . Fair algorithms for learning in allocation problems . In Proceedings of the Conference on Fairness, Accountability, and Transparency. 170\u2013179 . Hadi Elzayn, Shahin Jabbari, Christopher Jung, Michael Kearns, Seth Neel, Aaron Roth, and Zachary Schutzman. 2019. Fair algorithms for learning in allocation problems. In Proceedings of the Conference on Fairness, Accountability, and Transparency. 170\u2013179."},{"key":"e_1_3_2_1_12_1","volume-title":"Conference on Fairness, Accountability and Transparency. PMLR, 160\u2013171","author":"Ensign Danielle","year":"2018","unstructured":"Danielle Ensign , Sorelle A Friedler , Scott Neville , Carlos Scheidegger , and Suresh Venkatasubramanian . 2018 . Runaway feedback loops in predictive policing . In Conference on Fairness, Accountability and Transparency. PMLR, 160\u2013171 . Danielle Ensign, Sorelle A Friedler, Scott Neville, Carlos Scheidegger, and Suresh Venkatasubramanian. 2018. Runaway feedback loops in predictive policing. In Conference on Fairness, Accountability and Transparency. PMLR, 160\u2013171."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2783311"},{"key":"e_1_3_2_1_14_1","volume-title":"Monitoring Event Frequencies. In 28th EACSL Annual Conference on Computer Science Logic (CSL 2020)(Leibniz International Proceedings in Informatics (LIPIcs)","volume":"16","author":"Ferr\u00e8re Thomas","year":"2020","unstructured":"Thomas Ferr\u00e8re , Thomas A. Henzinger , and Bernhard Kragl . 2020 . Monitoring Event Frequencies. In 28th EACSL Annual Conference on Computer Science Logic (CSL 2020)(Leibniz International Proceedings in Informatics (LIPIcs) , Vol. 152), Maribel Fern\u00e1ndez and Anca Muscholl (Eds.). Schloss Dagstuhl\u2013Leibniz-Zentrum fuer Informatik, Dagstuhl, Germany, 20:1\u201320: 16 . https:\/\/doi.org\/10.4230\/LIPIcs.CSL.2020.20 10.4230\/LIPIcs.CSL.2020.20 Thomas Ferr\u00e8re, Thomas A. Henzinger, and Bernhard Kragl. 2020. Monitoring Event Frequencies. In 28th EACSL Annual Conference on Computer Science Logic (CSL 2020)(Leibniz International Proceedings in Informatics (LIPIcs), Vol. 152), Maribel Fern\u00e1ndez and Anca Muscholl (Eds.). Schloss Dagstuhl\u2013Leibniz-Zentrum fuer Informatik, Dagstuhl, Germany, 20:1\u201320:16. https:\/\/doi.org\/10.4230\/LIPIcs.CSL.2020.20"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1111\/jofi.13090"},{"key":"e_1_3_2_1_16_1","volume-title":"International Conference on Machine Learning. PMLR, 2357\u20132365","author":"Gordaliza Paula","year":"2019","unstructured":"Paula Gordaliza , Eustasio Del Barrio , Gamboa Fabrice , and Jean-Michel Loubes . 2019 . Obtaining fairness using optimal transport theory . In International Conference on Machine Learning. PMLR, 2357\u20132365 . Paula Gordaliza, Eustasio Del Barrio, Gamboa Fabrice, and Jean-Michel Loubes. 2019. Obtaining fairness using optimal transport theory. In International Conference on Machine Learning. PMLR, 2357\u20132365."},{"key":"e_1_3_2_1_17_1","volume-title":"Equality of opportunity in supervised learning. Advances in neural information processing systems 29","author":"Hardt Moritz","year":"2016","unstructured":"Moritz Hardt , Eric Price , and Nati Srebro . 2016. Equality of opportunity in supervised learning. Advances in neural information processing systems 29 ( 2016 ). Moritz Hardt, Eric Price, and Nati Srebro. 2016. Equality of opportunity in supervised learning. Advances in neural information processing systems 29 (2016)."},{"key":"e_1_3_2_1_18_1","first-page":"02","article-title":"Amazon\u2019s Alexa and Google Home show accent bias, with Chinese and Spanish hardest to understand. http:\/\/bit.ly\/2QFA1MR","volume":"05","author":"Harwell Drew","year":"2018","unstructured":"Drew Harwell . 2018 . Amazon\u2019s Alexa and Google Home show accent bias, with Chinese and Spanish hardest to understand. http:\/\/bit.ly\/2QFA1MR . Accessed : 05 . 02 .2023. Drew Harwell. 2018. Amazon\u2019s Alexa and Google Home show accent bias, with Chinese and Spanish hardest to understand. http:\/\/bit.ly\/2QFA1MR. Accessed: 05.02.2023.","journal-title":"Accessed"},{"key":"e_1_3_2_1_19_1","volume-title":"International Conference on Machine Learning. PMLR","author":"Hashimoto Tatsunori","year":"2018","unstructured":"Tatsunori Hashimoto , Megha Srivastava , Hongseok Namkoong , and Percy Liang . 2018 . Fairness without demographics in repeated loss minimization . In International Conference on Machine Learning. PMLR , 1929\u20131938. Tatsunori Hashimoto, Megha Srivastava, Hongseok Namkoong, and Percy Liang. 2018. Fairness without demographics in repeated loss minimization. In International Conference on Machine Learning. PMLR, 1929\u20131938."},{"key":"e_1_3_2_1_20_1","volume-title":"On the long-term impact of algorithmic decision policies: Effort unfairness and feature segregation through social learning. arXiv preprint arXiv:1903.01209","author":"Heidari Hoda","year":"2019","unstructured":"Hoda Heidari , Vedant Nanda , and Krishna P Gummadi . 2019. On the long-term impact of algorithmic decision policies: Effort unfairness and feature segregation through social learning. arXiv preprint arXiv:1903.01209 ( 2019 ). Hoda Heidari, Vedant Nanda, and Krishna P Gummadi. 2019. On the long-term impact of algorithmic decision policies: Effort unfairness and feature segregation through social learning. arXiv preprint arXiv:1903.01209 (2019)."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"crossref","unstructured":"Thomas A. Henzinger Mahyar Karimi Konstantin Kueffner and Kaushik Mallik. 2023. Monitoring Algorithmic Fairness. In Computer Aided Verification. (to appear). Thomas A. Henzinger Mahyar Karimi Konstantin Kueffner and Kaushik Mallik. 2023. Monitoring Algorithmic Fairness. In Computer Aided Verification. (to appear).","DOI":"10.1007\/978-3-031-37703-7_17"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"crossref","unstructured":"Thomas A. Henzinger Mahyar Karimi Konstantin Kueffner and Kaushik Mallik. 2023. Runtime Monitoring of Dynamic Fairness Properties. arxiv:2305.04699 [cs.CY] Thomas A. Henzinger Mahyar Karimi Konstantin Kueffner and Kaushik Mallik. 2023. Runtime Monitoring of Dynamic Fairness Properties. arxiv:2305.04699 [cs.CY]","DOI":"10.1145\/3593013.3594028"},{"key":"e_1_3_2_1_23_1","first-page":"24005","article-title":"Fair algorithms for multi-agent multi-armed bandits","volume":"34","author":"Hossain Safwan","year":"2021","unstructured":"Safwan Hossain , Evi Micha , and Nisarg Shah . 2021 . Fair algorithms for multi-agent multi-armed bandits . Advances in Neural Information Processing Systems 34 (2021), 24005 \u2013 24017 . Safwan Hossain, Evi Micha, and Nisarg Shah. 2021. Fair algorithms for multi-agent multi-armed bandits. Advances in Neural Information Processing Systems 34 (2021), 24005\u201324017.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_24_1","volume-title":"Data preprocessing techniques for classification without discrimination. Knowledge and information systems 33, 1","author":"Kamiran Faisal","year":"2012","unstructured":"Faisal Kamiran and Toon Calders . 2012. Data preprocessing techniques for classification without discrimination. Knowledge and information systems 33, 1 ( 2012 ), 1\u201333. Faisal Kamiran and Toon Calders. 2012. Data preprocessing techniques for classification without discrimination. Knowledge and information systems 33, 1 (2012), 1\u201333."},{"key":"e_1_3_2_1_25_1","volume-title":"International Conference on Machine Learning. PMLR, 3150\u20133158","author":"Liu Lydia T","year":"2018","unstructured":"Lydia T Liu , Sarah Dean , Esther Rolf , Max Simchowitz , and Moritz Hardt . 2018 . Delayed impact of fair machine learning . In International Conference on Machine Learning. PMLR, 3150\u20133158 . Lydia T Liu, Sarah Dean, Esther Rolf, Max Simchowitz, and Moritz Hardt. 2018. Delayed impact of fair machine learning. In International Conference on Machine Learning. PMLR, 3150\u20133158."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372861"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3137003.3137005"},{"key":"e_1_3_2_1_28_1","volume-title":"2012 Second International Conference on Intelligent System Design and Engineering Application. IEEE, 509\u2013515","author":"Mao Jianhui","year":"2012","unstructured":"Jianhui Mao and Liqian Chen . 2012 . Runtime monitoring for cyber-physical systems: a case study of cooperative adaptive cruise control . In 2012 Second International Conference on Intelligent System Design and Engineering Application. IEEE, 509\u2013515 . Jianhui Mao and Liqian Chen. 2012. Runtime monitoring for cyber-physical systems: a case study of cooperative adaptive cruise control. In 2012 Second International Conference on Intelligent System Design and Engineering Application. IEEE, 509\u2013515."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3457607"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287599"},{"key":"e_1_3_2_1_31_1","volume-title":"Modern control engineering","author":"Katsuhiko Ogata","unstructured":"Katsuhiko Ogata 2010. Modern control engineering . Vol. 5 . Prentice hall Upper Saddle River, NJ. Katsuhiko Ogata 2010. Modern control engineering. Vol. 5. Prentice hall Upper Saddle River, NJ."},{"key":"e_1_3_2_1_32_1","volume-title":"Tracking the risk of a deployed model and detecting harmful distribution shifts. arXiv preprint arXiv:2110.06177","author":"Podkopaev Aleksandr","year":"2021","unstructured":"Aleksandr Podkopaev and Aaditya Ramdas . 2021. Tracking the risk of a deployed model and detecting harmful distribution shifts. arXiv preprint arXiv:2110.06177 ( 2021 ). Aleksandr Podkopaev and Aaditya Ramdas. 2021. Tracking the risk of a deployed model and detecting harmful distribution shifts. arXiv preprint arXiv:2110.06177 (2021)."},{"key":"e_1_3_2_1_33_1","volume-title":"High-dimensional statistics: A non-asymptotic viewpoint","author":"Wainwright Martin J","unstructured":"Martin J Wainwright . 2019. High-dimensional statistics: A non-asymptotic viewpoint . Vol. 48 . Cambridge university press . Martin J Wainwright. 2019. High-dimensional statistics: A non-asymptotic viewpoint. Vol. 48. Cambridge university press."},{"key":"e_1_3_2_1_34_1","volume-title":"Time-uniform central limit theory, asymptotic confidence sequences, and anytime-valid causal inference. arXiv preprint arXiv:2103.06476","author":"Waudby-Smith Ian","year":"2021","unstructured":"Ian Waudby-Smith , David Arbour , Ritwik Sinha , Edward H Kennedy , and Aaditya Ramdas . 2021. Time-uniform central limit theory, asymptotic confidence sequences, and anytime-valid causal inference. arXiv preprint arXiv:2103.06476 ( 2021 ). Ian Waudby-Smith, David Arbour, Ritwik Sinha, Edward H Kennedy, and Aaditya Ramdas. 2021. Time-uniform central limit theory, asymptotic confidence sequences, and anytime-valid causal inference. arXiv preprint arXiv:2103.06476 (2021)."},{"key":"e_1_3_2_1_35_1","volume-title":"Estimating means of bounded random variables by betting. arXiv preprint arXiv:2010.09686","author":"Waudby-Smith Ian","year":"2020","unstructured":"Ian Waudby-Smith and Aaditya Ramdas . 2020. Estimating means of bounded random variables by betting. arXiv preprint arXiv:2010.09686 ( 2020 ). Ian Waudby-Smith and Aaditya Ramdas. 2020. Estimating means of bounded random variables by betting. arXiv preprint arXiv:2010.09686 (2020)."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052660"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.5555\/3322706.3362016"},{"key":"e_1_3_2_1_38_1","volume-title":"International conference on machine learning. PMLR, 325\u2013333","author":"Zemel Rich","year":"2013","unstructured":"Rich Zemel , Yu Wu , Kevin Swersky , Toni Pitassi , and Cynthia Dwork . 2013 . Learning fair representations . In International conference on machine learning. PMLR, 325\u2013333 . Rich Zemel, Yu Wu, Kevin Swersky, Toni Pitassi, and Cynthia Dwork. 2013. Learning fair representations. In International conference on machine learning. PMLR, 325\u2013333."},{"key":"e_1_3_2_1_39_1","volume-title":"Group retention when using machine learning in sequential decision making: the interplay between user dynamics and fairness. Advances in neural information processing systems 32","author":"Zhang Xueru","year":"2019","unstructured":"Xueru Zhang , Mohammadmahdi Khaliligarekani , Cem Tekin , 2019. Group retention when using machine learning in sequential decision making: the interplay between user dynamics and fairness. Advances in neural information processing systems 32 ( 2019 ). Xueru Zhang, Mohammadmahdi Khaliligarekani, Cem Tekin, 2019. Group retention when using machine learning in sequential decision making: the interplay between user dynamics and fairness. Advances in neural information processing systems 32 (2019)."},{"key":"e_1_3_2_1_40_1","volume-title":"Handbook of Reinforcement Learning and Control","author":"Zhang Xueru","unstructured":"Xueru Zhang and Mingyan Liu . 2021. Fairness in learning-based sequential decision algorithms: A survey . In Handbook of Reinforcement Learning and Control . Springer , 525\u2013555. Xueru Zhang and Mingyan Liu. 2021. Fairness in learning-based sequential decision algorithms: A survey. In Handbook of Reinforcement Learning and Control. Springer, 525\u2013555."}],"event":{"name":"FAccT '23: the 2023 ACM Conference on Fairness, Accountability, and Transparency","location":"Chicago IL USA","acronym":"FAccT '23"},"container-title":["2023 ACM Conference on Fairness, Accountability, and Transparency"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3593013.3594028","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3593013.3594028","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:48:03Z","timestamp":1750178883000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3593013.3594028"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,12]]},"references-count":40,"alternative-id":["10.1145\/3593013.3594028","10.1145\/3593013"],"URL":"https:\/\/doi.org\/10.1145\/3593013.3594028","relation":{},"subject":[],"published":{"date-parts":[[2023,6,12]]},"assertion":[{"value":"2023-06-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}