{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T15:29:05Z","timestamp":1782401345739,"version":"3.54.5"},"reference-count":20,"publisher":"Association for Computing Machinery (ACM)","issue":"3","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Digit. Gov.: Res. Pract."],"published-print":{"date-parts":[[2025,9,30]]},"abstract":"<jats:p>In view of recent scandals, evolving regulatory demands, and changing perceptions of human involvement in automated systems, this study examines how the role of humans in semi-automated administrative decision-making (AADM) is conceptualized in academic literature. We conducted a qualitative systematic literature review from the public administration, law and socio-technological fields, to critically examine what is understood as human involvement in AADM.<\/jats:p>\n          <jats:p>Our findings suggest that the literature largely focuses on human intervention in AADM, where individual decision-makers either review automated outputs before deciding (human-in-the-loop) or review automated decisions (human-out-of-the-loop). However, a broader scope on human involvement in AADM\u2014which also includes system designers (human-in-control) and monitoring and supervisory roles responsible for ongoing oversight (human-on-the-loop)\u2014is crucial to fully capture the human-machine dynamic in AADM.<\/jats:p>\n          <jats:p>These insights can be used to advance the understanding of the human-automation interaction in AADM through a more comprehensive conceptualization of human involvement. This broader, governance-oriented, view has the potential to optimize the interrelationship between human involvement and automation, ultimately improving accountability, effectiveness, and adaptability in AADM. New legislation underscores the importance of meaningful human involvement beyond isolated review points, encompassing design and ongoing oversight.<\/jats:p>","DOI":"10.1145\/3716173","type":"journal-article","created":{"date-parts":[[2025,2,4]],"date-time":"2025-02-04T20:39:27Z","timestamp":1738701567000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["From Human Intervention to Human Involvement: A Critical Examination of the Role of Humans in (Semi-)Automated Administrative Decision-Making"],"prefix":"10.1145","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3313-545X","authenticated-orcid":false,"given":"Lucas","family":"Haitsma","sequence":"first","affiliation":[{"name":"Constitutional law, administrative law and public administration, University of Groningen Faculty of Law","place":["Groningen, Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9560-9393","authenticated-orcid":false,"given":"Barbara","family":"Brink","sequence":"additional","affiliation":[{"name":"Constitutional law, administrative law and public administration, University of Groningen Faculty of Law","place":["Groningen, Netherlands"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,8,27]]},"reference":[{"key":"e_1_3_2_2_1","unstructured":"Vooringenomenheid Voorkomen. 2024. Algorithm Audit AA:2024:02. Retrieved from https:\/\/algorithmaudit.eu\/nl\/algoprudence\/cases\/aa202402_preventing-prejudice_addendum\/."},{"key":"e_1_3_2_3_1","doi-asserted-by":"publisher","DOI":"10.1111\/rego.12358"},{"key":"e_1_3_2_4_1","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780198826491.003.0055"},{"key":"e_1_3_2_5_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13643-023-02178-5"},{"key":"e_1_3_2_6_1","unstructured":"J. Gerards. 2023. Machine learning and profiling in the PNR system. VerfBlog. Retrieved May 7 2023 from https:\/\/verfassungsblog.de\/ml-pnr\/."},{"key":"e_1_3_2_7_1","unstructured":"J. H. Gerards and E. R. Brouwer. 2022. Ligue des droits humains (HvJ EU C-817\/19)\u2014verduidelijking en vragen naar aanleiding van het passenger-name-record (PNR)-systeem. European Human Rights Cases Update. Retrieved from https:\/\/www.ehrc-updates.nl\/commentaar\/212281?skip_boomportal_auth=1."},{"key":"e_1_3_2_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.clsr.2022.105681"},{"key":"e_1_3_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/10.1145\/3287560.3287563"},{"key":"e_1_3_2_10_1","doi-asserted-by":"crossref","unstructured":"Case C-634\/21. 2023. SCHUFA Holdings ECLI:EU:C:2023:957.","DOI":"10.1038\/s41579-023-00911-4"},{"key":"e_1_3_2_11_1","unstructured":"Case C-817\/19. 2022. Ligue des Droits Humains EU:C:2022:491."},{"key":"e_1_3_2_12_1","doi-asserted-by":"publisher","DOI":"10.5553\/RdW\/138064242023044003004"},{"key":"e_1_3_2_13_1","doi-asserted-by":"publisher","DOI":"10.2924\/EJLS.2019.019"},{"key":"e_1_3_2_14_1","doi-asserted-by":"publisher","DOI":"10.1177\/1023263X20978649"},{"key":"e_1_3_2_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00146-023-01777"},{"key":"e_1_3_2_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.clsr.2023.105833"},{"key":"e_1_3_2_17_1","volume-title":"The Coding Manual for Qualitative Researchers","author":"Saldana J.","year":"2013","unstructured":"J. Saldana. 2013. The Coding Manual for Qualitative Researchers, 2nd ed. Sage Publications, Thousand Oaks, CA.","edition":"2"},{"key":"e_1_3_2_18_1","article-title":"Het UWV wil \u201cmenselijker\u201d worden, maar bij de afdeling Handhaving tellen vooral de targets","author":"Stokmans D.","year":"2024","unstructured":"D. Stokmans and S. Moeliker. 2024. Het UWV wil \u201cmenselijker\u201d worden, maar bij de afdeling Handhaving tellen vooral de targets. NRC. Retrieved from https:\/\/www.nrc.nl\/nieuws\/2024\/04\/19\/bij-handhaving-blijft-de-menselijke-maat-zoek-a4196601?t=1717060846.","journal-title":"NRC"},{"key":"e_1_3_2_19_1","doi-asserted-by":"publisher","DOI":"10.17176\/20230512-181843-0"},{"key":"e_1_3_2_20_1","doi-asserted-by":"publisher","DOI":"10.1002\/poi3.198"},{"key":"e_1_3_2_21_1","doi-asserted-by":"publisher","DOI":"10.1080\/20508840.2022.2033945"}],"container-title":["Digital Government: Research and Practice"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3716173","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,27]],"date-time":"2025-08-27T12:39:41Z","timestamp":1756298381000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3716173"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,27]]},"references-count":20,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,9,30]]}},"alternative-id":["10.1145\/3716173"],"URL":"https:\/\/doi.org\/10.1145\/3716173","relation":{},"ISSN":["2691-199X","2639-0175"],"issn-type":[{"value":"2691-199X","type":"print"},{"value":"2639-0175","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,27]]},"assertion":[{"value":"2024-07-12","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-01-08","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-08-27","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}