{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T13:12:21Z","timestamp":1770729141764,"version":"3.49.0"},"reference-count":82,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2023,12,19]],"date-time":"2023-12-19T00:00:00Z","timestamp":1702944000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003977","name":"Israel Science Foundation","doi-asserted-by":"crossref","award":["2019\/19"],"award-info":[{"award-number":["2019\/19"]}],"id":[{"id":"10.13039\/501100003977","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2024,2,29]]},"abstract":"<jats:p>Intelligent systems support human operators\u2019 decision-making processes, many of which are dynamic and involve temporal changes in the decision-related parameters. As we increasingly depend on automation, it becomes imperative to understand and quantify its influence on the operator\u2019s decisions and to evaluate its implications for the human\u2019s causal responsibility for outcomes. Past studies proposed a model for human responsibility in static decision-making processes involving intelligent systems. We present a model for dynamic, non-stationary decision-making events based on the concept of causation strength. We apply it to a test case of a dynamic binary categorization decision. The results show that for automation to influence humans significantly, it must have high detection sensitivity. However, this condition is insufficient since it is unlikely that automation, irrespective of its sensitivity, will sway humans with high detection sensitivity away from their original position. Specific combinations of automation and human detection sensitivities are required for automation to have a major influence. Moreover, the automation influence and the human causal responsibility that can be derived from it are sensitive to possible changes in the human\u2019s detection capabilities due to fatigue or other factors, creating a \u201cResponsibility Cliff.\u201d This should be considered during system design and when policies and regulations are defined. This model constitutes a basis for further analyses of complex events in which human and automation sensitivity levels change over time and for evaluating human involvement in such events.<\/jats:p>","DOI":"10.1145\/3631611","type":"journal-article","created":{"date-parts":[[2023,11,3]],"date-time":"2023-11-03T20:06:51Z","timestamp":1699042011000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Quantifying Levels of Influence and Causal Responsibility in Dynamic Decision Making Events"],"prefix":"10.1145","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0941-8932","authenticated-orcid":false,"given":"Yossef","family":"Saad","sequence":"first","affiliation":[{"name":"Department of Industrial Engineering, Faculty of Engineering, Tel Aviv University, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1801-9987","authenticated-orcid":false,"given":"Joachim","family":"Meyer","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, Faculty of Engineering, Tel Aviv University, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,12,19]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ssci.2020.104968"},{"key":"e_1_3_3_3_2","first-page":"222","volume-title":"Human-Centered Aviation Automation: Principles and Guidelines","author":"Billings Charles E.","year":"1996","unstructured":"Charles E. Billings. 1996. Human-Centered Aviation Automation: Principles and Guidelines. Technical Report. NASA, NASA Ames Research Center Moffett Field, CA United States. 222 pages. https:\/\/ntrs.nasa.gov\/api\/citations\/19960016374\/downloads\/19960016374.pdf"},{"key":"e_1_3_3_4_2","volume-title":"Limits on Autonomy in Weapon Systems: Identifying Practical Elements of Human Control","author":"Boulanin Vincent","year":"2020","unstructured":"Vincent Boulanin, Moa Peldan Carlsson, Netta Goussac, and Neil Davison. 2020. Limits on Autonomy in Weapon Systems: Identifying Practical Elements of Human Control. Technical Report. Stockholm International Peace Research Institute. https:\/\/www.sipri.org\/sites\/default\/files\/2020-06\/2006_limits_of_autonomy.pdf"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/0001-6918(92)90019-A"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.100.3.432"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1111\/itor.12936"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2427.2009.02286.x"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-008-0139-1"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/ITSC.2010.5625077"},{"key":"e_1_3_3_11_2","volume-title":"The Theory of Stochastic Processes","author":"Cox D. R.","year":"1965","unstructured":"D. R. Cox and H. D. Miller. 1965. The Theory of Stochastic Processes. Chapman & Hall\/CRC, Boca Raton, FL."},{"issue":"5","key":"e_1_3_3_12_2","article-title":"The killer robots are here: Legal and policy implications","volume":"36","author":"Crootof Rebecca","year":"2015","unstructured":"Rebecca Crootof. 2015. The killer robots are here: Legal and policy implications. Cardozo Law Review 36, 5 (12015). https:\/\/scholarship.richmond.edu\/law-faculty-publications\/1595","journal-title":"Cardozo Law Review"},{"key":"e_1_3_3_13_2","first-page":"63","article-title":"Augmenting team cognition in human-automation teams performing in complex operational environments","volume":"78","author":"Cuevas Haydee","year":"2007","unstructured":"Haydee Cuevas, Stephen Fiore, Barrett Caldwell, and Laura Strater. 2007. Augmenting team cognition in human-automation teams performing in complex operational environments. Aviation, Space, and Environmental Medicine 78 (62007), 63\u201370.","journal-title":"Aviation, Space, and Environmental Medicine"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/J.TRA.2019.08.002"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/COGSIMA.2016.7497782"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1177\/0018720820940516"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/TASE.2020.2965466"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/3425732"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1177\/001872086200400201"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511570667"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1080\/001401399185595"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2014.04.049"},{"key":"e_1_3_3_23_2","unstructured":"European Union. 2016. Article 22 - Automated individual decision-making including profiling. https:\/\/gdpr-info.eu\/art-22-gdpr\/"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1007\/S10111-019-00576-1\/FIGURES\/12"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.2196\/14464"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/J.COGNITION.2009.12.011"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2012.05.028"},{"key":"e_1_3_3_28_2","volume-title":"Signal Detection Theory and Psychophysics","author":"Green David M.","year":"1966","unstructured":"David M. Green and John A. Swets. 1966. Signal Detection Theory and Psychophysics. John Wiley & Sons. https:\/\/psycnet.apa.org\/record\/1967-02286-000"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2020.01069"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780199534777.001.0001"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780199534777.001.0001"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780198254744.001.0001"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1515\/crll.1909.136.210"},{"key":"e_1_3_3_34_2","unstructured":"Christopher Hitchcock. 2021. Probabilistic Causation. https:\/\/plato.stanford.edu\/cgi-bin\/encyclopedia\/archinfo.cgi?entry=causation-probabilistic"},{"key":"e_1_3_3_35_2","unstructured":"Michael C. Horowitz and Paul Scharre. 2015. Meaningful human control in weapon systems: A primer. (2015) 2\u201316 pages. https:\/\/www.cnas.org\/publications\/reports\/an-introduction-to-autonomy-in-weapon-systems"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1037\/H0093874"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1002\/wcs.76"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.5898\/JHRI.3.1.Johnson"},{"key":"e_1_3_3_39_2","volume-title":"Principles of Statistical Mechanics (1st ed.)","author":"Katz Amnon","year":"1967","unstructured":"Amnon Katz. 1967. Principles of Statistical Mechanics (1st ed.). W. H. Freeman, San Francisco, CA."},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1097\/JNN.0000000000000021"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1016\/0001-6918(94)90013-2"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1016\/0749-5978(87)90028-8"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.15827\/2311-6749.38.449"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.2991\/ijcis.d.200924.002"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1111\/cogs.12054"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.baae.2010.08.011\u00ef"},{"issue":"140","key":"e_1_3_3_47_2","first-page":"5","article-title":"A technique for the measurement of attitudes","volume":"22","author":"Likert Rensis","year":"1932","unstructured":"Rensis Likert. 1932. A technique for the measurement of attitudes. Archives of Psychology 22, 140 (61932), 5\u201355.","journal-title":"Archives of Psychology"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.3390\/E16031493"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1111\/soc4.13097"},{"issue":"4","key":"e_1_3_3_50_2","first-page":"395","article-title":"Intelligent safety warning and alert system for car driving","volume":"13","author":"Lu Shih Nan","year":"2010","unstructured":"Shih Nan Lu, Hsien Wei Tseng, Yang Han Lee, Yih Guang Jan, and Wei Chen Lee. 2010. Intelligent safety warning and alert system for car driving. Tamkang Journal of Science and Engineering 13, 4 (2010), 395\u2013404.","journal-title":"Tamkang Journal of Science and Engineering"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1016\/b0-08-043076-7\/00677-x"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.4324\/9781410611147"},{"key":"e_1_3_3_53_2","first-page":"189","volume-title":"Decision Making: Cognitive Models and Explanations","author":"Maule John A.","year":"1997","unstructured":"John A. Maule and Anne C. Edland. 1997. The effects of time pressure on human judgement and decision making. In Decision Making: Cognitive Models and Explanations, Rob Ranyard, Crozier Ray W., and Ola Svenson (Eds.). Routledge, New York, NY, Chapter 11, 189\u2013204."},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1006\/cogp.1994.1007"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSYST.2018.2890121"},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11547-020-01135-9"},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ajem.2009.07.005"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10111-018-0537-4"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/3468.844354"},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1080\/12460125.2020.1768680"},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-48713-5"},{"key":"e_1_3_3_62_2","doi-asserted-by":"publisher","DOI":"10.1518\/155723409X448026"},{"key":"e_1_3_3_63_2","doi-asserted-by":"publisher","DOI":"10.1007\/S10278-009-9257-X"},{"key":"e_1_3_3_64_2","doi-asserted-by":"publisher","DOI":"10.1016\/0022-2496(67)90041-7"},{"key":"e_1_3_3_65_2","unstructured":"SAE. 2016. Surface Vehicle Recommended Practice - Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles."},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-44289-7_5"},{"key":"e_1_3_3_67_2","doi-asserted-by":"publisher","DOI":"10.1111\/bioe.12887"},{"key":"e_1_3_3_68_2","doi-asserted-by":"publisher","DOI":"10.1002\/bjs.10046"},{"key":"e_1_3_3_69_2","doi-asserted-by":"publisher","DOI":"10.1007\/s13347-021-00450-x"},{"key":"e_1_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2018.00015"},{"key":"e_1_3_3_71_2","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.34.2.139"},{"key":"e_1_3_3_72_2","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.50.4.697"},{"key":"e_1_3_3_73_2","volume-title":"Handbook of Human Factors and Ergonomics (4th ed.)","author":"Sheridan Thomas B.","year":"2012","unstructured":"Thomas B. Sheridan. 2012. Human supervisory control. In Handbook of Human Factors and Ergonomics (4th ed.), Gavriel Salvendy (Ed.). John Wiley & Sons Inc., Hoboken, NJ, Chapter 34."},{"key":"e_1_3_3_74_2","doi-asserted-by":"publisher","DOI":"10.21236\/ADA057655"},{"key":"e_1_3_3_75_2","doi-asserted-by":"publisher","DOI":"10.1007\/S43681-022-00168-2"},{"key":"e_1_3_3_76_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-020-0221-y"},{"key":"e_1_3_3_77_2","doi-asserted-by":"publisher","DOI":"10.1007\/s13347-022-00571-x"},{"key":"e_1_3_3_78_2","doi-asserted-by":"publisher","DOI":"10.1109\/GLOCOM.2009.5426267"},{"key":"e_1_3_3_79_2","doi-asserted-by":"publisher","DOI":"10.1007\/s43681-020-00009-0"},{"key":"e_1_3_3_80_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-007-1878-4_2"},{"key":"e_1_3_3_81_2","doi-asserted-by":"publisher","DOI":"10.17226\/6018"},{"key":"e_1_3_3_82_2","volume-title":"Elementary Signal Detection Theory","author":"Wikens Thomas D.","year":"2002","unstructured":"Thomas D. Wikens. 2002. Elementary Signal Detection Theory. Oxford University Press, New York, NY. 262 pages."},{"key":"e_1_3_3_83_2","doi-asserted-by":"publisher","DOI":"10.1080\/18756891.2015.1023586"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3631611","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3631611","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:03:53Z","timestamp":1750291433000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3631611"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,19]]},"references-count":82,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,2,29]]}},"alternative-id":["10.1145\/3631611"],"URL":"https:\/\/doi.org\/10.1145\/3631611","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,19]]},"assertion":[{"value":"2023-02-05","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-10-23","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-12-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}