{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T16:08:58Z","timestamp":1778861338766,"version":"3.51.4"},"reference-count":35,"publisher":"Walter de Gruyter GmbH","issue":"2","funder":[{"DOI":"10.13039\/501100002347","name":"Bundesministerium f\u00fcr Bildung und Forschung","doi-asserted-by":"publisher","award":["16SV7675K"],"award-info":[{"award-number":["16SV7675K"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018,2,23]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>In the near future, drivers of automated cars will still have to take over from time to time at short notice. Current control systems implement a hard switch, disabling the automation all at once. However, studies show that the driver\u2019s ability to take over depends on his last activity. We therefore propose a system that uses camera based observation of the driver to assess the situation and to predict transition times. We combine this with a control system that uses a cooperative shared control method to support the driver in takeover situations and allows him to adjust safely to the current situation. We present our first steps towards this goal and show both how the behavior of the driver in the interior can be assessed and how a cooperative control transfer can be implemented. We further point out the necessary steps to implement the proposed system and give a first impression of the performance via simulation.<\/jats:p>","DOI":"10.1515\/auto-2017-0103","type":"journal-article","created":{"date-parts":[[2018,2,10]],"date-time":"2018-02-10T10:00:47Z","timestamp":1518256847000},"page":"146-159","source":"Crossref","is-referenced-by-count":17,"title":["Driver observation and shared vehicle control: supporting the driver on the way back into the control loop"],"prefix":"10.1515","volume":"66","author":[{"given":"Julian","family":"Ludwig","sequence":"first","affiliation":[{"name":"Karlsruher Institut f\u00fcr Technologie , Fakult\u00e4t f\u00fcr Elektrotechnik und Informationstechnik , Karlsruhe , Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Manuel","family":"Martin","sequence":"additional","affiliation":[{"name":"Fraunhofer IOSB , Karlsruhe , Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthias","family":"Horne","sequence":"additional","affiliation":[{"name":"Fraunhofer IOSB , Karlsruhe , Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Flad","sequence":"additional","affiliation":[{"name":"Karlsruher Institut f\u00fcr Technologie , Fakult\u00e4t f\u00fcr Elektrotechnik und Informationstechnik , Karlsruhe , Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Voit","sequence":"additional","affiliation":[{"name":"Fraunhofer IOSB , Karlsruhe , Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rainer","family":"Stiefelhagen","sequence":"additional","affiliation":[{"name":"Karlsruher Institut f\u00fcr Technologie , Fakult\u00e4t f\u00fcr Informatik , Karlsruhe , Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"S\u00f6ren","family":"Hohmann","sequence":"additional","affiliation":[{"name":"Karlsruher Institut f\u00fcr Technologie , Fakult\u00e4t f\u00fcr Elektrotechnik und Informationstechnik , Karlsruhe , Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"374","published-online":{"date-parts":[[2018,2,10]]},"reference":[{"key":"2023033119444907707_j_auto-2017-0103_ref_001_w2aab3b7b1b1b6b1ab1b4b1Aa","unstructured":"Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles sae j 3016, 2016."},{"key":"2023033119444907707_j_auto-2017-0103_ref_002_w2aab3b7b1b1b6b1ab1b4b2Aa","doi-asserted-by":"crossref","unstructured":"David A. Abbink, Mark Mulder, and Erwin R. Boer. Haptic shared control: smoothly shifting control authority? Cognition, Technology & Work, 14(1):19\u201328, 2012.10.1007\/s10111-011-0192-5","DOI":"10.1007\/s10111-011-0192-5"},{"key":"2023033119444907707_j_auto-2017-0103_ref_003_w2aab3b7b1b1b6b1ab1b4b3Aa","doi-asserted-by":"crossref","unstructured":"Shinko Y. Cheng and Mohan M. Trivedi. Vision-based infotainment user determination by hand recognition for driver assistance. IEEE transactions on intelligent transportation systems, 11(3):759\u2013764, 2010.10.1109\/TITS.2010.2049354","DOI":"10.1109\/TITS.2010.2049354"},{"key":"2023033119444907707_j_auto-2017-0103_ref_004_w2aab3b7b1b1b6b1ab1b4b4Aa","unstructured":"Daniel Damb\u00f6ck, Mehdi Farid, Lars T\u00f6nert, and Klaus Bengler. \u00dcbernahmezeiten beim hochautomatisierten fahren. Tagung Fahrerassistenz. M\u00fcnchen, 15:16, 2012."},{"key":"2023033119444907707_j_auto-2017-0103_ref_005_w2aab3b7b1b1b6b1ab1b4b5Aa","doi-asserted-by":"crossref","unstructured":"Aaron Enes and Wayne Book. Blended shared control of zermelo\u2019s navigation problem. In American Control Conference (ACC), pages 4307\u20134312. IEEE, 2010.","DOI":"10.1109\/ACC.2010.5530818"},{"key":"2023033119444907707_j_auto-2017-0103_ref_006_w2aab3b7b1b1b6b1ab1b4b6Aa","unstructured":"Jacob Engwerda. LQ dynamic optimization and differential games. John Wiley & Sons, 2005."},{"key":"2023033119444907707_j_auto-2017-0103_ref_007_w2aab3b7b1b1b6b1ab1b4b7Aa","doi-asserted-by":"crossref","unstructured":"Michael Flad, Jonas Otten, Stefan Schwab, and S\u00f6ren Hohmann. Steering driver assistance system: A systematic cooperative shared control design approach. In Proceedings of the International Conference on Systems, Man and Cybernetics (SMC), pages 3585\u20133592, 2014.","DOI":"10.1109\/SMC.2014.6974486"},{"key":"2023033119444907707_j_auto-2017-0103_ref_008_w2aab3b7b1b1b6b1ab1b4b8Aa","doi-asserted-by":"crossref","unstructured":"Christian Gold, Daniel Damb\u00f6ck, Lutz Lorenz, and Klaus Bengler. \u201cTake over!\u201d How long does it take to get the driver back into the loop? In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, volume 57, pages 1938\u20131942, 2013.","DOI":"10.1177\/1541931213571433"},{"key":"2023033119444907707_j_auto-2017-0103_ref_009_w2aab3b7b1b1b6b1ab1b4b9Aa","doi-asserted-by":"crossref","unstructured":"Albert Haque, Boya Peng, Zelun Luo, Alexandre Alahi, Serena Yeung, Li Fei-Fei, Jiri Matas, Nicu Sebe, and Max Welling. Towards viewpoint invariant 3d human pose estimation. In Proceedings of the European Conference on Computer Vision (ECCV), pages 160\u2013177, 2016.","DOI":"10.1007\/978-3-319-46448-0_10"},{"key":"2023033119444907707_j_auto-2017-0103_ref_010_w2aab3b7b1b1b6b1ab1b4c10Aa","doi-asserted-by":"crossref","unstructured":"Nikolas Hesse, Gregor Stachowiak, Timo Breuer, and Michael Arens. Estimating body pose of infants in depth images using random ferns. In Proceedings of the IEEE International Conference on Computer Vision Workshops, pages 35\u201343, 2015.","DOI":"10.1109\/ICCVW.2015.63"},{"key":"2023033119444907707_j_auto-2017-0103_ref_011_w2aab3b7b1b1b6b1ab1b4c11Aa","doi-asserted-by":"crossref","unstructured":"Pedro Jim\u00e9nez, Luis M. Bergasa, Jes\u00fas Nuevo, Noelia Hern\u00e1ndez, and Ivan G. Daza. Gaze fixation system for the evaluation of driver distractions induced by ivis. IEEE Transactions on Intelligent Transportation Systems, 13(3):1167\u20131178, 2012.10.1109\/TITS.2012.2187517","DOI":"10.1109\/TITS.2012.2187517"},{"key":"2023033119444907707_j_auto-2017-0103_ref_012_w2aab3b7b1b1b6b1ab1b4c12Aa","doi-asserted-by":"crossref","unstructured":"Uwe Kiencke and Lars Nielsen. Automotive control systems: for engine, driveline, and vehicle. Springer, 2005.","DOI":"10.1007\/b137654"},{"key":"2023033119444907707_j_auto-2017-0103_ref_013_w2aab3b7b1b1b6b1ab1b4c13Aa","doi-asserted-by":"crossref","unstructured":"Charles C. Liu, Simon G. Hosking, and Michael G. Lenn\u00e9. Predicting driver drowsiness using vehicle measures: Recent insights and future challenges. Journal of safety research, 40(4):239\u2013245, 2009.10.1016\/j.jsr.2009.04.005","DOI":"10.1016\/j.jsr.2009.04.005"},{"key":"2023033119444907707_j_auto-2017-0103_ref_014_w2aab3b7b1b1b6b1ab1b4c14Aa","doi-asserted-by":"crossref","unstructured":"Tianchi Liu, Yan Yang, Guang-Bin Huang, Yong Kiang Yeo, and Zhiping Lin. Driver distraction detection using semi-supervised machine learning. Transactions on intelligent transportation systems, 17(4):1108\u20131120, 2016.10.1109\/TITS.2015.2496157","DOI":"10.1109\/TITS.2015.2496157"},{"key":"2023033119444907707_j_auto-2017-0103_ref_015_w2aab3b7b1b1b6b1ab1b4c15Aa","doi-asserted-by":"crossref","unstructured":"Julian Ludwig, Christoph Gote, Michael Flad, and S\u00f6ren Hohmann. Cooperative dynamic vehicle control allocation using time-variant differential games. In Proceedings of the International Conference on Systems, Man and Cybernetics (SMC), pages 117\u2013122, 2017.","DOI":"10.1109\/SMC.2017.8122588"},{"key":"2023033119444907707_j_auto-2017-0103_ref_016_w2aab3b7b1b1b6b1ab1b4c16Aa","doi-asserted-by":"crossref","unstructured":"Manuel Martin, Frederik Diederichs, Kangxiong Li, Michael Voit, Vivien Melcher, Harald Wildroither, and Rainer Stiefelhagen. Klassifikation von fahrerzust\u00e4nden und nebent\u00e4tigkeiten \u00fcber k\u00f6rperposen bei automatisierter fahrt. In VDI\/VW-Gemeinschaftstagung Fahrerassistenzsysteme und automatisiertes Fahren, 2016.","DOI":"10.51202\/9783181022887-93"},{"key":"2023033119444907707_j_auto-2017-0103_ref_017_w2aab3b7b1b1b6b1ab1b4c17Aa","doi-asserted-by":"crossref","unstructured":"Manuel Martin, Stephan Stuehmer, Michael Voit, and Rainer Stiefelhagen. Real time driver body pose estimation for novel assistance systems. In International Conference on Intelligent Transportation Systems (ITSC), pages 1738\u20131744. IEEE, 2017.","DOI":"10.1109\/ITSC.2017.8317722"},{"key":"2023033119444907707_j_auto-2017-0103_ref_018_w2aab3b7b1b1b6b1ab1b4c18Aa","doi-asserted-by":"crossref","unstructured":"Harshal Maske, Girish Chowdhary, and Prabhakar Pagilla. Intent aware shared control in off-nominal situations. In Proceedings of the Conference on Decision and Control (CDC), pages 5171\u20135176. IEEE, 2016.","DOI":"10.1109\/CDC.2016.7799060"},{"key":"2023033119444907707_j_auto-2017-0103_ref_019_w2aab3b7b1b1b6b1ab1b4c19Aa","doi-asserted-by":"crossref","unstructured":"Ralph Oyini Mbouna, Seong G. Kong, and Myung-Geun Chun. Visual analysis of eye state and head pose for driver alertness monitoring. Transactions on intelligent transportation systems, 14(3):1462\u20131469, 2013.10.1109\/TITS.2013.2262098","DOI":"10.1109\/TITS.2013.2262098"},{"key":"2023033119444907707_j_auto-2017-0103_ref_020_w2aab3b7b1b1b6b1ab1b4c20Aa","doi-asserted-by":"crossref","unstructured":"Natasha Merat, A. Hamish Jamson, Frank C.\u2009H. Lai, and Oliver Carsten. Highly automated driving, secondary task performance, and driver state. Human factors, 54(5):762\u2013771, 2012.10.1177\/0018720812442087","DOI":"10.1177\/0018720812442087"},{"key":"2023033119444907707_j_auto-2017-0103_ref_021_w2aab3b7b1b1b6b1ab1b4c21Aa","doi-asserted-by":"crossref","unstructured":"Natasha Merat, A. Hamish Jamson, Frank C.\u2009H. Lai, Michael Daly, and Oliver M.\u2009J. Carsten. Transition to manual: Driver behaviour when resuming control from a highly automated vehicle. Transportation research part F: traffic psychology and behaviour, 27:274\u2013282, 2014.10.1016\/j.trf.2014.09.005","DOI":"10.1016\/j.trf.2014.09.005"},{"key":"2023033119444907707_j_auto-2017-0103_ref_022_w2aab3b7b1b1b6b1ab1b4c22Aa","doi-asserted-by":"crossref","unstructured":"Pavlo Molchanov, Shalini Gupta, Kihwan Kim, and Kari Pulli. Multi-sensor system for driver\u2019s hand-gesture recognition. In Proceedings of the Conference and Workshops on Automatic Face and Gesture Recognition (FG), volume 1, pages 1\u20138, 2015.","DOI":"10.1109\/FG.2015.7163132"},{"key":"2023033119444907707_j_auto-2017-0103_ref_023_w2aab3b7b1b1b6b1ab1b4c23Aa","doi-asserted-by":"crossref","unstructured":"Xiaoxiang Na and David J. Cole. Game-theoretic modeling of the steering interaction between a human driver and a vehicle collision avoidance controller. IEEE Transactions on Human-Machine Systems, 45(1):25\u201338, 2015.10.1109\/THMS.2014.2363124","DOI":"10.1109\/THMS.2014.2363124"},{"key":"2023033119444907707_j_auto-2017-0103_ref_024_w2aab3b7b1b1b6b1ab1b4c24Aa","doi-asserted-by":"crossref","unstructured":"S. Ozgur Oguz, Ayse Kucukyilmaz, Tevfik Metin Sezgin, and Cagatay Basdogan. Haptic negotiation and role exchange for collaboration in virtual environments. In Haptics Symposium, pages 371\u2013378, 2010.","DOI":"10.1109\/HAPTIC.2010.5444628"},{"key":"2023033119444907707_j_auto-2017-0103_ref_025_w2aab3b7b1b1b6b1ab1b4c25Aa","doi-asserted-by":"crossref","unstructured":"Eshed Ohn-Bar, Sujitha Martin, Ashish Tawari, and Mohan M. Trivedi. Head, eye, and hand patterns for driver activity recognition. In Proceedings of the International Conference on Pattern Recognition, pages 660\u2013665, 2014.","DOI":"10.1109\/ICPR.2014.124"},{"key":"2023033119444907707_j_auto-2017-0103_ref_026_w2aab3b7b1b1b6b1ab1b4c26Aa","unstructured":"Ina Petermann-Stock, Linn Hackenberg, Tobias Muhr, and Christian Mergl. Wie lange braucht der fahrer? eine analyse zu \u00fcbernahmezeiten aus verschiedenen nebent\u00e4tigkeiten w\u00e4hrend einer hochautomatisierten staufahrt. 6. Tagung Fahrerassistenzsysteme. Der Weg zum automatischen Fahren, 2013."},{"key":"2023033119444907707_j_auto-2017-0103_ref_027_w2aab3b7b1b1b6b1ab1b4c27Aa","doi-asserted-by":"crossref","unstructured":"Jonas Radlmayr, Christian Gold, Lutz Lorenz, Mehdi Farid, and Klaus Bengler. How traffic situations and non-driving related tasks affect the take-over quality in highly automated driving. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, volume 58, pages 2063\u20132067, 2014.","DOI":"10.1177\/1541931214581434"},{"key":"2023033119444907707_j_auto-2017-0103_ref_028_w2aab3b7b1b1b6b1ab1b4c28Aa","doi-asserted-by":"crossref","unstructured":"Jamie Shotton, Toby Sharp, Alex Kipman, Andrew Fitzgibbon, Mark Finocchio, Andrew Blake, Mat Cook, and Richard Moore. Real-time human pose recognition in parts from single depth images. Communications of the ACM, 56(1):116\u2013124, 2013.10.1145\/2398356.2398381","DOI":"10.1145\/2398356.2398381"},{"key":"2023033119444907707_j_auto-2017-0103_ref_029_w2aab3b7b1b1b6b1ab1b4c29Aa","doi-asserted-by":"crossref","unstructured":"Seyed Hossein Tamaddoni, Saied Taheri, and Mehdi Ahmadian. Optimal preview game theory approach to vehicle stability controller design. Vehicle system dynamics, 49(12):1967\u20131979, 2011.10.1080\/00423114.2011.565778","DOI":"10.1080\/00423114.2011.565778"},{"key":"2023033119444907707_j_auto-2017-0103_ref_030_w2aab3b7b1b1b6b1ab1b4c30Aa","doi-asserted-by":"crossref","unstructured":"Ashish Tawari and Mohan M. Trivedi. Robust and continuous estimation of driver gaze zone by dynamic analysis of multiple face videos. In Proceedings of the Intelligent Vehicles Symposium, pages 344\u2013349. IEEE, 2014.","DOI":"10.1109\/IVS.2014.6856607"},{"key":"2023033119444907707_j_auto-2017-0103_ref_031_w2aab3b7b1b1b6b1ab1b4c31Aa","doi-asserted-by":"crossref","unstructured":"Francisco Vicente, Zehua Huang, Xuehan Xiong, Fernando De la Torre, Wende Zhang, and Dan Levi. Driver gaze tracking and eyes off the road detection system. IEEE Transactions on Intelligent Transportation Systems, 16(4):2014\u20132027, 2015.10.1109\/TITS.2015.2396031","DOI":"10.1109\/TITS.2015.2396031"},{"key":"2023033119444907707_j_auto-2017-0103_ref_032_w2aab3b7b1b1b6b1ab1b4c32Aa","doi-asserted-by":"crossref","unstructured":"Hongsong Wang and Liang Wang. Modeling temporal dynamics and spatial configurations of actions using two-stream recurrent neural networks. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 2017.","DOI":"10.1109\/CVPR.2017.387"},{"key":"2023033119444907707_j_auto-2017-0103_ref_033_w2aab3b7b1b1b6b1ab1b4c33Aa","unstructured":"Shih-En Wei, Varun Ramakrishna, Takeo Kanade, and Yaser Sheikh. Convolutional pose machines. In Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), pages 4724\u20134732, 2016."},{"key":"2023033119444907707_j_auto-2017-0103_ref_034_w2aab3b7b1b1b6b1ab1b4c34Aa","doi-asserted-by":"crossref","unstructured":"Martin Wollmer, Christoph Blaschke, Thomas Schindl, Bj\u00f6rn Schuller, Berthold Farber, Stefan Mayer, and Benjamin Trefflich. Online driver distraction detection using long short-term memory. Transactions on Intelligent Transportation Systems, 12(2):574\u2013582, 2011.10.1109\/TITS.2011.2119483","DOI":"10.1109\/TITS.2011.2119483"},{"key":"2023033119444907707_j_auto-2017-0103_ref_035_w2aab3b7b1b1b6b1ab1b4c35Aa","doi-asserted-by":"crossref","unstructured":"Ho Yub Jung, Soochahn Lee, Yong Seok Heo, and Il Dong Yun. Random tree walk toward instantaneous 3d human pose estimation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 2467\u20132474, 2015.","DOI":"10.1109\/CVPR.2015.7298861"}],"container-title":["at - Automatisierungstechnik"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.degruyter.com\/view\/j\/auto.2018.66.issue-2\/auto-2017-0103\/auto-2017-0103.xml","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/auto-2017-0103\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/auto-2017-0103\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,1]],"date-time":"2023-04-01T07:37:08Z","timestamp":1680334628000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/auto-2017-0103\/html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,2,1]]},"references-count":35,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2018,2,10]]},"published-print":{"date-parts":[[2018,2,1]]}},"alternative-id":["10.1515\/auto-2017-0103"],"URL":"https:\/\/doi.org\/10.1515\/auto-2017-0103","relation":{},"ISSN":["2196-677X","0178-2312"],"issn-type":[{"value":"2196-677X","type":"electronic"},{"value":"0178-2312","type":"print"}],"subject":[],"published":{"date-parts":[[2018,2,1]]}}}