{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:57:40Z","timestamp":1760241460386,"version":"build-2065373602"},"reference-count":58,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2018,3,12]],"date-time":"2018-03-12T00:00:00Z","timestamp":1520812800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MAKE"],"abstract":"<jats:p>This study was conducted to create driving episodes using machine-learning-based algorithms that address long-term memory (LTM) and topological mapping. This paper presents a novel episodic memory model for driving safety according to traffic scenes. The model incorporates three important features: adaptive resonance theory (ART), which learns time-series features incrementally while maintaining stability and plasticity; self-organizing maps (SOMs), which represent input data as a map with topological relations using self-mapping characteristics; and counter propagation networks (CPNs), which label category maps using input features and counter signals. Category maps represent driving episode information that includes driving contexts and facial expressions. The bursting states of respective maps produce LTM created on ART as episodic memory. For a preliminary experiment using a driving simulator (DS), we measure gazes and face orientations of drivers as their internal information to create driving episodes. Moreover, we measure cognitive distraction according to effects on facial features shown in reaction to simulated near-misses. Evaluation of the experimentally obtained results show the possibility of using recorded driving episodes with image datasets obtained using an event data recorder (EDR) with two cameras. Using category maps, we visualize driving features according to driving scenes on a public road and an expressway.<\/jats:p>","DOI":"10.3390\/make1010003","type":"journal-article","created":{"date-parts":[[2018,3,12]],"date-time":"2018-03-12T13:13:48Z","timestamp":1520860428000},"page":"43-63","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Category Maps Describe Driving Episodes Recorded with Event Data Recorders"],"prefix":"10.3390","volume":"1","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5485-2928","authenticated-orcid":false,"given":"Hirokazu","family":"Madokoro","sequence":"first","affiliation":[{"name":"Faculty of Systems Science and Technology, Akita Prefectural University, Yurihonjo City, Akita 015-0055, Japan"}]},{"given":"Kazuhito","family":"Sato","sequence":"additional","affiliation":[{"name":"Faculty of Systems Science and Technology, Akita Prefectural University, Yurihonjo City, Akita 015-0055, Japan"}]},{"given":"Nobuhiro","family":"Shimoi","sequence":"additional","affiliation":[{"name":"Faculty of Systems Science and Technology, Akita Prefectural University, Yurihonjo City, Akita 015-0055, Japan"}]}],"member":"1968","published-online":{"date-parts":[[2018,3,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"686","DOI":"10.1126\/science.1193147","article-title":"Evidence for a Collective Intelligence Factor in the Performance of Human Groups","volume":"330","author":"Woolley","year":"2010","journal-title":"Science"},{"key":"ref_2","unstructured":"(2015). The Pathway to Driverless Cars: A Detailed Review of Regulations for Automated Vehicle Technologies, Department for Transport."},{"key":"ref_3","unstructured":"Anderson, J.M., Kalra, N., Stanley, K.D., Sorensen, P., Samaras, C., and Oluwatola, O.A. (2014). Autonomous Vehicle Technology: A Guide for Policymakers, RAND Corporation."},{"key":"ref_4","first-page":"774","article-title":"Nap Sign Detection during Driving Automobiles","volume":"116","author":"Obinata","year":"2013","journal-title":"J. Jpn. Soc. Mech. Eng."},{"key":"ref_5","first-page":"9","article-title":"Facial Feature Points Extraction for Driver Monitoring System with Depth Camera","volume":"37","author":"Uchida","year":"2013","journal-title":"Tech. Rep. Inst. Image Inf. Telev. Eng."},{"key":"ref_6","unstructured":"Hirayama, T., Mase, K., and Takeda, K. (2012, January 12\u201315). Timing Analysis of Driver Gaze under Cognitive Distraction toward Peripheral Vehicle Behavior. Proceedings of the 26th Annual Conference of the Japanese Society for Artificial Intelligence, Yamaguchi, Japan. (In Japanese)."},{"key":"ref_7","first-page":"73","article-title":"Technology for Estimation of Driver: Distracted State with Electroencephalogram","volume":"57","author":"Terada","year":"2011","journal-title":"Panasonic Tech. J."},{"key":"ref_8","first-page":"94","article-title":"Facial Expression Recognition Technology to understand the State of Driver","volume":"69","author":"Matsunaga","year":"2015","journal-title":"J. Automot. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"596","DOI":"10.1109\/TITS.2010.2092770","article-title":"Driver Inattention Monitoring System for Intelligent Vehicles: A Review","volume":"12","author":"Dong","year":"2011","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1177\/0278364904042206","article-title":"Vision In and Out of Vehicles: Integrated Driver and Road Scene Monitoring","volume":"23","author":"Apostoloff","year":"2004","journal-title":"Int. J. Robot. Res."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"774","DOI":"10.1177\/0278364908099459","article-title":"Driver Inattention Detection based on Eye Gaze\u2014Road Event Correlation","volume":"28","author":"Fletcher","year":"2009","journal-title":"Int. J. Robot. Res."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1016\/S1364-6613(00)01804-0","article-title":"Episodic future thinking","volume":"5","author":"Atance","year":"2001","journal-title":"Trends Cogn. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1146\/annurev.psych.53.100901.135114","article-title":"Episodic Memory: From Mind to Brain","volume":"53","author":"Tulving","year":"2002","journal-title":"Annu. Rev. Psychol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.nlm.2013.12.008","article-title":"Episodic Future Thinking and Episodic Counterfactual Thinking: Intersections between Memory and Decisions","volume":"117","author":"Schacter","year":"2015","journal-title":"Neurobiol. Learn. Mem."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"51","DOI":"10.7210\/jrsj.23.51","article-title":"How to Make a Conscious Robot: Fundamental Idea based on Passive Consciousness Model","volume":"23","author":"Maeno","year":"2005","journal-title":"J. Robot. Soc. Jpn."},{"key":"ref_16","first-page":"4919","article-title":"ART 2: Stable Self-Organization of Pattern Recognition Codes for Analog Input Patterns","volume":"26","author":"Carpenter","year":"1987","journal-title":"Aied Opt."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Kohonen, T. (1995). Self-Organizing Maps, Springer.","DOI":"10.1007\/978-3-642-97610-0"},{"key":"ref_18","first-page":"4979","article-title":"Counterpropagation networks","volume":"26","author":"Nielsen","year":"1987","journal-title":"Aied Opt."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Madokoro, H., Sato, K., Nakasho, K., and Shimoi, N. (2017, January 14\u201319). Adaptive Learning Based Driving Episode Description on Category Maps. Proceedings of the 2017 International Joint Conference on Neural Networks (IJCNN), Anchorage, AK, USA.","DOI":"10.1109\/IJCNN.2017.7966247"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1254","DOI":"10.1109\/34.730558","article-title":"A Model of Saliency-Based Visual Attention for Rapid Scene Analysis","volume":"20","author":"Itti","year":"1998","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_21","first-page":"349","article-title":"An Automatic Threshold Selection Method Based on Discriminant and Least Squares Criteria","volume":"J63-D","author":"Otsu","year":"1980","journal-title":"Trans. Inst. Electron. Commun. Eng. Jpn."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Hou, X., and Zhang, L. (2007, January 17\u201322). Saliency Detection: A Spectral Residual Approach. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383267"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1469","DOI":"10.1016\/S0042-6989(00)00003-1","article-title":"Seeing, Sensing, and Scrutinizing","volume":"40","author":"Rensink","year":"2000","journal-title":"Vis. Res."},{"key":"ref_24","first-page":"368","article-title":"To See or not to See: The Need for Attention to Perceive Changes in Scenes","volume":"8","author":"Rensink","year":"1997","journal-title":"Psychol. Rev."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1037\/0033-295X.102.1.101","article-title":"Preemption Effects in Visual Search: Evidence for Low-Level Grouping","volume":"102","author":"Rensink","year":"1995","journal-title":"Psychol. Rev."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/0010-0285(80)90005-5","article-title":"A Feature-Integration Theory of Attention","volume":"12","author":"Treisman","year":"1980","journal-title":"Cogn. Psychol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"202","DOI":"10.3758\/BF03200774","article-title":"Guided Search 2.0: A Revised Model of Guided Search","volume":"1","author":"Wolfe","year":"1994","journal-title":"Psychon. Bull. Rev."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1023\/A:1011139631724","article-title":"Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope","volume":"42","author":"Oliva","year":"2001","journal-title":"Int. J. Comput. Vis."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Lowe, D.G. (1999, January 20\u201327). Object Recognition from Local Scale-Invariant Features. Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece.","DOI":"10.1109\/ICCV.1999.790410"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1007\/978-3-642-33783-3_16","article-title":"KAZE Features","volume":"7577","author":"Alcantarilla","year":"2012","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Alcantarilla, P.F., Nuevo, J., and Bartoli, A. (2013, January 9\u201313). Fast Explicit Diffusion for Accelerated Features in Nonlinear Scale Spaces. Proceedings of the 24th British Machine Vision Conference, Bristol, UK.","DOI":"10.5244\/C.27.13"},{"key":"ref_32","unstructured":"Scharr, H. (2000). Optimal Operators in Digital Image Processing, Heidelberg University."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1006\/jvci.2001.0495","article-title":"A Scheme for Coherence-Enhancing Diffusion Filtering with Optimized Rotation Invariance","volume":"13","author":"Weickert","year":"2002","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_34","unstructured":"Yang, X., and Cheng, K.T. (2012, January 5\u20138). LDB: An Ultra-Fast Feature for Scalable Augmented Reality. Proceedings of the 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Atlanta, GA, USA."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1651","DOI":"10.1109\/34.56205","article-title":"Scale-Space and Edge Detection Using Anisotropic Diffusion","volume":"12","author":"Perona","year":"1990","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_36","first-page":"511","article-title":"Rapid Object Detection Using a Boosted Cascade of Simple Features","volume":"1","author":"Viola","year":"2001","journal-title":"Comput. Vis. Pattern Recognit."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/34.655647","article-title":"Neural Network-Based Face Detection","volume":"20","author":"Rowley","year":"1998","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_38","unstructured":"Papageorgiou, C., Oren, M., and Poggio, T. (1998, January 4\u20137). A General FrameWork for Object Detection. Proceedings of the Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271), Bombay, India."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1007\/BF01456326","article-title":"Zur Theorie der Orthogonalen Funktionensysteme","volume":"69","author":"Haar","year":"1910","journal-title":"Math. Ann."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1006\/jcss.1997.1504","article-title":"A Decision-Theoretic Generalization of On-Line Learning and an Aication to Boosting","volume":"55","author":"Freund","year":"1997","journal-title":"J. Comput. Syst. Sci."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Schapire, R.E., and Freund, Y. (2012). Boosting: Foundations and Algorithms, The MIT Press.","DOI":"10.7551\/mitpress\/8291.001.0001"},{"key":"ref_42","unstructured":"Amari, S. (2000). Encyclopedia of Brain Sciences, Asakurashoten Press. (In Japanese)."},{"key":"ref_43","first-page":"1","article-title":"Functional Architecture of Macaque Monkey Visual Cortex","volume":"198","author":"Hubel","year":"1978","journal-title":"Proc. R. Soc. B"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"959","DOI":"10.1109\/34.541406","article-title":"Image representation using 2D Gabor wavelets","volume":"18","author":"Lee","year":"1996","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Madokoro, H., Shimoi, N., and Sato, K. (2014, January 25\u201329). Adaptive Category Mang Networks for All-Mode Topological Feature Learning Used for Mobile Robot Vision. Proceedings of the 23rd IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), Edinburgh, UK.","DOI":"10.1109\/ROMAN.2014.6926331"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"964","DOI":"10.1109\/TNN.2009.2014374","article-title":"Associative Memory for Online Learning in Noisy Environments Using Self-Organizing Incremental Neural Network","volume":"20","author":"Sudo","year":"2009","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_47","unstructured":"Csurka, G., Dance, C.R., Fan, L., Willamowski, J., and Bray, C. (2004, January 16). Visual Categorization with Bags of Keypoints. Proceedings of the ECCV Workshop Statistical Learning Computer Vision, Prague, Czech Republic."},{"key":"ref_48","unstructured":"McQueen, J. (1967). Some Methods for Classification and Analysis of Multivariate Observations. Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability: Statistics, University of California Press."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"586","DOI":"10.1109\/72.846731","article-title":"Clustering of the Self-Organizing Map","volume":"11","author":"Vesanto","year":"2000","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_50","first-page":"1280","article-title":"Unsupervised Cluster Segmentation Method Using Data Density Histogram on Self-Organizing Feature Map","volume":"J79-D-II","author":"Terashima","year":"1996","journal-title":"Trans. Inst. Electron. Inf. Commun. Eng."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Carpenter, G.A., and Grossberg, S. (1991). Pattern Recognition by Self-Organizing Neural Networks, The MIT Press.","DOI":"10.7551\/mitpress\/5271.001.0001"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Sato, K., Ito, M., Madokoro, H., and Kadowaki, S. (2015, January 5\u20137). Driver Body Information Analysis for Distraction State Detection. Proceedings of the IEEE International Conference on Vehicular Electronics and Safety (ICEVS2015), Yokohama, Japan.","DOI":"10.1109\/ICVES.2015.7396886"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"62","DOI":"10.5100\/jje.51.62","article-title":"Fundamental Study of Recovery Time from External Information Processing while Driving Car","volume":"51","author":"Suenaga","year":"2015","journal-title":"Jpn. Ergon. Soc. Ergon."},{"key":"ref_54","first-page":"87","article-title":"Induction and Biosignal Evaluation of Tunnel Vision Driving Caused by Sub-Task","volume":"J91-A","author":"Abe","year":"2008","journal-title":"Trans. Inst. Electron. Inf. Commun. Eng. A"},{"key":"ref_55","unstructured":"Ishibahi, M. (2003). HQL Manual of Driving Style Questionnaires, Research Institute of Human Engineering for Quality Life. (In Japanese)."},{"key":"ref_56","unstructured":"Ishibahi, M. (2003). HQL Manual of Driving Workload Sensibility Questionnaires, Research Institute of Human Engineering for Quality Life. (In Japanese)."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Regan, M.A., Lee, J.D., and Young, K.L. (2008). Driver Distraction: Theory, Effects, and Mitigation, CRC Press.","DOI":"10.1201\/9781420007497"},{"key":"ref_58","unstructured":"Hynd, D., and McCarthy, M. (2014). Study on the Benefits Resulting from the Installation of Event Data Recorders, Transport Research Laboratory. Project Report PRP707."}],"container-title":["Machine Learning and Knowledge Extraction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-4990\/1\/1\/3\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T14:56:46Z","timestamp":1760194606000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-4990\/1\/1\/3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,3,12]]},"references-count":58,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,3]]}},"alternative-id":["make1010003"],"URL":"https:\/\/doi.org\/10.3390\/make1010003","relation":{},"ISSN":["2504-4990"],"issn-type":[{"type":"electronic","value":"2504-4990"}],"subject":[],"published":{"date-parts":[[2018,3,12]]}}}