{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:10:30Z","timestamp":1750219830043,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":14,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,12,16]],"date-time":"2022-12-16T00:00:00Z","timestamp":1671148800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,12,16]]},"DOI":"10.1145\/3584376.3584459","type":"proceedings-article","created":{"date-parts":[[2023,4,19]],"date-time":"2023-04-19T22:54:51Z","timestamp":1681944891000},"page":"457-463","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["TOCIM: An improved operant conditioning model with task-oriented curiosity"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-9302-0619","authenticated-orcid":false,"given":"Yufan","family":"Li","sequence":"first","affiliation":[{"name":"Faculty of Information Technology, Beijing University of Technology, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8804-7150","authenticated-orcid":false,"given":"Jing","family":"Huang","sequence":"additional","affiliation":[{"name":"Faculty of Information Technology, Beijing University of Technology, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-2160-5916","authenticated-orcid":false,"given":"Chenliang","family":"Lin","sequence":"additional","affiliation":[{"name":"Faculty of Information Technology, Beijing University of Technology, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-3907-0396","authenticated-orcid":false,"given":"Yazhou","family":"Lu","sequence":"additional","affiliation":[{"name":"Faculty of Information Technology, Beijing University of Technology, China"}]}],"member":"320","published-online":{"date-parts":[[2023,4,19]]},"reference":[{"issue":"1","key":"e_1_3_2_1_1_1","first-page":"43","article-title":"The behavior of organisms: An experimental analysis [J]","volume":"186","author":"Skinner B F","year":"1938","unstructured":"Skinner B F . The behavior of organisms: An experimental analysis [J] . New York: D Appleton Century Company , 1938 , 186 ( 1 ): 43 \u00ad 50 . 8 Skinner B F. The behavior of organisms: An experimental analysis [J]. New York: D Appleton Century Company, 1938, 186(1):43\u00ad50. 8","journal-title":"New York: D Appleton Century Company"},{"issue":"56","key":"e_1_3_2_1_2_1","first-page":"2745","article-title":"The skinner automaton: A psychological model formalizing the theory of operant conditioning","volume":"2013","author":"Ruan X G","unstructured":"Ruan X G , Wu X . The skinner automaton: A psychological model formalizing the theory of operant conditioning . Sci. China Technol. Sci. 2013 : 56 , 2745 \u2013 2761 . Ruan X G, Wu X. The skinner automaton: A psychological model formalizing the theory of operant conditioning. Sci. China Technol. Sci. 2013: 56, 2745\u20132761.","journal-title":"Sci. China Technol. Sci."},{"issue":"6","key":"e_1_3_2_1_3_1","first-page":"1016","article-title":"Artificial sensorimotor system with operant conditioning function [J]","volume":"2014","author":"Ruan X G","unstructured":"Ruan X G , Huang J , Fan Q W , Artificial sensorimotor system with operant conditioning function [J] . Control and Decision , 2014 ( 6 ): 1016 \u00ad 1020 . Ruan X G, Huang J, Fan Q W, Artificial sensorimotor system with operant conditioning function [J]. Control and Decision, 2014 (6):1016\u00ad1020.","journal-title":"Control and Decision"},{"issue":"5","key":"e_1_3_2_1_4_1","first-page":"1016","article-title":"A learning model based on operant conditioning principles [J]","volume":"2015","author":"Huang J","unstructured":"Huang J , Ruan X G , Yu N G , A learning model based on operant conditioning principles [J] . Control Theory and Applications , 2015 ( 5 ): 5 ( 1016 - 1020 ). Huang J, Ruan X G, Yu N G, A learning model based on operant conditioning principles [J]. Control Theory and Applications, 2015 (5): 5 (1016-1020).","journal-title":"Control Theory and Applications"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/bs.pbr.2016.05.005"},{"key":"e_1_3_2_1_6_1","volume-title":"2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE","author":"Pathak D","year":"2017","unstructured":"Pathak D , Agrawal P , Efros A A , Curiosity-Driven Exploration by Self-Supervised Prediction [C]\/\/ 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE , 2017 . Pathak D, Agrawal P, Efros A A, Curiosity-Driven Exploration by Self-Supervised Prediction [C]\/\/ 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE, 2017."},{"key":"e_1_3_2_1_7_1","first-page":"139","volume":"2020","author":"Li J","unstructured":"Li J , Shi X , Li J , Random Curiosity -driven Exploration in Deep Reinforcement Learning [J] . Neurocomputing , 2020 : 139 - 147 . Li J, Shi X, Li J, Random Curiosity-driven Exploration in Deep Reinforcement Learning [J]. Neurocomputing, 2020: 139-147.","journal-title":"Neurocomputing"},{"key":"e_1_3_2_1_8_1","first-page":"72","article-title":"Mobile robot autonomous path planning method based on intrinsic motivation mechanism [J]","author":"Zhang X P","year":"2018","unstructured":"Zhang X P , Ruan X G , Xiao Y , Mobile robot autonomous path planning method based on intrinsic motivation mechanism [J] . Control and Decision , 2018 , v .33(09): 72 - 78 . Zhang X P, Ruan X G, Xiao Y, Mobile robot autonomous path planning method based on intrinsic motivation mechanism [J]. Control and Decision, 2018, v.33(09):72-78.","journal-title":"Control and Decision"},{"issue":"9","key":"e_1_3_2_1_9_1","first-page":"2211","article-title":"A mobile robot environment cognitive model based on intrinsic motivation theory [J]","volume":"36","author":"Ruan X G","year":"2021","unstructured":"Ruan X G , Zhang J H , Huang J . A mobile robot environment cognitive model based on intrinsic motivation theory [J] . Journal of Control and Decision , 2021 , 36 ( 9 ): 2211 - 2217 . 2019.1744. Ruan X G, Zhang J H, Huang J. A mobile robot environment cognitive model based on intrinsic motivation theory [J]. Journal of Control and Decision, 2021, 36(9):2211-2217. 2019.1744.","journal-title":"Journal of Control and Decision"},{"key":"e_1_3_2_1_10_1","volume-title":"International Conference on Information System & Artificial Intelligence. IEEE","author":"Lu C X","year":"2017","unstructured":"Lu C X , Sun Z Y , Shi Z Z , Using Emotions as Intrinsic Motivation to Accelerate Classic Reinforcement Learning [C]\/\/ International Conference on Information System & Artificial Intelligence. IEEE , 2017 . Lu C X, Sun Z Y, Shi Z Z, Using Emotions as Intrinsic Motivation to Accelerate Classic Reinforcement Learning [C]\/\/ International Conference on Information System & Artificial Intelligence. IEEE, 2017."},{"key":"e_1_3_2_1_11_1","unstructured":"Bellemare M Srinivasan S Ostrovski G Unifying count-based exploration and intrinsic motivation [C] Advances in neural information processing systems. 2016: 1471-1479.  Bellemare M Srinivasan S Ostrovski G Unifying count-based exploration and intrinsic motivation [C] Advances in neural information processing systems. 2016: 1471-1479."},{"key":"e_1_3_2_1_12_1","volume-title":"Count-Based Exploration with Neural Density Models [C] International Conference on Machine Learning.","author":"Ostrovski G","year":"2017","unstructured":"Ostrovski G , Bellemare M G , Oord A , Count-Based Exploration with Neural Density Models [C] International Conference on Machine Learning. 2017 . Ostrovski G, Bellemare M G, Oord A, Count-Based Exploration with Neural Density Models [C] International Conference on Machine Learning. 2017."},{"key":"e_1_3_2_1_13_1","volume-title":"a study of count-based exploration for deep reinforcement learning [C]\/\/ Neural Information Processing Systems","author":"Tang H","year":"2017","unstructured":"Tang H , Houthooft R , Foote D , # Exploration : a study of count-based exploration for deep reinforcement learning [C]\/\/ Neural Information Processing Systems . Curran Associates Inc . 2017 . Tang H, Houthooft R, Foote D, #Exploration: a study of count-based exploration for deep reinforcement learning [C]\/\/ Neural Information Processing Systems. Curran Associates Inc. 2017."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1006\/ceps.1999.1020"}],"event":{"name":"RICAI 2022: 2022 4th International Conference on Robotics, Intelligent Control and Artificial Intelligence","acronym":"RICAI 2022","location":"Dongguan China"},"container-title":["Proceedings of the 2022 4th International Conference on Robotics, Intelligent Control and Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3584376.3584459","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3584376.3584459","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:46:31Z","timestamp":1750178791000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3584376.3584459"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,16]]},"references-count":14,"alternative-id":["10.1145\/3584376.3584459","10.1145\/3584376"],"URL":"https:\/\/doi.org\/10.1145\/3584376.3584459","relation":{},"subject":[],"published":{"date-parts":[[2022,12,16]]},"assertion":[{"value":"2023-04-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}