{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,30]],"date-time":"2026-05-30T00:22:50Z","timestamp":1780100570799,"version":"3.54.0"},"reference-count":67,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2014,8,11]],"date-time":"2014-08-11T00:00:00Z","timestamp":1407715200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100004963","name":"Seventh Framework Programme","doi-asserted-by":"publisher","award":["#231722 (IM-Clever project), #288551 (WAY project), and #270247 (NeuralDynamics project)"],"award-info":[{"award-number":["#231722 (IM-Clever project), #288551 (WAY project), and #270247 (NeuralDynamics project)"]}],"id":[{"id":"10.13039\/501100004963","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2014,11,21]]},"abstract":"<jats:p>\n            We introduce a novel algorithm called\n            <jats:italic>upper<\/jats:italic>\n            <jats:italic>confidence<\/jats:italic>\n            -\n            <jats:italic>weighted<\/jats:italic>\n            <jats:italic>learning<\/jats:italic>\n            (UCWL) for online multiclass learning from binary feedback (e.g., feedback that indicates whether the prediction was right or wrong). UCWL combines the upper confidence bound (UCB) framework with the soft confidence-weighted (SCW) online learning scheme. In UCB, each instance is classified using both score and uncertainty. For a given instance in the sequence, the algorithm might guess its class label primarily to reduce the class uncertainty. This is a form of informed exploration, which enables the performance to improve with lower sample complexity compared to the case without exploration. Combining UCB with SCW leads to the ability to deal well with noisy and nonseparable data, and state-of-the-art performance is achieved without increasing the computational cost. A potential application setting is human-robot interaction (HRI), where the robot is learning to classify some set of inputs while the human teaches it by providing only binary feedback\u2014or sometimes even the wrong answer entirely. Experimental results in the HRI setting and with two benchmark datasets from other settings show that UCWL outperforms other state-of-the-art algorithms in the online binary feedback setting\u2014and\n            <jats:italic>surprisingly<\/jats:italic>\n            even sometimes outperforms state-of-the-art algorithms that get full feedback (e.g., the true class label), whereas UCWL gets only binary feedback on the same data sequence.\n          <\/jats:p>","DOI":"10.1145\/2629631","type":"journal-article","created":{"date-parts":[[2014,8,12]],"date-time":"2014-08-12T13:53:48Z","timestamp":1407851628000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Efficient Interactive Multiclass Learning from Binary Feedback"],"prefix":"10.1145","volume":"4","author":[{"given":"Hung","family":"Ngo","sequence":"first","affiliation":[{"name":"IDSIA, Dalle Molle Institute for Artificial Intelligence, USI-SUPSI, Manno-Lugano, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew","family":"Luciw","sequence":"additional","affiliation":[{"name":"IDSIA, Dalle Molle Institute for Artificial Intelligence, USI-SUPSI, Manno-Lugano, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jawas","family":"Nagi","sequence":"additional","affiliation":[{"name":"IDSIA, Dalle Molle Institute for Artificial Intelligence, USI-SUPSI, Manno-Lugano, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Forster","sequence":"additional","affiliation":[{"name":"IDSIA, Dalle Molle Institute for Artificial Intelligence, USI-SUPSI, Manno-Lugano, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"J\u00fcrgen","family":"Schmidhuber","sequence":"additional","affiliation":[{"name":"IDSIA, Dalle Molle Institute for Artificial Intelligence, USI-SUPSI, Manno-Lugano, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ngo Anh","family":"Vien","sequence":"additional","affiliation":[{"name":"MLR Lab, University of Stuttgart, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2014,8,11]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"N. Alon and J. H. Spencer. 2004. The Probabilistic Method. John Wiley & Sons.  N. Alon and J. H. Spencer. 2004. The Probabilistic Method. John Wiley & Sons."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2008.10.024"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/944919.944941"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010896012157"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.2748\/tmj\/1178243286"},{"key":"e_1_2_1_6_1","volume-title":"On-Line Learning in Neural Networks","author":"Bottou L.","unstructured":"L. Bottou . 1999. On-line learning and stochastic approximations . In On-Line Learning in Neural Networks . Cambridge University Press , New York, NY , 9--42. L. Bottou. 1999. On-line learning and stochastic approximations. In On-Line Learning in Neural Networks. Cambridge University Press, New York, NY, 9--42."},{"key":"e_1_2_1_7_1","unstructured":"L. Bottou and O. Bousquet. 2007. The tradeoffs of large scale learning. In Advances in Neural Information Processing Systems (NIPS). MIT Press 161--168.  L. Bottou and O. Bousquet. 2007. The tradeoffs of large scale learning. In Advances in Neural Information Processing Systems (NIPS). MIT Press 161--168."},{"key":"e_1_2_1_8_1","volume-title":"Advances in Neural Information Processing Systems (NIPS)","author":"Bottou L.","unstructured":"L. Bottou and Y. LeCun . 2004. Large scale online learning . In Advances in Neural Information Processing Systems (NIPS) , Vol. 16 . MIT Press . L. Bottou and Y. LeCun. 2004. Large scale online learning. In Advances in Neural Information Processing Systems (NIPS), Vol. 16. MIT Press."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1162\/153244303765208377"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1137\/S0097539703432542"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553390"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/1248547.1248549"},{"key":"e_1_2_1_13_1","doi-asserted-by":"crossref","unstructured":"N. Cesa-Bianchi and G. Lugosi. 2006. Prediction Learning and Games. Cambridge University Press Cambridge UK.   N. Cesa-Bianchi and G. Lugosi. 2006. Prediction Learning and Games. Cambridge University Press Cambridge UK.","DOI":"10.1017\/CBO9780511546921"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1961189.1961199"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.5121\/ijcses.2011.2109"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDAR.2011.229"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.5555\/2283516.2283603"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022627411411"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/1248547.1248566"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing. 496--504","author":"Crammer K.","unstructured":"K. Crammer , M. Dredze , and A. Kulesza . 2009a. Multi-class confidence weighted algorithms . In Proceedings of the Conference on Empirical Methods in Natural Language Processing. 496--504 . K. Crammer, M. Dredze, and A. Kulesza. 2009a. Multi-class confidence weighted algorithms. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. 496--504."},{"key":"e_1_2_1_21_1","first-page":"1891","article-title":"Confidence-weighted linear classification for text categorization","volume":"13","author":"Crammer K.","year":"2012","unstructured":"K. Crammer , M. Dredze , and F. Pereira . 2012 . Confidence-weighted linear classification for text categorization . Journal of Machine Learning Research 13 , 1, 1891 -- 1926 . K. Crammer, M. Dredze, and F. Pereira. 2012. Confidence-weighted linear classification for text categorization. Journal of Machine Learning Research 13, 1, 1891--1926.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_2_1_22_1","unstructured":"K. Crammer M. D. Fern and O. Pereira. 2008. Exact convex confidence-weighted learning. In Advances in Neural Information Processing Systems (NIPS). 345--352.  K. Crammer M. D. Fern and O. Pereira. 2008. Exact convex confidence-weighted learning. In Advances in Neural Information Processing Systems (NIPS). 345--352."},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML\u201911)","author":"Crammer K.","unstructured":"K. Crammer and C. Gentile . 2011. Multiclass classification with bandit feedback using adaptive regularization . In Proceedings of the International Conference on Machine Learning (ICML\u201911) . 273--280. K. Crammer and C. Gentile. 2011. Multiclass classification with bandit feedback using adaptive regularization. In Proceedings of the International Conference on Machine Learning (ICML\u201911). 273--280."},{"key":"e_1_2_1_24_1","first-page":"414","article-title":"Adaptive regularization of weight vectors","volume":"22","author":"Crammer K.","year":"2009","unstructured":"K. Crammer , A. Kulesza , and M. Dredze . 2009 b. Adaptive regularization of weight vectors . In Advances in Neural Information Processing Systems (NIPS) , Vol. 22 , 414 -- 422 . K. Crammer, A. Kulesza, and M. Dredze. 2009b. Adaptive regularization of weight vectors. In Advances in Neural Information Processing Systems (NIPS), Vol. 22, 414--422.","journal-title":"Advances in Neural Information Processing Systems (NIPS)"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-013-5327-x"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the IEEE International Conference on Automatic Face Gesture Recognition. 1--6.","author":"Cruz C.","unstructured":"C. Cruz , L. E. Sucar , and E. F. Morales . 2008. Real-time face recognition for human-robot interaction . In Proceedings of the IEEE International Conference on Automatic Face Gesture Recognition. 1--6. C. Cruz, L. E. Sucar, and E. F. Morales. 2008. Real-time face recognition for human-robot interaction. In Proceedings of the IEEE International Conference on Automatic Face Gesture Recognition. 1--6."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390190"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00344251"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1561\/1100000005"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.5121\/ijcses.2010.1203"},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the 24th AAAI Conference on Artificial Intelligence. 481--486","author":"Judah K.","unstructured":"K. Judah , S. Roy , A. Fern , and T. G. Dietterich . 2010. Reinforcement learning via practice and critique advice . In Proceedings of the 24th AAAI Conference on Artificial Intelligence. 481--486 . K. Judah, S. Roy, A. Fern, and T. G. Dietterich. 2010. Reinforcement learning via practice and critique advice. In Proceedings of the 24th AAAI Conference on Artificial Intelligence. 481--486."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390156.1390212"},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR\u201912)","author":"Kankuekul P.","unstructured":"P. Kankuekul , A. Kawewong , S. Tangruamsub , and O. Hasegawa . 2012. Online incremental attribute-based zero-shot learning . In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR\u201912) . 3657--3664. P. Kankuekul, A. Kawewong, S. Tangruamsub, and O. Hasegawa. 2012. Online incremental attribute-based zero-shot learning. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR\u201912). 3657--3664."},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the International Joint Conference on Neural Networks (IJCNN\u201911)","author":"Kawewong A.","unstructured":"A. Kawewong , S. Tangruamsub , P. Kankuekul , and O. Hasegawa . 2011. Fast online incremental transfer learning for unseen object classification using self-organizing incremental neural networks . In Proceedings of the International Joint Conference on Neural Networks (IJCNN\u201911) . 749--756. A. Kawewong, S. Tangruamsub, P. Kankuekul, and O. Hasegawa. 2011. Fast online incremental transfer learning for unseen object classification using self-organizing incremental neural networks. In Proceedings of the International Joint Conference on Neural Networks (IJCNN\u201911). 749--756."},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the AAAI 2011 Spring Symposium: Help Me Help You: Bridging the Gaps in Human-Agent Collaboration. 36--41","author":"Knox W. B.","unstructured":"W. B. Knox , A. Setapen , and P. Stone . 2011. Reinforcement learning with human feedback in mountain car . In Proceedings of the AAAI 2011 Spring Symposium: Help Me Help You: Bridging the Gaps in Human-Agent Collaboration. 36--41 . W. B. Knox, A. Setapen, and P. Stone. 2011. Reinforcement learning with human feedback in mountain car. In Proceedings of the AAAI 2011 Spring Symposium: Help Me Help You: Bridging the Gaps in Human-Agent Collaboration. 36--41."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1597735.1597738"},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems (AAMAS\u201910)","author":"Knox W. B.","unstructured":"W. B. Knox and P. Stone . 2010a. Combining manual feedback with subsequent MDP reward signals for reinforcement learning . In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems (AAMAS\u201910) . 5--12. W. B. Knox and P. Stone. 2010a. Combining manual feedback with subsequent MDP reward signals for reinforcement learning. In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems (AAMAS\u201910). 5--12."},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems (AAMAS\u201910)","author":"Knox W. B.","unstructured":"W. B. Knox and P. Stone . 2010b. Training a Tetris agent via interactive shaping: A demonstration of the TAMER framework . In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems (AAMAS\u201910) . 1767--1768. W. B. Knox and P. Stone. 2010b. Training a Tetris agent via interactive shaping: A demonstration of the TAMER framework. In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems (AAMAS\u201910). 1767--1768."},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the 2011 ICML Workshop on New Developments in Imitation Learning.","author":"Knox W. B.","unstructured":"W. B. Knox and P. Stone . 2011. Augmenting reinforcement learning with human feedback . In Proceedings of the 2011 ICML Workshop on New Developments in Imitation Learning. W. B. Knox and P. Stone. 2011. Augmenting reinforcement learning with human feedback. In Proceedings of the 2011 ICML Workshop on New Developments in Imitation Learning."},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems (AAMAS\u201912)","author":"Knox W. B.","unstructured":"W. B. Knox and P. Stone . 2012. Reinforcement learning from simultaneous human and MDP reward . In Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems (AAMAS\u201912) . 475--482. W. B. Knox and P. Stone. 2012. Reinforcement learning from simultaneous human and MDP reward. In Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems (AAMAS\u201912). 475--482."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364913495721"},{"key":"e_1_2_1_42_1","volume-title":"Statistics and Information Theory","author":"Kullback S.","unstructured":"S. Kullback . 1959. Statistics and Information Theory . John Wiley & Sons , New York, NY . S. Kullback. 1959. Statistics and Information Theory. John Wiley & Sons, New York, NY."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022869011914"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCC.2007.893280"},{"key":"e_1_2_1_46_1","volume-title":"Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS\u201905)","author":"Moller B.","unstructured":"B. Moller , S. Posch , A. Haasch , J. Fritsch , and G. Sagerer . 2005. Interactive object learning for robot companions using mosaic images . In Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS\u201905) . 2650--2655. B. Moller, S. Posch, A. Haasch, J. Fritsch, and G. Sagerer. 2005. Interactive object learning for robot companions using mosaic images. In Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS\u201905). 2650--2655."},{"key":"e_1_2_1_47_1","volume-title":"Proceedings of the 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA\u201911)","author":"Nagi J.","unstructured":"J. Nagi , F. Ducatelle , G. A. Di Caro , D. Ciresan , U. Meier , A. Giusti , F. Nagi , J. Schmidhuber , and L. M. Gambardella . 2011. Max-pooling convolutional neural networks for vision-based hand gesture recognition . In Proceedings of the 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA\u201911) . 342--347. J. Nagi, F. Ducatelle, G. A. Di Caro, D. Ciresan, U. Meier, A. Giusti, F. Nagi, J. Schmidhuber, and L. M. Gambardella. 2011. Max-pooling convolutional neural networks for vision-based hand gesture recognition. In Proceedings of the 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA\u201911). 342--347."},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of the 21st IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN\u201912)","author":"Nagi J.","unstructured":"J. Nagi , H. Ngo , A. Giusti , L. M. Gambardella , J. Schmidhuber , and G. A. Di Caro . 2012. Incremental learning using partial feedback for gesture-based human-swarm interaction . In Proceedings of the 21st IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN\u201912) . 898--905. J. Nagi, H. Ngo, A. Giusti, L. M. Gambardella, J. Schmidhuber, and G. A. Di Caro. 2012. Incremental learning using partial feedback for gesture-based human-swarm interaction. In Proceedings of the 21st IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN\u201912). 898--905."},{"key":"e_1_2_1_49_1","volume-title":"Proceedings of the International Joint Conference of Neural Networks (IJCNN\u201912)","author":"Ngo H.","year":"2012","unstructured":"H. Ngo , M. Luciw , A. F\u00f6rster , and J. Schmidhuber . 2012. Learning skills from play: Artificial curiosity on a Katana robot arm . In Proceedings of the International Joint Conference of Neural Networks (IJCNN\u201912) . DOI: http:\/\/dx.doi.org\/10.1109\/IJCNN. 2012 .6252824 10.1109\/IJCNN.2012.6252824 H. Ngo, M. Luciw, A. F\u00f6rster, and J. Schmidhuber. 2012. Learning skills from play: Artificial curiosity on a Katana robot arm. In Proceedings of the International Joint Conference of Neural Networks (IJCNN\u201912). DOI: http:\/\/dx.doi.org\/10.1109\/IJCNN.2012.6252824"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2013.00833"},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI\u201913)","author":"Ngo H.","unstructured":"H. Ngo , M. Luciw , N. A. Vien , and J. Scmidhuber . 2013b. Upper confidence weighted learning for efficient exploration in multiclass prediction with binary feedback . In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI\u201913) . 2488--2494. H. Ngo, M. Luciw, N. A. Vien, and J. Scmidhuber. 2013b. Upper confidence weighted learning for efficient exploration in multiclass prediction with binary feedback. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI\u201913). 2488--2494."},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML\u201911)","author":"Orabona F.","unstructured":"F. Orabona and N. Cesa-Bianchi . 2011. Better algorithms for selective sampling . In Proceedings of the International Conference on Machine Learning (ICML\u201911) . 433--440. F. Orabona and N. Cesa-Bianchi. 2011. Better algorithms for selective sampling. In Proceedings of the International Conference on Machine Learning (ICML\u201911). 433--440."},{"key":"e_1_2_1_53_1","volume-title":"Proceedings of the IEEE International Conference Computer Vision and Pattern Recognition (CVPR\u201907)","author":"Raducanu B.","unstructured":"B. Raducanu and J. Vitria . 2007. Online learning for human-robot interaction . In Proceedings of the IEEE International Conference Computer Vision and Pattern Recognition (CVPR\u201907) . 1--7. B. Raducanu and J. Vitria. 2007. Online learning for human-robot interaction. In Proceedings of the IEEE International Conference Computer Vision and Pattern Recognition (CVPR\u201907). 1--7."},{"key":"e_1_2_1_54_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR\u201907)","author":"Ranzato M. A.","unstructured":"M. A. Ranzato , F. Huang , Y. Boureau , and Y. LeCun . 2007. Unsupervised learning of invariant feature hierarchies with applications to object recognition . In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR\u201907) . IEEE, Los Alamitos, CA, 1--8. M. A. Ranzato, F. Huang, Y. Boureau, and Y. LeCun. 2007. Unsupervised learning of invariant feature hierarchies with applications to object recognition. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR\u201907). IEEE, Los Alamitos, CA, 1--8."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1038\/14819"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.5555\/1005332.1005336"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0042519"},{"key":"e_1_2_1_58_1","volume-title":"Proceedings of the International Conference on Artificial Neural Networks (ICANN\u201910)","author":"Scherer D.","unstructured":"D. Scherer , A. Muller , and S. Behnke . 2010. Evaluation of pooling operations in convolutional architectures for object recognition . In Proceedings of the International Conference on Artificial Neural Networks (ICANN\u201910) . 92--101. D. Scherer, A. Muller, and S. Behnke. 2010. Evaluation of pooling operations in convolutional architectures for object recognition. In Proceedings of the International Conference on Artificial Neural Networks (ICANN\u201910). 92--101."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAMD.2010.2056368"},{"key":"e_1_2_1_60_1","volume-title":"Proceedings of the 14th European Symposium on Artificial Neural Networks (ESANN\u201906)","author":"Steil J. J.","unstructured":"J. J. Steil and H. Wersing . 2006. Recent trends in online learning for cognitive robotics . In Proceedings of the 14th European Symposium on Artificial Neural Networks (ESANN\u201906) . 77--87. J. J. Steil and H. Wersing. 2006. Recent trends in online learning for cognitive robotics. In Proceedings of the 14th European Symposium on Artificial Neural Networks (ESANN\u201906). 77--87."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1162\/153244302760185252"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.2200\/S00268ED1V01Y201005AIM009"},{"key":"e_1_2_1_63_1","volume-title":"Proceedings of the 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob\u201912)","author":"Vien N. A.","unstructured":"N. A. Vien and W. Ertel . 2012. Reinforcement learning combined with human feedback in continuous state and action spaces . In Proceedings of the 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob\u201912) . IEEE, Los Alamitos, CA, 1--6. N. A. Vien and W. Ertel. 2012. Reinforcement learning combined with human feedback in continuous state and action spaces. In Proceedings of the 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob\u201912). IEEE, Los Alamitos, CA, 1--6."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10489-012-0412-6"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1751-5823.2001.tb00457.x"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/1897816.1897838"},{"key":"e_1_2_1_67_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML\u201912)","author":"Wang J.","unstructured":"J. Wang , P. Zhao , and S. C. Hoi . 2012. Exact soft confidence-weighted learning . In Proceedings of the International Conference on Machine Learning (ICML\u201912) . ACM, New York, NY, 121--128. J. Wang, P. Zhao, and S. C. Hoi. 2012. Exact soft confidence-weighted learning. In Proceedings of the International Conference on Machine Learning (ICML\u201912). ACM, New York, NY, 121--128."}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2629631","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2629631","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T06:13:30Z","timestamp":1750227210000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2629631"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,8,11]]},"references-count":67,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2014,11,21]]}},"alternative-id":["10.1145\/2629631"],"URL":"https:\/\/doi.org\/10.1145\/2629631","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"value":"2160-6455","type":"print"},{"value":"2160-6463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,8,11]]},"assertion":[{"value":"2013-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-08-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}