{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T14:08:27Z","timestamp":1753884507218,"version":"3.41.2"},"reference-count":40,"publisher":"World Scientific Pub Co Pte Ltd","issue":"01","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Patt. Recogn. Artif. Intell."],"published-print":{"date-parts":[[2022,1]]},"abstract":"<jats:p> Modern model-based reinforcement learning methods for high-dimensional inputs often incorporate an unsupervised learning step for dimensionality reduction. The training objective of these unsupervised learning methods often leverages only static inputs such as reconstructing observations. These representations are combined with predictor functions for simulating rollouts to navigate the environment. We advance this idea by taking advantage of the fact that we navigate dynamic environments with visual stimulus and create a representation that is specifically designed with control and actions in mind. We propose to learn a feature map that is maximally predictable for a predictor function. This results in representations that are well suited for the task of planning, where the predictor is used as a forward model. To this end, we introduce a new way of learning this representation along with the prediction function, a system we dub Latent Representation Prediction Network (LARP). The prediction function is used as a forward model for a search on a graph in a viewpoint-matching task, and the representation learned to maximize predictability is found to outperform other representations. The sample efficiency and overall performance of our approach are shown to rival standard reinforcement learning methods, and our learned representation transfers successfully to unseen environments. <\/jats:p>","DOI":"10.1142\/s0218001422510028","type":"journal-article","created":{"date-parts":[[2021,11,1]],"date-time":"2021-11-01T06:46:42Z","timestamp":1635749202000},"source":"Crossref","is-referenced-by-count":0,"title":["Latent Representation Prediction Networks"],"prefix":"10.1142","volume":"36","author":[{"given":"Hlynur","family":"David Hlynsson","sequence":"first","affiliation":[{"name":"Institut f\u00fcr Neuroinformatik, Ruhr-Universit\u00e4t Bochum, Bochum, Universit\u00e4tsstra\u00dfe 150, Bochum 44801, Germany"}]},{"given":"Merlin","family":"Sch\u00fcler","sequence":"additional","affiliation":[{"name":"Institut f\u00fcr Neuroinformatik, Ruhr-Universit\u00e4t Bochum, Bochum, Universit\u00e4tsstra\u00dfe 150, Bochum 44801, Germany"}]},{"given":"Robin","family":"Schiewer","sequence":"additional","affiliation":[{"name":"Institut f\u00fcr Neuroinformatik, Ruhr-Universit\u00e4t Bochum, Bochum, Universit\u00e4tsstra\u00dfe 150, Bochum 44801, Germany"}]},{"given":"Tobias","family":"Glasmachers","sequence":"additional","affiliation":[{"name":"Institut f\u00fcr Neuroinformatik, Ruhr-Universit\u00e4t Bochum, Bochum, Universit\u00e4tsstra\u00dfe 150, Bochum 44801, Germany"}]},{"given":"Laurenz","family":"Wiskott","sequence":"additional","affiliation":[{"name":"Institut f\u00fcr Neuroinformatik, Ruhr-Universit\u00e4t Bochum, Bochum, Universit\u00e4tsstra\u00dfe 150, Bochum 44801, Germany"}]}],"member":"219","published-online":{"date-parts":[[2021,12,28]]},"reference":[{"key":"S0218001422510028BIB001","doi-asserted-by":"publisher","DOI":"10.1162\/089976603321780317"},{"key":"S0218001422510028BIB002","doi-asserted-by":"publisher","DOI":"10.1145\/1150402.1150464"},{"key":"S0218001422510028BIB003","first-page":"8224","volume-title":"Advances in Neural Information Processing Systems","volume":"31","author":"Buckman J.","year":"2018"},{"key":"S0218001422510028BIB004","first-page":"17","volume-title":"Working notes of AAAI 1998 Fall Symp. Planning with Partially Observable Markov Decision Processes","volume":"1724","author":"Cassandra A. R.","year":"1998"},{"key":"S0218001422510028BIB005","first-page":"2172","volume-title":"Advances in Neural Information Processing Systems","author":"Chen X.","year":"2016"},{"key":"S0218001422510028BIB007","first-page":"4754","volume-title":"Advances in Neural Information Processing Systems","author":"Chua K.","year":"2018"},{"key":"S0218001422510028BIB008","first-page":"1049","volume-title":"Int. Conf. Machine Learning","author":"Corneil D.","year":"2018"},{"key":"S0218001422510028BIB009","first-page":"998","volume-title":"Proc. 18th Int. Conf. Autonomous Agents and MultiAgent Systems","author":"Cuccu G.","year":"2019"},{"key":"S0218001422510028BIB010","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"S0218001422510028BIB011","first-page":"4414","volume-title":"Advances in Neural Information Processing Systems","author":"Denton E. L.","year":"2017"},{"volume-title":"Int. Conf. Learning Representations","year":"2019","author":"Du S. S.","key":"S0218001422510028BIB013"},{"issue":"1","key":"S0218001422510028BIB014","first-page":"3683","volume":"14","author":"Escalante-B A. N.","year":"2013","journal-title":"J. Mach. Learn. Res."},{"key":"S0218001422510028BIB015","volume-title":"Data-Efficient Machine Learning Workshop, ICML","volume":"4","author":"Gal Y.","year":"2016"},{"key":"S0218001422510028BIB016","doi-asserted-by":"publisher","DOI":"10.1016\/0005-1098(89)90002-2"},{"key":"S0218001422510028BIB017","first-page":"2170","volume-title":"Int. Conf. Machine Learning","author":"Gelada C.","year":"2019"},{"key":"S0218001422510028BIB018","first-page":"2672","volume-title":"Advances in Neural Information Processing Systems","author":"Goodfellow I.","year":"2014"},{"key":"S0218001422510028BIB019","first-page":"1234","volume-title":"Advances in Neural Information Processing Systems","author":"Goroshin R.","year":"2015"},{"key":"S0218001422510028BIB021","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.100"},{"key":"S0218001422510028BIB022","first-page":"2555","volume-title":"Int. Conf. Machine Learning","author":"Hafner D.","year":"2018"},{"issue":"1","key":"S0218001422510028BIB023","first-page":"3395","volume":"15","author":"Hamilton W.","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"S0218001422510028BIB026","doi-asserted-by":"publisher","DOI":"10.5220\/0007456306910698"},{"key":"S0218001422510028BIB027","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-30179-8_15"},{"key":"S0218001422510028BIB029","first-page":"8733","volume-title":"Advances in Neural Information Processing Systems","author":"Kurutach T.","year":"2018"},{"key":"S0218001422510028BIB030","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2004.1315150"},{"key":"S0218001422510028BIB031","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1000894"},{"key":"S0218001422510028BIB033","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-21735-7_7"},{"key":"S0218001422510028BIB034","doi-asserted-by":"publisher","DOI":"10.21105\/joss.00861"},{"volume-title":"NIPS Deep Learning Workshop","year":"2013","author":"Mnih V.","key":"S0218001422510028BIB035"},{"key":"S0218001422510028BIB036","first-page":"2863","volume-title":"Advances in Neural Information Processing Systems","author":"Oh J.","year":"2015"},{"key":"S0218001422510028BIB037","doi-asserted-by":"publisher","DOI":"10.1109\/ICMLA.2015.158"},{"volume-title":"Int. Conf. Learning Representations","year":"2018","author":"Savinov N.","key":"S0218001422510028BIB039"},{"key":"S0218001422510028BIB040","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"S0218001422510028BIB041","first-page":"316","volume-title":"Asian Conf. Machine Learning","author":"Sch\u00fcler M.","year":"2019"},{"key":"S0218001422510028BIB044","first-page":"4732","volume-title":"Int. Conf. Machine Learning","author":"Srinivas A.","year":"2018"},{"key":"S0218001422510028BIB045","first-page":"1988","volume-title":"Advances in Neural Information Processing Systems","author":"Sun Y.","year":"2014"},{"key":"S0218001422510028BIB046","first-page":"2154","volume-title":"Advances in Neural Information Processing Systems","author":"Tamar A.","year":"2016"},{"issue":"2","key":"S0218001422510028BIB047","first-page":"26","volume":"4","author":"Tieleman T.","year":"2012","journal-title":"COURSERA"},{"key":"S0218001422510028BIB048","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.18"},{"volume-title":"Int. Conf. Learning Representations","year":"2016","author":"Wang Z.","key":"S0218001422510028BIB049"},{"key":"S0218001422510028BIB052","doi-asserted-by":"publisher","DOI":"10.1162\/089976602317318938"}],"container-title":["International Journal of Pattern Recognition and Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218001422510028","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,3,3]],"date-time":"2022-03-03T07:58:39Z","timestamp":1646294319000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0218001422510028"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,28]]},"references-count":40,"journal-issue":{"issue":"01","published-print":{"date-parts":[[2022,1]]}},"alternative-id":["10.1142\/S0218001422510028"],"URL":"https:\/\/doi.org\/10.1142\/s0218001422510028","relation":{},"ISSN":["0218-0014","1793-6381"],"issn-type":[{"type":"print","value":"0218-0014"},{"type":"electronic","value":"1793-6381"}],"subject":[],"published":{"date-parts":[[2021,12,28]]},"article-number":"2251002"}}