{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T00:52:29Z","timestamp":1767142349667,"version":"build-2238731810"},"reference-count":66,"publisher":"Springer Science and Business Media LLC","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Comput Neurosci"],"published-print":{"date-parts":[[2008,12]]},"DOI":"10.1007\/s10827-008-0094-6","type":"journal-article","created":{"date-parts":[[2008,4,29]],"date-time":"2008-04-29T11:59:45Z","timestamp":1209470385000},"page":"562-582","source":"Crossref","is-referenced-by-count":9,"title":["Path-finding in real and simulated rats: assessing the influence of path characteristics on navigation learning"],"prefix":"10.1007","volume":"25","author":[{"given":"Minija","family":"Tamosiunaite","sequence":"first","affiliation":[]},{"given":"James","family":"Ainge","sequence":"additional","affiliation":[]},{"given":"Tomas","family":"Kulvicius","sequence":"additional","affiliation":[]},{"given":"Bernd","family":"Porr","sequence":"additional","affiliation":[]},{"given":"Paul","family":"Dudchenko","sequence":"additional","affiliation":[]},{"given":"Florentin","family":"W\u00f6rg\u00f6tter","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2008,4,30]]},"reference":[{"issue":"36","key":"94_CR1","doi-asserted-by":"crossref","first-page":"9769","DOI":"10.1523\/JNEUROSCI.2011-07.2007","volume":"27","author":"J. A. Ainge","year":"2007","unstructured":"Ainge, J. A., Tamosiunaite, M., W\u00f6rg\u00f6tter, F., & Dudchenko, P. A. (2007). Hippocampal CA1 place cells encode intended destination on a maze with multiple choice points. The Journal of Neuroscience, 27(36), 9769\u20139779.","journal-title":"The Journal of Neuroscience"},{"issue":"3","key":"94_CR2","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1007\/s004220000171","volume":"83","author":"A. Arleo","year":"2000","unstructured":"Arleo, A., & Gerstner, W. (2000). Spatial cognition and neuro-mimetic navigation: A model of hippocampal place cell activity. Biological Cybernetics, 83(3), 287\u2013299.","journal-title":"Biological Cybernetics"},{"issue":"3","key":"94_CR3","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1109\/TNN.2004.826221","volume":"15","author":"A. Arleo","year":"2004","unstructured":"Arleo, A., Smeraldi, F., & Gerstner, W. (2004). Cognitive navigation based on nonuniform Gabor space sampling, unsupervised growing networks, and reinforcement learning. IEEE Transactions on Neural Networks, 15(3), 639\u2013652.","journal-title":"IEEE Transactions on Neural Networks"},{"key":"94_CR4","doi-asserted-by":"crossref","unstructured":"Asfour, T., Regenstein, K., Azad, P., Schr\u00f6der, J., Bierbaum, A., Vahrenkamp, N., et al. (2006). ARMAR-III: An integrated humanoid plattfrom for sensory-motor control. In: In IEEE-RAS International Conference on Humanoid Robots.","DOI":"10.1109\/ICHR.2006.321380"},{"key":"94_CR5","first-page":"215","volume-title":"Models of information processing in the basal ganglia","author":"A. Barto","year":"1995","unstructured":"Barto, A. (1995). Adaptive critics and the basal ganglia. In: J. C. Houk, J. L. Davis, & D. G. Beiser (Eds.), Models of information processing in the basal ganglia (pp.\u00a0215\u2013232). Cambridge: MIT."},{"key":"94_CR6","first-page":"835","volume":"13","author":"A. G. Barto","year":"1983","unstructured":"Barto, A. G., Sutton, R. S., & Anderson, C. W. (1983). Neuronlike elements that can solve difficult learning control problems. IEEE Transactions on Systems, Man, and Cybernetics, 13, 835\u2013846.","journal-title":"IEEE Transactions on Systems, Man, and Cybernetics"},{"issue":"6","key":"94_CR7","doi-asserted-by":"crossref","first-page":"722","DOI":"10.1002\/hipo.20095","volume":"15","author":"S. Becker","year":"2005","unstructured":"Becker, S. (2005). A computational principle for hippocampal learning and neurogenesis. Hippocampus, 15(6), 722\u2013738.","journal-title":"Hippocampus"},{"issue":"1","key":"94_CR8","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1162\/089892998563815","volume":"10","author":"G. S. Berns","year":"1998","unstructured":"Berns, G. S., & Sejnowski, T. J. (1998). A computational model of how the basal ganglia produce sequences. The Journal of Cognitive Neuroscience, 10(1), 108\u2013121.","journal-title":"The Journal of Cognitive Neuroscience"},{"issue":"23","key":"94_CR9","doi-asserted-by":"crossref","first-page":"10502","DOI":"10.1523\/JNEUROSCI.19-23-10502.1999","volume":"19","author":"J. Brown","year":"1999","unstructured":"Brown, J., Bullock, D., & Grossberg, S. (1999). How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues. The Journal of Neuroscience, 19(23), 10502\u201310511.","journal-title":"The Journal of Neuroscience"},{"issue":"3","key":"94_CR10","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1002\/hipo.450050304","volume":"5","author":"M. A. Brown","year":"1995","unstructured":"Brown, M. A., & Sharp, P. E. (1995). Simulation of spatial learning in the Morris water maze by a neural network model of the hippocampal formation and nucleus accumbens. Hippocampus, 5(3), 171\u2013188.","journal-title":"Hippocampus"},{"key":"94_CR11","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1007\/s004220000172","volume":"83","author":"N. Burgess","year":"2000","unstructured":"Burgess, N., Jackson, A., Hartley, T., & O\u2019Keefe, J. (2000). Predictions derived from modelling the hippocampal role in navigation. Biological Cybernetics, 83, 301\u2013312.","journal-title":"Biological Cybernetics"},{"key":"94_CR12","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1023\/A:1008862904946","volume":"6","author":"J. L. Contreras-Vidal","year":"1999","unstructured":"Contreras-Vidal, J. L., & Schultz, W. (1999). A predictive reinforcement model of dopamine neurons for learning approach behavior. Journal of Computational Neuroscience, 6, 191\u2013214.","journal-title":"Journal of Computational Neuroscience"},{"key":"94_CR13","volume-title":"Theoretical neuroscience: computational and mathematical modeling of neural systems","author":"P. Dayan","year":"2005","unstructured":"Dayan, P., & Abbott, L. F. (2005). Theoretical neuroscience: computational and mathematical modeling of neural systems. Cambridge: MIT."},{"key":"94_CR14","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1037\/0735-7044.111.1.3","volume":"111","author":"P. A. Dudchenko","year":"1997","unstructured":"Dudchenko, P. A., & Taube, J. S. (1997). Correlation between head-direction single unit activity and spatial behavior on a radial arm maze. Behavioral Neuroscience, 111, 3\u201319.","journal-title":"Behavioral Neuroscience"},{"issue":"16","key":"94_CR15","first-page":"4","volume":"4","author":"D. Eilam","year":"2004","unstructured":"Eilam, D. (2004). Locomotor activity in common spiny mice (Acomys cahirinuse): The effect of light and environmental complexity. BMC Ecology, 4(16), 4\u201316.","journal-title":"BMC Ecology"},{"key":"94_CR16","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/S0166-4328(89)80102-0","volume":"34","author":"D. Eilam","year":"1989","unstructured":"Eilam, D., & Golani, I. (1989). Home base behavior of rats (rattus norvegicus) exploring a novel environment. Behavioural Brain Research, 34, 199\u2013211.","journal-title":"Behavioural Brain Research"},{"issue":"Pt 1","key":"94_CR17","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1242\/jeb.199.1.201","volume":"199","author":"A. S. Etienne","year":"1996","unstructured":"Etienne, A. S., Maurer, R., & Seguinot, V. (1996). Path integration in mammals and its interaction with visual landmarks. Journal of Experimental Biology, 199(Pt 1), 201\u2013209.","journal-title":"Journal of Experimental Biology"},{"issue":"1","key":"94_CR18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/(SICI)1098-1063(2000)10:1<1::AID-HIPO1>3.0.CO;2-1","volume":"10","author":"D. J. Foster","year":"2000","unstructured":"Foster, D. J., Morris, R. G., & Dayan, P. (2000). A model of hippocampally dependent navigation, using the temporal difference learning rule. Hippocampus, 10(1), 1\u201316.","journal-title":"Hippocampus"},{"key":"94_CR19","unstructured":"Glaubius, R., & Smart, W. D. (2004). Manifold representations for value function approximation. In: Proceedings of the AAAI-04 workshop on learning and planning in markov processes (pp.\u00a013\u2013189)."},{"key":"94_CR20","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1037\/0735-7044.115.2.285","volume":"115","author":"E. J. Golob","year":"2001","unstructured":"Golob, E. J., Stackman, R. W., Wong, A. C., & Taube, J. S. (2001). On the behavioural significance of head direction cells: Neural and behavioral dynamics during a spatial memory task. Behavioral Neuroscience, 115, 285\u2013304.","journal-title":"Behavioral Neuroscience"},{"issue":"4","key":"94_CR21","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1002\/1098-1063(2000)10:4<369::AID-HIPO3>3.0.CO;2-0","volume":"10","author":"T. Hartley","year":"2000","unstructured":"Hartley, T., Burgess, N., Lever, C., Cacucci, F., & O\u2019Keefe, J. (2000). Modeling place fields in terms of the cortical inputs to the hippocampus. Hippocampus, 10(4), 369\u2013379.","journal-title":"Hippocampus"},{"key":"94_CR22","doi-asserted-by":"crossref","first-page":"2363","DOI":"10.1111\/j.1460-9568.2005.04412.x","volume":"22","author":"D. J. Hines","year":"2005","unstructured":"Hines, D. J., & Whishaw, I. Q. (2005). Home bases formed to visual cues but not to self-movement (dead reckoning) cues in exploring hippocampectomized rats. European Journal of Neuroscience, 22, 2363\u20132375.","journal-title":"European Journal of Neuroscience"},{"issue":"5","key":"94_CR23","doi-asserted-by":"crossref","first-page":"1635","DOI":"10.1523\/JNEUROSCI.21-05-01635.2001","volume":"21","author":"S. A. Hollup","year":"2001","unstructured":"Hollup, S. A., Molden, S., Donnett, J. G., Moser, M. B., & Moser, E. I. (2001). Accumulation of hippocampal place fields at the goal location in an annular watermaze task. The Journal of Neuroscience, 21(5), 1635\u20131644.","journal-title":"The Journal of Neuroscience"},{"key":"94_CR24","first-page":"249","volume-title":"Models of information processing in the basal ganglia","author":"J. C. Houk","year":"1995","unstructured":"Houk, J. C., Adams, J. L., & Barto, A. G. (1995). A model of how the basal ganglia generate and use neural signals that predict reinforcement. In: J. C. Houk, J. L. Davis, & D. G. Beiser (Eds.), Models of information processing in the basal ganglia (pp.\u00a0249\u2013270). Cambridge: MIT."},{"key":"94_CR25","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1613\/jair.301","volume":"4","author":"L. P. Kaelbling","year":"1996","unstructured":"Kaelbling, L. P., Littman, M., & Moore, A. (1996). Reinforcement learning: A survey. Journal of Artificial Intelligence Research, 4, 237\u2013285.","journal-title":"Journal of Artificial Intelligence Research"},{"key":"94_CR26","doi-asserted-by":"crossref","first-page":"7463","DOI":"10.1523\/JNEUROSCI.20-19-07463.2000","volume":"20","author":"S. Kali","year":"2000","unstructured":"Kali, S., & Dayan, P. (2000). The involvement of recurrent connections in area CA3 in establishing the properties of place fields: A model. The Journal of Neuroscience, 20, 7463\u20137477.","journal-title":"The Journal of Neuroscience"},{"issue":"3","key":"94_CR27","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1385\/NI:3:3:197","volume":"3","author":"J. L. Krichmar","year":"2005","unstructured":"Krichmar, J. L., Seth, A. K., Nitz, D. A., Fleischer, J. G., & Edelman, G. M. (2005). Spatial navigation and causal analysis in a brain-based device modeling cortical-hippocampal interactions. Neuroinformatics, 3(3), 197\u2013221.","journal-title":"Neuroinformatics"},{"key":"94_CR28","doi-asserted-by":"crossref","unstructured":"Kulvicius, T., Tamosiunaite, M., Ainge, J., Dudchenko, P., & W\u00f6rg\u00f6tter, F. (2008). Odor supported place cell model and goal navigation in rodents. Journal of Computational Neuroscience. doi: 10.1007\/s10827-008-0090-x .","DOI":"10.1007\/s10827-008-0090-x"},{"key":"94_CR29","doi-asserted-by":"crossref","first-page":"8918","DOI":"10.1073\/pnas.94.16.8918","volume":"94","author":"M. R. Mehta","year":"1997","unstructured":"Mehta, M. R., Barnes, C. A., & McNaughton, B. (1997). Experience-dependent, asymmetric expansion of hippocampal place fields. Proceedings of the Natianal Academy of Sciences, 94, 8918\u20138921.","journal-title":"Proceedings of the Natianal Academy of Sciences"},{"key":"94_CR30","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1016\/0023-9690(81)90020-5","volume":"12","author":"R. Morris","year":"1981","unstructured":"Morris, R. (1981). Spatial localization does not require the presence of local cues. Learning and Motivation, 12, 239\u2013260.","journal-title":"Learning and Motivation"},{"issue":"1","key":"94_CR31","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/0165-0270(84)90007-4","volume":"11","author":"R. Morris","year":"1984","unstructured":"Morris, R. (1984). Developments of a water-maze procedure for studying spatial learning in the rat. Journal of Neuroscience Methods, 11(1), 47\u201360.","journal-title":"Journal of Neuroscience Methods"},{"issue":"8","key":"94_CR32","doi-asserted-by":"crossref","first-page":"1057","DOI":"10.1038\/nn1743","volume":"9","author":"G. Morris","year":"2006","unstructured":"Morris, G., Nevet, A., Arkadir, D., Vaadia, E., & Bergman, H. (2006). Midbrain dopamine neurons encode decisions for future action. Nature Neuroscience, 9(8), 1057\u20131063.","journal-title":"Nature Neuroscience"},{"key":"94_CR33","doi-asserted-by":"crossref","first-page":"813","DOI":"10.1016\/S0896-6273(00)80214-7","volume":"17","author":"R. Muller","year":"1996","unstructured":"Muller, R. (1996). A quarter of a century of place cells. Neuron, 17, 813\u2013822.","journal-title":"Neuron"},{"key":"94_CR34","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.bbr.2007.05.016","volume":"182","author":"F. Nemati","year":"2007","unstructured":"Nemati, F., & Whishaw, I. Q. (2007). The point of entry contributes to the organization of exploratory behaviour of rats on an open field: An example of spontaneous episodic memory. Behavioural Brain Research, 182, 119\u2013128.","journal-title":"Behavioural Brain Research"},{"issue":"8","key":"94_CR35","doi-asserted-by":"crossref","first-page":"987","DOI":"10.1038\/nn0806-987","volume":"9","author":"Y. Niv","year":"2006","unstructured":"Niv, Y., Daw, N. D., & Dayan, P. (2006). Choice values. Nature Neuroscience, 9(8), 987\u2013988.","journal-title":"Nature Neuroscience"},{"key":"94_CR36","doi-asserted-by":"crossref","first-page":"452","DOI":"10.1126\/science.1094285","volume":"304","author":"J. O\u2019Doherty","year":"2004","unstructured":"O\u2019Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science, 304, 452\u2013454.","journal-title":"Science"},{"issue":"6581","key":"94_CR37","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1038\/381425a0","volume":"381","author":"J. O\u2019Keefe","year":"1996","unstructured":"O\u2019Keefe, J., & Burgess, N. (1996). Geometric determinants of the place fields of hippocampal neurons. Nature, 381(6581), 425\u2013428.","journal-title":"Nature"},{"key":"94_CR38","unstructured":"Okhawa, K., Shibata, T., & Tanie, K. (1998). Method for generating of global cooperation based on local communication. In: Proceedings of the 1998 IEEE\/RSJ intl. conference on intelligent robots and systems (pp.\u00a0108\u2013113)."},{"issue":"6","key":"94_CR39","doi-asserted-by":"crossref","first-page":"735","DOI":"10.1002\/(SICI)1098-1063(1996)6:6<735::AID-HIPO15>3.0.CO;2-1","volume":"6","author":"M. Recce","year":"1996","unstructured":"Recce, M., & Harris, K. D. (1996). Memory for places: A navigational model in support of Marr\u2019s theory of hippocampal function. Hippocampus, 6(6), 735\u2013748.","journal-title":"Hippocampus"},{"issue":"12","key":"94_CR40","doi-asserted-by":"crossref","first-page":"967","DOI":"10.1038\/nrn2022","volume":"7","author":"P. Redgrave","year":"2006","unstructured":"Redgrave, P., & Gurney, K. N. (2006). The short-latency dopamine signal: A role in discovering. Nature Reviews Neuroscience, 7(12), 967\u2013975.","journal-title":"Nature Reviews Neuroscience"},{"key":"94_CR41","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1016\/S0166-2236(98)01373-3","volume":"22","author":"P. Redgrave","year":"1999","unstructured":"Redgrave, P., Prescott, T. J., & Gurney, K. (1999). Is the short-latency dopamine response too short to signal reward error? Trends in Neurosciences, 22(4), 146\u2013151.","journal-title":"Trends in Neurosciences"},{"key":"94_CR42","unstructured":"Reynolds, S. I. (2002). The stability of general discounted reinforcement learning with linear function approximation. In: UK workshop on computational intelligence (UKCI-02) (pp.\u00a0139\u2013146)."},{"issue":"15","key":"94_CR43","doi-asserted-by":"crossref","first-page":"5900","DOI":"10.1523\/JNEUROSCI.17-15-05900.1997","volume":"17","author":"A. Samsonovich","year":"1997","unstructured":"Samsonovich, A., & McNaughton, B. L. (1997). Path integration and cognitive mapping in a continuous attractor neural network model. The Journal of Neuroscience, 17(15), 5900\u20135920.","journal-title":"The Journal of Neuroscience"},{"issue":"1","key":"94_CR44","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1002\/(SICI)1098-1063(2000)10:1<64::AID-HIPO7>3.0.CO;2-Y","volume":"10","author":"E. Save","year":"2000","unstructured":"Save, E., Nerad, L., & Poucet, B. (2000). Contribution of multiple sensory information to place field stability in hippocampal place cells. Hippocampus, 10(1), 64\u201376.","journal-title":"Hippocampus"},{"key":"94_CR45","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/S0896-6273(02)00967-4","volume":"36","author":"W. Schultz","year":"2002","unstructured":"Schultz, W. (2002). Getting formal with dopamine and reward. Neuron, 36, 241\u2013263.","journal-title":"Neuron"},{"key":"94_CR46","unstructured":"Schultz, W. (2007). Reward Signals. Scholarpedia, http:\/\/www.scholarpedia.org\/article\/Reward_Signals ."},{"issue":"5","key":"94_CR47","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1016\/S0166-2236(00)01797-5","volume":"24","author":"P. E. Sharp","year":"2001","unstructured":"Sharp, P. E., Blair, H. T., & Cho, J. (2001). The anatomical and computational basis of the rat head-direction cell signal. Trends in Neurosciences, 24(5), 289\u201394.","journal-title":"Trends in Neurosciences"},{"key":"94_CR48","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1007\/11521082_15","volume-title":"Biomimetic Neural Learning for Intelligent Robots: Intelligent Systems, Cognitive Robotics, and Neuroscience","author":"D. Sheynikhovich","year":"2005","unstructured":"Sheynikhovich, D., Chavarriaga, R., Str\u00f6sslin, T., & Gerstner, W. (2005). Spatial representation and navigation in a bio-inspired robot. In: S. Wermter (Ed.), Biomimetic Neural Learning for Intelligent Robots: Intelligent Systems, Cognitive Robotics, and Neuroscience (pp.\u00a0245\u2013264). New York: Springer."},{"issue":"9","key":"94_CR49","doi-asserted-by":"crossref","first-page":"1125","DOI":"10.1016\/j.neunet.2005.08.012","volume":"18","author":"T. Str\u00f6sslin","year":"2005","unstructured":"Str\u00f6sslin, T., Sheynikhovich, D., Chavarriaga, R., & Gerstner, W. (2005). Robust self-localisation and navigation based on hippocampal place cells. Neural Networks, 18(9), 1125\u20131140.","journal-title":"Neural Networks"},{"key":"94_CR50","volume-title":"Kendall\u2019s advanced theory of statistics","author":"A. Stuart","year":"1999","unstructured":"Stuart, A., Ord, K., & Arnold, S. (1999). Kendall\u2019s advanced theory of statistics. London: Arnold, a member of the Hodder Headline Group."},{"key":"94_CR51","first-page":"9","volume":"3","author":"R. S. Sutton","year":"1988","unstructured":"Sutton, R. S. (1988). Learning to predict by the methods of temporal differences. Machine Learning, 3, 9\u201344.","journal-title":"Machine Learning"},{"key":"94_CR52","volume-title":"Reinforcement learning: An introduction","author":"R. Sutton","year":"1998","unstructured":"Sutton, R., & Barto, A. (1998). Reinforcement learning: An introduction. Cambridge: MIT."},{"key":"94_CR53","doi-asserted-by":"crossref","unstructured":"Szepesvari, C., & Smart, W. D. (2004). Interpolation-based Q-learning. In: Twenty-First international conference on machine learning (ICML04) (vol.\u00a021, pp.\u00a0791\u2013798).","DOI":"10.1145\/1015330.1015445"},{"issue":"3","key":"94_CR54","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1145\/203330.203343","volume":"38","author":"G. Tesauro","year":"1995","unstructured":"Tesauro, G. (1995). Temporal difference learning and TD-gammon. Communications of the ACM, 38(3), 58\u201367.","journal-title":"Communications of the ACM"},{"issue":"5","key":"94_CR55","doi-asserted-by":"crossref","first-page":"674","DOI":"10.1109\/9.580874","volume":"42","author":"J. N. Tsitsiklis","year":"1997","unstructured":"Tsitsiklis, J. N., & Van\u00a0Roy, B. (1997). An Analysis of temporal-difference learning with function approximation. IEEE Transactions on Automatic Control, 42(5), 674\u2013690.","journal-title":"IEEE Transactions on Automatic Control"},{"issue":"4","key":"94_CR56","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1002\/(SICI)1098-1063(1999)9:4<481::AID-HIPO14>3.0.CO;2-S","volume":"9","author":"M. Tsodyks","year":"1999","unstructured":"Tsodyks, M. (1999). Attractor neural network models of spatial maps in hippocampus. Hippocampus, 9(4), 481\u2013489.","journal-title":"Hippocampus"},{"issue":"1\u20132","key":"94_CR57","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/S0166-4328(01)00384-9","volume":"131","author":"D. G. Wallace","year":"2002","unstructured":"Wallace, D. G., Gorny, B., & Whishaw, I. Q. (2002). Rats can track odors, other rats, and themselves: Implications for the study of spatial behavior. Behavioural Brain Research, 131(1\u20132), 185\u2013192.","journal-title":"Behavioural Brain Research"},{"key":"94_CR58","first-page":"279","volume":"8","author":"C. J. Watkins","year":"1992","unstructured":"Watkins, C. J., & Dayan, P. (1992). Q-learning. Machine Learning, 8, 279\u2013292.","journal-title":"Machine Learning"},{"key":"94_CR59","doi-asserted-by":"crossref","unstructured":"Werbos, P. J. (1988). Backpropagation: Past and future. In: Proceedings of the IEEE international conference on neural networks (pp.\u00a0343\u2013353).","DOI":"10.1109\/ICNN.1988.23866"},{"issue":"1\u20132","key":"94_CR60","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/S0166-4328(01)00359-X","volume":"127","author":"I. Q. Whishaw","year":"2001","unstructured":"Whishaw, I. Q., Hines, D. J., & Wallace, D. G. (2001). Dead reckoning (path integration) requires the hippocampal formation: Evidence from spontaneous exploration and spatial learning tasks in light (allothetic) and dark (idiothetic) tests. Behavioural Brain Research, 127(1\u20132), 49\u201369.","journal-title":"Behavioural Brain Research"},{"key":"94_CR61","doi-asserted-by":"crossref","unstructured":"Wiering, M. (2004). Convergence and divergence in standard averaging reinforcement learning. In: J. Boulicaut, F. Esposito, F. Giannotti, & D. Pedreschi (Eds.), Proceedings of the 15th European conference on machine learning ECML\u201904 (pp.\u00a0477\u2013488).","DOI":"10.1007\/978-3-540-30115-8_44"},{"issue":"5124","key":"94_CR62","doi-asserted-by":"crossref","first-page":"1055","DOI":"10.1126\/science.8351520","volume":"261","author":"M. A. Wilson","year":"1993","unstructured":"Wilson, M. A., & McNaughton, B. L. (1993). Dynamics of the hippocampal ensemble code for space. Science, 261(5124), 1055\u20131058.","journal-title":"Science"},{"issue":"2","key":"94_CR63","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1162\/0899766053011555","volume":"17","author":"F. W\u00f6rg\u00f6tter","year":"2005","unstructured":"W\u00f6rg\u00f6tter, F., & Porr, B. (2005). Temporal sequence learning, prediction, and control: A review of different models and their relation to biological mechanisms. Neural Computation, 17(2), 245\u2013319.","journal-title":"Neural Computation"},{"key":"94_CR64","unstructured":"W\u00f6rg\u00f6tter, F., & Porr, B. (2007). Reinforcement Learning. Scholar pedia, http:\/\/www.scholarpedia.org\/article\/Reinforcement_Learning ."},{"issue":"2","key":"94_CR65","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/S0019-0578(07)60032-9","volume":"43","author":"G. G. Yen","year":"2004","unstructured":"Yen, G. G., & Hickey, T. (2004). Reinforcement learning algorithms for robotic navigation in dynamic environments. ISA Transactions, 43(2), 217\u2013230.","journal-title":"ISA Transactions"},{"key":"94_CR66","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/j.bbr.2004.09.022","volume":"159","author":"P. Zadicario","year":"2005","unstructured":"Zadicario, P., Avni, R., Zadicario, E., & Eilam, D. (2005). \u2018Looping\u2019: An exploration and navigation mechanism in a dark open field. Behavioural Brain Research, 159, 27\u201336.","journal-title":"Behavioural Brain Research"}],"updated-by":[{"DOI":"10.1007\/s10827-010-0217-8","type":"erratum","label":"Erratum","source":"publisher","updated":{"date-parts":[[2010,2,27]],"date-time":"2010-02-27T00:00:00Z","timestamp":1267228800000}}],"container-title":["Journal of Computational Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10827-008-0094-6.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,9]],"date-time":"2021-09-09T00:35:13Z","timestamp":1631147713000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10827-008-0094-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,4,30]]},"references-count":66,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2008,12]]}},"alternative-id":["94"],"URL":"https:\/\/doi.org\/10.1007\/s10827-008-0094-6","relation":{},"ISSN":["0929-5313","1573-6873"],"issn-type":[{"value":"0929-5313","type":"print"},{"value":"1573-6873","type":"electronic"}],"subject":[],"published":{"date-parts":[[2008,4,30]]}}}