{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,18]],"date-time":"2026-07-18T15:49:43Z","timestamp":1784389783645,"version":"3.55.0"},"reference-count":66,"publisher":"Springer Science and Business Media LLC","issue":"9","license":[{"start":{"date-parts":[[2024,6,5]],"date-time":"2024-06-05T00:00:00Z","timestamp":1717545600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,6,5]],"date-time":"2024-06-05T00:00:00Z","timestamp":1717545600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mach Learn"],"published-print":{"date-parts":[[2024,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The success of deep learning in computer vision and natural language processing communities can be attributed to the training of very deep neural networks with millions or billions of parameters, which can then be trained with massive amounts of data. However, a similar trend has largely eluded the training of deep reinforcement learning (RL) algorithms where larger networks do not lead to performance improvement. Previous work has shown that this is mostly due to instability during the training of deep RL agents when using larger networks. In this paper, we make an attempt to understand and address the training of larger networks for deep RL. We first show that naively increasing network capacity does not improve performance. Then, we propose a novel method that consists of (1) wider networks with DenseNet connection, (2) decoupling representation learning from the training of RL, and (3) a distributed training method to mitigate overfitting problems. Using this three-fold technique, we show that we can train very large networks that result in significant performance gains. We present several ablation studies to demonstrate the efficacy of the proposed method and some intuitive understanding of the reasons for performance gain. We show that our proposed method outperforms other baseline algorithms on several challenging locomotion tasks.<\/jats:p>","DOI":"10.1007\/s10994-024-06547-6","type":"journal-article","created":{"date-parts":[[2024,6,5]],"date-time":"2024-06-05T22:03:10Z","timestamp":1717624990000},"page":"6115-6139","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["A framework for training larger networks for deep Reinforcement learning"],"prefix":"10.1007","volume":"113","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5744-3027","authenticated-orcid":false,"given":"Kei","family":"Ota","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Devesh K.","family":"Jha","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Asako","family":"Kanezaki","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,6,5]]},"reference":[{"key":"6547_CR1","unstructured":"Achiam, J., Knight, E., & Abbeel, P. (2019). Towards characterizing divergence in deep q-learning. arXiv preprint arXiv:1903.08894"},{"key":"6547_CR2","unstructured":"Ahn, M., Brohan, A., Brown, N., Chebotar, Y., Cortes, O., David, B., Finn, C., Fu, C., Gopalakrishnan, K., Hausman, K., Herzog, A., Ho, D., Hsu, J., Ibarz, J., Ichter, B., Irpan, A., Jang, E., Ruano, R.J., Jeffrey, K., Jesmonth, S., Joshi, N., Julian, R., Kalashnikov, D., Kuang, Y., Lee, K.-H., Levine, S., Lu, Y., Luu, L., Parada, C., Pastor, P., Quiambao, J., Rao, K., Rettinghouse, J., Reyes, D., Sermanet, P., Sievers, N., Tan, C., Toshev, A., Vanhoucke, V., Xia, F., Xiao, T., Xu, P., Xu, S., Yan, M., & Zeng, A. (2022). Do as i can and not as i say: Grounding language in robotic affordances. arXiv Preprint arXiv:2204.01691"},{"key":"6547_CR3","unstructured":"Andrychowicz, M., Raichuk, A., Sta\u0144czyk, P., Orsini, M., Girgin, S., Marinier, R., Hussenot, L., Geist, M., Pietquin, O., Michalski, M., Gelly, S., & Bachem, O. (2021). What matters in on-policy reinforcement learning? A large-scale empirical study. In Proceedings of international conference on learning representations (ICLR)."},{"key":"6547_CR4","unstructured":"Andrychowicz, M., Wolski, F., Ray, A., Schneider, J., Fong, R., Welinder, P., McGrew, B., Tobin, J., Pieter\u00a0Abbeel, O., & Zaremba, W. (2017). Hindsight experience replay. In Proceedings of advances in neural information processing systems (NeurIPS) (Vol. 30)."},{"key":"6547_CR5","unstructured":"Aviral\u00a0Kumar, D. G. Rishabh\u00a0Agarwal, & Levine, S. (2021). Implicit under-parameterization inhibits data-efficient deep reinforcement learning. In Proceedings of international conference on learning representations (ICLR)."},{"key":"6547_CR6","doi-asserted-by":"crossref","unstructured":"Brohan, A., Brown, N., Carbajal, J., Chebotar, Y., Dabis, J., Finn, C., Gopalakrishnan, K., Hausman, K., Herzog, A., Hsu, J., Ibarz, J., Ichter, B., Irpan, A., Jackson, T., Jesmonth, S., Joshi, N., Julian, R., Kalashnikov, D., Kuang, Y., Leal, I., Lee, K.-H., Levine, S., Lu, Y., Malla, U., Manjunath, D., Mordatch, I., Nachum, O., Parada, C., Peralta, J., Perez, E., Pertsch, K., Quiambao, J., Rao, K., Ryoo, M., Salazar, G., Sanketi, P., Sayed, K., Singh, J., Sontakke, S., Stone, A., Tan, C., Tran, H., Vanhoucke, V., Vega, S., Vuong, Q., Xia, F., Xiao, T., Xu, P., Xu, S., Yu, T., & Zitkovich, B. (2022). Rt-1: Robotics transformer for real-world control at scale. In: arXiv Preprint arXiv:2212.06817","DOI":"10.15607\/RSS.2023.XIX.025"},{"key":"6547_CR7","unstructured":"Brown, T.B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D. ., Wu, J., Winter, C., Hesse, C., Chen, M., Sigler, E., Litwin, M., Gray, S., Chess, B., Clark, J., Berner, C., McCandlish, S., Radford, A., Sutskever, I., & Amodei, D. (2020). Language models are few-shot learners. In H. Larochelle, M. Ranzato, R. Hadsell, M. Balcan, & H. Lin (Eds.), Proceedings of advances in neural information processing systems (NeurIPS)."},{"key":"6547_CR8","unstructured":"Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020). A simple framework for contrastive learning of visual representations. In Proceedings of international conference on machine learning (ICML) (pp. 1597\u20131607)."},{"key":"6547_CR9","unstructured":"Chen, T., Kornblith, S., Swersky, K., Norouzi, M., & Hinton, G. (2020). Big self-supervised models are strong semi-supervised learners. In Proceedings of advances in neural information processing systems (NeurIPS)."},{"key":"6547_CR10","first-page":"15084","volume":"34","author":"L Chen","year":"2021","unstructured":"Chen, L., Lu, K., Rajeswaran, A., Lee, K., Grover, A., Laskin, M., Abbeel, P., Srinivas, A., & Mordatch, I. (2021). Decision transformer: Reinforcement learning via sequence modeling. Advances in Neural Information Processing Systems, 34, 15084\u201315097.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"6547_CR11","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L., Li, K., & Fei-Fei L. (2009). Imagenet: A large-scale hierarchical image database. In 2009 IEEE Conference on computer vision and pattern recognition.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"6547_CR12","unstructured":"Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: Human language technologies, volume 1 (long and short papers)."},{"key":"6547_CR13","unstructured":"Fedus, W., Ramachandran, P., Agarwal, R., Bengio, Y., Larochelle, H., Rowland, M., & Dabney, W. (2020). Revisiting fundamentals of experience replay. In Proceedings of the 37th international conference on machine learning (pp. 3061\u20133071)."},{"key":"6547_CR14","unstructured":"Fu, J., Kumar, A., Soh, M., & Levine, S. (2019). Diagnosing bottlenecks in deep q-learning algorithms. In Proceedings of international conference on machine learning (ICML)."},{"key":"6547_CR15","unstructured":"Fujimoto, S., van Hoof, H., & Meger, D. (2018). Addressing function approximation error in actor-critic methods. In Proceedings of international conference on machine learning (ICML)."},{"key":"6547_CR16","unstructured":"Glorot, X., & Bengio, Y. (2010). Understanding the difficulty of training deep feedforward neural networks. In Y.W. Teh, & M. Titterington (Eds.), Proceedings of the artificial intelligence and statistics (AISTATS). Proceedings of machine learning research (Vol. 9, pp. 249\u2013256). PMLR. https:\/\/proceedings.mlr.press\/v9\/glorot10a.html"},{"key":"6547_CR17","unstructured":"Ha, D., & Schmidhuber, J. (2018). Recurrent world models facilitate policy evolution. In Proceedings of advances in neural information processing systems (NeurIPS)."},{"key":"6547_CR18","unstructured":"Haarnoja, T., Zhou, A., Abbeel, P., & Levine, S. (2018). Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. CoRR. arXiv:1801.01290 [abs]"},{"key":"6547_CR19","doi-asserted-by":"crossref","unstructured":"He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020). Momentum contrast for unsupervised visual representation learning. In Proceedings of IEEE conference on computer vision and pattern recognition (CVPR).","DOI":"10.1109\/CVPR42600.2020.00975"},{"key":"6547_CR20","doi-asserted-by":"publisher","unstructured":"He, K., Zhang, X., Ren, S., & Sun, J. (2016a). Deep residual learning for image recognition. In Proceedings of IEEE conference on computer vision and pattern recognition (CVPR) (pp. 770\u2013778). https:\/\/doi.org\/10.1109\/CVPR.2016.90","DOI":"10.1109\/CVPR.2016.90"},{"key":"6547_CR21","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., & Sun, J. (2016b). Identity mappings in deep residual networks. In Proceedings of European conference on computer vision (ECCV).","DOI":"10.1007\/978-3-319-46493-0_38"},{"key":"6547_CR22","unstructured":"Henaff, O. (2020). Data-efficient image recognition with contrastive predictive coding. In Proceedings of international conference on machine learning (ICML) (pp. 4182\u20134192)."},{"key":"6547_CR23","doi-asserted-by":"crossref","unstructured":"Henderson, P., Islam, R., Bachman, P., Pineau, J., Precup, D., & Meger, D. (2018). Deep reinforcement learning that matters. In Proceedings of AAAI conference on artificial intelligence.","DOI":"10.1609\/aaai.v32i1.11694"},{"key":"6547_CR24","unstructured":"Hernandez, D., Kaplan, J., Henighan, T., & McCandlish, S. (2021). Scaling laws for transfer. arXiv preprint arXiv:2102.01293 [cs.LG]"},{"key":"6547_CR25","doi-asserted-by":"crossref","unstructured":"Hessel, M., Modayil, J., van Hasselt, H., Schaul, T., Ostrovski, G., Dabney, W., Horgan, D., Piot, B., Azar, M. G., & Silver, D. (2018). Rainbow: Combining improvements in deep reinforcement learning. In Proceedings of AAAI conference on artificial intelligence.","DOI":"10.1609\/aaai.v32i1.11796"},{"key":"6547_CR26","unstructured":"Horgan, D., Quan, J., Budden, D., Barth-Maron, G., Hessel, M., Van\u00a0Hasselt, H., & Silver, D. (2018). Distributed prioritized experience replay. arXiv preprint arXiv:1803.00933."},{"key":"6547_CR27","doi-asserted-by":"publisher","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017). Densely connected convolutional networks. In 2017 IEEE Conference on computer vision and pattern recognition (CVPR) (pp. 2261\u20132269). https:\/\/doi.org\/10.1109\/CVPR.2017.243","DOI":"10.1109\/CVPR.2017.243"},{"key":"6547_CR28","unstructured":"Ioffe, S., & Szegedy, C. (2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift. In Proceedings of international conference on machine learning (ICML)."},{"key":"6547_CR29","unstructured":"Jaderberg, M., Dalibard, V., Osindero, S., Czarnecki, W. M., Donahue, J., Razavi, A., Vinyals, O., Green, T., Dunning, I., Simonyan, K., Fernando, C., & Kavukcuoglu, K. (2017a). Population based training of neural networks. arXiv preprint arXiv:1711.09846."},{"key":"6547_CR30","unstructured":"Jaderberg, M., Mnih, V., Czarnecki, W. M., Schaul, T., Leibo, J. Z., Silver, D., & Kavukcuoglu, K. (2017b). Reinforcement learning with unsupervised auxiliary tasks. In Proceedings of international conference on learning representations (ICLR)."},{"key":"6547_CR31","unstructured":"Kaplan, J., McCandlish, S., Henighan, T., Brown, T.B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., & Amodei, D. (2020). Scaling laws for neural language models. arXiv preprint arXiv:2001.08361arXiv:2001.08361 [cs.LG]"},{"key":"6547_CR32","unstructured":"Kapturowski, S., Ostrovski, G., Dabney, W., Quan, J., & Munos, R. (2019). Recurrent experience replay in distributed reinforcement learning. In Proceedings of international conference on learning representations (ICLR)."},{"key":"6547_CR33","unstructured":"Konan, S. G., Seraj, E., & Gombolay, M. (2023). Contrastive decision transformers. In K. Liu, D. Kulic, & J. Ichnowski (Eds.), Proceedings of the 6th conference on robot learning. Proceedings of machine learning research (Vol. 205, pp. 2159\u20132169). PMLR. https:\/\/proceedings.mlr.press\/v205\/konan23a.html"},{"key":"6547_CR34","first-page":"1097","volume-title":"Proceedings of Advances in Neural Information Processing Systems (NeurIPS)","author":"A Krizhevsky","year":"2012","unstructured":"Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). Imagenet classification with deep convolutional neural networks. In F. Pereira, C. J. C. Burges, L. Bottzou, & K. Q. Weinberger (Eds.), Proceedings of Advances in Neural Information Processing Systems (NeurIPS) (Vol. 25, pp. 1097\u20131105). Curran Associates Inc."},{"key":"6547_CR35","doi-asserted-by":"crossref","unstructured":"Lesort, T., D\u00edaz-Rodr\u00edguez, N., Goudou, J.-F., & Filliat, D. (2018). State representation learning for control: An overview. CoRR. arXiv:1802.04181 [abs]","DOI":"10.1016\/j.neunet.2018.07.006"},{"key":"6547_CR36","unstructured":"Li, H., Xu, Z., Taylor, G., Studer, C., & Goldstein, T. (2018). Visualizing the loss landscape of neural nets. In Proceedings of advances in neural information processing systems (NeurIPS) (pp. 6391\u20136401)."},{"key":"6547_CR37","unstructured":"Li, W., Luo, H., Lin, Z., Zhang, C., Lu, Z., & Ye, D. (2023) A survey on transformers in reinforcement learning. Transactions on Machine Learning Research Survey Certification."},{"key":"6547_CR38","first-page":"30865","volume":"35","author":"X Li","year":"2022","unstructured":"Li, X., Shang, J., Das, S., & Ryoo, M. (2022). Does self-supervised learning really improve reinforcement learning from pixels? Advances in Neural Information Processing Systems, 35, 30865\u201330881.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"6547_CR39","unstructured":"Liu, Z., Li, X., Kang, B., & Darrell, T. (2021). Regularization matters in policy optimization. In Proceedings of international conference on learning representations (ICLR)."},{"key":"6547_CR40","unstructured":"Lu, Z., Pu, H., Wang, F., Hu, Z., & Wang, L. (2017). The expressive power of neural networks: A view from the width. In Proceedings of advances in neural information processing systems (NeurIPS) (pp. 6232\u20136240)."},{"issue":"7540","key":"6547_CR41","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1038\/nature14236","volume":"518","author":"V Mnih","year":"2015","unstructured":"Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., Petersen, S., Beattie, C., Sadik, A., Antonoglou, I., King, H., Kumaran, D., Wierstra, D., Legg, S. & Hassabis, D. (2015). Human-level control through deep reinforcement learning. Nature, 518(7540), 529\u2013533.","journal-title":"Nature"},{"key":"6547_CR42","unstructured":"Mohan, A., Benjamins, C., Wienecke, K., Dockhorn, A., & Lindauer, M. (2023). Autorl hyperparameter landscapes. arXiv preprint arXiv:2304.02396"},{"key":"6547_CR43","doi-asserted-by":"crossref","unstructured":"Munk, J., Kober, J., & Babu\u0161ka, R. (2016). Learning state representation for deep actor-critic control. In IEEE Conference on decision and control (CDC) (pp. 4667\u20134673).","DOI":"10.1109\/CDC.2016.7798980"},{"key":"6547_CR44","unstructured":"Neyshabur, B., Li, Z., Bhojanapalli, S., LeCun, Y., & Srebro, N. (2019). The role of over-parametrization in generalization of neural networks. In Proceedings of international conference on learning representations (ICLR). https:\/\/openreview.net\/forum?id=BygfghAcYX"},{"key":"6547_CR45","unstructured":"Nguyen, Q., & Hein, M. (2017). The loss surface of deep and wide neural networks. In Proceedings of international conference on machine learning (ICML) (pp. 2603\u20132612)."},{"key":"6547_CR46","unstructured":"Ota, K., Oiki, T., Jha, D., Mariyama, T., & Nikovski, D. (2020). Can increasing input dimensionality improve deep reinforcement learning? In Proceedings of international conference on machine learning (ICML) (pp. 7424\u20137433)."},{"key":"6547_CR47","doi-asserted-by":"publisher","first-page":"517","DOI":"10.1613\/jair.1.13596","volume":"74","author":"J Parker-Holder","year":"2022","unstructured":"Parker-Holder, J., Rajan, R., Song, X., Biedenkapp, A., Miao, Y., Eimer, T., Zhang, B., Nguyen, V., Calandra, R., Faust, A., Hutter, F., & Lindauer, M. (2022). Automated reinforcement learning (autorl): A survey and open problems. Journal of Artificial Intelligence Research, 74, 517\u2013568.","journal-title":"Journal of Artificial Intelligence Research"},{"key":"6547_CR48","unstructured":"Plappert, M., Andrychowicz, M., Ray, A., McGrew, B., Baker, B., Powell, G., Schneider, J., Tobin, J., Chociej, M., Welinder, P., Kumar, V., & Zaremba, W. (2018). Multi-goal reinforcement learning: Challenging robotics environments and request for research. arXiv preprint arXiv:1802.09464"},{"key":"6547_CR49","unstructured":"Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., & Sutskever, I. (2019). Language models are unsupervised multitask learners."},{"key":"6547_CR50","unstructured":"Ramachandran, P., Zoph, B., & Le, Q.V. (2017). Searching for activation functions. CoRR. arXiv:1710.05941 [abs]"},{"issue":"3","key":"6547_CR51","first-page":"261","volume":"44","author":"H Ramchoun","year":"2017","unstructured":"Ramchoun, H., Idrissi, M. A. J., Ghanou, Y., & Ettaouil, M. (2017). New modeling of multilayer perceptron architecture optimization with regularization: An application to pattern classification. IAENG International Journal of Computer Science, 44(3), 261\u2013269.","journal-title":"IAENG International Journal of Computer Science"},{"key":"6547_CR52","unstructured":"Schaul, T., Quan, J., Antonoglou, I., & Silver, D. (2016). Prioritized experience replay. In Proceedings of international conference on learning representations (ICLR)."},{"key":"6547_CR53","doi-asserted-by":"crossref","unstructured":"Shang, J., Kahatapitiya, K., Li, X., & Ryoo, M. S. (2022). Starformer: Transformer with state-action-reward representations for visual reinforcement learning. In European conference on computer vision (pp. 462\u2013479). Springer.","DOI":"10.1007\/978-3-031-19842-7_27"},{"key":"6547_CR54","unstructured":"Shelhamer, E., Mahmoudieh, P., Argus, M., & Darrell, T. (2017). Loss is its own reward: Self-supervision for reinforcement learning. In Proceedings of international conference on learning representations (ICLR)."},{"key":"6547_CR55","unstructured":"Sinha, S., Bharadhwaj, H., Srinivas, A., & Garg, A. (2020). D2rl: Deep dense architectures in reinforcement learning. arXiv preprint arXiv:2010.09163 [cs.LG]"},{"key":"6547_CR56","unstructured":"Stooke, A., & Abbeel, P. (2018). Accelerated methods for deep reinforcement learning. arXiv preprint arXiv:1803.02811"},{"key":"6547_CR57","unstructured":"Stooke, A., Lee, K., Abbeel, P., & Laskin, M. (2020). Decoupling representation learning from reinforcement learning. arXiv preprint arXiv:2009.08319 [cs.LG]"},{"key":"6547_CR58","unstructured":"Tan, M., & Le, Q. (2019). Efficientnet: Rethinking model scaling for convolutional neural networks. In Proceedings of international conference on machine learning (ICML) (pp. 6105\u20136114). PMLR."},{"key":"6547_CR59","doi-asserted-by":"crossref","unstructured":"Todorov, E., Erez, T., & Tassa, Y. (2012). Mujoco: A physics engine for model-based control. In Proceedings of IEEE\/RSJ international conference on intelligent robots and systems (IROS).","DOI":"10.1109\/IROS.2012.6386109"},{"key":"6547_CR60","unstructured":"van Hasselt, H., Doron, Y., Strub, F., Hessel, M., Sonnerat, N., & Modayil, J. (2018). Deep reinforcement learning and the deadly triad. CoRR."},{"key":"6547_CR61","doi-asserted-by":"crossref","unstructured":"Van\u00a0Hasselt, H., Guez, A., & Silver, D. (2016). Deep reinforcement learning with double q-learning. In Thirtieth AAAI conference on artificial intelligence.","DOI":"10.1609\/aaai.v30i1.10295"},{"key":"6547_CR62","unstructured":"Wan, X., Lu, C., Parker-Holder, J., Ball, P. J., Nguyen, V., Ru, B., & Osborne, M. (2022). Bayesian generational population-based training. In International conference on automated machine learning (pp. 14\u20131). PMLR."},{"key":"6547_CR63","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1016\/j.patcog.2019.01.006","volume":"90","author":"Z Wu","year":"2019","unstructured":"Wu, Z., Shen, C., & Van Den Hengel, A. (2019). Wider or deeper: Revisiting the resnet model for visual recognition. Pattern Recognition, 90, 119\u2013133.","journal-title":"Pattern Recognition"},{"key":"6547_CR64","doi-asserted-by":"crossref","unstructured":"Zagoruyko, S., & Komodakis, N. (2016). Wide residual networks. In Proceedings of British machine vision conference (BMVC).","DOI":"10.5244\/C.30.87"},{"key":"6547_CR65","unstructured":"Zhang, C., Bengio, S., Hardt, M., Recht, B., & Vinyals, O. (2017). Understanding deep learning requires rethinking generalization. In Proceedings of international conference on learning representations (ICLR)."},{"key":"6547_CR66","unstructured":"Zhou, C., Li, Q., Li, C., Yu, J., Liu, Y., Wang, G., Zhang, K., Ji, C., Yan, Q., He, L., Peng, H., Li, J., Wu, J., Liu, Z., Xie, P., Xiong, C., Pei, J., Yu, P., & Sun, L. (2023). A comprehensive survey on pretrained foundation models: A history from bert to chatgpt. arXiv preprint arXiv:2302.09419"}],"container-title":["Machine Learning"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-024-06547-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10994-024-06547-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-024-06547-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,7]],"date-time":"2024-08-07T17:23:31Z","timestamp":1723051411000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10994-024-06547-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,5]]},"references-count":66,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2024,9]]}},"alternative-id":["6547"],"URL":"https:\/\/doi.org\/10.1007\/s10994-024-06547-6","relation":{},"ISSN":["0885-6125","1573-0565"],"issn-type":[{"value":"0885-6125","type":"print"},{"value":"1573-0565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,5]]},"assertion":[{"value":"2 April 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 January 2024","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 April 2024","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 June 2024","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"Yes.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}}]}}