{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,6]],"date-time":"2026-07-06T15:58:44Z","timestamp":1783353524332,"version":"3.54.6"},"reference-count":114,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2025,3,4]],"date-time":"2025-03-04T00:00:00Z","timestamp":1741046400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,3,4]],"date-time":"2025-03-04T00:00:00Z","timestamp":1741046400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100016378","name":"Technische Universit\u00e4t Dortmund","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100016378","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mach Learn"],"published-print":{"date-parts":[[2025,4]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Learning meaningful representations is at the heart of many tasks in the field of modern machine learning. Recently, a lot of methods were introduced that allow learning of image representations without supervision. These representations can then be used in downstream tasks like classification or object detection. The quality of these representations is close to supervised learning, while no labeled images are needed. This survey paper provides a comprehensive review of these methods in a unified notation, points out similarities and differences of these methods, and proposes a taxonomy which sets these methods in relation to each other. Furthermore, our survey summarizes the most recent experimental results reported in the literature in form of a meta-study. Our survey is intended as a starting point for researchers and practitioners who want to dive into the field of representation learning.<\/jats:p>","DOI":"10.1007\/s10994-024-06708-7","type":"journal-article","created":{"date-parts":[[2025,3,4]],"date-time":"2025-03-04T17:30:07Z","timestamp":1741109407000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["A survey on self-supervised methods for visual representation learning"],"prefix":"10.1007","volume":"114","author":[{"given":"Tobias","family":"Uelwer","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jan","family":"Robine","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stefan Sylvius","family":"Wagner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marc","family":"H\u00f6ftmann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eric","family":"Upschulte","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sebastian","family":"Konietzny","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maike","family":"Behrendt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stefan","family":"Harmeling","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,3,4]]},"reference":[{"issue":"12","key":"6708_CR1","doi-asserted-by":"crossref","first-page":"2313","DOI":"10.3390\/jimaging8120320","volume":"8","author":"J Anton","year":"2022","unstructured":"Anton, J., Castelli, L., Chan, M. F., Outters, M., Tang, W. H., Cheung, V., Shukla, P., Walambe, R., & Kotecha, K. (2022). How well do self-supervised models transfer to medical imaging? Journal of Imaging, 8(12), 2313\u2013433X.","journal-title":"Journal of Imaging"},{"key":"6708_CR2","unstructured":"Asano, Y.\u00a0M., Rupprecht, C., & Andrea, V. (2020). Self-labelling via simultaneous clustering and representation learning. In International conference on learning representations."},{"key":"6708_CR3","doi-asserted-by":"crossref","unstructured":"Assran, M., Caron, M., Misra, I., Bojanowski, P., Joulin, A., Ballas, N., & Rabbat, M. (2021). Semi-supervised learning of visual features by non-parametrically predicting view assignments with support samples. In 2021 IEEE\/CVF international conference on computer vision (ICCV) (pp. 8423\u20138432).","DOI":"10.1109\/ICCV48922.2021.00833"},{"key":"6708_CR4","unstructured":"Ba, J. L., Kiros, J.\u00a0R., & Hinton, G.\u00a0E. (2016). Layer normalization. arXiv:1607.06450"},{"key":"6708_CR5","doi-asserted-by":"crossref","unstructured":"Bai, W., Chen, C., Tarroni, G., Duan, J., Guitton, F., Petersen, S. E., Guo, Y., Matthews, P.\u00a0M., & Rueckert, D. (2019). Self-supervised learning for cardiac mr image segmentation by anatomical position prediction. In Shen, D., Liu, T., Peters, T.\u00a0M., Staib, L.\u00a0H., Essert, C., Zhou, S., Yap, P.-T., & Khan, A. (Eds.), Medical image computing and computer assisted intervention\u2014MICCAI 2019 (pp. 541\u2013549). Springer. ISBN 978-3-030-32245-8","DOI":"10.1007\/978-3-030-32245-8_60"},{"key":"6708_CR6","unstructured":"Bardes, A., Ponce, J., & LeCun, Y. (2021). Vicreg: Variance-invariance-covariance regularization for self-supervised learning. In International conference on learning representations."},{"key":"6708_CR7","unstructured":"Barlow, H.\u00a0B. (1961). Possible principles underlying the transformation of sensory messages. Sensory Communication, 1(01)."},{"issue":"4","key":"6708_CR8","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1016\/j.neuron.2012.10.038","volume":"76","author":"AM Bastos","year":"2012","unstructured":"Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P., & Friston, K. J. (2012). Canonical microcircuits for predictive coding. Neuron, 76(4), 695\u2013711.","journal-title":"Neuron"},{"key":"6708_CR9","unstructured":"Botteghi, N., Poel, M., & Brune, C. (2022). Unsupervised representation learning in deep reinforcement learning: A review. arXiv:2208.14226"},{"key":"6708_CR10","doi-asserted-by":"crossref","unstructured":"Bromley, J., Guyon, I., LeCun, Y., S\u00e4ckinger, E., & Shah, R. (1993). Signature verification using a \u201cSiamese\u201d time delay neural network. Advances in Neural Information Processing Systems, 6.","DOI":"10.1142\/9789812797926_0003"},{"key":"6708_CR11","doi-asserted-by":"crossref","unstructured":"Caron, M., Bojanowski, P., Joulin, A., & Douze, M. (2018). Deep clustering for unsupervised learning of visual features. In Proceedings of the European conference on computer vision (ECCV) (pp. 132\u2013149).","DOI":"10.1007\/978-3-030-01264-9_9"},{"key":"6708_CR12","first-page":"9912","volume":"33","author":"M Caron","year":"2020","unstructured":"Caron, M., Misra, I., Mairal, J., Goyal, P., Bojanowski, P., & Joulin, A. (2020). Unsupervised learning of visual features by contrasting cluster assignments. Advances in Neural Information Processing Systems, 33, 9912\u20139924.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"6708_CR13","doi-asserted-by":"crossref","unstructured":"Caron, M., Touvron, H., Misra, I., J\u00e9gou, H., Mairal, J., Bojanowski, P., & Joulin, A. (2021). Emerging properties in self-supervised vision transformers. In Proceedings of the IEEE\/CVF international conference on computer vision (pp. 9650\u20139660).","DOI":"10.1109\/ICCV48922.2021.00951"},{"key":"6708_CR14","doi-asserted-by":"crossref","unstructured":"Chen, C., Zhong, A., Wu, D., Luo, J., & Li, Q. (2023a). Contrastive masked image-text modeling for medical visual representation learning. In International conference on medical image computing and computer-assisted intervention (pp. 493\u2013503). Springer.","DOI":"10.1007\/978-3-031-43904-9_48"},{"issue":"101539","key":"6708_CR15","volume":"58","author":"L Chen","year":"2019","unstructured":"Chen, L., Bentley, P., Mori, K., Misawa, K., Fujiwara, M., & Rueckert, D. (2019). Self-supervised learning for medical image analysis using image context restoration. Medical Image Analysis, 58(101539), 101539.","journal-title":"Medical Image Analysis"},{"issue":"12","key":"6708_CR16","doi-asserted-by":"crossref","first-page":"11701","DOI":"10.1109\/TII.2023.3249794","volume":"19","author":"R Chen","year":"2023","unstructured":"Chen, R., Cai, Z., & Yuan, J. (2023). Uiesc: An underwater image enhancement framework via self-attention and contrastive learning. IEEE Transactions on Industrial Informatics, 19(12), 11701\u201311711.","journal-title":"IEEE Transactions on Industrial Informatics"},{"key":"6708_CR17","unstructured":"Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020a). A simple framework for contrastive learning of visual representations. In International conference on machine learning (pp. 1597\u20131607). PMLR."},{"key":"6708_CR18","doi-asserted-by":"crossref","unstructured":"Chen, X., & He, K. (2021). Exploring simple siamese representation learning. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 15750\u201315758).","DOI":"10.1109\/CVPR46437.2021.01549"},{"key":"6708_CR19","unstructured":"Chen, X., Fan, H., Girshick, R., & He, K. (2020b). Improved baselines with momentum contrastive learning. arXiv:2003.04297"},{"key":"6708_CR20","doi-asserted-by":"crossref","unstructured":"Chen, Z., Agarwal, D., Aggarwal, K., Safta, W., Balan, M., & Brown, K. (2023c). Masked image modeling advances 3d medical image analysis. In 2023 IEEE\/CVF winter conference on applications of computer vision (WACV) (pp. 1969\u20131979). IEEE Computer Society.","DOI":"10.1109\/WACV56688.2023.00201"},{"key":"6708_CR21","doi-asserted-by":"crossref","unstructured":"Cubuk, E. D., Zoph, B., Shlens, J., & Le, Q. V. (2020). Randaugment: Practical automated data augmentation with a reduced search space. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition workshops (pp. 702\u2013703).","DOI":"10.1109\/CVPRW50498.2020.00359"},{"key":"6708_CR22","volume-title":"Advances in neural information processing systems","author":"M Cuturi","year":"2013","unstructured":"Cuturi, M. (2013). Sinkhorn distances: Lightspeed computation of optimal transport. In C. J. Burges, L. Bottou, M. Welling, Z. Ghahramani, & K. Q. Weinberger (Eds.), Advances in neural information processing systems.  (Vol. 26). Curran Associates Inc."},{"key":"6708_CR23","unstructured":"de\u00a0Haan, P., & L\u00f6we, S. (2021). Contrastive predictive coding for anomaly detection. arXiv:2107.07820"},{"key":"6708_CR24","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., Uszkoreit, J., & Houlsby, N. (2021). An image is worth 16x16 words: Transformers for image recognition at scale. In International conference on learning representations."},{"key":"6708_CR25","doi-asserted-by":"crossref","unstructured":"Eldele, E., Ragab, M., Chen, Z., Wu, M., Kwoh, C.\u00a0K., Li, X., & Guan, C. (2021). Time-series representation learning via temporal and contextual contrasting. In Proceedings of the thirtieth international joint conference on artificial intelligence (IJCAI-21).","DOI":"10.24963\/ijcai.2021\/324"},{"key":"6708_CR26","doi-asserted-by":"crossref","unstructured":"Ericsson, L., Gouk, H., & Hospedales, T.\u00a0M. (2021). How well do self-supervised models transfer? In 2021 IEEE\/CVF conference on computer vision and pattern recognition (CVPR) (pp. 5410\u20135419).","DOI":"10.1109\/CVPR46437.2021.00537"},{"key":"6708_CR27","first-page":"5565","volume":"33","author":"A Ermolov","year":"2020","unstructured":"Ermolov, A., & Sebe, N. (2020). Latent world models for intrinsically motivated exploration. Advances in Neural Information Processing Systems, 33, 5565\u20135575.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"6708_CR28","unstructured":"Ermolov, A., Siarohin, A., Sangineto, E., & Sebe, N. (2021). Whitening for self-supervised representation learning. In International conference on machine learning (pp. 3015\u20133024). PMLR."},{"key":"6708_CR29","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s11263-009-0275-4","volume":"88","author":"M Everingham","year":"2009","unstructured":"Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2009). The pascal visual object classes (VOC) challenge. International Journal of Computer Vision, 88, 303\u2013308.","journal-title":"International Journal of Computer Vision"},{"key":"6708_CR30","doi-asserted-by":"crossref","unstructured":"Feng, H., Jia, Y., Xu, R., Prasad, M., Anaissi, A., & Braytee, A. (2024). Integration of self-supervised BYOL in semi-supervised medical image recognition. arXiv:2404.10405","DOI":"10.1007\/978-3-031-63772-8_16"},{"key":"6708_CR31","unstructured":"Fetterman, A., & Albrecht, J. (2020). Understanding self-supervised and contrastive learning with bootstrap your own latent (BYOL)."},{"key":"6708_CR32","unstructured":"Garrido, Q., Chen, Y., Bardes, A., Najman, L., & Lecun, Y. (2022). On the duality between contrastive and non-contrastive self-supervised learning. arXiv:2206.02574"},{"key":"6708_CR33","unstructured":"Geiping, J., Garrido, Q., Fernandez, P., Bar, A., Pirsiavash, H., LeCun, Y., & Goldblum, M. (2023). A cookbook of self-supervised learning. arXiv:2304.12210"},{"key":"6708_CR34","unstructured":"Gidaris, S., Singh, P., & Komodakis, N. (2018). Unsupervised representation learning by predicting image rotations. In International conference on learning representations."},{"key":"6708_CR35","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015). Fast R-CNN. In Proceedings of the IEEE international conference on computer vision (pp. 1440\u20131448).","DOI":"10.1109\/ICCV.2015.169"},{"issue":"6","key":"6708_CR36","doi-asserted-by":"crossref","first-page":"1789","DOI":"10.1007\/s11263-021-01453-z","volume":"129","author":"J Gou","year":"2021","unstructured":"Gou, J., Yu, B., Maybank, S. J., & Tao, D. (2021). Knowledge distillation: A survey. International Journal of Computer Vision, 129(6), 1789\u20131819.","journal-title":"International Journal of Computer Vision"},{"key":"6708_CR37","doi-asserted-by":"crossref","unstructured":"Goyal, P., Mahajan, D., Gupta, A., & Misra, I. (2019). Scaling and benchmarking self-supervised visual representation learning. In Proceedings of the IEEE\/CVF international conference on computer vision (pp. 6391\u20136400).","DOI":"10.1109\/ICCV.2019.00649"},{"key":"6708_CR38","first-page":"21271","volume":"33","author":"J-B Grill","year":"2020","unstructured":"Grill, J.-B., Strub, F., Altch\u00e9, F., Tallec, C., Richemond, P., Buchatskaya, E., Doersch, C., Pires, A., Bernardo, G., Zhaohan Mohammad, G. A., et al. (2020). Bootstrap your own latent-a new approach to self-supervised learning. Advances in Neural Information Processing Systems, 33, 21271\u201321284.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"6708_CR39","doi-asserted-by":"crossref","unstructured":"Grover, A., & Leskovec, J. (2016). node2vec: Scalable feature learning for networks. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining (pp. 855\u2013864).","DOI":"10.1145\/2939672.2939754"},{"key":"6708_CR40","doi-asserted-by":"crossref","unstructured":"Guo, W., Zhang, W., Zhang, Z., Tang, P., & Gao, S. (2022a). Deep temporal iterative clustering for satellite image time series land cover analysis. Remote Sensing, 14(15).","DOI":"10.3390\/rs14153635"},{"key":"6708_CR41","first-page":"31855","volume-title":"Advances in neural information processing systems","author":"Z Guo","year":"2022","unstructured":"Guo, Z., Thakoor, S., Pislar, M., Pires, A., Bernardo, A., Florent, T., Corentin, S., Alaa, C., Daniele, G., Jean-Bastien, T., Yunhao, V., Michal, M., Remi Mohammad, G. A.,, & Piot, B. (2022). Byol-explore: Exploration by bootstrapped prediction. In S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, & A. Oh (Eds.), Advances in neural information processing systems (Vol. 35, pp. 31855\u201331870). Curran Associates Inc."},{"key":"6708_CR42","unstructured":"Gutmann, M., & Hyv\u00e4rinen, A. (2010). Noise-contrastive estimation: A new estimation principle for unnormalized statistical models. In Proceedings of the thirteenth international conference on artificial intelligence and statistics (pp. 297\u2013304). JMLR workshop and conference proceedings."},{"key":"6708_CR46","doi-asserted-by":"crossref","unstructured":"He, K., Chen, X., Xie, S., Li, Y., Doll\u00e1r, P., & Girshick, R. (2022). Masked autoencoders are scalable vision learners. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 16000\u201316009).","DOI":"10.1109\/CVPR52688.2022.01553"},{"key":"6708_CR45","doi-asserted-by":"crossref","unstructured":"He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020). Momentum contrast for unsupervised visual representation learning. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 9729\u20139738).","DOI":"10.1109\/CVPR42600.2020.00975"},{"key":"6708_CR44","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., & Girshick, R. (2017). Mask R-CNN. In Proceedings of the IEEE international conference on computer vision (pp. 2961\u20132969).","DOI":"10.1109\/ICCV.2017.322"},{"key":"6708_CR43","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770\u2013778).","DOI":"10.1109\/CVPR.2016.90"},{"key":"6708_CR47","unstructured":"Henaff, O. (2020). Data-efficient image recognition with contrastive predictive coding. In International conference on machine learning (pp. 4182\u20134192). PMLR."},{"issue":"5","key":"6708_CR48","first-page":"580","volume":"2","author":"Y Huang","year":"2011","unstructured":"Huang, Y., & Rao, R. P. N. (2011). Predictive coding. Wiley Interdisciplinary Reviews: Cognitive Science, 2(5), 580\u2013593.","journal-title":"Wiley Interdisciplinary Reviews: Cognitive Science"},{"key":"6708_CR49","unstructured":"Huang, Z., Jin, X., Lu, C., Hou, Q., Cheng, M.-M., Fu, D., Shen, X., & Feng, J.. (2022). Contrastive masked autoencoders are stronger vision learners. arXiv:2207.13532"},{"key":"6708_CR50","unstructured":"Ioffe, S., & Szegedy, C. (2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift. In International conference on machine learning (pp. 448\u2013456). PMLR."},{"key":"6708_CR51","unstructured":"Jimenez-Perez, G., Osorio, P., Cersovsky, J., Montalt-Tordera, J., Hooge, J., Vogler, S., & Mohammadi, S. (2024). DiNO-diffusion. Scaling medical diffusion via self-supervised pre-training. arXiv:2407.11594"},{"key":"6708_CR52","doi-asserted-by":"crossref","unstructured":"Kart, T., Bai, W., Glocker, B., & Rueckert, D. (2021). Deepmcat: Large-scale deep clustering for medical image categorization. In Engelhardt, S., Oksuz, I., Zhu, D., Yuan, Y., Mukhopadhyay, A., Heller, N., Huang, S. X., Nguyen, H., Sznitman, R., & Xue, Y., (Eds.), Deep generative models and data augmentation, labelling, and imperfections (pp. 259\u2013267). Springer. ISBN 978-3-030-88210-5","DOI":"10.1007\/978-3-030-88210-5_26"},{"key":"6708_CR53","unstructured":"Kenton, J. D., Chang, M.-W., & Toutanova, L. K. (2019). Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of NAACL-HLT (pp. 4171\u20134186)."},{"key":"6708_CR54","unstructured":"Kingma, D.\u00a0P., & Welling, M. (2013). Auto-encoding variational Bayes. arXiv:1312.6114"},{"key":"6708_CR55","unstructured":"Kipf, T. N., & Welling, M. (2016). Variational graph auto-encoders. arXiv:1611.07308"},{"key":"6708_CR56","doi-asserted-by":"crossref","unstructured":"Kolesnikov, A., Zhai, X., & Beyer, L. (2019). Revisiting self-supervised visual representation learning. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 1920\u20131929).","DOI":"10.1109\/CVPR.2019.00202"},{"key":"6708_CR57","unstructured":"Kr\u00e4henb\u00fchl, P., Doersch, C., Donahue, J., & Darrell, T. (2015). Data-dependent initializations of convolutional neural networks. arXiv:1511.06856"},{"key":"6708_CR58","unstructured":"Krizhevsky, A., Hinton, G., et\u00a0al. (2009). Learning multiple layers of features from tiny images."},{"issue":"6","key":"6708_CR59","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","volume":"60","author":"A Krizhevsky","year":"2017","unstructured":"Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017). ImageNet classification with deep convolutional neural networks. Communications of the ACM, 60(6), 84\u201390.","journal-title":"Communications of the ACM"},{"key":"6708_CR60","doi-asserted-by":"crossref","unstructured":"Lafabregue, B., Puissant, A., Weber, J., & Forestier, G. (2022). Deep clustering methods study applied to satellite images time series. In IEEE international geoscience and remote sensing symposium (IGARSS) (pp. 195\u2013198). IEEE","DOI":"10.1109\/IGARSS46834.2022.9884322"},{"key":"6708_CR61","doi-asserted-by":"crossref","unstructured":"Le\u00a0Cun, Y. (1987). Mod\u00e8les connexionnistes de l\u2019apprentissage. Ph.D thesis, Paris 6.","DOI":"10.3406\/intel.1987.1804"},{"key":"6708_CR62","doi-asserted-by":"crossref","unstructured":"Li, A. C., Efros, A.\u00a0A., & Pathak, D. (2022). Understanding collapse in non-contrastive siamese representation learning. In European conference on computer vision (pp. 490\u2013505). Springer.","DOI":"10.1007\/978-3-031-19821-2_28"},{"key":"6708_CR63","unstructured":"Li, C., Yang, J., Zhang, P., Gao, M., Xiao, B., Dai, X., Yuan, L., & Gao, J. (2021). Efficient self-supervised vision transformers for representation learning. In International conference on learning representations."},{"key":"6708_CR64","unstructured":"Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2019). Continuous control with deep reinforcement learning."},{"key":"6708_CR65","unstructured":"Lin, M., Chen, Q., & Yan, S. (2013). Network in network. arXiv:1312.4400"},{"key":"6708_CR67","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Doll\u00e1r, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017). Feature pyramid networks for object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2117\u20132125).","DOI":"10.1109\/CVPR.2017.106"},{"key":"6708_CR66","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Maire, M., Belongie S., Hays J., Pietro, P., Deva , R., Piotr, D., & Lawrence, Z. C. (2014). Microsoft COCO: Common objects in context. In Proceedings of the European conference on computer vision (ECCV) 2014 (pp. 740\u2013755). Springer.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"6708_CR68","unstructured":"Liu, K.-J., Suganuma, M., & Okatani, T. (2022). Bridging the gap from asymmetry tricks to decorrelation principles in non-contrastive self-supervised learning. In Oh, A.\u00a0H., Agarwal, A., Belgrave, D., & Cho, K. (Eds.), Advances in neural information processing systems."},{"issue":"2","key":"6708_CR69","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1109\/TIT.1982.1056489","volume":"28","author":"S Lloyd","year":"1982","unstructured":"Lloyd, S. (1982). Least squares quantization in PCM. IEEE Transactions on Information Theory, 28(2), 129\u2013137.","journal-title":"IEEE Transactions on Information Theory"},{"key":"6708_CR70","unstructured":"Loshchilov, I., & Hutter, F. (2017). SGDR: Stochastic gradient descent with warm restarts. In International conference on learning representations."},{"key":"6708_CR71","unstructured":"Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013a). Efficient estimation of word representations in vector space. arXiv:1301.3781"},{"key":"6708_CR72","unstructured":"Mikolov, T., Sutskever, I., Chen, K., Corrado, G.\u00a0S., & Dean, J. (2013b). Distributed representations of words and phrases and their compositionality. Advances in Neural Information Processing Systems, 26."},{"key":"6708_CR73","doi-asserted-by":"crossref","unstructured":"Misra, I., & Maaten, L. van\u00a0der. (2020). Self-supervised learning of pretext-invariant representations. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 6707\u20136717).","DOI":"10.1109\/CVPR42600.2020.00674"},{"key":"6708_CR74","doi-asserted-by":"crossref","unstructured":"Mojtahedi, R., Hamghalam, M., Jarnagin, W.\u00a0R., Do, R.\u00a0K. G., & Simpson, A.\u00a0L. (2023). Leveraging contrastive learning with simsiam for the classification of primary and secondary liver cancers. In International conference on medical image computing and computer-assisted intervention (pp. 311\u2013321). Springer.","DOI":"10.1007\/978-3-031-47425-5_28"},{"key":"6708_CR75","unstructured":"Nguyen, T.\u00a0D., Shu, R., Pham, T., Bui, H., & Ermon, S. (2021). Temporal predictive coding for model-based planning in latent space. In International conference on machine learning (pp. 8130\u20138139). PMLR."},{"key":"6708_CR76","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1109\/TASLP.2022.3221007","volume":"31","author":"D Niizumi","year":"2023","unstructured":"Niizumi, D., Takeuchi, D., Ohishi, Y., Harada, N., & Kashino, K. (2023). Byol for audio: Exploring pre-trained general-purpose audio representations. IEEE\/ACM Transactions on Audio, Speech and Language Processing, 31, 137\u2013151.","journal-title":"IEEE\/ACM Transactions on Audio, Speech and Language Processing"},{"key":"6708_CR77","doi-asserted-by":"crossref","unstructured":"Noroozi, M., & Favaro, P. (2016). Unsupervised learning of visual representations by solving jigsaw puzzles. In European conference on computer vision (pp. 69\u201384). Springer.","DOI":"10.1007\/978-3-319-46466-4_5"},{"key":"6708_CR78","doi-asserted-by":"crossref","unstructured":"Nozawa, K., & Sato, I. (2022). Evaluation methods for representation learning: A survey. In Proceedings of the thirty-first international joint conference on artificial intelligence (IJCAI-22)\u2014survey track (pp. 5556\u20135563).","DOI":"10.24963\/ijcai.2022\/776"},{"key":"6708_CR79","unstructured":"Oquab, M., Darcet, T., Moutakanni, T., Vo, H. V., Szafraniec, M., Khalidov, V., Fernandez, P., HAZIZA, D., Massa, F., El-Nouby, A., Assran, M., Ballas, N., Galuba, W., Howes, R., Huang, P.-Y., Li, S.-W., Misra, I., Rabbat, M., Sharma, V., Synnaeve, G., Xu, H., Jegou, H., Mairal, J., Labatut, P., Joulin, A., & Bojanowski, P. (2024). DINOv2: Learning robust visual features without supervision. Transactions on Machine Learning Research."},{"key":"6708_CR80","unstructured":"Ozbulak, U., Lee, H.\u00a0J., Boga, B., Anzaku, E.\u00a0T., Park, H., Van\u00a0Messem, A., De\u00a0Neve, W, & Vankerschaver, J. (2023). Know your self-supervised learning: A survey on image-based generative and discriminative training. arXiv:2305.13689"},{"key":"6708_CR81","doi-asserted-by":"crossref","unstructured":"Padilla, R., Netto, S. L., & da\u00a0Silva, E. A.\u00a0B. (2020). A survey on performance metrics for object-detection algorithms. In 2020 International conference on systems, signals and image processing (IWSSIP) (pp. 237\u2013242).","DOI":"10.1109\/IWSSIP48289.2020.9145130"},{"key":"6708_CR82","doi-asserted-by":"crossref","DOI":"10.1016\/j.neucom.2024.128033","volume":"599","author":"M Pech\u00e1c","year":"2024","unstructured":"Pech\u00e1c, M., Chovanec, M., & Farka\u0161, I. (2024). Self-supervised network distillation: An effective approach to exploration in sparse reward environments. Neurocomputing, 599, 128033.","journal-title":"Neurocomputing"},{"key":"6708_CR83","doi-asserted-by":"crossref","unstructured":"P\u00e9rez-Garc\u00eda, F., Sharma, H., Bond-Taylor, B., Kenza, S., Valentina, I., Maximilian, B., Shruthi, C., Daniel, C., Schwaighofer, A., Lungren, M.\u00a0P., Wetscherek, M., Codella, N., Hyland, S.\u00a0L., Alvarez-Valle, J., & Oktay, O. (2024). RAD-DINO: Exploring scalable medical image encoders beyond text supervision. arXiv:2401.10815","DOI":"10.1038\/s42256-024-00965-w"},{"key":"6708_CR84","doi-asserted-by":"crossref","unstructured":"Perozzi, B., Al-Rfou, R., & Skiena, S. (2014). Deepwalk: Online learning of social representations. In Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining (pp. 701\u2013710).","DOI":"10.1145\/2623330.2623732"},{"key":"6708_CR85","doi-asserted-by":"publisher","unstructured":"Pham, H., Dai, Z., Xie, Q., & Le, Q.\u00a0V. (2021). Meta pseudo labels. In 2021 IEEE\/CVF conference on computer vision and pattern recognition (CVPR) (pp. 11552\u201311563). https:\/\/doi.org\/10.1109\/CVPR46437.2021.01139","DOI":"10.1109\/CVPR46437.2021.01139"},{"key":"6708_CR86","unstructured":"Pham, T., Zhang, C., Niu, Axi, Zhang, K., & Yoo, C. D. (2022). On the pros and cons of momentum encoder in self-supervised visual representation learning."},{"key":"6708_CR87","unstructured":"Poole, B., Ozair, S., Van D.\u00a0O., Aaron, A. A., & Tucker, G. (2019). On variational bounds of mutual information. In International conference on machine learning (pp. 5171\u20135180). PMLR."},{"issue":"12","key":"6708_CR88","doi-asserted-by":"crossref","first-page":"4585","DOI":"10.1007\/s10994-022-06219-3","volume":"111","author":"NS Punn","year":"2022","unstructured":"Punn, N. S., & Agarwal, S. (2022). BT-Unet: A self-supervised learning framework for biomedical image segmentation using barlow twins with u-net models. Machine Learning, 111(12), 4585\u20134600.","journal-title":"Machine Learning"},{"key":"6708_CR89","doi-asserted-by":"crossref","unstructured":"Ravanbakhsh, E., Liang, Y., Ramanujam, J., & Li, X. (2023). Deep video representation learning: A survey. Multimedia Tools and Applications, 1\u201331.","DOI":"10.1007\/s11042-023-17815-3"},{"key":"6708_CR90","unstructured":"Ren, S., He, K., Girshick, R., & Sun, J. (2015). Faster R-CNN: Towards real-time object detection with region proposal networks. Advances in Neural Information Processing Systems, 28."},{"key":"6708_CR91","unstructured":"Rifai, S., Vincent, P., Muller, X., Glorot, X., & Bengio, Y. (2011). Contractive auto-encoders: Explicit invariance during feature extraction. In Proceedings of the 28th international conference on machine learning, ICML\u201911 (pp. 833\u2013840). Omnipress."},{"key":"6708_CR92","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","volume":"115","author":"O Russakovsky","year":"2015","unstructured":"Russakovsky, O., Deng, J., Hao, S., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015). Imagenet large scale visual recognition challenge. International Journal of Computer Vision, 115, 211\u2013252.","journal-title":"International Journal of Computer Vision"},{"key":"6708_CR93","unstructured":"Sch\u00f6lkopf, B., Janzing, D., Peters, J., Sgouritsa, E., Zhang, K., & Mooij, J. (2012). On causal and anticausal learning. arXiv:1206.6471"},{"issue":"1","key":"6708_CR94","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1186\/s12911-024-02529-9","volume":"24","author":"H Sheng","year":"2024","unstructured":"Sheng, H., Ma, L., Samson, J.-F., & Liu, D. (2024). BarlowTwins-CXR: enhancing chest x-ray abnormality localization in heterogeneous data with cross-domain self-supervised learning. BMC Medical Informatics and Decision Making, 24(1), 126.","journal-title":"BMC Medical Informatics and Decision Making"},{"issue":"1","key":"6708_CR95","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-019-0197-0","volume":"6","author":"C Shorten","year":"2019","unstructured":"Shorten, C., & Khoshgoftaar, T. M. (2019). A survey on image data augmentation for deep learning. Journal of Big Data, 6(1), 1\u201348.","journal-title":"Journal of Big Data"},{"issue":"3","key":"6708_CR96","doi-asserted-by":"crossref","first-page":"252","DOI":"10.3390\/e26030252","volume":"26","author":"R Shwartz-Ziv","year":"2024","unstructured":"Shwartz-Ziv, R., & LeCun, Y. (2024). To compress or not to compress-self-supervised learning and information theory: A review. Entropy, 26(3), 252.","journal-title":"Entropy"},{"key":"6708_CR97","first-page":"8161","volume":"33","author":"J Song","year":"2020","unstructured":"Song, J., & Ermon, S. (2020). Multi-label contrastive predictive coding. Advances in Neural Information Processing Systems, 33, 8161\u20138173.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"6708_CR98","doi-asserted-by":"crossref","unstructured":"Tao, C., Wang, H., Zhu, X., Dong, J. S., Shiji, H., Gao, & Dai, J. (2022). Exploring the equivalence of siamese self-supervised learning via a unified gradient framework. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 14431\u201314440).","DOI":"10.1109\/CVPR52688.2022.01403"},{"key":"6708_CR99","doi-asserted-by":"crossref","unstructured":"Tian, Y., Krishnan, D., & Isola, P. (2020a). Contrastive multiview coding. In European conference on computer vision (pp. 776\u2013794). Springer.","DOI":"10.1007\/978-3-030-58621-8_45"},{"key":"6708_CR100","unstructured":"Tian, Y., Yu, L., Chen, X., & Ganguli, S. (2020b). Understanding self-supervised learning with dual deep networks. arXiv:2010.00578"},{"key":"6708_CR101","unstructured":"van\u00a0den Oord, A., Kalchbrenner, N., Espeholt, L., Vinyals, O., Graves, A., et\u00a0al. (2016). Conditional image generation with pixelCNN decoders. Advances in Neural Information Processing Systems, 29."},{"key":"6708_CR102","unstructured":"van\u00a0den Oord, A., Li, Y., & Vinyals, O. (2018). Representation learning with contrastive predictive coding. arXiv:1807.03748"},{"key":"6708_CR103","doi-asserted-by":"publisher","unstructured":"Vaswani, A., Ramachandran, P., Srinivas, A., Parmar, N., Hechtman, B., & Shlens, J. (2021). Scaling local self-attention for parameter efficient visual backbones. arXiv:2103.12731. https:\/\/doi.org\/10.48550\/arXiv.2103.12731","DOI":"10.48550\/arXiv.2103.12731"},{"key":"6708_CR104","unstructured":"Vincent, P., Larochelle, H., Lajoie, I., Bengio, Y., Manzagol, P.-A., & Bottou, L. (2010). Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. Journal of Machine Learning Research, 11(12)."},{"key":"6708_CR105","unstructured":"Wagner, S.\u00a0S., & Harmeling, S. (2024). Just cluster it: An approach for exploration in high-dimensions using clustering and pre-trained representations. In Salakhutdinov, R., Kolter, Z., Heller, K., Weller, A., Oliver, N., Scarlett, J., Berkenkamp, F. (Eds.), Proceedings of the 41st international conference on machine learning, volume 235 of Proceedings of machine learning research (pp. 49788\u201349807). PMLR, 21\u201327."},{"key":"6708_CR106","doi-asserted-by":"crossref","unstructured":"Wu, Z., Xiong, Y., Yu, S.\u00a0X., & Lin, D. (2018). Unsupervised feature learning via non-parametric instance discrimination. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 3733\u20133742).","DOI":"10.1109\/CVPR.2018.00393"},{"key":"6708_CR107","doi-asserted-by":"crossref","unstructured":"Xiao, B., & Lu, C. (2023). Semi-supervised medical image classification combined with unsupervised deep clustering. Applied Sciences, 13(9).","DOI":"10.3390\/app13095520"},{"key":"6708_CR108","unstructured":"Yang, S., Xiao, W., Zhang, M., Guo, S., Zhao, J., & Shen, F. (2022). Image data augmentation for deep learning: A survey. arXiv:2204.08610"},{"key":"6708_CR109","unstructured":"You, Y., Gitman, I., & Ginsburg, B. (2017). Large batch training of convolutional networks. arXiv:1708.03888."},{"key":"6708_CR110","unstructured":"Zbontar, J., Jing, L., Misra, I., LeCun, Y., & Deny, S. (2021). Barlow twins: Self-supervised learning via redundancy reduction. In International conference on machine learning(pp. 12310\u201312320). PMLR."},{"key":"6708_CR111","doi-asserted-by":"crossref","unstructured":"Zeng, D., Wu, Y., Hu, X., Xu, X., Hu, J., & Shi, Y. (2023). Additional positive enables better representation learning for medical images. In Greenspan, H., Madabhushi, A., Mousavi, P., Salcudean, S., Duncan, J., Syeda-Mahmood, T., & Taylor, R. (Eds.), Medical image computing and computer assisted intervention\u2014MICCAI 2023 (pp. 119\u2013129). Springer. ISBN 978-3-031-43907-0","DOI":"10.1007\/978-3-031-43907-0_12"},{"key":"6708_CR112","unstructured":"Zhang, C., Zhang, K., Zhang, C., Pham, T. X., Yoo, C. D., & Kweon, I. S. (2022). How does Simsiam avoid collapse without negative samples? A unified understanding with self-supervised contrastive learning. In International conference on learning representations."},{"key":"6708_CR113","unstructured":"Zhou, B., Lapedriza, A., Xiao, J., Torralba, A., & Oliva, A. (2014). Learning deep features for scene recognition using places database. Advances in Neural Information Processing Systems, 27."},{"key":"6708_CR114","doi-asserted-by":"crossref","unstructured":"Zhou, L., Liu, H., Bae, J., He, J., Samaras, D., & Prasanna, P. (2023). Self pre-training with masked autoencoders for medical image classification and segmentation. In 2023 IEEE 20th international symposium on biomedical imaging (ISBI), (pp. 1\u20136).","DOI":"10.1109\/ISBI53787.2023.10230477"}],"container-title":["Machine Learning"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-024-06708-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10994-024-06708-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-024-06708-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,30]],"date-time":"2025-03-30T15:12:27Z","timestamp":1743347547000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10994-024-06708-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,4]]},"references-count":114,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,4]]}},"alternative-id":["6708"],"URL":"https:\/\/doi.org\/10.1007\/s10994-024-06708-7","relation":{},"ISSN":["0885-6125","1573-0565"],"issn-type":[{"value":"0885-6125","type":"print"},{"value":"1573-0565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,4]]},"assertion":[{"value":"9 January 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 August 2024","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 November 2024","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 March 2025","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Funding"}},{"value":"None.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"Not applicable.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"Not applicable.","order":6,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"Not applicable.","order":7,"name":"Ethics","group":{"name":"EthicsHeading","label":"Availability of data and material"}},{"value":"Not applicable.","order":8,"name":"Ethics","group":{"name":"EthicsHeading","label":"Code availability"}}],"article-number":"111"}}