{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,27]],"date-time":"2026-10-27T15:18:56Z","timestamp":1793114336283,"version":"4.5.0"},"reference-count":170,"publisher":"Springer Science and Business Media LLC","issue":"9","license":[{"start":{"date-parts":[[2024,8,2]],"date-time":"2024-08-02T00:00:00Z","timestamp":1722556800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,8,2]],"date-time":"2024-08-02T00:00:00Z","timestamp":1722556800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100015688","name":"\u00d3buda University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100015688","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Artif Intell Rev"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Justifiably, while big data is the primary interest of research and public discourse, it is essential to acknowledge that small data remains prevalent. The same technological and societal forces that generate big datasets also produce a more significant number of small datasets. Contrary to the notion that more data is inherently superior, real-world constraints such as budget limitations and increased analytical complexity present critical challenges. Quality versus quantity trade-offs necessitate strategic decision-making, where small data often leads to quicker, more accurate, and cost-effective insights. Concentrating AI research, particularly in deep learning (DL), on big datasets exacerbates AI inequality, as tech giants such as Meta, Amazon, Apple, Netflix and Google (MAANG) can easily lead AI research due to their access to vast datasets, creating a barrier for small and mid-sized enterprises that lack similar access. This article addresses this imbalance by exploring DL techniques optimized for small datasets, offering a comprehensive review of historic and state-of-the-art DL models developed specifically for small datasets. This study aims to highlight the feasibility and benefits of these approaches, promoting a more inclusive and equitable AI landscape. Through a PRISMA-based literature search, 175+\u2009relevant articles are identified and subsequently analysed based on various attributes, such as publisher, country, utilization of small dataset technique, dataset size, and performance. This article also delves into current DL models and highlights open research problems, offering recommendations for future investigations. Additionally, the article highlights the importance of developing DL models that effectively utilize small datasets, particularly in domains where data acquisition is difficult and expensive.<\/jats:p>","DOI":"10.1007\/s10462-024-10859-3","type":"journal-article","created":{"date-parts":[[2024,8,2]],"date-time":"2024-08-02T11:03:31Z","timestamp":1722596611000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":124,"title":["Breaking the data barrier: a review of deep learning techniques for democratizing AI with small datasets"],"prefix":"10.1007","volume":"57","author":[{"given":"Ishfaq Hussain","family":"Rather","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sushil","family":"Kumar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amir H.","family":"Gandomi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,8,2]]},"reference":[{"issue":"4","key":"10859_CR1","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1109\/MSP.2019.2900993","volume":"36","author":"P Afshar","year":"2019","unstructured":"Afshar P, Mohammadi A, Plataniotis KN, Oikonomou A, Benali H (2019) From handcrafted to deep-learning-based cancer radiomics: challenges and opportunities. IEEE Signal Process Mag 36(4):132\u2013160. https:\/\/doi.org\/10.1109\/MSP.2019.2900993","journal-title":"IEEE Signal Process Mag"},{"key":"10859_CR2","doi-asserted-by":"publisher","DOI":"10.1016\/J.COMPCHEMENG.2022.107694","volume":"159","author":"P Agarwal","year":"2022","unstructured":"Agarwal P, Aghaee M, Tamer M, Budman H (2022) A novel unsupervised approach for batch process monitoring using deep learning. Comput Chem Eng 159:107694. https:\/\/doi.org\/10.1016\/J.COMPCHEMENG.2022.107694","journal-title":"Comput Chem Eng"},{"key":"10859_CR3","doi-asserted-by":"publisher","DOI":"10.1007\/S11042-024-19361-Y","author":"Z Ahmad","year":"2024","unstructured":"Ahmad Z, ul Abidin Jaffri Z, Chen M, Bao S (2024) Understanding GANs: fundamentals, variants, training challenges, applications, and open problems. Multimed Tools Appl. https:\/\/doi.org\/10.1007\/S11042-024-19361-Y","journal-title":"Multimed Tools Appl"},{"key":"10859_CR4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/S10462-023-10466-8","volume":"2023","author":"SF Ahmed","year":"2023","unstructured":"Ahmed SF et al (2023) Deep learning modelling techniques: current progress, applications, advantages, and challenges. Artif Intell Rev 2023:1\u201397. https:\/\/doi.org\/10.1007\/S10462-023-10466-8","journal-title":"Artif Intell Rev"},{"issue":"2","key":"10859_CR5","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1109\/MSP.2021.3119273","volume":"39","author":"M Akcakaya","year":"2022","unstructured":"Akcakaya M, Yaman B, Chung H, Ye JC (2022) Unsupervised deep learning methods for biological image reconstruction and enhancement: an overview from a signal processing perspective. IEEE Signal Process Mag 39(2):28\u201344. https:\/\/doi.org\/10.1109\/MSP.2021.3119273","journal-title":"IEEE Signal Process Mag"},{"key":"10859_CR6","doi-asserted-by":"publisher","unstructured":"Allen-Zhu Z, Li Y (2022) Feature purification: how adversarial training performs robust deep learning. In: Proceedings\u2014annual IEEE symposium on foundations of computer science, FOCS, vol 2022-February. pp 977\u2013988. https:\/\/doi.org\/10.1109\/FOCS52979.2021.00098","DOI":"10.1109\/FOCS52979.2021.00098"},{"key":"10859_CR7","unstructured":"Antoniou A, Storkey A, Edwards H (2017) Data augmentation generative adversarial networks. http:\/\/arxiv.org\/abs\/1711.04340"},{"key":"10859_CR8","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-018-1088-1","author":"SM Anwar","year":"2018","unstructured":"Anwar SM, Majid M, Qayyum A, Awais M, Alnowami M, Khan MK (2018) Medical image analysis using convolutional neural networks: a review. J Med Syst. https:\/\/doi.org\/10.1007\/s10916-018-1088-1","journal-title":"J Med Syst"},{"key":"10859_CR9","doi-asserted-by":"publisher","unstructured":"Azizi S et al (2021) Big self-supervised models advance medical image classification. In: Proceedings of the IEEE international conference on computer vision. pp 3458\u20133468. https:\/\/doi.org\/10.48550\/arxiv.2101.05224","DOI":"10.48550\/arxiv.2101.05224"},{"key":"10859_CR10","doi-asserted-by":"publisher","unstructured":"Bagherinezhad H, Horton M, Rastegari M, Farhadi A (2018) Label refinery: improving ImageNet classification through label progression. https:\/\/doi.org\/10.48550\/arxiv.1805.02641","DOI":"10.48550\/arxiv.1805.02641"},{"key":"10859_CR11","doi-asserted-by":"publisher","unstructured":"Bansal T, Jha R, McCallum A (2019) Learning to few-shot learn across diverse natural language classification tasks. pp 5108\u20135123. https:\/\/doi.org\/10.48550\/arxiv.1911.03863","DOI":"10.48550\/arxiv.1911.03863"},{"issue":"10s","key":"10859_CR12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3502287","volume":"54","author":"A Bansal","year":"2022","unstructured":"Bansal A, Sharma R, Kathuria M (2022) A systematic review on data scarcity problem in deep learning: solution and applications. ACM Comput Surv (CSUR) 54(10s):1\u201329. https:\/\/doi.org\/10.1145\/3502287","journal-title":"ACM Comput Surv (CSUR)"},{"key":"10859_CR13","doi-asserted-by":"crossref","unstructured":"Bao Y, Li Y, Huang SL, Zhang L, Zheng L, Zamir A, Guibas L (2019) An information-theoretic approach to transferability in task transfer learning. In: 2019 IEEE international conference on image processing (ICIP). IEEE, pp 2309\u20132313","DOI":"10.1109\/ICIP.2019.8803726"},{"key":"10859_CR14","doi-asserted-by":"publisher","DOI":"10.1016\/J.INFFUS.2023.102035","volume":"102","author":"JA Barbero-Aparicio","year":"2024","unstructured":"Barbero-Aparicio JA, Olivares-Gil A, Rodr\u00edguez JJ, Garc\u00eda-Osorio C, D\u00edez-Pastor JF (2024) Addressing data scarcity in protein fitness landscape analysis: a study on semi-supervised and deep transfer learning techniques. Inf Fusion 102:102035. https:\/\/doi.org\/10.1016\/J.INFFUS.2023.102035","journal-title":"Inf Fusion"},{"key":"10859_CR15","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1016\/J.PATREC.2021.11.020","volume":"153","author":"G Bargshady","year":"2022","unstructured":"Bargshady G, Zhou X, Barua PD, Gururajan R, Li Y, Acharya UR (2022) Application of CycleGAN and transfer learning techniques for automated detection of COVID-19 using X-ray images. Pattern Recognit Lett 153:67\u201374. https:\/\/doi.org\/10.1016\/J.PATREC.2021.11.020","journal-title":"Pattern Recognit Lett"},{"key":"10859_CR16","doi-asserted-by":"crossref","unstructured":"Barz B, Denzler J (2020) Deep learning on small datasets without pre-training using cosine loss. In: Proceedings of the IEEE\/CVF winter conference on applications of computer vision. pp 1371\u20131380","DOI":"10.1109\/WACV45572.2020.9093286"},{"issue":"1","key":"10859_CR17","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1111\/NYAS.14593","volume":"1505","author":"RM Battleday","year":"2021","unstructured":"Battleday RM, Peterson JC, Griffiths TL (2021) From convolutional neural networks to models of higher-level cognition (and back again). Ann N Y Acad Sci 1505(1):55\u201378. https:\/\/doi.org\/10.1111\/NYAS.14593","journal-title":"Ann N Y Acad Sci"},{"key":"10859_CR18","unstructured":"Bertinetto L, Henriques JF, Valmadre J, Torr P, Vedaldi A (2016) Learning feed-forward one-shot learners. In: Advances in neural information processing systems, vol 29"},{"issue":"3","key":"10859_CR19","doi-asserted-by":"publisher","first-page":"499","DOI":"10.1162\/153244302760200704","volume":"2","author":"O Bousquet","year":"2002","unstructured":"Bousquet O, Elisseeff A (2002) Stability and generalization. J Mach Learn Res 2(3):499\u2013526. https:\/\/doi.org\/10.1162\/153244302760200704","journal-title":"J Mach Learn Res"},{"key":"10859_CR20","unstructured":"Bowles C, Gunn R, Hammers A, Rueckert D (2018) GANsfer learning: combining labelled and unlabelled data for GAN based data augmentation. http:\/\/arxiv.org\/abs\/1811.10669"},{"key":"10859_CR21","doi-asserted-by":"publisher","unstructured":"Cai A, Hu W, Zheng J (2020) Few-shot learning for medical image classification. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), vol 12396 LNCS. pp 441\u2013452. https:\/\/doi.org\/10.1007\/978-3-030-61609-0_35\/COVER","DOI":"10.1007\/978-3-030-61609-0_35\/COVER"},{"issue":"1","key":"10859_CR22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41467-022-32550-3","volume":"13","author":"MC Caro","year":"2022","unstructured":"Caro MC et al (2022) Generalization in quantum machine learning from few training data. Nat Commun 13(1):1\u201311. https:\/\/doi.org\/10.1038\/s41467-022-32550-3","journal-title":"Nat Commun"},{"key":"10859_CR23","doi-asserted-by":"publisher","unstructured":"Chahal H, Toner H, Rahkovsky I (2021) Small data\u2019s big AI potential. Center for Security and Emerging Technology. https:\/\/doi.org\/10.51593\/20200075","DOI":"10.51593\/20200075"},{"key":"10859_CR24","doi-asserted-by":"publisher","unstructured":"Chatfield K, Simonyan K, Vedaldi A, Zisserman A (2014) Return of the devil in the details: delving deep into convolutional nets. In: BMVC 2014\u2014proceedings of the British machine vision conference 2014. https:\/\/doi.org\/10.48550\/arxiv.1405.3531","DOI":"10.48550\/arxiv.1405.3531"},{"key":"10859_CR25","unstructured":"Chatterjee S, Zielinski P (2022) On the generalization mystery in deep learning. arXiv Preprint. https:\/\/arxiv.org\/abs\/2203.10036"},{"key":"10859_CR26","doi-asserted-by":"publisher","first-page":"514","DOI":"10.1109\/ACCESS.2014.2325029","volume":"2","author":"XW Chen","year":"2014","unstructured":"Chen XW, Lin X (2014) Big data deep learning: challenges and perspectives. IEEE Access 2:514\u2013525. https:\/\/doi.org\/10.1109\/ACCESS.2014.2325029","journal-title":"IEEE Access"},{"issue":"1","key":"10859_CR27","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1109\/TPAMI.2010.92","volume":"33","author":"K Chen","year":"2011","unstructured":"Chen K, Wang S (2011) Semi-supervised learning via regularized boosting working on multiple semi-supervised assumptions. IEEE Trans Pattern Anal Mach Intell 33(1):129\u2013143. https:\/\/doi.org\/10.1109\/TPAMI.2010.92","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"11","key":"10859_CR28","doi-asserted-by":"publisher","first-page":"2453","DOI":"10.1109\/TMI.2018.2835303","volume":"37","author":"L Chen","year":"2018","unstructured":"Chen L, Bentley P, Mori K, Misawa K, Fujiwara M, Rueckert D (2018) DRINet for medical image segmentation. IEEE Trans Med Imaging 37(11):2453\u20132462. https:\/\/doi.org\/10.1109\/TMI.2018.2835303","journal-title":"IEEE Trans Med Imaging"},{"issue":"3","key":"10859_CR29","doi-asserted-by":"publisher","first-page":"787","DOI":"10.1109\/TMI.2019.2935409","volume":"39","author":"X Chen","year":"2020","unstructured":"Chen X et al (2020a) One-shot generative adversarial learning for MRI segmentation of craniomaxillofacial bony structures. IEEE Trans Med Imaging 39(3):787\u2013796. https:\/\/doi.org\/10.1109\/TMI.2019.2935409","journal-title":"IEEE Trans Med Imaging"},{"key":"10859_CR30","doi-asserted-by":"publisher","unstructured":"Chen DH, Zhang L, Ma C (2020b) A multimodal diagnosis predictive model of Alzheimer\u2019s disease with few-shot learning. In: Proceedings\u20142020 international conference on public health and data science (ICPHDS 2020). pp 273\u2013277. https:\/\/doi.org\/10.1109\/ICPHDS51617.2020.00060","DOI":"10.1109\/ICPHDS51617.2020.00060"},{"issue":"5","key":"10859_CR31","doi-asserted-by":"publisher","first-page":"437","DOI":"10.1109\/TAI.2021.3053511","volume":"2","author":"S Chen","year":"2021","unstructured":"Chen S, Cao Y, Kang Y, Li P, Sun B (2021) Deep feature representation based imitation learning for autonomous helicopter aerobatics. IEEE Trans Artif Intell 2(5):437\u2013446. https:\/\/doi.org\/10.1109\/TAI.2021.3053511","journal-title":"IEEE Trans Artif Intell"},{"issue":"2","key":"10859_CR32","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1109\/TSM.2022.3164904","volume":"35","author":"CF Chien","year":"2022","unstructured":"Chien CF, Hung WT, Liao ETY (2022) Redefining monitoring rules for intelligent fault detection and classification via CNN transfer learning for smart manufacturing. IEEE Trans Semicond Manuf 35(2):158\u2013165. https:\/\/doi.org\/10.1109\/TSM.2022.3164904","journal-title":"IEEE Trans Semicond Manuf"},{"key":"10859_CR33","unstructured":"Codella N et al (2019) Skin lesion analysis toward melanoma detection 2018: a challenge hosted by the international skin imaging collaboration (ISIC). http:\/\/arxiv.org\/abs\/1902.03368. Accessed 28 Nov 2022"},{"key":"10859_CR34","doi-asserted-by":"publisher","unstructured":"Deng J, Dong W, Socher R, Li L-J, Li K, Fei-Fei L (2010) ImageNet: a large-scale hierarchical image database. pp 248\u2013255. https:\/\/doi.org\/10.1109\/CVPR.2009.5206848","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"10859_CR35","unstructured":"DeVries T, Taylor GW (2017) Improved regularization of convolutional neural networks with cutout. https:\/\/arxiv.org\/abs\/1708.04552v2. Accessed 12 June 2024"},{"key":"10859_CR36","doi-asserted-by":"publisher","unstructured":"DIlmaghani S, Brust MR, Danoy G, Cassagnes N, Pecero J, Bouvry P (2019) Privacy and security of Big Data in AI systems: a research and standards perspective. In: Proceedings\u20142019 IEEE international conference on Big Data, Big Data 2019. pp 5737\u20135743. https:\/\/doi.org\/10.1109\/BIGDATA47090.2019.9006283","DOI":"10.1109\/BIGDATA47090.2019.9006283"},{"key":"10859_CR37","unstructured":"dos Santos Tanaka FHK, Aranha C (2019) Data augmentation using GANs. In: Proceedings of machine learning research. pp 1\u201316"},{"key":"10859_CR38","doi-asserted-by":"crossref","unstructured":"Drumond RR, Brinkmeyer L, Schmidt-Thieme L (2023) Few-shot human motion prediction for heterogeneous sensors. In: Pacific-Asia conference on knowledge discovery and data mining. Springer Nature Switzerland, Cham, pp 551\u2013563","DOI":"10.1007\/978-3-031-33377-4_42"},{"issue":"2","key":"10859_CR39","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1007\/S11263-009-0275-4","volume":"88","author":"M Everingham","year":"2009","unstructured":"Everingham M et al (2009) The Pascal Visual Object Classes (VOC) CHALLENGE. Int J Comput Vis 88(2):303\u2013338. https:\/\/doi.org\/10.1007\/S11263-009-0275-4","journal-title":"Int J Comput Vis"},{"key":"10859_CR40","doi-asserted-by":"publisher","first-page":"142","DOI":"10.1016\/j.spl.2018.02.031","volume":"136","author":"JJ Faraway","year":"2018","unstructured":"Faraway JJ, Augustin NH (2018) When small data beats big data. Stat Probab Lett 136:142\u2013145. https:\/\/doi.org\/10.1016\/j.spl.2018.02.031","journal-title":"Stat Probab Lett"},{"issue":"4","key":"10859_CR41","doi-asserted-by":"publisher","first-page":"594","DOI":"10.1109\/TPAMI.2006.79","volume":"28","author":"L Fei-Fei","year":"2006","unstructured":"Fei-Fei L, Fergus R, Perona P (2006) One-shot learning of object categories. IEEE Trans Pattern Anal Mach Intell 28(4):594\u2013611. https:\/\/doi.org\/10.1109\/TPAMI.2006.79","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"10859_CR42","doi-asserted-by":"publisher","DOI":"10.1016\/J.ESWA.2019.06.070","volume":"138","author":"S Feng","year":"2019","unstructured":"Feng S, Duarte MF (2019) Few-shot learning-based human activity recognition. Expert Syst Appl 138:112782. https:\/\/doi.org\/10.1016\/J.ESWA.2019.06.070","journal-title":"Expert Syst Appl"},{"key":"10859_CR43","unstructured":"Feyjie AR, Azad R, Pedersoli M, Kauffman C, Ayed IB, Dolz J (2020) Semi-supervised few-shot learning for medical image segmentation. arXiv Preprint. https:\/\/arxiv.org\/abs\/2003.08462"},{"key":"10859_CR44","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1016\/j.neucom.2018.09.013","volume":"321","author":"M Frid-Adar","year":"2018","unstructured":"Frid-Adar M, Diamant I, Klang E, Amitai M, Goldberger J, Greenspan H (2018) GAN-based synthetic medical image augmentation for increased CNN performance in liver lesion classification. Neurocomputing 321:321\u2013331. https:\/\/doi.org\/10.1016\/j.neucom.2018.09.013","journal-title":"Neurocomputing"},{"key":"10859_CR45","doi-asserted-by":"publisher","unstructured":"Gao F et al (2018) A deep convolutional generative adversarial networks (DCGANs)-based semi-supervised method for object recognition in synthetic aperture radar (SAR) images. mdpi.com. https:\/\/doi.org\/10.3390\/rs10060846","DOI":"10.3390\/rs10060846"},{"key":"10859_CR46","doi-asserted-by":"publisher","first-page":"3449","DOI":"10.1109\/TIP.2022.3169689","volume":"31","author":"K Gao","year":"2022","unstructured":"Gao K, Liu B, Yu X, Yu A (2022) Unsupervised meta learning with multiview constraints for hyperspectral image small sample set classification. IEEE Trans Image Process 31:3449\u20133462. https:\/\/doi.org\/10.1109\/TIP.2022.3169689","journal-title":"IEEE Trans Image Process"},{"key":"10859_CR47","doi-asserted-by":"publisher","DOI":"10.1145\/3659943","author":"H Gharoun","year":"2024","unstructured":"Gharoun H, Momenifar F, Chen F, Gandomi A (2024) Meta-learning approaches for few-shot learning: a survey of recent advances. ACM Comput Surv. https:\/\/doi.org\/10.1145\/3659943","journal-title":"ACM Comput Surv"},{"key":"10859_CR48","doi-asserted-by":"publisher","unstructured":"Gheisari M, Wang G, Bhuiyan MZA (2017) A survey on deep learning in Big Data. In: Proceedings\u20142017 IEEE international conference on computational science and engineering and IEEE\/IFIP international conference on embedded and ubiquitous computing, CSE and EUC 2017. Institute of Electrical and Electronics Engineers Inc., pp 173\u2013180. https:\/\/doi.org\/10.1109\/CSE-EUC.2017.215","DOI":"10.1109\/CSE-EUC.2017.215"},{"key":"10859_CR49","doi-asserted-by":"publisher","DOI":"10.1016\/J.COMPBIOMED.2021.104458","author":"E Goceri","year":"2021","unstructured":"Goceri E (2021) Diagnosis of skin diseases in the era of deep learning and mobile technology. Comput Biol Med. https:\/\/doi.org\/10.1016\/J.COMPBIOMED.2021.104458","journal-title":"Comput Biol Med"},{"key":"10859_CR50","unstructured":"Goodfellow IJ et al (2014) Generative adversarial nets. In: Advances in neural information processing systems, vol 27. http:\/\/www.github.com\/goodfeli\/adversarial. Accessed 20 Aug 2022"},{"key":"10859_CR51","doi-asserted-by":"publisher","DOI":"10.1098\/RSPA.2021.0068","author":"A Goyal","year":"2022","unstructured":"Goyal A, Bengio Y (2022) Inductive biases for deep learning of higher-level cognition. Proc R Soc A. https:\/\/doi.org\/10.1098\/RSPA.2021.0068","journal-title":"Proc R Soc A"},{"issue":"2","key":"10859_CR52","doi-asserted-by":"publisher","first-page":"699","DOI":"10.1109\/TMI.2020.3035253","volume":"40","author":"R Gu","year":"2021","unstructured":"Gu R et al (2021) CA-Net: comprehensive attention convolutional neural networks for explainable medical image segmentation. IEEE Trans Med Imaging 40(2):699\u2013711. https:\/\/doi.org\/10.1109\/TMI.2020.3035253","journal-title":"IEEE Trans Med Imaging"},{"issue":"2","key":"10859_CR53","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1109\/MIS.2009.36","volume":"24","author":"A Halevy","year":"2009","unstructured":"Halevy A, Norvig P, Pereira F (2009) The unreasonable effectiveness of data. IEEE Intell Syst 24(2):8\u201312. https:\/\/doi.org\/10.1109\/MIS.2009.36","journal-title":"IEEE Intell Syst"},{"key":"10859_CR54","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. pp 770\u2013778. http:\/\/image-net.org\/challenges\/LSVRC\/2015\/. Accessed 13 Dec 2022","DOI":"10.1109\/CVPR.2016.90"},{"key":"10859_CR55","doi-asserted-by":"crossref","unstructured":"He K, Girshick R, Doll\u00e1r P (2019) Rethinking imagenet pre-training. In: Proceedings of the IEEE\/CVF international conference on computer vision. pp 4918\u20134927","DOI":"10.1109\/ICCV.2019.00502"},{"issue":"2","key":"10859_CR56","doi-asserted-by":"publisher","first-page":"243","DOI":"10.2307\/1416950","volume":"57","author":"F Heider","year":"1944","unstructured":"Heider F, Simmel M (1944) An experimental study of apparent behavior. Am J Psychol 57(2):243. https:\/\/doi.org\/10.2307\/1416950","journal-title":"Am J Psychol"},{"issue":"8","key":"10859_CR57","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/NECO.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735\u20131780. https:\/\/doi.org\/10.1162\/NECO.1997.9.8.1735","journal-title":"Neural Comput"},{"key":"10859_CR58","doi-asserted-by":"publisher","unstructured":"Huang Z, Datcu M, Pan Z, Lei B (2020) A hybrid and explainable deep learning framework for SAR images. In: International geoscience and remote sensing symposium (IGARSS). Institute of Electrical and Electronics Engineers Inc., pp 1727\u20131730. https:\/\/doi.org\/10.1109\/IGARSS39084.2020.9323845","DOI":"10.1109\/IGARSS39084.2020.9323845"},{"key":"10859_CR59","doi-asserted-by":"publisher","unstructured":"Huh M, Agrawal P, Efros AA (2016) What makes ImageNet good for transfer learning? https:\/\/doi.org\/10.48550\/arxiv.1608.08614","DOI":"10.48550\/arxiv.1608.08614"},{"issue":"2","key":"10859_CR60","doi-asserted-by":"publisher","first-page":"547","DOI":"10.1002\/MP.12045","volume":"44","author":"B Ibragimov","year":"2017","unstructured":"Ibragimov B, Xing L (2017) Segmentation of organs-at-risks in head and neck CT images using convolutional neural networks. Med Phys 44(2):547\u2013557. https:\/\/doi.org\/10.1002\/MP.12045","journal-title":"Med Phys"},{"key":"10859_CR61","doi-asserted-by":"publisher","unstructured":"Inoue H (2018) Data augmentation by pairing samples for images classification. https:\/\/doi.org\/10.48550\/arxiv.1801.02929","DOI":"10.48550\/arxiv.1801.02929"},{"issue":"6","key":"10859_CR62","doi-asserted-by":"publisher","first-page":"2672","DOI":"10.1002\/MP.12890","volume":"45","author":"Y Interian","year":"2018","unstructured":"Interian Y et al (2018) Deep nets vs expert designed features in medical physics: an IMRT QA case study. Med Phys 45(6):2672\u20132680. https:\/\/doi.org\/10.1002\/MP.12890","journal-title":"Med Phys"},{"key":"10859_CR63","unstructured":"Iwata T, Kumagai A (2020) Few-shot learning for time-series forecasting. arXiv Preprint. https:\/\/arxiv.org\/abs\/2009.14379"},{"key":"10859_CR64","unstructured":"Jiang Y, Neyshabur B, Mobahi H, Krishnan D, Bengio S (2019) Fantastic generalization measures and where to find them. http:\/\/arxiv.org\/abs\/1912.02178"},{"key":"10859_CR65","unstructured":"Kang G, Dong X, Zheng L, Yang Y (2017) PatchShuffle regularization. arXiv. https:\/\/arxiv.org\/abs\/1707.07103"},{"key":"10859_CR66","unstructured":"Karras T, Aittala M, Hellsten J, Laine S, Lehtinen J, Aila T (2020) styleGAN_with limited data. In: Conference on neural information processing systems (NeurIPS 2020), Vancouver, Canada. pp 12104\u201312114"},{"key":"10859_CR67","doi-asserted-by":"publisher","unstructured":"Kawaguchi K, Bengio Y, Kaelbling L (2022) Generalization in deep learning. In: Mathematical aspects of deep learning. pp 112\u2013148. https:\/\/doi.org\/10.1017\/9781009025096.003","DOI":"10.1017\/9781009025096.003"},{"key":"10859_CR68","doi-asserted-by":"publisher","unstructured":"Keshari R, Ghosh S, Chhabra S, Vatsa M, Singh R (2020) Unravelling small sample size problems in the deep learning world. In: Proceedings\u20142020 IEEE 6th international conference on multimedia big data, BigMM 2020. pp 134\u2013143. https:\/\/doi.org\/10.1109\/BIGMM50055.2020.00028","DOI":"10.1109\/BIGMM50055.2020.00028"},{"key":"10859_CR69","doi-asserted-by":"publisher","unstructured":"Kim D, Koo J, Kim UM (2022) A survey on automated machine learning: problems, methods and frameworks. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), vol 13302 LNCS. pp 57\u201370. https:\/\/doi.org\/10.1007\/978-3-031-05311-5_4","DOI":"10.1007\/978-3-031-05311-5_4"},{"key":"10859_CR70","doi-asserted-by":"crossref","unstructured":"Kim SY, Malatesta JL, Lee WC (2023) Generalizability theory and applications. Int Encycl Educ 59-71","DOI":"10.1016\/B978-0-12-818630-5.10009-0"},{"key":"10859_CR71","doi-asserted-by":"crossref","unstructured":"Kornblith S, Shlens J, Le QV (2019) Do better ImageNet models transfer better? pp 2661\u20132671","DOI":"10.1109\/CVPR.2019.00277"},{"key":"10859_CR72","doi-asserted-by":"publisher","DOI":"10.1145\/3065386","author":"A Krizhevsky","year":"2017","unstructured":"Krizhevsky A, Sutskever I, Hinton GE (2017) ImageNet classification with deep convolutional neural networks. Commun ACM. https:\/\/doi.org\/10.1145\/3065386","journal-title":"Commun ACM"},{"key":"10859_CR73","unstructured":"Lake BM, Salakhutdinov R, Tenenbaum JB (2022) Human-level concept learning through probabilistic program induction, vol 21. p 2022, https:\/\/www.science.org. Accessed 22 Oct 2022"},{"issue":"11","key":"10859_CR74","doi-asserted-by":"publisher","first-page":"2278","DOI":"10.1109\/5.726791","volume":"86","author":"Y LeCun","year":"1998","unstructured":"LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278\u20132323. https:\/\/doi.org\/10.1109\/5.726791","journal-title":"Proc IEEE"},{"issue":"7553","key":"10859_CR75","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y Lecun","year":"2015","unstructured":"Lecun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436\u2013444. https:\/\/doi.org\/10.1038\/nature14539","journal-title":"Nature"},{"key":"10859_CR76","unstructured":"Lemberger P (2017) On generalization and regularization in deep learning. http:\/\/arxiv.org\/abs\/1704.01312"},{"issue":"3","key":"10859_CR77","doi-asserted-by":"publisher","first-page":"1195","DOI":"10.1109\/TAFFC.2020.2981446","volume":"13","author":"S Li","year":"2022","unstructured":"Li S, Deng W (2022) Deep facial expression recognition: a survey. IEEE Trans Affect Comput 13(3):1195\u20131215. https:\/\/doi.org\/10.1109\/TAFFC.2020.2981446","journal-title":"IEEE Trans Affect Comput"},{"key":"10859_CR78","doi-asserted-by":"publisher","first-page":"6482","DOI":"10.1109\/TIP.2020.2990277","volume":"29","author":"X Li","year":"2020","unstructured":"Li X et al (2020) OSLNet: deep small-sample classification with an orthogonal softmax layer. IEEE Trans Image Process 29:6482\u20136495. https:\/\/doi.org\/10.1109\/TIP.2020.2990277","journal-title":"IEEE Trans Image Process"},{"issue":"4","key":"10859_CR79","doi-asserted-by":"publisher","first-page":"2290","DOI":"10.1109\/TGRS.2018.2872830","volume":"57","author":"B Liu","year":"2019","unstructured":"Liu B, Yu X, Yu A, Zhang P, Wan G, Wang R (2019) Deep few-shot learning for hyperspectral image classification. IEEE Trans Geosci Remote Sens 57(4):2290\u20132304. https:\/\/doi.org\/10.1109\/TGRS.2018.2872830","journal-title":"IEEE Trans Geosci Remote Sens"},{"key":"10859_CR80","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2022.3176925","author":"G Ma","year":"2022","unstructured":"Ma G et al (2022) A transfer learning-based method for personalized state of health estimation of lithium-ion batteries. IEEE Trans Neural Netw Learn Syst. https:\/\/doi.org\/10.1109\/TNNLS.2022.3176925","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"10859_CR81","doi-asserted-by":"crossref","unstructured":"Majurski M et al (2019) Cell image segmentation using generative adversarial networks, transfer learning, and augmentations. https:\/\/nei.nih.gov\/eyedata\/amd. Accessed 15 June 2023","DOI":"10.1109\/CVPRW.2019.00145"},{"key":"10859_CR82","unstructured":"Marchesi M (2017) Megapixel size image creation using generative adversarial networks. http:\/\/arxiv.org\/abs\/1706.00082"},{"key":"10859_CR83","unstructured":"Marcus G (2018) Deep learning: a critical appraisal http:\/\/www.nytimes.com\/2012\/11\/24\/science\/scientists-see-advances-in-deep-learning-a-part-of-artificial"},{"key":"10859_CR84","unstructured":"Martin Lindstrom Company (2016) Small data: the tiny clues that uncover huge trends. John Murray Press. ISBN 9781473630154. https:\/\/books.google.co.in\/books?id=UtJbCgAAQBAJ"},{"issue":"4","key":"10859_CR85","doi-asserted-by":"publisher","first-page":"939","DOI":"10.1002\/JMRI.26534","volume":"49","author":"MA Mazurowski","year":"2019","unstructured":"Mazurowski MA, Buda M, Saha A, Bashir MR (2019) Deep learning in radiology: an overview of the concepts and a survey of the state of the art with focus on MRI. J Magn Reson Imaging 49(4):939\u2013954. https:\/\/doi.org\/10.1002\/JMRI.26534","journal-title":"J Magn Reson Imaging"},{"key":"10859_CR86","doi-asserted-by":"publisher","unstructured":"Medela A et al (2019) Few shot learning in histopathological images: reducing the need of labeled data on biological datasets. In: Proceedings\u2014international symposium on biomedical imaging, vol 2019-April. pp 1860\u20131864. https:\/\/doi.org\/10.1109\/ISBI.2019.8759182","DOI":"10.1109\/ISBI.2019.8759182"},{"issue":"12","key":"10859_CR87","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3578938","volume":"55","author":"G Menghani","year":"2023","unstructured":"Menghani G (2023) Efficient deep learning: a survey on making deep learning models smaller, faster, and better. ACM Comput Surv 55(12):1\u201337","journal-title":"ACM Comput Surv"},{"key":"10859_CR88","unstructured":"Miller T (2017) Explanation in artificial intelligence: insights from the social sciences. http:\/\/arxiv.org\/abs\/1706.07269"},{"key":"10859_CR89","doi-asserted-by":"publisher","unstructured":"Moreno-Barea FJ, Strazzera F, Jerez JM, Urda D, Franco L (2019) Forward noise adjustment scheme for data augmentation. In: Proceedings of the 2018 IEEE symposium series on computational intelligence (SSCI 2018). pp 728\u2013734. https:\/\/doi.org\/10.1109\/SSCI.2018.8628917","DOI":"10.1109\/SSCI.2018.8628917"},{"key":"10859_CR90","doi-asserted-by":"crossref","unstructured":"Mormont R, Geurts P, Maree R (2018) Comparison of deep transfer learning strategies for digital pathology. pp 2262\u20132271","DOI":"10.1109\/CVPRW.2018.00303"},{"key":"10859_CR91","unstructured":"Mumuni A, Mumuni F (2024) Data augmentation with automated machine learning: approaches and performance comparison with classical data augmentation methods. https:\/\/arxiv.org\/abs\/2403.08352v1. Accessed 8 June 2024"},{"key":"10859_CR92","unstructured":"Nagarajan V (2021) Explaining generalization in deep learning: progress and fundamental limits. http:\/\/arxiv.org\/abs\/2110.08922"},{"key":"10859_CR93","unstructured":"Neyshabur B, Sedghi H, Zhang C (2020) What is being transferred in transfer learning? In: Advances in neural information processing systems, vol 33. pp 512\u2013523"},{"key":"10859_CR94","doi-asserted-by":"publisher","unstructured":"Ng HW, Nguyen VD, Vonikakis V, Winkler S (2015) Deep learning for emotion recognition on small datasets using transfer learning. In: Proceedings of the 2015 ACM on international conference on multimodal interaction. pp 443\u2013449. https:\/\/doi.org\/10.1145\/2818346.2830593","DOI":"10.1145\/2818346.2830593"},{"issue":"2","key":"10859_CR95","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1109\/TAI.2021.3054609","volume":"1","author":"S Niu","year":"2020","unstructured":"Niu S, Liu Y, Wang J, Song H (2020) A decade survey of transfer learning (2010\u20132020). IEEE Trans Artif Intell 1(2):151\u2013166. https:\/\/doi.org\/10.1109\/TAI.2021.3054609","journal-title":"IEEE Trans Artif Intell"},{"key":"10859_CR96","unstructured":"Olson M, Wyner A, Berk R (2018) Modern neural networks generalize on small data sets. In: Advances in neural information processing systems, vol 31"},{"key":"10859_CR97","unstructured":"OpenAI et al (2019) Dota 2 with large scale deep reinforcement learning. http:\/\/arxiv.org\/abs\/1912.06680"},{"key":"10859_CR98","doi-asserted-by":"publisher","DOI":"10.1016\/J.IJSU.2021.105906","volume":"88","author":"MJ Page","year":"2021","unstructured":"Page MJ et al (2021) The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Int J Surg 88:105906. https:\/\/doi.org\/10.1016\/J.IJSU.2021.105906","journal-title":"Int J Surg"},{"issue":"2","key":"10859_CR99","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1109\/TNN.2010.2091281","volume":"22","author":"SJ Pan","year":"2011","unstructured":"Pan SJ, Tsang IW, Kwok JT, Yang Q (2011) Domain adaptation via transfer component analysis. IEEE Trans Neural Netw 22(2):199\u2013210. https:\/\/doi.org\/10.1109\/TNN.2010.2091281","journal-title":"IEEE Trans Neural Netw"},{"key":"10859_CR100","doi-asserted-by":"crossref","unstructured":"Peng Z, Li Z, Zhang J, Li Y, Qi G-J, Tang J (2019) Few-shot image recognition with knowledge transfer. pp 441\u2013449","DOI":"10.1109\/ICCV.2019.00053"},{"key":"10859_CR101","doi-asserted-by":"publisher","DOI":"10.1016\/J.COGNITION.2020.104365","volume":"203","author":"P Perconti","year":"2020","unstructured":"Perconti P, Plebe A (2020) Deep learning and cognitive science. Cognition 203:104365. https:\/\/doi.org\/10.1016\/J.COGNITION.2020.104365","journal-title":"Cognition"},{"key":"10859_CR102","doi-asserted-by":"publisher","unstructured":"Pfister T, Charles J, Zisserman A (2014) Domain-adaptive discriminative one-shot learning of gestures. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), vol 8694 LNCS, no PART 6. pp 814\u2013829. https:\/\/doi.org\/10.1007\/978-3-319-10599-4_52","DOI":"10.1007\/978-3-319-10599-4_52"},{"key":"10859_CR103","doi-asserted-by":"crossref","unstructured":"Plested J, Gedeon T (2019a) An analysis of the interaction between transfer learning protocols in deep neural networks. In: Neural information processing: 26th international conference, ICONIP 2019, Sydney, NSW, Australia, December 12\u201315, 2019, proceedings, part I 26. Springer International Publishing, pp 312\u2013323","DOI":"10.1007\/978-3-030-36708-4_26"},{"key":"10859_CR104","doi-asserted-by":"publisher","unstructured":"Plested J, Gedeon T (2019b) An analysis of the interaction between transfer learning protocols in deep neural networks. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), vol 11953 LNCS. pp 312\u2013323. https:\/\/doi.org\/10.1007\/978-3-030-36708-4_26\/COVER","DOI":"10.1007\/978-3-030-36708-4_26\/COVER"},{"key":"10859_CR105","unstructured":"Plested J, Gedeon T (2022) Deep transfer learning for image classification: a survey. http:\/\/arxiv.org\/abs\/2205.09904"},{"key":"10859_CR106","unstructured":"Power A, Burda Y, Edwards H, Babuschkin I, Misra V (2022) Grokking: generalization beyond overfitting on small algorithmic datasets. arXiv Preprint. http:\/\/arxiv.org\/abs\/2201.02177"},{"key":"10859_CR107","doi-asserted-by":"publisher","DOI":"10.1016\/J.PATCOG.2022.108889","volume":"131","author":"Z Qian","year":"2022","unstructured":"Qian Z, Huang K, Wang QF, Zhang XY (2022) A survey of robust adversarial training in pattern recognition: fundamental, theory, and methodologies. Pattern Recognit 131:108889. https:\/\/doi.org\/10.1016\/J.PATCOG.2022.108889","journal-title":"Pattern Recognit"},{"key":"10859_CR108","doi-asserted-by":"publisher","first-page":"105568","DOI":"10.1016\/j.cmpb.2020.105568","volume":"195","author":"Z Qin","year":"2020","unstructured":"Qin Z, Liu Z, Zhu P, Xue Y (2020) A GAN-based image synthesis method for skin lesion classification. Comput Methods Programs Biomed 195:105568","journal-title":"Comput Methods Programs Biomed"},{"key":"10859_CR109","doi-asserted-by":"publisher","DOI":"10.1016\/J.ARTMED.2021.102158","volume":"124","author":"TP Quinn","year":"2022","unstructured":"Quinn TP, Jacobs S, Senadeera M, Le V, Coghlan S (2022) The three ghosts of medical AI: can the black-box present deliver? Artif Intell Med 124:102158. https:\/\/doi.org\/10.1016\/J.ARTMED.2021.102158","journal-title":"Artif Intell Med"},{"key":"10859_CR110","doi-asserted-by":"publisher","DOI":"10.48550\/arxiv.1902.07208","author":"M Raghu","year":"2019","unstructured":"Raghu M, Zhang C, Kleinberg J, Bengio S (2019) Transfusion: understanding transfer learning for medical imaging. Adv Neural Inf Process Syst. https:\/\/doi.org\/10.48550\/arxiv.1902.07208","journal-title":"Adv Neural Inf Process Syst"},{"key":"10859_CR111","doi-asserted-by":"publisher","unstructured":"Rahadian A, Yusuf R (2023) Online learning facial expression detection using simplified AlexNet deep learning architecture: image data samples comparison experiment. pp 83\u201388. https:\/\/doi.org\/10.1109\/ICSET57543.2022.10011131","DOI":"10.1109\/ICSET57543.2022.10011131"},{"issue":"1","key":"10859_CR112","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1007\/S11747-019-00710-5\/TABLES\/1","volume":"48","author":"A Rai","year":"2020","unstructured":"Rai A (2020) Explainable AI: from black box to glass box. J Acad Mark Sci 48(1):137\u2013141. https:\/\/doi.org\/10.1007\/S11747-019-00710-5\/TABLES\/1","journal-title":"J Acad Mark Sci"},{"key":"10859_CR113","unstructured":"Raileanu R, Goldstein M, Yarats D, Kostrikov I, Fergus R (2021) Automatic data augmentation for generalization in reinforcement learning. In: Advances in neural information processing systems, vol 34. pp 5402\u20135415. https:\/\/github.com\/rraileanu\/auto-drac. Accessed 12 June 2024"},{"issue":"2","key":"10859_CR114","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3582274","volume":"9","author":"Y Rayhan","year":"2023","unstructured":"Rayhan Y, Hashem T (2023) AIST: an interpretable attention-based deep learning model for crime prediction. ACM Trans Spat Algorithms Syst 9(2):1\u201331","journal-title":"ACM Trans Spat Algorithms Syst"},{"issue":"6","key":"10859_CR115","doi-asserted-by":"publisher","first-page":"619","DOI":"10.1016\/J.JKSUCI.2018.09.002","volume":"33","author":"IM Revina","year":"2021","unstructured":"Revina IM, Emmanuel WRS (2021) A survey on human face expression recognition techniques. J King Saud Univ Comput Inf Sci 33(6):619\u2013628. https:\/\/doi.org\/10.1016\/J.JKSUCI.2018.09.002","journal-title":"J King Saud Univ Comput Inf Sci"},{"issue":"8","key":"10859_CR116","doi-asserted-by":"publisher","first-page":"2390","DOI":"10.1109\/TBME.2018.2889705","volume":"66","author":"PLC Rodrigues","year":"2019","unstructured":"Rodrigues PLC, Jutten C, Congedo M (2019) Riemannian procrustes analysis: transfer learning for brain-computer interfaces. IEEE Trans Biomed Eng 66(8):2390\u20132401. https:\/\/doi.org\/10.1109\/TBME.2018.2889705","journal-title":"IEEE Trans Biomed Eng"},{"key":"10859_CR117","doi-asserted-by":"publisher","unstructured":"Romero M, Interian Y, Solberg T, Valdes G (2019) Targeted transfer learning to improve performance in small medical physics datasets. https:\/\/doi.org\/10.1002\/mp.14507","DOI":"10.1002\/mp.14507"},{"key":"10859_CR118","unstructured":"Settles B (2009) Active learning literature survey. Technical report TR-1648. University of Wisconsin-Madison Department of Computer Sciences"},{"key":"10859_CR119","doi-asserted-by":"publisher","DOI":"10.1016\/J.ENGAPPAI.2022.105461","volume":"116","author":"K Shaukat","year":"2022","unstructured":"Shaukat K, Luo S, Varadharajan V (2022) A novel method for improving the robustness of deep learning-based malware detectors against adversarial attacks. Eng Appl Artif Intell 116:105461. https:\/\/doi.org\/10.1016\/J.ENGAPPAI.2022.105461","journal-title":"Eng Appl Artif Intell"},{"key":"10859_CR120","doi-asserted-by":"publisher","unstructured":"Shen L, Lin Z, Huang Q (2016) Relay backpropagation for effective learning of deep convolutional neural networks. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), vol 9911 LNCS. pp 467\u2013482. https:\/\/doi.org\/10.1007\/978-3-319-46478-7_29\/TABLES\/6","DOI":"10.1007\/978-3-319-46478-7_29\/TABLES\/6"},{"key":"10859_CR121","first-page":"4165","volume":"2017","author":"J Shijie","year":"2017","unstructured":"Shijie J, Ping W, Peiyi J, Siping H (2017) Research on data augmentation for image classification based on convolution neural networks. Chin Autom Congr 2017:4165\u20134170","journal-title":"Chin Autom Congr"},{"key":"10859_CR122","doi-asserted-by":"publisher","DOI":"10.1186\/s40537-019-0197-0","author":"C Shorten","year":"2019","unstructured":"Shorten C, Khoshgoftaar TM (2019) A survey on image data augmentation for deep learning. J Big Data. https:\/\/doi.org\/10.1186\/s40537-019-0197-0","journal-title":"J Big Data"},{"key":"10859_CR123","doi-asserted-by":"crossref","unstructured":"Singh M et al (2022) Revisiting weakly supervised pre-training of visual perception models. pp 804\u2013814. https:\/\/github.com\/facebookresearch\/SWAG. Accessed 9 Dec 2022","DOI":"10.1109\/CVPR52688.2022.00088"},{"key":"10859_CR124","doi-asserted-by":"publisher","unstructured":"Singha A, Thakur RS, Patel T (2021) Deep learning applications in medical image analysis. Biomed Data Min Inf Retr 2021:293\u2013350. https:\/\/doi.org\/10.1002\/9781119711278.ch11","DOI":"10.1002\/9781119711278.ch11"},{"issue":"2","key":"10859_CR125","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1007\/s41019-016-0011-3","volume":"1","author":"S Siuly","year":"2016","unstructured":"Siuly S, Zhang Y (2016) Medical big data: neurological diseases diagnosis through medical data analysis. Data Scie Eng 1(2):54\u201364. https:\/\/doi.org\/10.1007\/s41019-016-0011-3","journal-title":"Data Scie Eng"},{"key":"10859_CR126","doi-asserted-by":"publisher","DOI":"10.1109\/LGRS.2022.3162707","author":"Y Song","year":"2022","unstructured":"Song Y, Li J, Gao P, Li L, Tian T, Tian J (2022) Two-stage cross-modality transfer learning method for military-civilian SAR ship recognition. IEEE Geosci Remote Sens Lett. https:\/\/doi.org\/10.1109\/LGRS.2022.3162707","journal-title":"IEEE Geosci Remote Sens Lett"},{"key":"10859_CR127","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1016\/J.CONB.2019.02.004","volume":"55","author":"J Spicer","year":"2019","unstructured":"Spicer J, Sanborn AN (2019) What does the mind learn? A comparison of human and machine learning representations. Curr Opin Neurobiol 55:97\u2013102. https:\/\/doi.org\/10.1016\/J.CONB.2019.02.004","journal-title":"Curr Opin Neurobiol"},{"key":"10859_CR128","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/11442.003.0077","author":"KR Storrs","year":"2019","unstructured":"Storrs KR, Kriegeskorte N (2019a) Deep learning for cognitive neuroscience. Cognit Neurosci. https:\/\/doi.org\/10.7551\/mitpress\/11442.003.0077","journal-title":"Cognit Neurosci"},{"key":"10859_CR129","doi-asserted-by":"publisher","DOI":"10.48550\/arxiv.1903.01458","author":"KR Storrs","year":"2019","unstructured":"Storrs KR, Kriegeskorte N (2019b) Deep learning for cognitive neuroscience. Cognit Neurosci. https:\/\/doi.org\/10.48550\/arxiv.1903.01458","journal-title":"Cognit Neurosci"},{"issue":"4","key":"10859_CR130","doi-asserted-by":"publisher","first-page":"3588","DOI":"10.1109\/TIE.2020.2977553","volume":"68","author":"X Sun","year":"2021","unstructured":"Sun X, Xv H, Dong J, Zhou H, Chen C, Li Q (2021) Few-shot learning for domain-specific fine-grained image classification. IEEE Trans Ind Electron 68(4):3588\u20133598. https:\/\/doi.org\/10.1109\/TIE.2020.2977553","journal-title":"IEEE Trans Ind Electron"},{"key":"10859_CR131","doi-asserted-by":"publisher","unstructured":"Suzuki K (2022) Small data deep learning for lung cancer detection in CT.In: Proceedings\u2014IEEE 8th international conference on big data computing service and applications, BigDataService 2022. pp 114\u2013118. https:\/\/doi.org\/10.1109\/BIGDATASERVICE55688.2022.00025","DOI":"10.1109\/BIGDATASERVICE55688.2022.00025"},{"key":"10859_CR132","unstructured":"\u015awiechowski M (2022) Deep learning and artificial general intelligence: still a long way to go. http:\/\/arxiv.org\/abs\/2203.14963"},{"issue":"5","key":"10859_CR133","doi-asserted-by":"publisher","first-page":"1299","DOI":"10.1109\/TMI.2016.2535302","volume":"35","author":"N Tajbakhsh","year":"2016","unstructured":"Tajbakhsh N et al (2016) Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE Trans Med Imaging 35(5):1299\u20131312. https:\/\/doi.org\/10.1109\/TMI.2016.2535302","journal-title":"IEEE Trans Med Imaging"},{"key":"10859_CR134","doi-asserted-by":"publisher","unstructured":"Tan C, Sun F, Kong T, Zhang W, Yang C, Liu C (2018) A survey on deep transfer learning. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), vol 11141 LNCS. pp 270\u2013279. https:\/\/doi.org\/10.1007\/978-3-030-01424-7_27\/COVER","DOI":"10.1007\/978-3-030-01424-7_27\/COVER"},{"key":"10859_CR135","doi-asserted-by":"crossref","unstructured":"Tan Y, Li Y, Huang SL, Zhang XP (2024) Transferability-guided cross-domain cross-task transfer learning. IEEE Trans Neural Netw Learn Syst","DOI":"10.1109\/TNNLS.2024.3358094"},{"key":"10859_CR136","doi-asserted-by":"publisher","DOI":"10.1109\/TIM.2022.3196436","author":"X Tao","year":"2022","unstructured":"Tao X, Gong X, Zhang X, Yan S, Adak C (2022) Deep learning for unsupervised anomaly localization in industrial images: a survey. IEEE Trans Instrum Meas. https:\/\/doi.org\/10.1109\/TIM.2022.3196436","journal-title":"IEEE Trans Instrum Meas"},{"key":"10859_CR137","doi-asserted-by":"crossref","unstructured":"Tran AT, Nguyen CV, Hassner T (2019) Transferability and hardness of supervised classification tasks. In: Proceedings of the IEEE\/CVF international conference on computer vision. pp 1395\u20131405","DOI":"10.1109\/ICCV.2019.00148"},{"key":"10859_CR138","unstructured":"Triantafillou E, Zemel R, Urtasun R (2017) Few-shot learning through an information retrieval lens. In: Advances in neural information processing systems, vol 30"},{"key":"10859_CR139","unstructured":"Tsai YHH, Salakhutdinov R (2017) Improving one-shot learning through fusing side information. arXiv Preprint. https:\/\/arxiv.org\/abs\/1710.08347"},{"key":"10859_CR140","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/S13198-024-02346-3\/TABLES\/10","volume":"1","author":"S ul Sabha","year":"2024","unstructured":"ul Sabha S, Assad A, Shafi S, Din NMU, Dar RA, Bhat MR (2024) Imbalcbl: addressing deep learning challenges with small and imbalanced datasets. Inte J Syst Assur Eng Manag 1:1\u201313. https:\/\/doi.org\/10.1007\/S13198-024-02346-3\/TABLES\/10","journal-title":"Inte J Syst Assur Eng Manag"},{"key":"10859_CR141","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/S00146-022-01437-8\/TABLES\/1","volume":"1","author":"P Verdegem","year":"2022","unstructured":"Verdegem P (2022) Dismantling AI capitalism: the commons as an alternative to the power concentration of Big Tech. AI Soc 1:1\u201311. https:\/\/doi.org\/10.1007\/S00146-022-01437-8\/TABLES\/1","journal-title":"AI Soc"},{"key":"10859_CR142","unstructured":"Vinyals O, Deepmind G, Blundell C, Lillicrap T, KKavukcuoglu K, Wierstra D (2016) Matching networks for one shot learning. In: Advances in neural information processing systems, vol 29"},{"key":"10859_CR143","unstructured":"Wah C, Branson S, Welinder P, Perona P, Belongie S (2011) The caltech-ucsd birds-200-2011 dataset. Tech. Rep. CNS-TR-2011-001, California Institute of Technology"},{"key":"10859_CR500","unstructured":"Wang Y (2020) A mathematical introduction to generative adversarial nets (GAN). arXiv 2020. arXiv preprint arXiv:2009.00169."},{"key":"10859_CR144","unstructured":"Wang J, Perez L (2017) The effectiveness of data augmentation in image classification using deep learning. http:\/\/arxiv.org\/abs\/1712.04621"},{"key":"10859_CR145","unstructured":"Wang Y, Ramanan D, Hebert M (2017) Learning to model the tail. NIPS"},{"key":"10859_CR146","unstructured":"\u201cWhy machine learning \u2018succeeds\u2019 in development but fails in deployment.\u201d www.causaLens.com"},{"issue":"7","key":"10859_CR147","doi-asserted-by":"publisher","first-page":"194","DOI":"10.3390\/JIMAGING8070194","volume":"8","author":"A Wibowo","year":"2022","unstructured":"Wibowo A et al (2022) Cardiac disease classification using two-dimensional thickness and few-shot learning based on magnetic resonance imaging image segmentation. J Imaging 8(7):194. https:\/\/doi.org\/10.3390\/JIMAGING8070194","journal-title":"J Imaging"},{"key":"10859_CR148","doi-asserted-by":"crossref","unstructured":"Wong SC, Gatt A, Stamatescu V, McDonnell MD (2016) Understanding data augmentation for classification: when to warp? In: 2016 international conference on digital image computing: techniques and applications (DICTA 2016). https:\/\/arxiv.org\/abs\/1609.08764v2","DOI":"10.1109\/DICTA.2016.7797091"},{"key":"10859_CR149","unstructured":"Xing C, Rostamzadeh N, Oreshkin B, Pinheiro POO (2019) Adaptive cross-modal few-shot learning. In: Advances in neural information processing systems, vol 32"},{"key":"10859_CR150","doi-asserted-by":"publisher","DOI":"10.1016\/j.measurement.2020.108502","author":"Y Xu","year":"2021","unstructured":"Xu Y, Li Z, Wang S, Li W, Sarkodie-Gyan T, Feng S (2021) A hybrid deep-learning model for fault diagnosis of rolling bearings. Measurement (London). https:\/\/doi.org\/10.1016\/j.measurement.2020.108502","journal-title":"Measurement (London)"},{"key":"10859_CR151","doi-asserted-by":"publisher","unstructured":"Yosinski J, Clune J, Bengio Y, Lipson H (2014) How transferable are features in deep neural networks? In: Advances in neural information processing systems, vol 4, no January. pp 3320\u20133328. https:\/\/doi.org\/10.48550\/arxiv.1411.1792","DOI":"10.48550\/arxiv.1411.1792"},{"key":"10859_CR152","unstructured":"Yousefzadeh R (2022) Deep learning generalization, extrapolation, and over-parameterization. http:\/\/arxiv.org\/abs\/2203.10366"},{"issue":"8","key":"10859_CR153","doi-asserted-by":"publisher","first-page":"2008","DOI":"10.1109\/TPAMI.2018.2889774","volume":"41","author":"C Zhang","year":"2019","unstructured":"Zhang C, Butepage J, Kjellstrom H, Mandt S (2019) Advances in variational inference. IEEE Trans Pattern Anal Mach Intell 41(8):2008\u20132026. https:\/\/doi.org\/10.1109\/TPAMI.2018.2889774","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"10859_CR154","doi-asserted-by":"publisher","first-page":"1016","DOI":"10.1109\/TIP.2019.2938307","volume":"29","author":"L Zhang","year":"2020","unstructured":"Zhang L, Liu J, Zhang B, Zhang D, Zhu C (2020) Deep cascade model-based face recognition: when deep-layered learning meets small data. IEEE Trans Image Process 29:1016\u20131029. https:\/\/doi.org\/10.1109\/TIP.2019.2938307","journal-title":"IEEE Trans Image Process"},{"issue":"1","key":"10859_CR155","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1109\/TCSVT.2020.2967419","volume":"31","author":"X Zhang","year":"2021","unstructured":"Zhang X, Wang Z, Liu D, Lin Q, Ling Q (2021a) Deep adversarial data augmentation for extremely low data regimes. IEEE Trans Circuits Syst Video Technol 31(1):15\u201328. https:\/\/doi.org\/10.1109\/TCSVT.2020.2967419","journal-title":"IEEE Trans Circuits Syst Video Technol"},{"issue":"3","key":"10859_CR156","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1145\/3446776","volume":"64","author":"C Zhang","year":"2021","unstructured":"Zhang C, Bengio S, Hardt M, Recht B, Vinyals O (2021b) Understanding deep learning (still) requires rethinking generalization. Commun ACM 64(3):107\u2013115. https:\/\/doi.org\/10.1145\/3446776","journal-title":"Commun ACM"},{"issue":"3","key":"10859_CR157","doi-asserted-by":"publisher","first-page":"1294","DOI":"10.1109\/TNET.2021.3137084","volume":"30","author":"C Zhang","year":"2022","unstructured":"Zhang C, Costa-Perez X, Patras P (2022) Adversarial attacks against deep learning-based network intrusion detection systems and defense mechanisms. IEEE\/ACM Trans Netw 30(3):1294\u20131311. https:\/\/doi.org\/10.1109\/TNET.2021.3137084","journal-title":"IEEE\/ACM Trans Netw"},{"issue":"2","key":"10859_CR158","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1109\/JAS.2022.106004","volume":"10","author":"W Zhang","year":"2023","unstructured":"Zhang W, Deng L, Zhang L, Wu D (2023) A survey on negative transfer. IEEE\/CAA J Autom Sin 10(2):305\u2013329. https:\/\/doi.org\/10.1109\/JAS.2022.106004","journal-title":"IEEE\/CAA J Autom Sin"},{"key":"10859_CR159","unstructured":"Zhang P, Zhong Y, Deng Y, Tang X, Li X (2019) A survey on deep learning of small sample in biomedical image\nanalysis. arXiv:190800473"},{"key":"10859_CR160","doi-asserted-by":"publisher","unstructured":"Zhao J, Yuan M, Cui J, Dong S, Qu Y, Xu B (2022) A small-sample intelligent fault diagnosis method based on deep transfer learning; a small-sample intelligent fault diagnosis method based on deep transfer learning. https:\/\/doi.org\/10.1109\/DSIT55514.2022.9943875","DOI":"10.1109\/DSIT55514.2022.9943875"},{"key":"10859_CR161","doi-asserted-by":"publisher","unstructured":"Zhao Q, Yu H, Chu J, Li T (2023) Few-shot learning with attention mechanism and transfer learning for import and export commodities classification. pp 125\u2013130. https:\/\/doi.org\/10.1109\/CCIS57298.2022.10016358","DOI":"10.1109\/CCIS57298.2022.10016358"},{"key":"10859_CR162","unstructured":"Zheng Y, Jin M, Liu Y, Chi L, Phan KT, Pan S, Chen YPP (2022) From unsupervised to few-shot graph anomaly detection: a multi-scale contrastive learning approach. arXiv Preprint. https:\/\/arxiv.org\/abs\/2202.05525"},{"key":"10859_CR163","doi-asserted-by":"crossref","unstructured":"Zhong Z, Zheng L, Kang G, Li S, Yang Y (2020) Random erasing data augmentation. In Proceedings of the AAAI conference on artificial intelligence, Vol 34, No 07, pp 13001-13008","DOI":"10.1609\/aaai.v34i07.7000"},{"issue":"1","key":"10859_CR164","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1093\/nsr\/nwx106","volume":"5","author":"Z-H Zhou","year":"2018","unstructured":"Zhou Z-H (2018) A brief introduction to weakly supervised learning. Natl Sci Rev 5(1):44\u201353. https:\/\/doi.org\/10.1093\/nsr\/nwx106","journal-title":"Natl Sci Rev"},{"issue":"6","key":"10859_CR165","doi-asserted-by":"publisher","first-page":"1452","DOI":"10.1109\/TPAMI.2017.2723009","volume":"40","author":"B Zhou","year":"2018","unstructured":"Zhou B, Lapedriza A, Khosla A, Oliva A, Torralba A (2018) Places: a 10 million image database for scene recognition. IEEE Trans Pattern Anal Mach Intell 40(6):1452\u20131464. https:\/\/doi.org\/10.1109\/TPAMI.2017.2723009","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"10859_CR166","doi-asserted-by":"publisher","DOI":"10.1109\/TIM.2022.3225008","author":"Y Zhu","year":"2022","unstructured":"Zhu Y, Liang X, Wang T, Xie J, Yang J (2022) Multi-information fusion fault diagnosis of bogie bearing under small samples via unsupervised representation alignment deep Q-learning. IEEE Trans Instrum Meas. https:\/\/doi.org\/10.1109\/TIM.2022.3225008","journal-title":"IEEE Trans Instrum Meas"},{"issue":"1","key":"10859_CR167","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1109\/JPROC.2020.3004555","volume":"109","author":"F Zhuang","year":"2021","unstructured":"Zhuang F et al (2021) A comprehensive survey on transfer learning. Proc IEEE 109(1):43\u201376. https:\/\/doi.org\/10.1109\/JPROC.2020.3004555","journal-title":"Proc IEEE"},{"key":"10859_CR168","unstructured":"Zoph B, Ghiasi G, Lin TY, Cui Y, Liu H, Cubuk ED, Le Q (2020a) Rethinking pre-training and self-training. In: Advances in neural information processing systems, vol 33. pp 3833\u20133845"},{"key":"10859_CR169","doi-asserted-by":"publisher","unstructured":"Zoph B et al (2020b) Rethinking pre-training and self-training. In: Advances in neural information processing systems, vol. 2020-December. https:\/\/doi.org\/10.48550\/arxiv.2006.06882","DOI":"10.48550\/arxiv.2006.06882"}],"container-title":["Artificial Intelligence Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-024-10859-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10462-024-10859-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-024-10859-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,5]],"date-time":"2024-09-05T01:06:16Z","timestamp":1725498376000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10462-024-10859-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,2]]},"references-count":170,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["10859"],"URL":"https:\/\/doi.org\/10.1007\/s10462-024-10859-3","relation":{},"ISSN":["1573-7462"],"issn-type":[{"value":"1573-7462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,2]]},"assertion":[{"value":"13 July 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 August 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"226"}}