{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T05:39:18Z","timestamp":1773812358754,"version":"3.50.1"},"reference-count":40,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2019,8,9]],"date-time":"2019-08-09T00:00:00Z","timestamp":1565308800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Deep neural networks are successful learning tools for building nonlinear models. However, a robust deep learning-based classification model needs a large dataset. Indeed, these models are often unstable when they use small datasets. To solve this issue, which is particularly critical in light of the possible clinical applications of these predictive models, researchers have developed approaches such as virtual sample generation. Virtual sample generation significantly improves learning and classification performance when working with small samples. The main objective of this study is to evaluate the ability of the proposed virtual sample generation to overcome the small sample size problem, which is a feature of the automated detection of a neurodevelopmental disorder, namely autism spectrum disorder. Results show that our method enhances diagnostic accuracy from 84%\u201395% using virtual samples generated on the basis of five actual clinical samples. The present findings show the feasibility of using the proposed technique to improve classification performance even in cases of clinical samples of limited size. Accounting for concerns in relation to small sample sizes, our technique represents a meaningful step forward in terms of pattern recognition methodology, particularly when it is applied to diagnostic classifications of neurodevelopmental disorders. Besides, the proposed technique has been tested with other available benchmark datasets. The experimental outcomes showed that the accuracy of the classification that used virtual samples was superior to the one that used original training data without virtual samples.<\/jats:p>","DOI":"10.3390\/a12080160","type":"journal-article","created":{"date-parts":[[2019,8,9]],"date-time":"2019-08-09T11:11:31Z","timestamp":1565349091000},"page":"160","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["A Novel Virtual Sample Generation Method to Overcome the Small Sample Size Problem in Computer Aided Medical Diagnosing"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6731-7246","authenticated-orcid":false,"given":"Mohammad","family":"Wedyan","sequence":"first","affiliation":[{"name":"Faculty of Engineering and Information Technology, University of Technology Sydney, Ultimo 2007, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alessandro","family":"Crippa","sequence":"additional","affiliation":[{"name":"IRCCS Eugenio Medea, Scientific Institute, 23842 Bosisio Parini, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0297-2463","authenticated-orcid":false,"given":"Adel","family":"Al-Jumaily","sequence":"additional","affiliation":[{"name":"Faculty of Engineering and Information Technology, University of Technology Sydney, Ultimo 2007, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,8,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1561\/2000000039","article-title":"Deep learning: Methods and applications","volume":"7","author":"Deng","year":"2014","journal-title":"Found. Trends\u00ae Signal Process."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Charalambous, C.C., and Bharath, A.A. (2016). A data augmentation methodology for training machine\/deep learning gait recognition algorithms. arXiv.","DOI":"10.5244\/C.30.110"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Masood, A., and Al-Jumaily, A. (2016, January 16\u201320). Semi-advised learning model for skin cancer diagnosis based on histopathalogical images. Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA.","DOI":"10.1109\/EMBC.2016.7590781"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1016\/j.neucom.2014.06.004","article-title":"A genetic algorithm-based virtual sample generation technique to improve small data set learning","volume":"143","author":"Li","year":"2014","journal-title":"Neurocomputing"},{"key":"ref_6","first-page":"17S","article-title":"Maple syrup urine disease","volume":"132","author":"Strauss","year":"2013","journal-title":"J. Pediatr."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"868","DOI":"10.1016\/j.joca.2015.01.009","article-title":"Radiographic features of hand osteoarthritis in adult Kashin-Beck Disease (KBD): The Yongshou KBD study","volume":"23","author":"Fu","year":"2015","journal-title":"Osteoarthr. Cartil."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1007\/s13244-015-0394-0","article-title":"Medical imaging in personalised medicine: A white paper of the research committee of the European Society of Radiology (ESR)","volume":"6","author":"Radiology","year":"2015","journal-title":"Insights Imaging"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Colubri, A., Silver, T., Fradet, T., Retzepi, K., Fry, B., and Sabeti, P. (2016). Transforming clinical data into actionable prognosis models: Machine-learning framework and field-deployable app to predict outcome of Ebola patients. PLoS Negl. Trop. Dis., 10.","DOI":"10.1371\/journal.pntd.0004549"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"20","DOI":"10.5507\/bp.2016.002","article-title":"Emergency situations in rheumatology with a focus on systemic autoimmune diseases","volume":"160","author":"Vymetal","year":"2016","journal-title":"Biomed. Pap. Med Fac. Palacky Univ. Olomouc"},{"key":"ref_11","unstructured":"Ildstad, S.T., and Evans, C.H. (2001). Small Clinical Trials: Issues and Challenges, National Academy Press."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1140","DOI":"10.1016\/j.neubiorev.2012.01.004","article-title":"Using support vector machine to identify imaging biomarkers of neurological and psychiatric disease: A critical review","volume":"36","author":"Orru","year":"2012","journal-title":"Neurosci. Biobehav. Rev."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wedyan, M., and Al-Jumaily, A. (2016, January 17\u201320). Early diagnosis autism based on upper limb motor coordination in high risk subjects for autism. Proceedings of the 2016 IEEE International Symposium on Robotics and Intelligent Sensors (IRIS), Tokyo, Japan.","DOI":"10.1109\/IRIS.2016.8066059"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Wedyan, M., and Al-Jumaily, A. (2016, January 6\u20139). Upper limb motor coordination based early diagnosis in high risk subjects for Autism. Proceedings of the 2016 IEEE Symposium Series on Computational Intelligence (SSCI), Athens, Greece.","DOI":"10.1109\/SSCI.2016.7849893"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"966","DOI":"10.1016\/j.cor.2005.05.019","article-title":"Using mega-trend-diffusion and artificial samples in small data set learning for early flexible manufacturing system scheduling knowledge","volume":"34","author":"Li","year":"2007","journal-title":"Comput. Oper. Res."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1016\/j.ijar.2003.06.001","article-title":"A diffusion-neural-network for learning from small samples","volume":"35","author":"Huang","year":"2004","journal-title":"Int. J. Approx. Reason."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"127","DOI":"10.13031\/2013.24474","article-title":"Neural-network-based classification of meat: Evaluation of techniques to overcome small dataset problems","volume":"1","author":"Khot","year":"2008","journal-title":"Biol. Eng. Trans."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1575","DOI":"10.1016\/j.eswa.2011.08.071","article-title":"A tree-based-trend-diffusion prediction procedure for small sample sets in the early stages of manufacturing systems","volume":"39","author":"Li","year":"2012","journal-title":"Expert Syst. Appl."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/j.lwt.2011.06.011","article-title":"Evaluation of technique to overcome small dataset problems during neural-network based contamination classification of packaged beef using integrated olfactory sensor system","volume":"45","author":"Khot","year":"2012","journal-title":"LWT Food Sci. Technol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"4011","DOI":"10.1080\/0020754031000149211","article-title":"Using functional virtual population as assistance to learn scheduling knowledge in dynamic manufacturing environments","volume":"41","author":"Li","year":"2003","journal-title":"Int. J. Prod. Res."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1016\/j.eswa.2006.09.008","article-title":"A non-parametric learning algorithm for small manufacturing data sets","volume":"34","author":"Li","year":"2008","journal-title":"Expert Syst. Appl."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"7963","DOI":"10.1016\/j.eswa.2010.12.035","article-title":"A new approach to prediction of radiotherapy of bladder cancer cells in small dataset analysis","volume":"38","author":"Chao","year":"2011","journal-title":"Expert Syst. Appl."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1016\/j.ejor.2005.05.005","article-title":"Using virtual sample generation to build up management knowledge in the early manufacturing stages","volume":"175","author":"Li","year":"2006","journal-title":"Eur. J. Oper. Res."},{"key":"ref_24","unstructured":"Johnson, R., and Wichern, D. (1982). The multivariate normal distribution. Applied Multivariate Statistical Analysis, Prentice-Hall Inc."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1016\/S0950-5849(99)00021-X","article-title":"Evaluating data mining procedures: Techniques for generating artificial data sets","volume":"41","author":"Scott","year":"1999","journal-title":"Inf. Softw. Technol."},{"key":"ref_26","unstructured":"Khot, L.R. (2009). Characterization and Pattern Recognition of Selected Sensors For Food Safety Applications, North Dakota State University."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"6679","DOI":"10.1080\/00207543.2011.613867","article-title":"A multi-model approach to determine early manufacturing parameters for small-data-set prediction","volume":"50","author":"Li","year":"2012","journal-title":"Int. J. Prod. Res."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2196","DOI":"10.1109\/5.726787","article-title":"Incorporating prior information in machine learning by creating virtual examples","volume":"86","author":"Niyogi","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2740","DOI":"10.1016\/j.ins.2009.04.003","article-title":"Utilization of virtual samples to facilitate cancer identification for DNA microarray data in the early stages of an investigation","volume":"179","author":"Li","year":"2009","journal-title":"Inf. Sci."},{"key":"ref_30","unstructured":"Dheeru, D., and Karra Taniskidou, E. (2019, November 25). UCI Machine Learning Repository. Available online: http:\/\/archive.ics.uci.edu\/ml\/datasets.php."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1016\/j.eng.2018.11.018","article-title":"Wasserstein GAN-Based Small-Sample Augmentation for New-Generation Artificial Intelligence: A Case Study of Cancer-Staging Data in Biology","volume":"5","author":"Liu","year":"2019","journal-title":"Engineering"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"S221","DOI":"10.1016\/j.jval.2018.04.1497","article-title":"Synthetic Sample Generation Representing the English Population Using Spearman Rank Correlation and Chomsky Decomposition","volume":"21","author":"Martin","year":"2018","journal-title":"Value Health"},{"key":"ref_33","unstructured":"MathLab (2018, November 25). Normally Distributed Random Numbers. Available online: https:\/\/www.mathworks.com\/help\/matlab\/ref\/randn.html."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"740","DOI":"10.1016\/j.knosys.2010.12.010","article-title":"A novel virtual sample generation method based on Gaussian distribution","volume":"24","author":"Yang","year":"2011","journal-title":"Knowl. Based Syst."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"2146","DOI":"10.1007\/s10803-015-2379-8","article-title":"Use of Machine Learning to Identify Children with Autism and Their Motor Abnormalities","volume":"45","author":"Crippa","year":"2015","journal-title":"J. Autism Dev. Disord."},{"key":"ref_36","unstructured":"UCI (2019, November 25). UCI Machine Learning Repository. Available online: http:\/\/archive.ics.uci.edu\/ml\/datasets.php."},{"key":"ref_37","unstructured":"Lichman, M. (2019, November 25). UCI Machine Learning Repository. Available online: http:\/\/archive.ics.uci.edu\/ml."},{"key":"ref_38","unstructured":"MathLab (2019, November 25). Train Stacked Autoencoders for Image Classification. Available online: https:\/\/www.mathworks.com\/help\/deeplearning\/examples\/train-stacked-autoencoders-for-image-classification.html."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Kalchbrenner, N., Grefenstette, E., and Blunsom, P. (2014). A convolutional neural network for modelling sentences. arXiv.","DOI":"10.3115\/v1\/P14-1062"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/S0169-7439(97)00061-0","article-title":"Introduction to multi-layer feed-forward neural networks","volume":"39","author":"Svozil","year":"1997","journal-title":"Chemom. Intell. Lab. Syst."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/12\/8\/160\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:09:55Z","timestamp":1760188195000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/12\/8\/160"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,9]]},"references-count":40,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2019,8]]}},"alternative-id":["a12080160"],"URL":"https:\/\/doi.org\/10.3390\/a12080160","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,8,9]]}}}