{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:27:17Z","timestamp":1760239637809,"version":"build-2065373602"},"reference-count":31,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2020,12,16]],"date-time":"2020-12-16T00:00:00Z","timestamp":1608076800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006261","name":"Taif University","doi-asserted-by":"publisher","award":["TURSP-2020\/231"],"award-info":[{"award-number":["TURSP-2020\/231"]}],"id":[{"id":"10.13039\/501100006261","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Deep Learning algorithms are becoming common in solving different supervised and unsupervised learning problems. Different deep learning algorithms were developed in last decade to solve different learning problems in different domains such as computer vision, speech recognition, machine translation, etc. In the research field of computer vision, it is observed that deep learning has become overwhelmingly popular. In solving computer vision related problems, we first take a CNN (Convolutional Neural Network) which is trained from scratch or some times a pre-trained model is taken and further fine-tuned based on the dataset that is available. The problem of training the model from scratch on new datasets suffers from catastrophic forgetting. Which means that when a new dataset is used to train the model, it forgets the knowledge it has obtained from an existing dataset. In other words different datasets does not help the model to increase its knowledge. The problem with the pre-trained models is that mostly CNN models are trained on open datasets, where the data set contains instances from specific regions. This results into predicting disturbing labels when the same model is used for instances of datasets collected in a different region. Therefore, there is a need to find a solution on how to reduce the gap of Geo-diversity in different computer vision problems in developing world. In this paper, we explore the problems of models that were trained from scratch along with models which are pre-trained on a large dataset, using a dataset specifically developed to understand the geo-diversity issues in open datasets. The dataset contains images of different wedding scenarios in South Asian countries. We developed a Lifelong CNN that can incrementally increase knowledge i.e., the CNN learns labels from the new dataset but includes the existing knowledge of open data sets. The proposed model demonstrates highest accuracy compared to models trained from scratch or pre-trained model.<\/jats:p>","DOI":"10.3390\/sym12122094","type":"journal-article","created":{"date-parts":[[2020,12,16]],"date-time":"2020-12-16T22:12:06Z","timestamp":1608156726000},"page":"2094","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Lifelong Machine Learning for Regional-Based Image Classification in Open Datasets"],"prefix":"10.3390","volume":"12","author":[{"given":"Hashem","family":"Alyami","sequence":"first","affiliation":[{"name":"Department of Computer Science, College of Computers and Information Technology, Taif University, P.O. Box 11099, Taif 21944, Saudi Arabia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Abdullah","family":"Alharbi","sequence":"additional","affiliation":[{"name":"Department of Information Technology, College of Computers and Information Technology, Taif University, P.O. Box 11099, Taif 21944, Saudi Arabia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1355-3881","authenticated-orcid":false,"given":"Irfan","family":"Uddin","sequence":"additional","affiliation":[{"name":"Institute of Computing, Kohat University of Science and Technology, Kohat 26000, Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,12,16]]},"reference":[{"key":"ref_1","unstructured":"Shankar, S., Halpern, Y., Breck, E., Atwood, J., Wilson, J., and Sculley, D. (2017). No Classification without Representation: Assessing Geodiversity Issues in Open Data Sets for the Developing World. arXiv."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1109\/72.554195","article-title":"Face recognition: A convolutional neural-network approach","volume":"8","author":"Lawrence","year":"1997","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Bobi\u0107, V.N., Tadi\u0107, P.R., and Kvascev, G. (2016, January 22\u201324). Hand gesture recognition using neural network based techniques. Proceedings of the 2016 13th Symposium on Neural Networks and Applications (NEUREL), Belgrade, Serbia.","DOI":"10.1109\/NEUREL.2016.7800104"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Gu, J., Wang, G., Cai, J., and Chen, T. (2017, January 22\u201329). An Empirical Study of Language CNN for Image Captioning. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.138"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","article-title":"ImageNet Large Scale Visual Recognition Challenge","volume":"115","author":"Russakovsky","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Awasthi, A., and Sarawagi, S. (2019, January 3\u20135). Continual Learning with Neural Networks: A Review. Proceedings of the ACM India Joint International Conference on Data Science and Management of Data, Kolkata, India.","DOI":"10.1145\/3297001.3297062"},{"key":"ref_8","unstructured":"Silver, D.L., Yang, Q., and Li, L. (2013). Lifelong Machine Learning Systems: Beyond Learning Algorithms, AAAI."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Sultana, F., Sufian, A., and Dutta, P. (2018, January 19). Advancements in Image Classification using Convolutional Neural Network. Proceedings of the 2018 Fourth International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN), Copenhagen, Denmark.","DOI":"10.1109\/ICRCICN.2018.8718718"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"941","DOI":"10.3389\/fpls.2019.00941","article-title":"Convolutional Neural Networks for the Automatic Identification of Plant Diseases","volume":"10","author":"Boulent","year":"2019","journal-title":"Front. Plant Sci."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Jmour, N., Zayen, S., and Abdelkrim, A. (2018, January 22\u201325). Convolutional neural networks for image classification. Proceedings of the 2018 International Conference on Advanced Systems and Electric Technologies, Hammamet, Tunisia.","DOI":"10.1109\/ASET.2018.8379889"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1016\/j.procs.2018.05.198","article-title":"An Analysis Of Convolutional Neural Networks For Image Classification","volume":"132","author":"Sharma","year":"2018","journal-title":"Procedia Comput. Sci."},{"key":"ref_13","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet Classification with Deep Convolutional Neural Networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_15","unstructured":"He, T., Zhang, Z., Zhang, H., Zhang, Z., Xie, J., and Li, M. (2017, January 21\u201326). Bag of Tricks for Image Classification with Convolutional Neural Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Lee, S., Stokes, J., and Eaton, E. (2019, January 10\u201316). Learning Shared Knowledge for Deep Lifelong Learning using Deconvolutional Networks. Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI-19, Macao, China.","DOI":"10.24963\/ijcai.2019\/393"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Yang, K., Qinami, K., Li, F.-F., Deng, J., and Russakovsky, O. (2020, January 27\u201330). Towards Fairer Datasets: Filtering and Balancing the Distribution of the People Subtree in the ImageNet Hierarchy. Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (FAT*\u201920), Barcelona, Spain.","DOI":"10.1145\/3351095.3375709"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Jia, Y., Batra, N., Wang, H., and Whitehouse, K. (2019, January 17). A Tree-Structured Neural Network Model for Household Energy Breakdown. Proceedings of the World Wide Web Conference, New York, NY, USA.","DOI":"10.1145\/3308558.3313405"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1186\/s13638-018-1197-z","article-title":"Tree-CNN: From generalization to specialization","volume":"2018","author":"Jiang","year":"2018","journal-title":"EURASIP J. Wirel. Commun. Netw."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2020\/7490840","article-title":"An Improved Deep Residual Network-Based Semantic Simultaneous Localization and Mapping Method for Monocular Vision Robot","volume":"2020","author":"Ni","year":"2020","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2020\/6503459","article-title":"Using Harmony Search Algorithm in Neural Networks to Improve Fraud Detection in Banking System","volume":"2020","author":"Daliri","year":"2020","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_22","first-page":"1","article-title":"Anomaly Detection in EEG Signals: A Case Study on Similarity Measure","volume":"2020","author":"Chen","year":"2020","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_23","first-page":"1","article-title":"An Overview of Image Caption Generation Methods","volume":"2020","author":"Wang","year":"2020","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"Lecun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015). Deep Residual Learning for Image Recognition. arXiv.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1109\/72.279181","article-title":"Learning Long-term Dependencies with Gradient Descent is Difficult","volume":"5","author":"Bengio","year":"1994","journal-title":"Trans. Neur. Netw."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27\u201330). Rethinking the Inception Architecture for Computer Vision. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.neunet.2019.09.010","article-title":"Tree-CNN: A hierarchical Deep Convolutional Neural Network for incremental learning","volume":"121","author":"Roy","year":"2020","journal-title":"Neural Netw."},{"key":"ref_29","unstructured":"Kingma, D.P., and Ba, J. (2015, January 7\u20139). Adam: A Method for Stochastic Optimization, 2014. Proceedings of the 3rd International Conference for Learning Representations, San Diego, CA, USA."},{"key":"ref_30","unstructured":"Glorot, X., and Bengio, Y. (2010, January 13\u201315). Understanding the difficulty of training deep feedforward neural networks. Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS\u201910), Sardinia, Italy."},{"key":"ref_31","unstructured":"Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., and Isard, M. (2016, January 4). TensorFlow: A System for Large-scale Machine Learning. Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation, Berkeley, CA, USA."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/12\/2094\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:46:07Z","timestamp":1760179567000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/12\/2094"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,16]]},"references-count":31,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["sym12122094"],"URL":"https:\/\/doi.org\/10.3390\/sym12122094","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2020,12,16]]}}}