{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T14:03:51Z","timestamp":1760709831144,"version":"build-2065373602"},"reference-count":38,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2019,2,15]],"date-time":"2019-02-15T00:00:00Z","timestamp":1550188800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["NRF- 2017R1D1A1B03028417","NRF-2016M3A9E1915855"],"award-info":[{"award-number":["NRF- 2017R1D1A1B03028417","NRF-2016M3A9E1915855"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Automatic sorting of banknotes in payment facilities, such as automated payment machines or vending machines, consists of many tasks such as recognition of banknote type, classification of fitness for recirculation, and counterfeit detection. Previous studies addressing these problems have mostly reported separately on each of these classification tasks and for a specific type of currency only. In other words, there has been little research conducted considering a combination of these multiple tasks, such as classification of banknote denomination and fitness of banknotes, as well as considering a multinational currency condition of the method. To overcome this issue, we propose a multinational banknote type and fitness classification method that both recognizes the denomination and input direction of banknotes and determines whether the banknote is suitable for reuse or should be replaced by a new one. We also propose a method for estimating the fitness value of banknotes and the consistency of the estimation results among input trials of a banknote. Our method is based on a combination of infrared-light transmission and visible-light reflection images of the input banknote and uses deep-learning techniques with a convolutional neural network. The experimental results on a dataset composed of Indian rupee (INR), Korean won (KRW), and United States dollar (USD) banknote images with mixture of two and three fitness levels showed that the proposed method gives good performance in the combination condition of currency types and classification tasks.<\/jats:p>","DOI":"10.3390\/s19040792","type":"journal-article","created":{"date-parts":[[2019,2,17]],"date-time":"2019-02-17T22:11:50Z","timestamp":1550441510000},"page":"792","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Deep Learning-Based Multinational Banknote Type and Fitness Classification with the Combined Images by Visible-Light Reflection and Infrared-Light Transmission Image Sensors"],"prefix":"10.3390","volume":"19","author":[{"given":"Tuyen Danh","family":"Pham","sequence":"first","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 100-715, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dat Tien","family":"Nguyen","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 100-715, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chanhum","family":"Park","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 100-715, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kang Ryoung","family":"Park","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 100-715, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,2,15]]},"reference":[{"key":"ref_1","first-page":"77","article-title":"A Review: Paper currency recognition","volume":"3","author":"Bala","year":"2014","journal-title":"Int. J. Emerg. Res. Manag. Technol."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Lee, J.W., Hong, H.G., Kim, K.W., and Park, K.R. (2017). A survey on banknote recognition methods by various sensors. Sensors, 17.","DOI":"10.3390\/s17020313"},{"key":"ref_3","first-page":"4418","article-title":"Currency recognition using image processing","volume":"3","author":"Bhurke","year":"2015","journal-title":"Int. J. Innov. Res. Comput. Commun. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/j.neucom.2013.02.029","article-title":"Employing quaternion wavelet transform for banknote classification","volume":"118","author":"Gai","year":"2013","journal-title":"Neurocomputing"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Pham, T.D., Park, Y.H., Kwon, S.Y., Park, K.R., Jeong, D.S., and Yoon, S. (2016). Efficient banknote recognition based on selection of discriminative regions with one-dimensional visible-light line sensor. Sensors, 16.","DOI":"10.3390\/s16030328"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/j.patcog.2017.06.027","article-title":"Banknote recognition based on optimization of discriminative regions by genetic algorithm with one-dimensional visible-light line sensor","volume":"72","author":"Pham","year":"2017","journal-title":"Pattern Recognit."},{"key":"ref_7","unstructured":"Takeda, F., Nishikage, T., and Matsumoto, Y. (1998, January 4\u20139). Characteristics Extraction of Paper Currency Using Symmetrical Masks Optimized by GA and Neuro-Recognition of Multi-national Paper Currency. Proceedings of the IEEE International Joint Conference on Neural Networks, Anchorage, AK, USA."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.neucom.2015.01.014","article-title":"Efficient multi-currency classification of CIS banknotes","volume":"156","author":"Youn","year":"2015","journal-title":"Neurocomputing"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Pham, T.D., Lee, D.E., and Park, K.R. (2017). Multi-national banknote classification based on visible-light line sensor and convolutional neural network. Sensors, 17.","DOI":"10.3390\/s17071595"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"10105","DOI":"10.1016\/j.eswa.2009.01.057","article-title":"Using hidden Markov models for paper currency recognition","volume":"36","author":"Hassanpour","year":"2009","journal-title":"Expert Syst. Appl."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Pham, T.D., Nguyen, D.T., Kang, J.K., and Park, K.R. (2018). Deep learning-based multinational banknote fitness classification with a combination of visible-light reflection and infrared-light transmission images. Symmetry, 10.","DOI":"10.3390\/sym10100431"},{"key":"ref_12","unstructured":"Lee, S., Baek, S., Choi, E., Baek, Y., and Lee, C. (2017, January 8\u201310). Soiled banknote fitness determination based on morphology and Otsu\u2019s thresholding. Proceedings of the IEEE International Conference on Consumer Electronics, Las Vegas, NV, USA."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","article-title":"A threshold selection method from gray-level histograms","volume":"9","author":"Otsu","year":"1979","journal-title":"IEEE Trans. Sys. Man. Cyber."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Kwon, S.Y., Pham, T.D., Park, K.R., Jeong, D.S., and Yoon, S. (2016). Recognition of banknote fitness based on a fuzzy system using visible light reflection and near-infrared light transmission images. Sensors, 16.","DOI":"10.3390\/s16060863"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Pham, T.D., Nguyen, D.T., Kim, W., Park, S.H., and Park, K.R. (2018). Deep learning-based banknote fitness classification using the reflection images by a visible-light one-dimensional line image sensor. Sensors, 18.","DOI":"10.3390\/s18020472"},{"key":"ref_16","first-page":"99","article-title":"Euro banknote recognition system using a three-layered perceptron and RBF networks","volume":"44","author":"Aoba","year":"2003","journal-title":"IPSJ Trans. Math. Model. Appl."},{"key":"ref_17","unstructured":"Nanni, L., Ghidoni, S., and Brahnam, S. (2018). Ensemble of convolutional neural networks for bioimage classification. Appl. Comput Inform., in press."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1109\/MSP.2017.2749125","article-title":"Advanced deep-learning techniques for salient and category-specific object detection: A survey","volume":"35","author":"Han","year":"2018","journal-title":"IEEE Signal Process Mag."},{"key":"ref_19","first-page":"1","article-title":"Deep learning for computer vision: A brief review","volume":"2018","author":"Voulodimos","year":"2018","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_20","unstructured":"(2018, December 31). Dongguk Banknote Type and Fitness Database (DF-DB3) & CNN Model with Algorithms. Available online: http:\/\/dm.dgu.edu\/link.html."},{"key":"ref_21","unstructured":"(2018, December 31). Newton. Available online: http:\/\/kisane.com\/our-service\/newton\/."},{"key":"ref_22","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20138). ImageNet Classification with Deep Convolutional Neural Networks. Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going Deeper with Convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_25","unstructured":"Glorot, X., Bordes, A., and Bengio, Y. (2011, January 11\u201313). Deep Sparse Rectifier Neural Networks. Proceedings of the 14th International Conference on Artificial Intelligence and Statistics, Fort Lauderdale, FL, USA."},{"key":"ref_26","unstructured":"Ioffe, S., and Szegedy, C. (2015, January 6\u201311). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. Proceedings of the International Conference on Machine Learning, Lille, France."},{"key":"ref_27","first-page":"1929","article-title":"Dropout: A simple way to prevent neural networks from overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_28","unstructured":"Bishop, C.M. (2006). Pattern Recognition and Machine Learning, Springer."},{"key":"ref_29","unstructured":"Cui, J., Wang, Y., Huang, J., Tan, T., and Sun, Z. (2004, January 23\u201326). An Iris Image Synthesis Method based on PCA and Super-Resolution. Proceedings of the International Conference on Pattern Recognition, Cambridge, UK."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J., Zhou, T., and Efros, A.A. (2017, January 21\u201326). Image-to-Image Translation with Conditional Adversarial Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Zhu, J., Park, T., Isola, P., and Efros, A.A. (2017, January 22\u201329). Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.244"},{"key":"ref_32","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of the 3rd International Conference on Learning Representations, San Diego, CA, USA."},{"key":"ref_33","unstructured":"(2018, December 31). Pretrained Convolutional Neural Networks\u2014MATLAB & Simulink. Available online: https:\/\/www.mathworks.com\/help\/deeplearning\/ug\/pretrained-convolutional-neural-networks.html."},{"key":"ref_34","unstructured":"(2018, December 31). Deep Learning with Images\u2014MATLAB & Simulink. Available online: https:\/\/www.mathworks.com\/help\/deeplearning\/deep-learning-with-images.html."},{"key":"ref_35","unstructured":"(2018, December 31). Intel\u00ae CoreTM i7-3770K Processor (8 M Cache, up to 3.90 GHz) Product Specifications. Available online: https:\/\/ark.intel.com\/products\/65523\/Intel-Core-i7-3770K-Processor-8M-Cache-up-to-3_90-GHz."},{"key":"ref_36","unstructured":"(2018, December 31). GeForce GTX 1070. Available online: https:\/\/www.nvidia.com\/en-us\/geforce\/products\/10series\/geforce-gtx-1070-ti\/#specs."},{"key":"ref_37","unstructured":"Kohavi, R. (1995, January 20\u201325). A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection. Proceedings of the International Joint Conference on Artificial Intelligence, Montreal, QC, Canada."},{"key":"ref_38","unstructured":"Schindler, A., Lidy, T., and Rauber, A. (2016, January 23\u201324). Comparing Shallow versus Deep Neural Network Architectures for Automatic Music Genre Classification. Proceedings of the Forum Media Technology 2016, St. Polten, Austria."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/4\/792\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:32:22Z","timestamp":1760185942000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/4\/792"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,2,15]]},"references-count":38,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2019,2]]}},"alternative-id":["s19040792"],"URL":"https:\/\/doi.org\/10.3390\/s19040792","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2019,2,15]]}}}