{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,9]],"date-time":"2026-04-09T23:44:35Z","timestamp":1775778275329,"version":"3.50.1"},"reference-count":33,"publisher":"Walter de Gruyter GmbH","issue":"1","license":[{"start":{"date-parts":[[2024,6,1]],"date-time":"2024-06-01T00:00:00Z","timestamp":1717200000000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,6,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Urine sediment examination (USE) is an essential aspect in detecting urinary system diseases, and it is a prerequisite for diagnostic procedures. Urine images are complex, containing numerous particles, which makes a detailed analysis and interpretation challenging. It is crucial for both patients and medical professionals to conduct urine analysis automatically, quickly and inexpensively, without compromising reliability. In this paper, we present a deep multi-modal fusion system, commonly employed in artificial intelligence, capable of automatically distinguishing particles in urine sediment. To achieve this objective, we first created a new dataset comprising erythrocytes, leukocytes, yeast, epithelium, bacteria, crystals, cylinders, and other particles (such as sperm). The data were gathered from urinalysis requests made between July 2022 and September 2022 at the biochemistry laboratory of Fethi Sekin Medical Center Hospital. A dataset containing 8509 images was compiled using the Optika B293PLi microscope with trinocular brightfield. We propose a 5-step process for detecting particles in the dataset using a multi-modal fusion deep learning model: i) The obtained images were augmented by applying affine transformation. ii) To distinguish images, we opted for ResNet18 and ResNet50 models, which yielded high performance in medical data. iii) Feature vectors from both models were fused to generate more consistent, accurate, and useful particle features. iv) We employed ReliefF, Neighborhood Component Analysis (NCA), and Minimum-Redundancy Maximum-Relevancy (mRMR) feature selection methods, widely used to determine features that maximise particle discrimination success. v) In the final step, Support Vector Machine (SVM) was utilised to distinguish the particles. The results demonstrate that the highest accuracy value achieved is 98.54 % when employing the ReliefF algorithm. Contributions of the study include eliminating standardisation differences in manual microscopy, achieving high accuracy in particle discrimination, offering an artificial intelligence-based system applicable in laboratory environments, and providing the dataset as educational and practical material for biochemistry professionals.<\/jats:p>","DOI":"10.2478\/acss-2024-0005","type":"journal-article","created":{"date-parts":[[2024,8,15]],"date-time":"2024-08-15T03:25:55Z","timestamp":1723692355000},"page":"35-44","source":"Crossref","is-referenced-by-count":1,"title":["Deep Multi-Modal Fusion Model for Identification of Eight Different Particles in Urinary Sediment"],"prefix":"10.2478","volume":"29","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6472-8306","authenticated-orcid":false,"given":"Seda Arslan","family":"Tuncer","sequence":"first","affiliation":[{"name":"Firat University , El\u00e2z\u0131\u011f , Turkey"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5528-2226","authenticated-orcid":false,"given":"Ahmet","family":"\u00c7\u0131nar","sequence":"additional","affiliation":[{"name":"Firat University , El\u00e2z\u0131\u011f , Turkey"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2175-5667","authenticated-orcid":false,"given":"Merve","family":"Erku\u015f","sequence":"additional","affiliation":[{"name":"Firat University , El\u00e2z\u0131\u011f , Turkey"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0526-4526","authenticated-orcid":false,"given":"Taner","family":"Tuncer","sequence":"additional","affiliation":[{"name":"Firat University , El\u00e2z\u0131\u011f , Turkey"}]}],"member":"374","published-online":{"date-parts":[[2024,8,15]]},"reference":[{"key":"2026040922544117834_j_acss-2024-0005_ref_001","unstructured":"X. Zhang, G. Chen, K. Saruta, and Y. Terata, \u201cDetection and classification of RBCs and WBCs in urine analysis with deep network,\u201d in ACHI 2018: The Eleventh International Conference on Advances in Computer-Human Interactions, 2018, pp. 194\u2013198. [Online]. Available: https:\/\/personales.upv.es\/thinkmind\/dl\/conferences\/achi\/achi_2018\/achi_ 2018_10_30_20157.pdf"},{"key":"2026040922544117834_j_acss-2024-0005_ref_002","unstructured":"R. Kang, Y. Liang, C. Lian, and Y. Mao, \u201cCNN-based automatic urinary particles recognition\u201d, arXiv:1803.02699v1, 2018. [Online]. Available: https:\/\/www.academia.edu\/83267226\/CNN_Based_Automatic_Urinary_Particles_Recognition"},{"key":"2026040922544117834_j_acss-2024-0005_ref_003","unstructured":"T. Batur, E. \u00c7okluk, S. Aky\u00fcz, B. U\u00e7ar, H.H. Alp, and Z. Huyut, \u201cDiagnostic performance evaluation of complete urinalysis in the diagnosis of urinary tract infection: Complete urinalysis in the diagnosis of urinary tract infection,\u201d Chronicles of Precision Medical Researchers, vol. 3, no. 2, pp. 52\u201356, 2022. https:\/\/doi.org\/10.5281\/zenodo.6965805"},{"key":"2026040922544117834_j_acss-2024-0005_ref_004","doi-asserted-by":"crossref","unstructured":"F. D. \u0130nce, H. Y. Ellida\u011f, M. Koseo\u011flu, N. \u015eim\u015fek, H. Yal\u00e7\u0131n, and M. O. Zengin, \u201cThe comparison of automated urine analyzers with manual microscopic examination for urinalysis automated urine analyzers and manual urinalysis,\u201d Pract. Lab. Med., vol. 1, no. 5, pp. 14\u201320, Aug. 2016. https:\/\/doi.org\/10.1016\/j.plabm.2016.03.002","DOI":"10.1016\/j.plabm.2016.03.002"},{"key":"2026040922544117834_j_acss-2024-0005_ref_005","doi-asserted-by":"crossref","unstructured":"N. Sharda, O. Bakhtar, B. Thajudeen, E. Meister, and H. Szerlip, \u201cManual urine microscopy versus automated urine analyzer microscopy in patients with acute kidney injury,\u201d Laboratory Medicine, vol. 45, no. 4, pp. e152\u2013 e155, Nov. 2014. https:\/\/doi.org\/10.1309\/LMVJK6W4KQL1ZHKS","DOI":"10.1309\/LMVJK6W4KQL1ZHKS"},{"key":"2026040922544117834_j_acss-2024-0005_ref_006","doi-asserted-by":"crossref","unstructured":"F. Dong, Y. Yao, Y. Chen, Y. Guo, C. Jing, and J. Wu \u201cDiagnostic performance of urine analysis based on flow microimaging and artificial intelligence recognition technology in suspected urinary tract infection patients,\u201d Scandinavian Journal of Clinical and Laboratory Investigation, vol. 82, no. 5, pp. 385\u2013390, Jul. 2022. https:\/\/doi.org\/10.1080\/00365513.2022.2100273","DOI":"10.1080\/00365513.2022.2100273"},{"key":"2026040922544117834_j_acss-2024-0005_ref_007","doi-asserted-by":"crossref","unstructured":"J. Pan, C. Jiang, and T. Zhu, \u201cClassification of urine sediment based on convolution neural network,\u201d AIP Conference Proceedings, vol. 1955, no. 1, Apr. 2018, Art. no. 040176. https:\/\/doi.org\/10.1063\/1.5033840","DOI":"10.1063\/1.5033840"},{"key":"2026040922544117834_j_acss-2024-0005_ref_008","doi-asserted-by":"crossref","unstructured":"Q. Ji, X. Li, Z. Qu, and C. Dai, \u201cResearch on urine sediment images recognition based on deep learning,\u201d IEEE Access, vol. 7, pp. 166711\u2013 166720, Nov. 2019. https:\/\/doi.org\/10.1109\/ACCESS.2019.2953775","DOI":"10.1109\/ACCESS.2019.2953775"},{"key":"2026040922544117834_j_acss-2024-0005_ref_009","doi-asserted-by":"crossref","unstructured":"Y. Liang, Z. Tang, M. Yan, and J. Liu, \u201cObject detection based on deep learning for urine sediment examination,\u201d Biocybernetics and Biomedical Engineering, vol. 38, no. 3, pp. 661\u2013670, 2018. https:\/\/doi.org\/10.1016\/j.bbe.2018.05.004","DOI":"10.1016\/j.bbe.2018.05.004"},{"key":"2026040922544117834_j_acss-2024-0005_ref_010","doi-asserted-by":"crossref","unstructured":"S. Mondal, S. Park, T. H. Vo, J. Choi, V.H.M. Doan, D.T. Phan, C.-S. Kim, B.-il. Lee, and J. Oh, \u201cSmart inexpensive quantitative urine glucose and contaminant bromide ion sensor based on metal nanoparticles with deep learning approach,\u201d Materials Chemistry and Physics, vol. 287, Aug. 2022, Art. no. 126289. https:\/\/doi.org\/10.1016\/j.matchemphys.2022.126289","DOI":"10.1016\/j.matchemphys.2022.126289"},{"key":"2026040922544117834_j_acss-2024-0005_ref_011","doi-asserted-by":"crossref","unstructured":"K. Suhail and D. Brindha, \u201cA review on various methods for recognition of urine particles using digital microscopic images of urine sediments,\u201d Biomedical Signal Processing and Control, vol. 68, Jul. 2021, Art. no. 102806. https:\/\/doi.org\/10.1016\/j.bspc.2021.102806","DOI":"10.1016\/j.bspc.2021.102806"},{"key":"2026040922544117834_j_acss-2024-0005_ref_012","doi-asserted-by":"crossref","unstructured":"X. Liu and Z. Sun, \u201cA kind of computer microscopic urinary sediments analyzer by SVM,\u201d in 2008 International Workshop on Education Technology and Training & 2008 International Workshop on Geoscience and Remote Sensing, Shanghai, China, pp. 483\u2013486, Dec. 2008. https:\/\/doi.org\/10.1109\/ETTandGRS.2008.235","DOI":"10.1109\/ETTandGRS.2008.235"},{"key":"2026040922544117834_j_acss-2024-0005_ref_013","doi-asserted-by":"crossref","unstructured":"M. -l. Shen and R. Zhang, \u201cUrine sediment recognition method based on SVM and AdaBoost,\u201d in International Conference on Computational Intelligence and Software Engineering, Wuhan, China, Dec. 2009, pp. 1\u20134. https:\/\/doi.org\/10.1109\/CISE.2009.5365881","DOI":"10.1109\/CISE.2009.5365881"},{"key":"2026040922544117834_j_acss-2024-0005_ref_014","doi-asserted-by":"crossref","unstructured":"X. Zhou, X. Xiao, and C. Ma, \u201cA study of automatic recognition and counting system of urine-sediment visual components,\u201d in 2010 3rd International Conference on Biomedical Engineering and Informatics, Yantai, China, Oct. 2010, pp. 78\u201381. https:\/\/doi.org\/10.1109\/BMEI.2010.5639648","DOI":"10.1109\/BMEI.2010.5639648"},{"key":"2026040922544117834_j_acss-2024-0005_ref_015","doi-asserted-by":"crossref","unstructured":"W. Tangsuksant, C. Pintavirooj, S. Taertulakarn, and S. Daochai, \u201cDevelopment algorithm to count blood cells in urine sediment using ANN and Hough Transform,\u201d in The 6th 2013 Biomedical Engineering International Conference, Amphur Muang, Thailand, Oct. 2013, pp. 1\u20134. https:\/\/doi.org\/10.1109\/BMEiCon.2013.6687725","DOI":"10.1109\/BMEiCon.2013.6687725"},{"key":"2026040922544117834_j_acss-2024-0005_ref_016","doi-asserted-by":"crossref","unstructured":"D. Avci, M.K. Leblebicioglu, M. Poyraz, and E. Dogantekin, \u201cA new method based on adaptive discrete wavelet entropy energy and neural network classifier (ADWEENN) for recognition of urine cells from microscopic images independent of rotation and scaling,\u201d J. Med. Syst., vol. 38, no. 7, Feb. 2014. https:\/\/doi.org\/10.1007\/s10916-014-0007-3","DOI":"10.1007\/s10916-014-0007-3"},{"key":"2026040922544117834_j_acss-2024-0005_ref_017","doi-asserted-by":"crossref","unstructured":"C. Li, Y.Y. Tang, H. Luo, and X. Zheng, \u201cJoin Gabor and scattering transform for urine sediment particle texture analysis,\u201d in 2015 IEEE 2nd International Conference on Cybernetics (CYBCONF), Gdynia, Poland, Jun. 2015, pp. 410\u2013415. https:\/\/doi.org\/10.1109\/CYBConf.2015.7175969","DOI":"10.1109\/CYBConf.2015.7175969"},{"key":"2026040922544117834_j_acss-2024-0005_ref_018","doi-asserted-by":"crossref","unstructured":"Q. Sun, S. Yang, C. Sun, and W. Yang, \u201cAn automatic method for red blood cells detection in urine sediment micrograph,\u201d in 2018 33rd Youth Academic Annual Conference of Chinese Association of Automation (YAC), Nanjing, China, May 2018, pp. 241\u2013245. https:\/\/doi.org\/10.1109\/YAC.2018.8406379","DOI":"10.1109\/YAC.2018.8406379"},{"key":"2026040922544117834_j_acss-2024-0005_ref_019","doi-asserted-by":"crossref","unstructured":"X. Jiang, F. Chen, Q. Chen, M. Si, and W. Wang, \u201cTexture segmentation of urinary sediment image based on a weighted Gaussian mixture model with Markov random fields,\u201d in Proceedings of the 2018 7th International Conference on Bioinformatics and Biomedical Science (ICBBS '18), New York, NY, USA, Jun. 2018, pp. 82\u201387. https:\/\/doi.org\/10.1145\/3239264.3239276","DOI":"10.1145\/3239264.3239276"},{"key":"2026040922544117834_j_acss-2024-0005_ref_020","doi-asserted-by":"crossref","unstructured":"T. H. N. Le, Y. Zheng, C. Zhu, K. Luu, and M. Savvides, \u201cMultiple scale faster-RCNN approach to driver\u2019s cell-phone usage and hands on steering wheel detection,\u201d in 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Las Vegas, NV, USA, 2016, pp. 46\u201353.","DOI":"10.1109\/CVPRW.2016.13"},{"key":"2026040922544117834_j_acss-2024-0005_ref_021","doi-asserted-by":"crossref","unstructured":"A. Shrivastava, A. Gupta, and R. Girshick, \u201cTraining region-based object detectors with online hard example mining,\u201d in Proceedings of the IEEE International Conference on Computer Vision, Jun. 2016, pp. 1440\u20131448. https:\/\/doi.org\/10.1109\/CVPR.2016.89","DOI":"10.1109\/CVPR.2016.89"},{"key":"2026040922544117834_j_acss-2024-0005_ref_022","doi-asserted-by":"crossref","unstructured":"K. Suhail and D. Brindha, \u201cMicroscopic urinary particle detection by different YOLOv5 models with evolutionary genetic algorithm based hyperparameter optimization,\u201d Computers in Biology and Medicine, vol. 169, Feb. 2024, Art. no. 107895. https:\/\/doi.org\/10.1016\/j.compbiomed.2023.107895","DOI":"10.1016\/j.compbiomed.2023.107895"},{"key":"2026040922544117834_j_acss-2024-0005_ref_023","doi-asserted-by":"crossref","unstructured":"A. \u00c7\u0131nar, M. Erku\u015f, T. Tuncer, H. Ayy\u0131ld\u0131z, and S.A. Tuncer, \u201cYOLOv5 based detector for eight different urine particles components on single board computer,\u201d International Journal of Imaging Systems and Technology, vol. 34, no. 1, Jan. 2024, Art. no. e22968. https:\/\/doi.org\/10.1002\/ima.22968","DOI":"10.1002\/ima.22968"},{"key":"2026040922544117834_j_acss-2024-0005_ref_024","unstructured":"X. Zhang, G. Chen, K. Saruta, and Y. Terata, \u201cDetection and classification of RBCs and WBCs in urine analysis with deep network,\u201d in The Eleventh International Conference on Advances in Computer-Human Interactions, 2018, pp. 194\u2013198."},{"key":"2026040922544117834_j_acss-2024-0005_ref_025","doi-asserted-by":"crossref","unstructured":"T. Li, D. Jin, C. Du, X. Cao, H. Chen, J. Yan, N. Chen, Z. Chen, Z. Feng, and S. Liu, \u201cThe image-based analysis and classification of urine sediments using a LeNet-5 neural network,\u201d Computer Methods in Biomechanics and Biomedical Engineering: Imaging\\Visualization, vol. 8, no. 1, pp. 109\u2013114, 2020. https:\/\/doi.org\/10.1080\/21681163.2019.1608307","DOI":"10.1080\/21681163.2019.1608307"},{"key":"2026040922544117834_j_acss-2024-0005_ref_026","doi-asserted-by":"crossref","unstructured":"T. Nagai, O. Onodera, and S. Okuda, \u201cDeep learning classification of urinary sediment crystals with optimal parameter tuning,\u201d Sci. Rep., vol. 12, Dec. 2022, Art. no. 21178. https:\/\/doi.org\/10.1038\/s41598-022-25385-x","DOI":"10.1038\/s41598-022-25385-x"},{"key":"2026040922544117834_j_acss-2024-0005_ref_027","doi-asserted-by":"crossref","unstructured":"Q. Ji, Y. Jiang, Z. Wu, Q. Liu, and L. Qu, \u201cAn image recognition method for urine sediment based on semi-supervised learning,\u201d IRBM, vol. 44, no. 2, Apr. 2022, Art. no. 100739. https:\/\/doi.org\/10.1016\/j.irbm.2022.09.006","DOI":"10.1016\/j.irbm.2022.09.006"},{"key":"2026040922544117834_j_acss-2024-0005_ref_028","doi-asserted-by":"crossref","unstructured":"W. Liu, W. Li, and W. Gong, \u201cEnsemble of fine-tuned convolutional neural networks for urine sediment microscopic image classification,\u201d IET Computer Vision, vol. 14, no. 1, pp. 18\u201325, Feb. 2020. https:\/\/doi.org\/10.1049\/iet-cvi.2018.5829","DOI":"10.1049\/iet-cvi.2018.5829"},{"key":"2026040922544117834_j_acss-2024-0005_ref_029","doi-asserted-by":"crossref","unstructured":"H. Kaiming, X. Zhang, S. Ren, and J. Sun, \u201cDeep residual learning for image recognition,\u201d in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 770\u2013778. [Online]. Available: https:\/\/www.cv-foundation.org\/openaccess\/content_cvpr_2016\/papers\/He_Deep_Residu al_Learning_CVPR_2016_paper.pdf","DOI":"10.1109\/CVPR.2016.90"},{"key":"2026040922544117834_j_acss-2024-0005_ref_030","doi-asserted-by":"crossref","unstructured":"\u00c7. Danac\u0131 and S.A. Tuncer, \u201cIncorporating feature selection methods into machine learning-based Covid-19 diagnosis,\u201d Applied Computer Systems, vol. 27, no. 1, pp. 13\u201318, Jun. 2022. https:\/\/doi.org\/10.2478\/acss-2022-0002","DOI":"10.2478\/acss-2022-0002"},{"key":"2026040922544117834_j_acss-2024-0005_ref_031","doi-asserted-by":"crossref","unstructured":"C. Ding and H. Peng, \u201cMinimum redundancy feature selection from microarray gene expression data,\u201d Journal of Bioinformatics and Computational Biology, vol. 3, no. 2, pp. 185\u2013205, 2005. https:\/\/doi.org\/10.1142\/S0219720005001004","DOI":"10.1142\/S0219720005001004"},{"key":"2026040922544117834_j_acss-2024-0005_ref_032","doi-asserted-by":"crossref","unstructured":"W. Yang, K. Wang, and W. Zuo, \u201cNeighborhood component feature selection for high-dimensional data,\u201d Journal of Computers, vol. 7, no. 1, pp. 161\u2013168, Jan. 2012.","DOI":"10.4304\/jcp.7.1.161-168"},{"key":"2026040922544117834_j_acss-2024-0005_ref_033","doi-asserted-by":"crossref","unstructured":"M. Robnik-Sikonja and I. Kononenko, \u201cTheoretical and empirical analysis of ReliefF and RReliefF,\u201d Machine Learning, vol. 53, pp. 23\u201369, Oct. 2003. https:\/\/doi.org\/10.1023\/A:1025667309714","DOI":"10.1023\/A:1025667309714"}],"container-title":["Applied Computer Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/reference-global.com\/pdf\/10.2478\/acss-2024-0005","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,9]],"date-time":"2026-04-09T22:54:55Z","timestamp":1775775295000},"score":1,"resource":{"primary":{"URL":"https:\/\/reference-global.com\/article\/10.2478\/acss-2024-0005"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,1]]},"references-count":33,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,8,15]]},"published-print":{"date-parts":[[2024,6,1]]}},"alternative-id":["10.2478\/acss-2024-0005"],"URL":"https:\/\/doi.org\/10.2478\/acss-2024-0005","relation":{},"ISSN":["2255-8691"],"issn-type":[{"value":"2255-8691","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,1]]}}}