{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T05:25:01Z","timestamp":1779254701877,"version":"3.51.4"},"reference-count":46,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2021,4,25]],"date-time":"2021-04-25T00:00:00Z","timestamp":1619308800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Research Foundation of Korea (NRF) funded by the Ministry of Education","award":["2019R1I1A3A01042506"],"award-info":[{"award-number":["2019R1I1A3A01042506"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The deep random forest (DRF) has recently gained new attention in deep learning because it has a high performance similar to that of a deep neural network (DNN) and does not rely on a backpropagation. However, it connects a large number of decision trees to multiple layers, thereby making analysis difficult. This paper proposes a new method for simplifying a black-box model of a DRF using a proposed rule elimination. For this, we consider quantifying the feature contributions and frequency of the fully trained DRF in the form of a decision rule set. The feature contributions provide a basis for determining how features affect the decision process in a rule set. Model simplification is achieved by eliminating unnecessary rules by measuring the feature contributions. Consequently, the simplified and transparent DRF has fewer parameters and rules than before. The proposed method was successfully applied to various DRF models and benchmark sensor datasets while maintaining a robust performance despite the elimination of a large number of rules. A comparison with state-of-the-art compressed DNNs also showed the proposed model simplification\u2019s higher parameter compression and memory efficiency with a similar classification accuracy.<\/jats:p>","DOI":"10.3390\/s21093004","type":"journal-article","created":{"date-parts":[[2021,4,25]],"date-time":"2021-04-25T22:31:39Z","timestamp":1619389899000},"page":"3004","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Model Simplification of Deep Random Forest for Real-Time Applications of Various Sensor Data"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7452-3897","authenticated-orcid":false,"given":"Sangwon","family":"Kim","sequence":"first","affiliation":[{"name":"Department of Computer Engineering, Keimyung University, Daegu 42601, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7284-0768","authenticated-orcid":false,"given":"Byoung-Chul","family":"Ko","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Keimyung University, Daegu 42601, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jaeyeal","family":"Nam","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Keimyung University, Daegu 42601, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,4,25]]},"reference":[{"key":"ref_1","unstructured":"Marcus, G. (2018). Deep Learning: A Critical Appraisal. arXiv."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Chen, Y., Wang, N., and Zhang, Z. (2018, January 2\u20137). Darkrank: Accelerating deep metric learning via cross sample similarities transfer. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI), New Orleans, FL, USA.","DOI":"10.1609\/aaai.v32i1.11783"},{"key":"ref_3","unstructured":"Hinton, G.E., Vinyals, O., and Dean, J. (2015). Distilling the knowledge in a neural network. arXiv."},{"key":"ref_4","unstructured":"Wang, Y., Xu, C., Xu, C., Xu, C., and Tao, D. (2018, January 2\u20138). Learning Versatile Filters for Efficient Convolutional Neural Networks. Proceedings of the Thirty-Second Annual Conference on Neural Information Processing Systems (NeurIPS), Montr\u00e9al, QC, Canada."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Tung, F., and Mori, G. (2018, January 18\u201322). CLIP-Q: Deep Network Compression Learning by In-Parallel Pruning-Quantization. Proceedings of the 2018 IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00821"},{"key":"ref_6","first-page":"12315","article-title":"Fast Pedestrian Detection in Surveillance Video Based on Soft Target Training of Shallow Random Forest","volume":"7","author":"Kim","year":"2019","journal-title":"IEEE Access"},{"key":"ref_7","unstructured":"Miller, K., Hettinger, C., Humpherys, J., Jarvis, T., and Kartchner, D. (2017). Forward Thinking: Building Deep Random Forests. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhou, Z.H., and Feng, J. (2017, January 19\u201325). Deep forest: Towards an alternative to deep neural networks. Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence (IJCAI), Melbourne, Australia.","DOI":"10.24963\/ijcai.2017\/497"},{"key":"ref_9","unstructured":"David, G. (2020, November 08). Explainable Artificial Intelligence (XAI). Available online: https:\/\/www.darpa.mil\/program\/explainable-artificial-intelligence."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1007\/978-3-030-28954-6_16","article-title":"Understanding Patch-Based Learning of Video Data by Explaining Predictions","volume":"11700","author":"Anders","year":"2019","journal-title":"Lecture Notes Comput. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pone.0130140","article-title":"On Pixel-wise Explanations for Non-Linear Classifier Decisions by Layer-wise Relevance Propagation","volume":"10","author":"Bach","year":"2015","journal-title":"PLoS ONE"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1016\/j.patcog.2016.11.008","article-title":"Explaining non-linear classification decisions with deep Taylor decomposition","volume":"65","author":"Montavon","year":"2017","journal-title":"Pattern Recog."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.dsp.2017.10.011","article-title":"Methods for interpreting and understanding deep neural networks","volume":"73","author":"Montavon","year":"2018","journal-title":"Dig. Sig. Proc."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 21\u201326). Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/ICCV.2017.74"},{"key":"ref_15","unstructured":"Biran, O., and Cotton, C. (2017, January 19\u201325). Explanation and Justification in Machine Learning: A Survey. Proceedings of the Twenty-Sixth International Conference on Artificial Intelligence Workshop (IJCAIW), Melbourne, Australia."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Kim, S., Jeong, M., and Ko, B.C. (2020). Interpretation and Simplification of Deep Forest. TechRxiv, TechRxiv:techrxiv.11661246.v1.","DOI":"10.36227\/techrxiv.11661246.v1"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2189","DOI":"10.1109\/TPAMI.2013.35","article-title":"Learning AND-OR templates for object recognition and detection","volume":"35","author":"Si","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Machine Intell."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/1752-0509-8-S3-S1","article-title":"Learning accurate and interpretable models based on regularized random forests regression","volume":"8","author":"Liu","year":"2014","journal-title":"BMC Syst. Biol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1350","DOI":"10.1214\/15-AOAS848","article-title":"Interpretable classifiers using rules and Bayesian analysis: Building a better stroke prediction model","volume":"9","author":"Letham","year":"2015","journal-title":"Ann. Appl. Stat."},{"key":"ref_20","unstructured":"Lakkaraju, H., Bach, S.H., and Leskovec, J. (2019, January 4\u20138). Interpretable decision sets: A joint frame-work for description and prediction. Proceedings of the ACM International Conference Knowledge Discovery and Data Mining (KDD), Anchorage, AK, USA."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yang, H., Rudin, C., and Seltzer, M. (2017, January 11\u201315). Scalable Bayesian Rule Lists. Proceedings of the International Conference on Machine Learning (ICML), Sydney, Australia.","DOI":"10.32614\/CRAN.package.sbrl"},{"key":"ref_22","first-page":"1","article-title":"Enhancing Explainability of Neural Networks through Architecture Constraints","volume":"1","author":"Yang","year":"2020","journal-title":"IEEE Trans. on Neur. Netw. Learn. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"42200","DOI":"10.1109\/ACCESS.2020.2976199","article-title":"Explainable Machine Learning for Scientific Insights and Discoveries","volume":"8","author":"Roscher","year":"2020","journal-title":"IEEE Access"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Jeong, M., Park, M., and Ko, B.C. (2019, January 22\u201325). Intelligent Driver Emotion Monitoring Based on Lightweight Multilayer Random Forests. Proceedings of the International Conference on Industrial Informatics (INDIN), Helsinki-Espoo, Finland.","DOI":"10.1109\/INDIN41052.2019.8972136"},{"key":"ref_25","unstructured":"Ji, F., Yu, Y., and Zhou, Z.H. (2018, January 2\u20138). Multi-layered gradient boosting decision trees. Proceedings of the Thirty-Second Annual Conference on Neural Information Processing Systems (NeurIPS), Montr\u00e9al, QC, Canada."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.knosys.2017.10.006","article-title":"A Siamese Deep Forest","volume":"139","author":"Utkin","year":"2018","journal-title":"Knowl. Based Syst."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"40850","DOI":"10.1109\/ACCESS.2021.3065022","article-title":"Self-Supervised Keypoint Detection Based on Multi-layer Random Forest Regressor","volume":"9","author":"Kim","year":"2021","journal-title":"IEEE Acess"},{"key":"ref_28","unstructured":"Kim, S., Jeong, M., Lee, D., and Ko, B.C. (2019, January 16\u201320). Deep coupling of random ferns. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition Workshop (CVPRW), Long Beach, CA, USA."},{"key":"ref_29","unstructured":"Ioannou, Y., Robertson, D., Zikic, D., Kontschieder, P., Shotton, J., Brown, M., and Criminisi, A. (2016). Decision Forests, convolutional networks and the models in-between. arXiv."},{"key":"ref_30","unstructured":"Frosst, N., and Hinton, G.E. (2017). Distilling a neural network into a soft decision tree. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-018-34833-6","article-title":"A Deep Neural Network Model using Random Forest to Extract Feature Representation for Gene Expression Data Classification","volume":"8","author":"Kong","year":"2018","journal-title":"Sci. Rep."},{"key":"ref_32","unstructured":"Molnar, C. (2019). Interpretable Machine Learning, Leanpub Book. [1st ed.]."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., and Matthews, I. (2010, January 13\u201318). The extended cohn-kanade dataset (ck+): A complete dataset for action unit and emotion-specified expression. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition Workshop (CVPRW), San Francisco, CA, USA.","DOI":"10.1109\/CVPRW.2010.5543262"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_35","first-page":"1","article-title":"Cancer diagnosis via linear programming","volume":"23","author":"Mangasarian","year":"1998","journal-title":"SIAM News"},{"key":"ref_36","unstructured":"Samaria, F., and Harter, A. (1994, January 5\u20137). Parameterisation of a Stochastic Model for Human Face Identification. Proceedings of the IEEE Workshops on Applications of Computer Vision (WACV), Sarasota, FL, USA."},{"key":"ref_37","unstructured":"Dua, D., and Graff, C. (2020, November 08). UCI Machine Learning Repository. Available online: http:\/\/archive.ics.uci.edu\/ml."},{"key":"ref_38","unstructured":"Krizhenvsky, A., Sutskever, I., and Hinton, G. (2012, January 3\u20138). ImageNet classification with deep convolutional neural networks. Proceedings of the Annual Conference on Neural Information Processing Systems (NeurIPS), Lake Tahoe, NV, USA."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Liu, M., Li, S., Shan, S., Wang, R., and Chen, X. (2014, January 1\u20135). Deeply learning deformable facial action parts model for dynamic expression analysis. Proceedings of the Asian Conference on Computer Vision (ACCV), Singapore.","DOI":"10.1007\/978-3-319-16817-3_10"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Mollahosseini, A., Chan, D., and Mahoor, M.H. (2016, January 7\u201310). Going deeper in facial expression recognition using deep neural networks. Proceedings of the IEEE Workshops on Applications of Computer Vision (WACV), Lake Placid, NY, USA.","DOI":"10.1109\/WACV.2016.7477450"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Hasani, B., and Mahoor, M.H. (2017, January 21\u201326). Facial Expression Recognition Using Enhanced Deep 3D Convolutional Neural Networks. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition Workshop (CVPRW), Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.282"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Jeong, M., and Ko, B.C. (2018). Driver\u2019s Facial Expression Recognition in Real-Time for Safe Driving. Sensors, 18.","DOI":"10.3390\/s18124270"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Ma, N., Zhang, X., Zheng, H.T., and Sun, J. (2018, January 8\u201314). Shufflenet v2: Practical guidelines for efficient cnn architecture design. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01264-9_8"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18\u201322). Mobilenetv2: In-verted residuals and linear bottlenecks. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_46","unstructured":"Howard, A., Sandler, M., Chu, G., Chen, L.C., Chen, B., Tan, M., and Le, Q.V. (November, January 27). Searching for mobilenetv3. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Seoul, Korea."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/9\/3004\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:52:32Z","timestamp":1760161952000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/9\/3004"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,25]]},"references-count":46,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2021,5]]}},"alternative-id":["s21093004"],"URL":"https:\/\/doi.org\/10.3390\/s21093004","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,25]]}}}