{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,2]],"date-time":"2026-10-02T17:17:09Z","timestamp":1790961429265,"version":"4.1.0"},"reference-count":45,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2018,10,29]],"date-time":"2018-10-29T00:00:00Z","timestamp":1540771200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100007297","name":"Office of Naval Research","doi-asserted-by":"publisher","award":["N00014-16-1-2257"],"award-info":[{"award-number":["N00014-16-1-2257"]}],"id":[{"id":"10.13039\/100007297","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["#1614576 and IIS-1217466"],"award-info":[{"award-number":["#1614576 and IIS-1217466"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2018,11,30]]},"abstract":"<jats:p>Neural networks have become very popular in recent years, because of the astonishing success of deep learning in various domains such as image and speech recognition. In many of these domains, specific architectures of neural networks, such as convolutional networks, seem to fit the particular structure of the problem domain very well and can therefore perform in an astonishingly effective way. However, the success of neural networks is not universal across all domains. Indeed, for learning problems without any special structure, or in cases where the data are somewhat limited, neural networks are known not to perform well with respect to traditional machine-learning methods such as random forests. In this article, we show that a carefully designed neural network with random forest structure can have better generalization ability. In fact, this architecture is more powerful than random forests, because the back-propagation algorithm reduces to a more powerful and generalized way of constructing a decision tree. Furthermore, the approach is efficient to train and requires a small constant factor of the number of training examples. This efficiency allows the training of multiple neural networks to improve the generalization accuracy. Experimental results on real-world benchmark datasets demonstrate the effectiveness of the proposed enhancements for classification and regression.<\/jats:p>","DOI":"10.1145\/3232230","type":"journal-article","created":{"date-parts":[[2018,10,29]],"date-time":"2018-10-29T12:02:18Z","timestamp":1540814538000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":28,"title":["Random-Forest-Inspired Neural Networks"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3448-4878","authenticated-orcid":false,"given":"Suhang","family":"Wang","sequence":"first","affiliation":[{"name":"Arizona State University, Tempe, AZ"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Charu","family":"Aggarwal","sequence":"additional","affiliation":[{"name":"IBM T. J. Watson Research Center, Yorktown Heights, NY"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Huan","family":"Liu","sequence":"additional","affiliation":[{"name":"Arizona State University, Tempe, AZ"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2018,10,29]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Data Mining\u2014The Textbook","author":"Aggarwal Charu C.","unstructured":"Charu C. Aggarwal . 2015. Data Mining\u2014The Textbook . Springer . Charu C. Aggarwal. 2015. Data Mining\u2014The Textbook. Springer."},{"key":"e_1_2_1_2_1","volume-title":"Neural random forests. arXiv Preprint arXiv:1604.07143","author":"Biau G\u00e9rard","year":"2016","unstructured":"G\u00e9rard Biau , Erwan Scornet , and Johannes Welbl . 2016. Neural random forests. arXiv Preprint arXiv:1604.07143 ( 2016 ). G\u00e9rard Biau, Erwan Scornet, and Johannes Welbl. 2016. Neural random forests. arXiv Preprint arXiv:1604.07143 (2016)."},{"key":"e_1_2_1_3_1","volume-title":"Pattern Recognition and Machine Learning (Information Science and Statistics)","author":"Bishop Christopher M.","unstructured":"Christopher M. Bishop . 2006. Pattern Recognition and Machine Learning (Information Science and Statistics) . Springer-Verlag , New York, NY . Christopher M. Bishop. 2006. Pattern Recognition and Machine Learning (Information Science and Statistics). Springer-Verlag, New York, NY."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1961189.1961199"},{"key":"e_1_2_1_6_1","unstructured":"Fran\u00e7ois Chollet and others. 2015. Keras. Retrieved from https:\/\/github.com\/fchollet\/keras.  Fran\u00e7ois Chollet and others. 2015. Keras. Retrieved from https:\/\/github.com\/fchollet\/keras."},{"key":"e_1_2_1_7_1","volume-title":"Natural language processing (almost) from scratch. J. Mach. Learn. Res. 12 (Aug","author":"Collobert Ronan","year":"2011","unstructured":"Ronan Collobert , Jason Weston , L\u00e9on Bottou , Michael Karlen , Koray Kavukcuoglu , and Pavel Kuksa . 2011. Natural language processing (almost) from scratch. J. Mach. Learn. Res. 12 (Aug . 2011 ), 2493--2537. Ronan Collobert, Jason Weston, L\u00e9on Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. J. Mach. Learn. Res. 12 (Aug. 2011), 2493--2537."},{"key":"e_1_2_1_8_1","first-page":"3133","article-title":"Do we need hundreds of classifiers to solve real world classification problems","volume":"15","author":"Delgado Manuel Fern\u00e1ndez","year":"2014","unstructured":"Manuel Fern\u00e1ndez Delgado , Eva Cernadas , Sen\u00e9n Barro , and Dinani Gomes Amorim . 2014 . Do we need hundreds of classifiers to solve real world classification problems ? J. Mach. Learn. Res. 15 , 1 (2014), 3133 -- 3181 . Manuel Fern\u00e1ndez Delgado, Eva Cernadas, Sen\u00e9n Barro, and Dinani Gomes Amorim. 2014. Do we need hundreds of classifiers to solve real world classification problems? J. Mach. Learn. Res. 15, 1 (2014), 3133--3181.","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-7-3"},{"key":"e_1_2_1_10_1","series-title":"Springer Series in Statistics","volume-title":"The Elements of Statistical Learning","author":"Friedman Jerome","unstructured":"Jerome Friedman , Trevor Hastie , and Robert Tibshirani . 2001. The Elements of Statistical Learning . Springer Series in Statistics , Vol. 1 . Springer , New York, NY . Jerome Friedman, Trevor Hastie, and Robert Tibshirani. 2001. The Elements of Statistical Learning. Springer Series in Statistics, Vol. 1. Springer, New York, NY."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2013.6638947"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.123"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2012.2205597"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2006.18.7.1527"},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the International Conference on Document Analysis and Recognition (ICDAR\u201995)","volume":"1","author":"Ho Tin Kam","year":"1995","unstructured":"Tin Kam Ho . 1995 . Random decision forests . In Proceedings of the International Conference on Document Analysis and Recognition (ICDAR\u201995) , Vol. 1 . IEEE, 278--282. Tin Kam Ho. 1995. Random decision forests. In Proceedings of the International Conference on Document Analysis and Recognition (ICDAR\u201995), Vol. 1. IEEE, 278--282."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.2307\/1271436"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1002\/0471722146"},{"key":"e_1_2_1_19_1","unstructured":"Chih-Wei Hsu Chih-Chung Chang and Chih-Jen Lin. 2010. A practical guide to support vector classification. (2010).  Chih-Wei Hsu Chih-Chung Chang and Chih-Jen Lin. 2010. A practical guide to support vector classification. (2010)."},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML\u201915)","author":"Ioffe Sergey","year":"2015","unstructured":"Sergey Ioffe and Christian Szegedy . 2015 . Batch normalization: Accelerating deep network training by reducing internal covariate shift . In Proceedings of the International Conference on Machine Learning (ICML\u201915) . 448--456. Sergey Ioffe and Christian Szegedy. 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In Proceedings of the International Conference on Machine Learning (ICML\u201915). 448--456."},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of 3rd International Conference for Learning Representations.","author":"Diederik","unstructured":"Diederik P. Kingma and Jimmy Lei Ba. 2014. Adam: A method for stochastic optimization . In Proceedings of 3rd International Conference for Learning Representations. Diederik P. Kingma and Jimmy Lei Ba. 2014. Adam: A method for stochastic optimization. In Proceedings of 3rd International Conference for Learning Representations."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.172"},{"key":"e_1_2_1_23_1","volume-title":"Hinton","author":"Krizhevsky Alex","year":"2012","unstructured":"Alex Krizhevsky , Ilya Sutskever , and Geoffrey E . Hinton . 2012 . Imagenet classification with deep convolutional neural networks. In NIPS. 1097--1105. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. Imagenet classification with deep convolutional neural networks. In NIPS. 1097--1105."},{"key":"e_1_2_1_24_1","article-title":"Caret package","volume":"28","author":"Kuhn Max","year":"2008","unstructured":"Max Kuhn . 2008 . Caret package . Journal of Statistical Software 28 , 5 (2008). Max Kuhn. 2008. Caret package. Journal of Statistical Software 28, 5 (2008).","journal-title":"Journal of Statistical Software"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2018.03.050"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1080\/01431160412331269698"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the Pacific Symposium on Biocomputing. 531--542","author":"Qi Yanjun","year":"2005","unstructured":"Yanjun Qi , Judith Klein-Seetharaman , and Ziv Bar-Joseph . 2005 . Random forest similarity for protein-protein interaction prediction from multiple sources . In Proceedings of the Pacific Symposium on Biocomputing. 531--542 . Yanjun Qi, Judith Klein-Seetharaman, and Ziv Bar-Joseph. 2005. Random forest similarity for protein-protein interaction prediction from multiple sources. In Proceedings of the Pacific Symposium on Biocomputing. 531--542."},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of ICLR.","author":"Radford Alec","year":"2016","unstructured":"Alec Radford , Luke Metz , and Soumith Chintala . 2016 . Unsupervised representation learning with deep convolutional generative adversarial networks . In Proceedings of ICLR. Alec Radford, Luke Metz, and Soumith Chintala. 2016. Unsupervised representation learning with deep convolutional generative adversarial networks. In Proceedings of ICLR."},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML\u201916)","author":"Reed Scott E.","year":"2016","unstructured":"Scott E. Reed , Zeynep Akata , Xinchen Yan , Lajanugen Logeswaran , Bernt Schiele , and Honglak Lee . 2016 . Generative adversarial text to image synthesis . In Proceedings of the International Conference on Machine Learning (ICML\u201916) . 1060--1069. Scott E. Reed, Zeynep Akata, Xinchen Yan, Lajanugen Logeswaran, Bernt Schiele, and Honglak Lee. 2016. Generative adversarial text to image synthesis. In Proceedings of the International Conference on Machine Learning (ICML\u201916). 1060--1069."},{"key":"e_1_2_1_32_1","volume-title":"Relating cascaded random forests to deep convolutional neural networks for semantic segmentation. arXiv Preprint arXiv:1507.07583","author":"Richmond David L.","year":"2015","unstructured":"David L. Richmond , Dagmar Kainmueller , Michael Y. Yang , Eugene W. Myers , and Carsten Rother . 2015. Relating cascaded random forests to deep convolutional neural networks for semantic segmentation. arXiv Preprint arXiv:1507.07583 ( 2015 ). David L. Richmond, Dagmar Kainmueller, Michael Y. Yang, Eugene W. Myers, and Carsten Rother. 2015. Relating cascaded random forests to deep convolutional neural networks for semantic segmentation. arXiv Preprint arXiv:1507.07583 (2015)."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.58346"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:STCO.0000035301.49549.88"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/2627435.2670313"},{"key":"e_1_2_1_36_1","volume-title":"Le","author":"Sutskever Ilya","year":"2014","unstructured":"Ilya Sutskever , Oriol Vinyals , and Quoc V . Le . 2014 . Sequence to sequence learning with neural networks. In Advances in Neural Information Processing Systems . 3104--3112. Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. 2014. Sequence to sequence learning with neural networks. In Advances in Neural Information Processing Systems. 3104--3112."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1021\/ci034160g"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611974973.1"},{"key":"e_1_2_1_39_1","doi-asserted-by":"crossref","unstructured":"Suhang Wang and Huan Liu. 2018. Deep learning for feature representation. Feature Engineering for Machine Learning and Data Analytics. 279--307.  Suhang Wang and Huan Liu. 2018. Deep learning for feature representation. Feature Engineering for Machine Learning and Data Analytics. 279--307.","DOI":"10.1201\/9781315181080-11"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052638"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2018.00019"},{"key":"e_1_2_1_42_1","volume-title":"Google\u2019s neural machine translation system: Bridging the gap between human and machine translation. arXiv Preprint arXiv:1609.08144","author":"Wu Yonghui","year":"2016","unstructured":"Yonghui Wu , Mike Schuster , Zhifeng Chen , and Others. 2016. Google\u2019s neural machine translation system: Bridging the gap between human and machine translation. arXiv Preprint arXiv:1609.08144 ( 2016 ). Yonghui Wu, Mike Schuster, Zhifeng Chen, and Others. 2016. Google\u2019s neural machine translation system: Bridging the gap between human and machine translation. arXiv Preprint arXiv:1609.08144 (2016)."},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML\u201915)","author":"Xu Kelvin","year":"2015","unstructured":"Kelvin Xu , Jimmy Ba , Ryan Kiros , Kyunghyun Cho , Aaron C. Courville , Ruslan Salakhutdinov , Richard S. Zemel , and Yoshua Bengio . 2015 . Show, attend and tell: Neural image caption generation with visual attention . In Proceedings of the International Conference on Machine Learning (ICML\u201915) . 2048--2057. Kelvin Xu, Jimmy Ba, Ryan Kiros, Kyunghyun Cho, Aaron C. Courville, Ruslan Salakhutdinov, Richard S. Zemel, and Yoshua Bengio. 2015. Show, attend and tell: Neural image caption generation with visual attention. In Proceedings of the International Conference on Machine Learning (ICML\u201915). 2048--2057."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-1174"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.5555\/3172077.3172386"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3232230","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3232230","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3232230","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:39:42Z","timestamp":1750210782000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3232230"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,10,29]]},"references-count":45,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2018,11,30]]}},"alternative-id":["10.1145\/3232230"],"URL":"https:\/\/doi.org\/10.1145\/3232230","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,10,29]]},"assertion":[{"value":"2017-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-10-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}