{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,4]],"date-time":"2025-12-04T15:41:45Z","timestamp":1764862905329,"version":"3.46.0"},"reference-count":40,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2025,12,4]],"date-time":"2025-12-04T00:00:00Z","timestamp":1764806400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["71801036","71971056"],"award-info":[{"award-number":["71801036","71971056"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>Predicting how people choose their travel modes accurately is important in the transportation field. Machine learning (ML) and neural networks (NNs) have gradually become popular in recent years. However, which is better is seldom discussed in previous studies. Therefore, we collect several real-world travel datasets from different countries, and pick five typical ML models, six classic NN models, and ten new NN models for comparison. Some methods for improvement are also considered, including SMOTE, Near-Miss, and using focal loss. The results show that, when looking at the F1-score, the NN models do not perform as well as ML models. While the performances of different classic NN models are similar, making the neural network more complex does not improve the prediction results. Some new NN models can reach the level of ML models on small datasets, but they still perform poorly on large datasets. Due to such a result, we further discuss two important topics: why NN models are not as good as compared to the ones in some other fields, and why this phenomenon is not revealed in many previous papers. In summary, we think this study gives a good reference for future research on predicting travel modes and choosing the right models.<\/jats:p>","DOI":"10.3390\/systems13121099","type":"journal-article","created":{"date-parts":[[2025,12,4]],"date-time":"2025-12-04T15:14:06Z","timestamp":1764861246000},"page":"1099","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Are Neural Networks Better than Machine Learning? A Comparative Study for Travel Mode Predictions"],"prefix":"10.3390","volume":"13","author":[{"given":"Tongkai","family":"Zhang","sequence":"first","affiliation":[{"name":"Jiangsu Key Laboratory of Urban ITS, Southeast University of China, Nanjing 210096, China"},{"name":"Jiangsu Province Collaborative Innovation Center of Modern Urban Traffic Technologies, Nanjing 210096, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cheng-Jie","family":"Jin","sequence":"additional","affiliation":[{"name":"Jiangsu Key Laboratory of Urban ITS, Southeast University of China, Nanjing 210096, China"},{"name":"Jiangsu Province Collaborative Innovation Center of Modern Urban Traffic Technologies, Nanjing 210096, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuchen","family":"Song","sequence":"additional","affiliation":[{"name":"Department of Civil and Environmental Engineering, National University of Singapore, 1 Engineering Drive 2, Singapore 117576, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dawei","family":"Li","sequence":"additional","affiliation":[{"name":"Jiangsu Key Laboratory of Urban ITS, Southeast University of China, Nanjing 210096, China"},{"name":"Jiangsu Province Collaborative Innovation Center of Modern Urban Traffic Technologies, Nanjing 210096, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,12,4]]},"reference":[{"key":"ref_1","unstructured":"Zarembka, P. (1974). Conditional Logit Analysis of Qualitative Choice Behavior. Frontiers in Econometrics, Academic Press."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1002\/1099-1255(200009\/10)15:5<447::AID-JAE570>3.0.CO;2-1","article-title":"Mixed MNL models for discrete response","volume":"15","author":"McFadden","year":"2000","journal-title":"J. Appl. Econom."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"582","DOI":"10.1080\/03081060.2024.2411611","article-title":"Travel mode choice prediction: Developing new techniques to prioritize variables and interpret black-box machine learning techniques","volume":"48","author":"Naseri","year":"2025","journal-title":"Transp. Plan. Technol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1111\/grow.12587","article-title":"How does machine learning compare to conventional econometrics for transport data sets? A test of ML versus MLE","volume":"53","author":"Li","year":"2022","journal-title":"Growth Change"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1007\/s40864-023-00190-5","article-title":"Understanding influencing factors of travel mode choice in urban-suburban travel: A case study in Shanghai","volume":"9","author":"Le","year":"2023","journal-title":"Urban Rail Transit"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"331","DOI":"10.17270\/J.LOG.2023.845","article-title":"On the use of machine learning techniques and discrete choice models in mode choice analysis","volume":"19","author":"Benjdiya","year":"2023","journal-title":"LogForum Sci. J. Logist."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"5364252","DOI":"10.1155\/2020\/5364252","article-title":"A Customized Deep Neural Network Approach to Investigate Travel Mode Choice with Interpretable Utility Information","volume":"2020","author":"Zhang","year":"2020","journal-title":"J. Adv. Transp."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1016\/j.tbs.2022.07.003","article-title":"Predicting the travel mode choice with interpretable machine learning techniques: A comparative study","volume":"29","author":"Kashifi","year":"2022","journal-title":"Travel Behav. Soc."},{"key":"ref_9","first-page":"100852","article-title":"Analysis of mode choice affects from the introduction of Doha Metro using machine learning and statistical analysis","volume":"20","author":"Abulibdeh","year":"2023","journal-title":"Transp. Res. Interdiscip. Perspect."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1239","DOI":"10.3390\/smartcities6030060","article-title":"Can Bike-Sharing Reduce Car Use in Alexandroupolis? An Exploration through the Comparison of Discrete Choice and Machine Learning Models","volume":"6","author":"Narayanan","year":"2023","journal-title":"Smart Cities"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Kalantari, H.A., Sabouri, S., Brewer, S., Ewing, R., and Tian, G. (2025). Machine learning in mode choice prediction as part of MPOs\u2019 regional travel demand models: Is it time for change?. Sustainability, 17.","DOI":"10.3390\/su17083580"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Nam, D., and Cho, J. (2020). Deep neural network design for modeling individual-level travel mode choice behavior. Sustainability, 12.","DOI":"10.3390\/su12187481"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.trb.2021.03.011","article-title":"Deep neural networks for choice analysis: A statistical learning theory perspective","volume":"148","author":"Wang","year":"2021","journal-title":"Transp. Res. Part B Methodol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"116253","DOI":"10.1016\/j.eswa.2021.116253","article-title":"A systematic comparative evaluation of machine learning classifiers and discrete choice models for travel mode choice in the presence of response heterogeneity","volume":"193","author":"Salas","year":"2022","journal-title":"Expert Syst. Appl."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"376","DOI":"10.1177\/03611981231206175","article-title":"Comparison of discrete choice and machine learning models for simultaneous modeling of mobility tool ownership in agent-based travel demand models","volume":"2678","author":"Regue","year":"2024","journal-title":"Transp. Res. Rec."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1016\/j.tbs.2022.08.011","article-title":"A random effect bayesian neural network (RE-BNN) for travel mode choice analysis across multiple regions","volume":"30","author":"Xia","year":"2023","journal-title":"Travel Behav. Soc."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wen, X., and Chen, X. (2025). A New Breakthrough in Travel Behavior Modeling Using Deep Learning: A High-Accuracy Prediction Method Based on a CNN. Sustainability, 17.","DOI":"10.3390\/su17020738"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"104318","DOI":"10.1016\/j.trc.2023.104318","article-title":"A prediction and behavioural analysis of machine learning methods for modelling travel mode choice","volume":"156","author":"Ros","year":"2023","journal-title":"Transp. Res. Part C Emerg. Technol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"103061","DOI":"10.1016\/j.trb.2024.103061","article-title":"Comparing hundreds of machine learning and discrete choice models for travel demand modeling: An empirical benchmark","volume":"190","author":"Wang","year":"2024","journal-title":"Transp. Res. Part B Methodol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1007\/s41062-025-01959-2","article-title":"Stated preference survey for predicting eco-friendly transportation choices among Mansoura University students","volume":"10","author":"Shahdah","year":"2025","journal-title":"Innov. Infrastruct. Solut."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Jin, C., Luo, Y., Wu, C., Song, Y., and Li, D. (2024). Exploring the Pedestrian Route Choice Behaviors by Machine Learning Models. Int. J. Geo-Inf., 13.","DOI":"10.3390\/ijgi13050146"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_23","unstructured":"Klambauer, G., Unterthiner, T., Mayr, A., and Hochreiter, S. (2017, January 4\u20139). Self-Normalizing Neural Networks. Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Song, W., Shi, C., Xiao, Z., Wang, Z., Sun, L., and Rossi, P. (2019, January 3\u20137). AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networks. Proceedings of the 28th ACM International Conference on Information and Knowledge Management (CIKM \u201819), Beijing, China.","DOI":"10.1145\/3357384.3357925"},{"key":"ref_25","unstructured":"Badirli, S., Tufan, A., Kask, K., Can, F., User, H.B., and Yilmaz, A. (2020). Gradient Boosting Neural Networks: GrowNet. arXiv."},{"key":"ref_26","unstructured":"Popov, S., Morozov, S., and Babenko, A. (2020, January 26\u201330). Neural Oblivious Decision Ensembles for Deep Learning on Tabular Data. Proceedings of the International Conference on Learning Representations (ICLR 2020), Addis Ababa, Ethiopia."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Wang, R., Fu, B., Fu, G., and Wang, M. (2021, January 19\u201323). DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systems. Proceedings of the Web Conference 2021, Ljubljana, Slovenia.","DOI":"10.1145\/3442381.3450078"},{"key":"ref_28","unstructured":"Gorishniy, Y., Rubachev, I., Gulin, A., and Babenko, A. (2021, January 6\u201314). Revisiting Deep Learning Models for Tabular Data. Proceedings of the 35th Conference on Neural Information Processing Systems (NeurIPS 2021), Online."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Ar\u0131k, S.\u00d6., and Pfister, T. (2021, January 2\u20139). TabNet: Attentive Interpretable Tabular Learning. Proceedings of the 35th AAAI Conference on Artificial Intelligence (AAAI-21), Online.","DOI":"10.1609\/aaai.v35i8.16826"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Guo, H., Tang, R., Ye, Y., Li, Z., and He, X. (2017). DeepFM: A Factorization-Machine based Neural Network for CTR Prediction. arXiv.","DOI":"10.24963\/ijcai.2017\/239"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Yan, J., Chen, J., Wang, Q., Chen, D.Z., and Wu, J. (2024, January 25\u201329). Team up GBDTs and DNNs: Advancing Efficient and Effective Tabular Prediction with Tree-hybrid MLPs. Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD \u201824), Barcelona, Spain.","DOI":"10.1145\/3637528.3671964"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1613\/jair.953","article-title":"SMOTE: Synthetic Minority Over-sampling Technique","volume":"16","author":"Chawla","year":"2002","journal-title":"J. Artif. Intell. Res."},{"key":"ref_33","unstructured":"Zhang, J., and Mani, I. (2003, January 21\u201324). KNN Approach to Unbalanced Data Distributions: A Case Study Involving Information Extraction. Proceedings of the International Conference on Machine Learning (ICML), Washington, DC, USA."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1109\/TPAMI.2018.2858826","article-title":"Focal loss for dense object detection","volume":"42","author":"Lin","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1016\/j.inffus.2021.11.011","article-title":"Tabular data: Deep learning is not all you need","volume":"81","author":"Armon","year":"2022","journal-title":"Inf. Fusion"},{"key":"ref_36","unstructured":"Grinsztajn, L., Oyallon, E., and Varoquaux, G. (2022). Why do tree-based models still outperform deep learning on tabular data?. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"7499","DOI":"10.1109\/TNNLS.2022.3229161","article-title":"Deep Neural networks and tabular data: A survey","volume":"35","author":"Borisov","year":"2024","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Banyong, C., Hantanong, N., Nanthawong, S., Se, C., Wisutwattanasak, P., Champahom, T., Ratanavaraha, V., and Jomnonkwao, S. (2025). Machine learning-based analysis of travel mode preferences: Neural and boosting model comparison using stated preference data from Thailand\u2019s emerging high-speed rail network. Big Data Cogn. Comput., 9.","DOI":"10.3390\/bdcc9060155"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"667","DOI":"10.1049\/itr2.12290","article-title":"Travel mode choice prediction based on personalized recommendation model","volume":"17","author":"Lai","year":"2023","journal-title":"IET Intell. Transp. Syst."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"100625","DOI":"10.1016\/j.tbs.2023.100625","article-title":"Joint prediction of travel mode choice and purpose from travel surveys: A multitask deep learning approach","volume":"33","author":"Bei","year":"2023","journal-title":"Travel Behav. Soc."}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/13\/12\/1099\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,4]],"date-time":"2025-12-04T15:39:10Z","timestamp":1764862750000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/13\/12\/1099"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,4]]},"references-count":40,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["systems13121099"],"URL":"https:\/\/doi.org\/10.3390\/systems13121099","relation":{},"ISSN":["2079-8954"],"issn-type":[{"value":"2079-8954","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,4]]}}}