{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:29:28Z","timestamp":1760239768695,"version":"build-2065373602"},"reference-count":23,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2020,12,29]],"date-time":"2020-12-29T00:00:00Z","timestamp":1609200000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The broad availability of smartphones and Inertial Measurement Units in particular brings them into the focus of recent research. Inertial Measurement Unit data is used for a variety of tasks. One important task is the classification of the mode of transportation. In the first step, we present a deep-learning-based algorithm that combines long-short-term-memory (LSTM) layer and convolutional layer to classify eight different modes of transportation on the Sussex\u2013Huawei Locomotion-Transportation (SHL) dataset. The inputs of our model are the accelerometer, gyroscope, linear acceleration, magnetometer, gravity and pressure values as well as the orientation information. In the second step, we analyze the contribution of each sensor modality to the classification score and to the different modes of transportation. For this analysis, we subtract the baseline confusion matrix from a confusion matrix of a network trained with a left-out sensor modality (difference confusion matrix) and we visualize the low-level features from the LSTM layers. This approach provides useful insights into the properties of the deep-learning algorithm and indicates the presence of redundant sensor modalities.<\/jats:p>","DOI":"10.3390\/s21010176","type":"journal-article","created":{"date-parts":[[2020,12,29]],"date-time":"2020-12-29T19:55:25Z","timestamp":1609271725000},"page":"176","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Analyzing the Importance of Sensors for Mode of Transportation Classification"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3021-5873","authenticated-orcid":false,"given":"Bj\u00f6rn","family":"Friedrich","sequence":"first","affiliation":[{"name":"Department of Health Services Research, Medicine Faculty, Carl von Ossietzky University Oldenburg, Ammerl\u00e4nder Heerstra\u00dfe 114-118, 26129 Oldenburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5149-8134","authenticated-orcid":false,"given":"Carolin","family":"L\u00fcbbe","sequence":"additional","affiliation":[{"name":"Department of Health Services Research, Medicine Faculty, Carl von Ossietzky University Oldenburg, Ammerl\u00e4nder Heerstra\u00dfe 114-118, 26129 Oldenburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8846-2282","authenticated-orcid":false,"given":"Andreas","family":"Hein","sequence":"additional","affiliation":[{"name":"Department of Health Services Research, Medicine Faculty, Carl von Ossietzky University Oldenburg, Ammerl\u00e4nder Heerstra\u00dfe 114-118, 26129 Oldenburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,12,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Wang, L., Gjoreski, H., Ciliberto, M., Lago, P., Murao, K., Okita, T., and Roggen, D. (2020, January 12\u201317). Summary of the Sussex-Huawei Locomotion-Transportation Recognition Challenge 2020. Proceedings of the 2020 ACM International Joint Conference and 2020 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers, Virtual Event, Mexico.","DOI":"10.1145\/3410530.3414341"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Friedrich, B., Cauchi, B., Hein, A., and Fudickar, S. (2019). Transportation Mode Classification from Smartphone Sensors via a Long-Short-Term-Memory Network. Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers, Association for Computing Machinery.","DOI":"10.1145\/3341162.3344855"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Gilpin, L.H., Bau, D., Yuan, B.Z., Bajwa, A., Specter, M., and Kagal, L. (2018, January 1\u20133). Explaining Explanations: An Overview of Interpretability of Machine Learning. Proceedings of the 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA), Turin, Italy.","DOI":"10.1109\/DSAA.2018.00018"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Antar, A.D., Ahmed, M., Ishrak, M.S., and Ahad, M.A.R. (2018). A Comparative Approach to Classification of Locomotion and Transportation Modes Using Smartphone Sensor Data. Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers, Association for Computing Machinery.","DOI":"10.1145\/3267305.3267516"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Liono, J., Abdallah, Z.S., Qin, A.K., and Salim, F.D. (2018, January 5\u20137). Inferring Transportation Mode and Human Activity from Mobile Sensing in Daily Life. Proceedings of the 15th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services, New York, NY, USA.","DOI":"10.1145\/3286978.3287006"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1429","DOI":"10.14778\/2733004.2733015","article-title":"Big data small footprint: The design of a low-power classifier for detecting transportation modes","volume":"7","author":"Yu","year":"2014","journal-title":"Proc. Vldb Endow."},{"key":"ref_7","unstructured":"Fang, S.H., Liao, H.H., Fei, Y.X., Chen, K.H., Huang, J.W., Lu, Y.D., and Tsao, Y. (2019). Transportation Modes Classification Using Sensors on Smartphones. Sensors, 8."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Hemminki, S., Nurmi, P., and Tarkoma, S. (2013, January 11\u201315). Accelerometer-Based Transportation Mode Detection on Smartphones. Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems, Roma, Italy.","DOI":"10.1145\/2517351.2517367"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Jeyakumar, J.V., Lee, E.S., Xia, Z., Sandha, S.S., Tausik, N., and Srivastava, M. (2020, January 8\u201312). Deep Convolutional Bidirectional LSTM Based Transportation Mode Recognition. Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers, Singapore.","DOI":"10.1145\/3267305.3267529"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"142353","DOI":"10.1109\/ACCESS.2019.2944686","article-title":"Toward Transportation Mode Recognition Using Deep Convolutional and Long Short-Term Memory Recurrent Neural Networks","volume":"7","author":"Qin","year":"2019","journal-title":"IEEE Access"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Vu, T.H., Dung, L., and Wang, J.C. (2016, January 15\u201319). Transportation Mode Detection on Mobile Devices Using Recurrent Nets. Proceedings of the 24th ACM International Conference on Multimedia, Amsterdam, The Netherlands.","DOI":"10.1145\/2964284.2967249"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Tambi, R., Li, P., and Yang, J. (2018, January 4\u20137). An Efficient CNN Model for Transportation Mode Sensing. Proceedings of the 16th ACM Conference on Embedded Networked Sensor Systems, Shenzhen, China.","DOI":"10.1145\/3274783.3275160"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., and Torralba, A. (2016, January 27\u201330). Learning Deep Features for Discriminative Localization. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.319"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22\u201329). Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.74"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wang, Z., Yan, W., and Oates, T. (2017, January 14\u201319). Time Series Classification from Scratch with Deep Neural Networks: A Strong Baseline. Proceedings of the 2017 International Joint Conference on Neural Networks (IJCNN), Anchorage, AK, USA.","DOI":"10.1109\/IJCNN.2017.7966039"},{"key":"ref_16","unstructured":"Karpathy, A., Johnson, J., and Fei-Fei, L. (2015). Visualizing and understanding recurrent networks. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"667","DOI":"10.1109\/TVCG.2017.2744158","article-title":"LSTMVis: A Tool for Visual Analysis of Hidden State Dynamics in Recurrent Neural Networks","volume":"24","author":"Strobelt","year":"2018","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_18","unstructured":"Moreira, C., Sindhgatta, R., Ouyang, C., Bruza, P., and Wichert, A. (2020). An Investigation of Interpretability Techniques for Deep Learning in Predictive Process Analytics. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Liu, J., Danait, N., Hu, S., and Sengupta, S. (2013, January 16\u201318). A Leave-one-feature-out Wrapper Method for Feature Selection in Data Classification. Proceedings of the 2013 6th International Conference on Biomedical Engineering and Informatics, Hangzhou, China.","DOI":"10.1109\/BMEI.2013.6747021"},{"key":"ref_20","first-page":"1429","article-title":"Distribution-Free Predictive Inference For Regression","volume":"113","author":"Lei","year":"2016","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"055019","DOI":"10.1088\/0964-1726\/17\/5\/055019","article-title":"A probabilistic approach for optimal sensor allocation in structural health monitoring","volume":"17","author":"Azarbayejani","year":"2008","journal-title":"Smart Mater. Struct."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"42592","DOI":"10.1109\/ACCESS.2018.2858933","article-title":"The University of Sussex-Huawei locomotion and transportation dataset for multimodal analytics with mobile devices","volume":"6","author":"Gjoreski","year":"2018","journal-title":"IEEE Access"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"10870","DOI":"10.1109\/ACCESS.2019.2890793","article-title":"Enabling reproducible research in sensor-based transportation mode recognition with the Sussex-Huawei dataset","volume":"7","author":"Wang","year":"2019","journal-title":"IEEE Access"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/1\/176\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:47:30Z","timestamp":1760179650000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/1\/176"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,29]]},"references-count":23,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,1]]}},"alternative-id":["s21010176"],"URL":"https:\/\/doi.org\/10.3390\/s21010176","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,12,29]]}}}