{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T18:25:59Z","timestamp":1772821559697,"version":"3.50.1"},"reference-count":27,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,10,28]],"date-time":"2023-10-28T00:00:00Z","timestamp":1698451200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,10,28]],"date-time":"2023-10-28T00:00:00Z","timestamp":1698451200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100006013","name":"United Arab Emirates University","doi-asserted-by":"publisher","award":["31R291"],"award-info":[{"award-number":["31R291"]}],"id":[{"id":"10.13039\/501100006013","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Big Data"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This study proposes an innovative neural network framework, ASENN (Attention-based Selective Embedding Neural Network), for the prediction of pavement deterioration. Considering the complexity and uncertainty associated with the pavement deterioration process, two fundamental frameworks, SEL (Selective Embedding Layer) and MDAL (Multi-Dropout Attention Layer), are combined to enhance feature abstraction and prediction accuracy. This approach is significant while analyzing the pavement deterioration process due to the high variability of the contributing deterioration factors. These factors, represented as tabular data, undergo filtering, embedding, and fusion stages in the SEL, to extract crucial features for an effective representation of pavement deterioration. Further, multiple attention-weighted combinations of raw data are obtained through the MDAL. Several SELs and MDALs were combined as basic cells and layered to form an ASENN. The experimental results demonstrate that the proposed model outperforms existing tabular models on four road distress parameter datasets corresponding to cracking, deflection, international roughness index, and rutting. The optimal number of cells was determined using different ablation settings. The results also show that the feature learning capabilities of the ASENN model improved as the number of cells increased; however, owing to the limited combination space of feature fields, extreme depths were not preferred. Furthermore, the ablation investigation demonstrated that MDAL can improve performance, particularly on the cracking dataset. Notably, compared with mainstream transformer models, ASENN requires significantly less storage and achieves faster execution speed.<\/jats:p>","DOI":"10.1186\/s40537-023-00845-x","type":"journal-article","created":{"date-parts":[[2023,10,28]],"date-time":"2023-10-28T18:01:53Z","timestamp":1698516113000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["ASENN: attention-based selective embedding neural networks for road distress prediction"],"prefix":"10.1186","volume":"10","author":[{"given":"Babitha","family":"Philip","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhenyu","family":"Xu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hamad","family":"AlJassmi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qieshi","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luqman","family":"Ali","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,10,28]]},"reference":[{"key":"845_CR1","volume-title":"Highway engineering","author":"M Rogers","year":"2016","unstructured":"Rogers M, Enright B. Highway engineering. 3rd ed. Hoboken: John Wiley & Sons, Incorporated; 2016.","edition":"3"},{"key":"845_CR2","unstructured":"American Society of Civil Engineers, 2021 Report Card for America\u2019s Infrastructure: Solid Waste, 2022."},{"issue":"Feb","key":"845_CR3","doi-asserted-by":"publisher","DOI":"10.1016\/j.autcon.2022.104190","volume":"136","author":"N Sholevar","year":"2022","unstructured":"Sholevar N, Golroo A, Esfahani SR. Machine learning techniques for pavement condition evaluation. Autom Constr. 2022;136(Feb): 104190. https:\/\/doi.org\/10.1016\/j.autcon.2022.104190.","journal-title":"Autom Constr"},{"key":"845_CR4","doi-asserted-by":"publisher","DOI":"10.1016\/j.jtte.2021.03.005","author":"X Yang","year":"2021","unstructured":"Yang X, Guan J, Ding L, You Z, Lee VCS, Mohd Hasan MR, Cheng X. Research and applications of artificial neural network in pavement engineering: a state-of-the-art review. J Traffic Transp Eng. 2021. https:\/\/doi.org\/10.1016\/j.jtte.2021.03.005.","journal-title":"J Traffic Transp Eng"},{"issue":"1","key":"845_CR5","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman L. Random forests. Mach Learn. 2001;45(1):5\u201332. https:\/\/doi.org\/10.1023\/A:1010933404324.","journal-title":"Mach Learn"},{"key":"845_CR6","doi-asserted-by":"publisher","unstructured":"Chen T, Guestrin C. XGBoost: a scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2016. p. 785\u201394. https:\/\/doi.org\/10.1145\/2939672.2939785.","DOI":"10.1145\/2939672.2939785"},{"issue":"Dec(Nips)","key":"845_CR7","first-page":"3147","volume":"2017","author":"G Ke","year":"2017","unstructured":"Ke G, Meng Q, Finley T, Wang T, Chen W, Ma W, Liu TY. LightGBM: a highly efficient gradient boosting decision tree. Adv Neural Inf Process Syst. 2017;2017(Dec(Nips)):3147\u201355.","journal-title":"Adv Neural Inf Process Syst"},{"issue":"Dec(Section 4)","key":"845_CR8","first-page":"6638","volume":"2018","author":"L Prokhorenkova","year":"2018","unstructured":"Prokhorenkova L, Gusev G, Vorobev A, Dorogush AV, Gulin A. CatBoost: unbiased boosting with categorical features. Adv Neural Inf Process Syst. 2018;2018(Dec(Section 4)):6638\u201348.","journal-title":"Adv Neural Inf Process Syst"},{"key":"845_CR9","doi-asserted-by":"crossref","unstructured":"Ar\u0131k S, Pfister T. TabNet: attentive interpretable tabular learning. In: 35th AAAI Conference on Artificial Intelligence, AAAI 2021. 2021;8A:6679\u201387.","DOI":"10.1609\/aaai.v35i8.16826"},{"key":"845_CR10","unstructured":"Gorishniy Y, Rubachev I, Khrulkov V, Babenko A. Revisiting deep learning models for tabular data. In: 35th conference on neural information processing systems (NeurIPS 2021). 2021, 23(NeurIPS), pp. 18932\u201318943. https:\/\/doi.org\/10.48550\/ARXIV.2106.11959"},{"issue":"1","key":"845_CR11","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1177\/0361198118822501","volume":"2673","author":"L Yao","year":"2019","unstructured":"Yao L, Dong Q, Jiang J, Ni F. Establishment of prediction models of asphalt pavement performance based on a novel data calibration method and neural network. Transp Res Rec. 2019;2673(1):66\u201382.","journal-title":"Transp Res Rec"},{"issue":"8","key":"845_CR12","doi-asserted-by":"publisher","first-page":"2011","DOI":"10.1109\/TPAMI.2019.2913372","volume":"42","author":"J Hu","year":"2020","unstructured":"Hu J, Shen L, Albanie S, Sun G, Wu E. Squeeze-and-excitation networks. IEEE Trans Pattern Anal Mach Intell. 2020;42(8):2011\u201323.","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"5","key":"845_CR13","doi-asserted-by":"publisher","first-page":"1189","DOI":"10.1214\/aos\/1013203451","volume":"29","author":"JH Friedman","year":"2001","unstructured":"Friedman JH. Greedy function approximation: a gradient boosting machine. Ann Stat. 2001;29(5):1189\u2013232. https:\/\/doi.org\/10.1214\/aos\/1013203451.","journal-title":"Ann Stat"},{"key":"845_CR14","doi-asserted-by":"publisher","unstructured":"He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition, 2016-Decem. 2016. p. 770\u20138. https:\/\/doi.org\/10.1109\/CVPR.2016.90.","DOI":"10.1109\/CVPR.2016.90"},{"key":"845_CR15","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser \u0141, Polosukhin I. Attention is all you need. In: 31st conference on neural information processing systems (NIPS 2017). Long Beach, CA, USA ;2017."},{"issue":"11","key":"845_CR16","doi-asserted-by":"publisher","first-page":"22166","DOI":"10.1109\/TITS.2022.3161960","volume":"23","author":"D Ma","year":"2022","unstructured":"Ma D, Fang H, Wang N, Zhang C, Dong J, Hu H. Automatic detection and counting system for pavement cracks based on PCGAN and YOLO-MF. IEEE Trans Intell Transp Syst. 2022;23(11):22166\u201378.","journal-title":"IEEE Trans Intell Transp Syst"},{"key":"845_CR17","doi-asserted-by":"publisher","DOI":"10.1007\/s13753-023-00498-7","author":"J Jiang","year":"2023","unstructured":"Jiang J, Wang F, Wang Y, Jiang W, Qiao Y, Bai W, Zheng X. An urban road risk assessment framework based on convolutional neural networks. Int J Dis Risk Sci. 2023. https:\/\/doi.org\/10.1007\/s13753-023-00498-7.","journal-title":"Int J Dis Risk Sci"},{"key":"845_CR18","doi-asserted-by":"publisher","DOI":"10.1080\/10298436.2021.1942466","author":"AJ Haddad","year":"2021","unstructured":"Haddad AJ, Chehab GR, Saad GA. The use of deep neural networks for developing generic pavement rutting predictive models. Int J Pavement Eng. 2021. https:\/\/doi.org\/10.1080\/10298436.2021.1942466.","journal-title":"Int J Pavement Eng"},{"issue":"9","key":"845_CR19","doi-asserted-by":"publisher","first-page":"1434","DOI":"10.1177\/03611981211007846","volume":"2675","author":"L Gao","year":"2021","unstructured":"Gao L, Yu Y, Hao Ren Y, Lu P. Detection of pavement maintenance treatments using deep-learning network. Trans Res Rec. 2021;2675(9):1434\u201343. https:\/\/doi.org\/10.1177\/03611981211007846.","journal-title":"Trans Res Rec"},{"issue":"4","key":"845_CR20","doi-asserted-by":"publisher","first-page":"4021048","DOI":"10.1061\/JPEODX.0000310","volume":"147","author":"H Abohamer","year":"2021","unstructured":"Abohamer H, Elseifi M, Dhakal N, Zhang Z, Fillastre CN. Development of a deep convolutional neural network for the prediction of pavement roughness from 3D images. J Transp Eng Part B Pavements. 2021;147(4):4021048.","journal-title":"J Transp Eng Part B Pavements"},{"issue":"18","key":"845_CR21","doi-asserted-by":"publisher","first-page":"15349","DOI":"10.1007\/s00521-022-07467-z","volume":"34","author":"PVAB de Venancio","year":"2022","unstructured":"de Venancio PVAB, Lisboa AC, Barbosa AV. An automatic fire detection system based on deep convolutional neural networks for low-power, resource-constrained devices. Neural Comput Appl. 2022;34(18):15349\u201368.","journal-title":"Neural Comput Appl"},{"issue":"11","key":"845_CR22","doi-asserted-by":"publisher","first-page":"1062","DOI":"10.1177\/03611981211023765","volume":"2675","author":"Q Zhou","year":"2021","unstructured":"Zhou Q, Okte E, Al-Qadi IL. Predicting pavement roughness using deep learning algorithms. Transp Res Rec. 2021;2675(11):1062\u201372. https:\/\/doi.org\/10.1177\/03611981211023765.","journal-title":"Transp Res Rec"},{"key":"845_CR23","doi-asserted-by":"publisher","first-page":"30069","DOI":"10.1109\/ACCESS.2022.3159339","volume":"10","author":"J Oruh","year":"2022","unstructured":"Oruh J, Viriri S, Adegun A. Long short-term memory recurrent neural network for automatic speech recognition. IEEE Access. 2022;10:30069\u201379.","journal-title":"IEEE Access"},{"key":"845_CR24","doi-asserted-by":"publisher","DOI":"10.1016\/j.est.2021.103660","volume":"47","author":"C Vidal","year":"2022","unstructured":"Vidal C, Malysz P, Naguib M, Emadi A, Kollmeyer PJ. Estimating battery state of charge using recurrent and non-recurrent neural networks. J Energy Storage. 2022;47: 103660.","journal-title":"J Energy Storage"},{"issue":"2","key":"845_CR25","doi-asserted-by":"publisher","first-page":"62","DOI":"10.3390\/info14020062","volume":"14","author":"R Bayat","year":"2023","unstructured":"Bayat R, Talatahari S, Gandomi AH, Habibi M, Aminnejad B. Artificial neural networks for flexible pavement. Information. 2023;14(2):62.","journal-title":"Information"},{"key":"845_CR26","doi-asserted-by":"publisher","DOI":"10.3390\/buildings12071039","author":"B Philip","year":"2022","unstructured":"Philip B, Jassmi HA. A Bayesian approach towards modelling the interrelationships of pavement deterioration factors. Buildings. 2022. https:\/\/doi.org\/10.3390\/buildings12071039.","journal-title":"Buildings"},{"key":"845_CR27","doi-asserted-by":"publisher","unstructured":"Peters B, Niculae V, Martins AFT. Sparse sequence-to-sequence models. In: ACL 2019\u201457th annual meeting of the association for computational linguistics, proceedings of the conference. 2020. p. 1504\u201319. https:\/\/doi.org\/10.18653\/v1\/p19-1146.","DOI":"10.18653\/v1\/p19-1146"}],"container-title":["Journal of Big Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-023-00845-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40537-023-00845-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-023-00845-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,28]],"date-time":"2023-10-28T18:02:54Z","timestamp":1698516174000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofbigdata.springeropen.com\/articles\/10.1186\/s40537-023-00845-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,28]]},"references-count":27,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["845"],"URL":"https:\/\/doi.org\/10.1186\/s40537-023-00845-x","relation":{},"ISSN":["2196-1115"],"issn-type":[{"value":"2196-1115","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,28]]},"assertion":[{"value":"26 June 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 October 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 October 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"164"}}