{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,26]],"date-time":"2026-06-26T15:39:29Z","timestamp":1782488369048,"version":"3.54.5"},"reference-count":39,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,12,2]],"date-time":"2023-12-02T00:00:00Z","timestamp":1701475200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,12,2]],"date-time":"2023-12-02T00:00:00Z","timestamp":1701475200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004004","name":"Universit\u00e0 degli Studi di Trento","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004004","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["SN COMPUT. SCI."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Remaining useful life (RUL) prediction is a key enabler for making optimal maintenance strategies. Data-driven approaches, especially employing neural networks (NNs) such as multi-layer perceptrons (MLPs) and convolutional neural networks (CNNs), have gained increasing attention in the field of RUL prediction. Most of the past research has mainly focused on minimizing the RUL prediction error by training NNs with back-propagation (BP), which in general requires an extensive computational effort. However, in practice, such BP-based NNs (BPNNs) may not be affordable in industrial contexts that normally seek to save cost by minimizing access to expensive computing infrastructures. Driven by this motivation, here, we propose: (1) to use a very fast learning scheme called extreme learning machine (ELM) for training two different kinds of feed-forward neural networks (FFNNs), namely a single-layer feed-forward neural network (SL-FFNN) and a Convolutional ELM (CELM); and (2) to optimize the architecture of those networks by applying evolutionary computation. More specifically, we employ a multi-objective optimization (MOO) technique to search for the best network architectures in terms of trade-off between RUL prediction error and number of trainable parameters, the latter being correlated with computational effort. In our experiments, we test our methods on a widely used benchmark dataset, the C-MAPSS, on which we search such trade-off solutions. Compared to other methods based on BPNNs, our methods outperform a MLP and show a similar level of performance to a CNN in terms of prediction error, while using a much smaller (up to two orders of magnitude) number of trainable parameters.<\/jats:p>","DOI":"10.1007\/s42979-023-02320-z","type":"journal-article","created":{"date-parts":[[2023,12,2]],"date-time":"2023-12-02T14:02:04Z","timestamp":1701525724000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Evolutionary Optimization of Convolutional Extreme Learning Machine for Remaining Useful Life Prediction"],"prefix":"10.1007","volume":"5","author":[{"given":"Hyunho","family":"Mo","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9723-1830","authenticated-orcid":false,"given":"Giovanni","family":"Iacca","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,12,2]]},"reference":[{"issue":"3","key":"2320_CR1","doi-asserted-by":"publisher","first-page":"2213","DOI":"10.1109\/JSYST.2019.2905565","volume":"13","author":"W Zhang","year":"2019","unstructured":"Zhang W, Yang D, Wang H. Data-driven methods for predictive maintenance of industrial equipment: a survey. IEEE Syst J. 2019;13(3):2213\u201327.","journal-title":"IEEE Syst J"},{"key":"2320_CR2","doi-asserted-by":"crossref","unstructured":"Zheng C, Liu W, Chen B, Gao D, Cheng Y, Yang Y, Zhang X, Li S, Huang Z, Peng J. A data-driven approach for remaining useful life prediction of aircraft engines. In: International Conference on intelligent transportation systems (ITSC). 2018; pp. 184\u2013189.","DOI":"10.1109\/ITSC.2018.8569915"},{"issue":"3","key":"2320_CR3","first-page":"1","volume":"8","author":"V Atamuradov","year":"2017","unstructured":"Atamuradov V, Medjaher K, Dersin P, Lamoureux B, Zerhouni N. Prognostics and health management for maintenance practitioners-review, implementation and tools evaluation. Int J Progn Health Manag. 2017;8(3):1\u201331.","journal-title":"Int J Progn Health Manag"},{"key":"2320_CR4","unstructured":"Tinga T. Predicting critical failures using physics of failure: opportunities and challenges. In: AVT-356 Research Symposium on Physics of Failure for Military Platform Critical Subsystems, NATO Science & Technology Organization, 2021; pp. 1\u201313."},{"key":"2320_CR5","doi-asserted-by":"crossref","unstructured":"Fink O. Data-driven intelligent predictive maintenance of industrial assets. In: Women in industrial and systems engineering: key advances and perspectives on emerging topics. Cham: Springer; 2020. p. 589\u2013605.","DOI":"10.1007\/978-3-030-11866-2_25"},{"key":"2320_CR6","doi-asserted-by":"crossref","unstructured":"Sateesh Babu G, Zhao P, Li XL. Deep convolutional neural network based regression approach for estimation of remaining useful life. In: Database systems for advanced applications, 21st International conference, DASFAA 2016. Springer International Publishing; 2016. p. 214\u201328.","DOI":"10.1007\/978-3-319-32025-0_14"},{"key":"2320_CR7","doi-asserted-by":"crossref","unstructured":"Zheng S, Ristovski K, Farahat A, Gupta C. Long short-term memory network for remaining useful life estimation. In: International Conference on prognostics and health management (ICPHM), IEEE, 2017; p. 88\u201395.","DOI":"10.1109\/ICPHM.2017.7998311"},{"key":"2320_CR8","first-page":"1","volume":"2018","author":"J Ma","year":"2019","unstructured":"Ma J, Su H, Zhao WL, Liu B. Predicting the remaining useful life of an aircraft engine using a stacked sparse autoencoder with multilayer self-learning. Complexity. 2018;2018:1\u201313.","journal-title":"Complexity"},{"key":"2320_CR9","doi-asserted-by":"publisher","first-page":"75464","DOI":"10.1109\/ACCESS.2019.2919566","volume":"7","author":"J Li","year":"2019","unstructured":"Li J, Li X, He D. A directed acyclic graph network combined with CNN and LSTM for remaining useful life prediction. IEEE Access. 2019;7:75464\u201375.","journal-title":"IEEE Access"},{"key":"2320_CR10","doi-asserted-by":"crossref","unstructured":"Remadna I, Terrissa SL, Zemouri R, Ayad S, Zerhouni N. Leveraging the power of the combination of CNN and bi-directional LSTM networks for aircraft engine RUL estimation. In: Prognostics and Health Management Conference (PHM-Besan\u00e7on), IEEE, 2020; pp. 116\u2013121.","DOI":"10.1109\/PHM-Besancon49106.2020.00025"},{"key":"2320_CR11","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2021.107474","volume":"108","author":"H Mo","year":"2021","unstructured":"Mo H, Custode LL, Iacca G. Evolutionary neural architecture search for remaining useful life prediction. Appl Soft Comput. 2021;108: 107474.","journal-title":"Appl Soft Comput"},{"key":"2320_CR12","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2021.107379","volume":"107","author":"Z Ye","year":"2021","unstructured":"Ye Z, Yu J. Health condition monitoring of machines based on long short-term memory convolutional autoencoder. Appl Soft Comput. 2021;107: 107379.","journal-title":"Appl Soft Comput"},{"key":"2320_CR13","doi-asserted-by":"publisher","first-page":"82156","DOI":"10.1109\/ACCESS.2022.3188681","volume":"10","author":"AK Huthaifa","year":"2022","unstructured":"Huthaifa AK, Nasser AR, Hasan AM, Al Mhdawi AK, Al-Raweshidy H, Humaidi AJ. Aircraft engines remaining useful life prediction based on a hybrid model of autoencoder and deep belief network. IEEE Access. 2022;10:82156\u201363","journal-title":"IEEE Access"},{"key":"2320_CR14","unstructured":"Huang GB, Zhu QY, Siew CK. Extreme learning machine: a new learning scheme of feedforward neural networks. In: International Joint Conference on Neural Networks (IJCNN). Volume\u00a02., IEEE, 2004; pp. 985\u2013990"},{"issue":"1","key":"2320_CR15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1475-925X-8-31","volume":"8","author":"J Kim","year":"2009","unstructured":"Kim J, Shin HS, Shin K, Lee M. Robust algorithm for arrhythmia classification in ECG using extreme learning machine. Biomed Eng Online. 2009;8(1):1\u201312.","journal-title":"Biomed Eng Online"},{"issue":"6","key":"2320_CR16","first-page":"31","volume":"28","author":"LLC Kasun","year":"2013","unstructured":"Kasun LLC, Zhou H, Huang GB, Vong CM. Representational learning with ELMs for big data. IEEE Intell Syst. 2013;28(6):31\u201334.","journal-title":"IEEE Intell Syst"},{"key":"2320_CR17","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1016\/j.neucom.2018.10.063","volume":"329","author":"MM Dos Santos","year":"2019","unstructured":"Dos Santos MM, da Silva Filho AG, dos Santos WP. Deep convolutional extreme learning machines: filters combination and error model validation. Neurocomputing. 2019;329:359\u201369.","journal-title":"Neurocomputing"},{"issue":"2","key":"2320_CR18","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1109\/4235.996017","volume":"6","author":"K Deb","year":"2002","unstructured":"Deb K, Pratap A, Agarwal S, Meyarivan T. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput. 2002;6(2):182\u201397.","journal-title":"IEEE Trans Evol Comput"},{"key":"2320_CR19","doi-asserted-by":"crossref","unstructured":"Saxena A, Goebel K, Simon D, Eklund N. Damage propagation modeling for aircraft engine run-to-failure simulation. In: International Conference on prognostics and health management (ICPHM), IEEE, 2008; pp. 1\u20139.","DOI":"10.1109\/PHM.2008.4711414"},{"key":"2320_CR20","doi-asserted-by":"crossref","unstructured":"Mo H, Iacca G. Multi-objective optimization of extreme learning machine for remaining useful life prediction. In: International Conference on the applications of evolutionary computation (Part of EvoStar), Springer, 2022; pp. 191\u2013206.","DOI":"10.1007\/978-3-031-02462-7_13"},{"issue":"4","key":"2320_CR21","doi-asserted-by":"publisher","first-page":"863","DOI":"10.1109\/TNN.2006.875974","volume":"17","author":"GB Huang","year":"2006","unstructured":"Huang GB, Zhu QY, Siew CK. Real-time learning capability of neural networks. IEEE Trans Neural Netw. 2006;17(4):863\u201378.","journal-title":"IEEE Trans Neural Netw"},{"issue":"4","key":"2320_CR22","doi-asserted-by":"publisher","first-page":"879","DOI":"10.1109\/TNN.2006.875977","volume":"17","author":"GB Huang","year":"2006","unstructured":"Huang GB, Chen L, Siew CK. Universal approximation using incremental feedforward networks with arbitrary input weights. IEEE Trans Neural Netw. 2006;17(4):879\u201392.","journal-title":"IEEE Trans Neural Netw"},{"key":"2320_CR23","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1007\/s11277-017-5119-x","volume":"99","author":"S Popoola","year":"2018","unstructured":"Popoola S, Misra S, Atayero PA. Outdoor path loss predictions based on extreme learning machine. Wirel Pers Commun. 2018;99:441\u2013460.","journal-title":"Wirel Pers Commun"},{"key":"2320_CR24","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1109\/TCSII.2005.857540","volume":"53","author":"GB Huang","year":"2006","unstructured":"Huang GB, Zhu QY, Mao K, Siew C, Saratchandran P, Sundararajan N. Can threshold networks be trained directly? IEEE Trans Circ Syst II Express Briefs. 2006;53:187\u201391.","journal-title":"IEEE Trans Circ Syst II Express Briefs"},{"issue":"1\u20133","key":"2320_CR25","doi-asserted-by":"publisher","first-page":"489","DOI":"10.1016\/j.neucom.2005.12.126","volume":"70","author":"GB Huang","year":"2006","unstructured":"Huang GB, Zhu QY, Siew CK. Extreme learning machine: theory and applications. Neurocomputing. 2006;70(1\u20133):489\u2013501.","journal-title":"Neurocomputing"},{"key":"2320_CR26","unstructured":"LeCun Y, Boser B, Denker J, Henderson D, Howard R, Hubbard W, Jackel L. Handwritten digit recognition with a back-propagation network. In: Advances in neural information processing systems. Vol. 2. San Francisco, CA, USA: Morgan Kaufmann Publishers Inc.; 1990. p. 396\u2013404."},{"key":"2320_CR27","volume-title":"Using convolutional neural networks for image recognition","author":"S Hijazi","year":"2015","unstructured":"Hijazi S, Kumar R, Rowen C, et al. Using convolutional neural networks for image recognition, vol. 9. San Jose: Cadence Design Systems Inc.; 2015."},{"key":"2320_CR28","doi-asserted-by":"crossref","unstructured":"Chauhan R, Ghanshala KK, Joshi R. Convolutional neural network (CNN) for image detection and recognition. In: International Conference on secure cyber computing and communication (ICSCCC), IEEE, 2018; pp. 278\u2013282.","DOI":"10.1109\/ICSCCC.2018.8703316"},{"key":"2320_CR29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.ress.2017.11.021","volume":"172","author":"X Li","year":"2018","unstructured":"Li X, Ding Q, Sun JQ. Remaining useful life estimation in prognostics using deep convolution neural networks. Reliab Eng Syst Saf. 2018;172:1\u201311.","journal-title":"Reliab Eng Syst Saf"},{"key":"2320_CR30","doi-asserted-by":"crossref","unstructured":"Kiranyaz S, Ince T, Abdeljaber O, Avci O, Gabbouj M. 1-d convolutional neural networks for signal processing applications. In: International Conference on acoustics, speech and signal processing (ICASSP), IEEE, 2019; pp. 8360\u20138364.","DOI":"10.1109\/ICASSP.2019.8682194"},{"key":"2320_CR31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2016\/3049632","volume":"2016","author":"S Pang","year":"2016","unstructured":"Pang S, Yang X. Deep convolutional extreme learning machine and its application in handwritten digit classification. Comput Intell Neurosci. 2016;2016:1\u201310.","journal-title":"Comput Intell Neurosci"},{"key":"2320_CR32","doi-asserted-by":"publisher","first-page":"448","DOI":"10.1016\/j.neucom.2017.08.062","volume":"275","author":"M Duan","year":"2018","unstructured":"Duan M, Li K, Yang C, Li K. A hybrid deep learning CNN-ELM for age and gender classification. Neurocomputing. 2018;275:448\u201361.","journal-title":"Neurocomputing"},{"key":"2320_CR33","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1016\/j.neucom.2018.12.080","volume":"339","author":"Y Park","year":"2019","unstructured":"Park Y, Yang HS. Convolutional neural network based on an extreme learning machine for image classification. Neurocomputing. 2019;339:66\u201376.","journal-title":"Neurocomputing"},{"key":"2320_CR34","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1016\/j.neucom.2020.12.064","volume":"434","author":"Y Cai","year":"2021","unstructured":"Cai Y, Zhang Z, Yan Q, Zhang D, Banu MJ. Densely connected convolutional extreme learning machine for hyperspectral image classification. Neurocomputing. 2021;434:21\u201332.","journal-title":"Neurocomputing"},{"key":"2320_CR35","unstructured":"Frederick DK, DeCastro JA, Litt JS. User\u2019s guide for the commercial modular aero-propulsion system simulation (C-MAPSS). Technical report, NASA, TM-2007-215026. 2007."},{"key":"2320_CR36","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2021.107474","volume":"108","author":"H Mo","year":"2021","unstructured":"Mo H, Custode LL, Iacca G. Evolutionary neural architecture search for remaining useful life prediction. Appl Soft Comput. 2021;108: 107474.","journal-title":"Appl Soft Comput"},{"key":"2320_CR37","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1016\/j.compbiomed.2017.03.017","volume":"84","author":"S Li","year":"2017","unstructured":"Li S, Jiang H, Pang W. Joint multiple fully connected convolutional neural network with extreme learning machine for hepatocellular carcinoma nuclei grading. Comput Biol Med. 2017;84:156\u201367.","journal-title":"Comput Biol Med"},{"key":"2320_CR38","doi-asserted-by":"crossref","unstructured":"Kannojia SP, Jaiswal G. Ensemble of hybrid CNN-ELM model for image classification. In: International Conference on signal processing and integrated networks (SPIN), IEEE, 2018, pp. 538\u2013541.","DOI":"10.1109\/SPIN.2018.8474196"},{"key":"2320_CR39","doi-asserted-by":"crossref","unstructured":"Ratnawati DE, Marjono W, Anam S. Comparison of activation function on extreme learning machine (ELM) performance for classifying the active compound. In: AIP Conference Proceedings. Volume 2264., AIP Publishing LLC, 2020; p. 140001.","DOI":"10.1063\/5.0023872"}],"container-title":["SN Computer Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s42979-023-02320-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s42979-023-02320-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s42979-023-02320-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,2]],"date-time":"2023-12-02T14:21:25Z","timestamp":1701526885000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s42979-023-02320-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,2]]},"references-count":39,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,1]]}},"alternative-id":["2320"],"URL":"https:\/\/doi.org\/10.1007\/s42979-023-02320-z","relation":{},"ISSN":["2661-8907"],"issn-type":[{"value":"2661-8907","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,2]]},"assertion":[{"value":"30 August 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 September 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 December 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of Interest"}},{"value":"The code is available at:","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Code Availability"}}],"article-number":"54"}}