{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T01:59:39Z","timestamp":1771466379344,"version":"3.50.1"},"reference-count":57,"publisher":"World Scientific Pub Co Pte Ltd","issue":"09","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J CIRCUIT SYST COMP"],"published-print":{"date-parts":[[2022,6]]},"abstract":"<jats:p> Cyber-Physical System (CPS) is an integration of physical components like actuators, sensors and various types of equipment with the Internet possessing computational ability for efficient communication. A Heterogeneous Independent Network (HINT) is a realistic model that is used for the analysis of inter-dependability between the power grid and communications network. In the traditional Deep [Formula: see text]-Learning method, action needs to be stored in the [Formula: see text] table for the prediction. In real case studies, many state and action values affect the performance of the model. Existing Deep [Formula: see text]-Network (DQN) model generates all possible actions for the [Formula: see text]-values and this involves the generation of excessive information that causes the model to overfit. In this research, the Neural Network is applied to estimate the state\u2013action in the DQN and to store the particular state\u2013action value instead of storing all the state\u2013action values as followed in the traditional method. The HINT model provides realistic failure propagation in the network and its state\u2013action value overfits the existing DQN method due to the presence of more information. The proposed DQN with reinforcement learning stores selected state\u2013action values in the [Formula: see text] tables and eliminates irrelevant information that helps to increase the accuracy and reduce the computational time. The DQN with reinforcement learning is applied to adaptively learn the system to select the optimal action in a continuous interaction with a stochastic environment. The proposed DQN model involves the application of reward function to store state\u2013action value with higher probability based on prediction and eliminates other state\u2013action values. Features such as intra-degree, inter-betweenness, substation-betweenness, relay-betweenness and feature vector are extracted and given as input to the DQN to characterize the critical nodes. The proposed DQN method is evaluated on the HINT network and synthetic network to analyze its efficiency in fault detection. The result shows that the HINT network has a lower prediction error compared to the existing Deep Neural Network (DNN) method. The proposed DQN and LSTM models have accuracies of 98% and 93% in fault prediction, respectively. <\/jats:p>","DOI":"10.1142\/s0218126622501584","type":"journal-article","created":{"date-parts":[[2022,3,18]],"date-time":"2022-03-18T05:59:50Z","timestamp":1647583190000},"source":"Crossref","is-referenced-by-count":14,"title":["Deep <i>Q<\/i>-Network with Reinforcement Learning for Fault Detection in Cyber-Physical Systems"],"prefix":"10.1142","volume":"31","author":[{"given":"J.","family":"Stanly Jayaprakash","sequence":"first","affiliation":[{"name":"Mahendra Institute of Technology, Namakkal 637503, Tamil Nadu, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"M. Jasmine Pemeena","family":"Priyadarsini","sequence":"additional","affiliation":[{"name":"Vellore Institute of Technology, Vellore Campus, Vellore 632014, Tamil Nadu, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3997-5070","authenticated-orcid":false,"given":"B. D.","family":"Parameshachari","sequence":"additional","affiliation":[{"name":"Department of Telecommunication Engineering, GSSS Institute of Engineering & Technology for Women, Mysuru 570016, Karnataka, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hamid Reza","family":"Karimi","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, Politecnico di Milano, 20156 Milan, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sasikumar","family":"Gurumoorthy","sequence":"additional","affiliation":[{"name":"Jerusalem Coll\u00e8ge of Engineering, Chennai - 600100, Tamil Nadu, India"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2022,3,16]]},"reference":[{"key":"S0218126622501584BIB001","doi-asserted-by":"publisher","DOI":"10.1007\/s12652-018-0881-5"},{"key":"S0218126622501584BIB002","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijepes.2017.01.016"},{"key":"S0218126622501584BIB003","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2020.3048345"},{"key":"S0218126622501584BIB004","doi-asserted-by":"publisher","DOI":"10.1016\/j.apenergy.2020.116429"},{"key":"S0218126622501584BIB005","doi-asserted-by":"publisher","DOI":"10.3390\/app8060898"},{"key":"S0218126622501584BIB006","doi-asserted-by":"publisher","DOI":"10.3390\/s17092109"},{"key":"S0218126622501584BIB007","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2020.2970556"},{"key":"S0218126622501584BIB008","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2021.04.003"},{"key":"S0218126622501584BIB009","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclepro.2018.03.149"},{"key":"S0218126622501584BIB010","doi-asserted-by":"publisher","DOI":"10.1007\/s10817-018-09509-5"},{"key":"S0218126622501584BIB011","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2020.3031440"},{"key":"S0218126622501584BIB012","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2987324"},{"key":"S0218126622501584BIB013","doi-asserted-by":"publisher","DOI":"10.1016\/j.rcim.2020.102040"},{"key":"S0218126622501584BIB014","doi-asserted-by":"publisher","DOI":"10.1016\/j.automatica.2018.03.040"},{"key":"S0218126622501584BIB015","doi-asserted-by":"publisher","DOI":"10.1109\/JSYST.2020.2965400"},{"key":"S0218126622501584BIB016","doi-asserted-by":"publisher","DOI":"10.1016\/j.autcon.2019.02.010"},{"key":"S0218126622501584BIB017","doi-asserted-by":"publisher","DOI":"10.1109\/MWC.001.2000374"},{"key":"S0218126622501584BIB018","author":"Guo Z.","year":"2021","journal-title":"IEEE Trans. Netw. Sci. Eng."},{"key":"S0218126622501584BIB019","doi-asserted-by":"publisher","DOI":"10.1109\/MCE.2021.3081874"},{"key":"S0218126622501584BIB020","author":"Yu K.","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"S0218126622501584BIB021","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2021.3113321"},{"key":"S0218126622501584BIB022","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2020.3024631"},{"key":"S0218126622501584BIB023","doi-asserted-by":"publisher","DOI":"10.1109\/TIM.2015.2444238"},{"key":"S0218126622501584BIB024","doi-asserted-by":"publisher","DOI":"10.1109\/TNSE.2021.3101842"},{"key":"S0218126622501584BIB025","author":"Li H.","year":"2021","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"S0218126622501584BIB026","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2020.3027568"},{"key":"S0218126622501584BIB027","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2021.3076015"},{"key":"S0218126622501584BIB028","doi-asserted-by":"publisher","DOI":"10.1109\/TFUZZ.2021.3052109"},{"key":"S0218126622501584BIB029","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2021.3070544"},{"key":"S0218126622501584BIB030","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2021.09.044"},{"key":"S0218126622501584BIB031","author":"Ding F.","year":"2020","journal-title":"IEEE Consum. Electron. Mag."},{"key":"S0218126622501584BIB032","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2019.2925418"},{"key":"S0218126622501584BIB033","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2911979"},{"key":"S0218126622501584BIB034","doi-asserted-by":"publisher","DOI":"10.1109\/ICPHYS.2018.8387666"},{"key":"S0218126622501584BIB035","doi-asserted-by":"publisher","DOI":"10.1007\/s11036-017-0962-2"},{"key":"S0218126622501584BIB036","doi-asserted-by":"publisher","DOI":"10.1016\/j.comcom.2020.04.039"},{"key":"S0218126622501584BIB037","doi-asserted-by":"publisher","DOI":"10.1080\/17517575.2020.1791361"},{"key":"S0218126622501584BIB038","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.101.2001126"},{"key":"S0218126622501584BIB039","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2021.3098422"},{"key":"S0218126622501584BIB040","author":"Feng C.","year":"2021","journal-title":"IEEE Trans. Ind. Inform."},{"key":"S0218126622501584BIB041","author":"Yu K.","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"S0218126622501584BIB042","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2021.3120075"},{"key":"S0218126622501584BIB043","author":"Tan L.","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"S0218126622501584BIB044","doi-asserted-by":"publisher","DOI":"10.1016\/j.isatra.2020.03.014"},{"key":"S0218126622501584BIB045","doi-asserted-by":"publisher","DOI":"10.3390\/s20082429"},{"key":"S0218126622501584BIB046","doi-asserted-by":"publisher","DOI":"10.1016\/j.isatra.2019.12.002"},{"key":"S0218126622501584BIB047","doi-asserted-by":"publisher","DOI":"10.1109\/TNSE.2018.2872034"},{"key":"S0218126622501584BIB048","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2017.2752709"},{"key":"S0218126622501584BIB049","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysarc.2020.101739"},{"key":"S0218126622501584BIB050","doi-asserted-by":"publisher","DOI":"10.1109\/TNSE.2018.2830307"},{"key":"S0218126622501584BIB051","doi-asserted-by":"publisher","DOI":"10.1007\/s11280-019-00684-y"},{"key":"S0218126622501584BIB052","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2017.2657006"},{"key":"S0218126622501584BIB053","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2020.3006871"},{"key":"S0218126622501584BIB054","doi-asserted-by":"publisher","DOI":"10.1186\/s13638-019-1616-9"},{"key":"S0218126622501584BIB055","doi-asserted-by":"publisher","DOI":"10.3390\/s18041096"},{"key":"S0218126622501584BIB056","doi-asserted-by":"publisher","DOI":"10.3390\/s21030972"},{"key":"S0218126622501584BIB057","doi-asserted-by":"publisher","DOI":"10.3390\/s20123401"}],"container-title":["Journal of Circuits, Systems and Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218126622501584","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,5,27]],"date-time":"2022-05-27T08:16:03Z","timestamp":1653639363000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0218126622501584"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,16]]},"references-count":57,"journal-issue":{"issue":"09","published-print":{"date-parts":[[2022,6]]}},"alternative-id":["10.1142\/S0218126622501584"],"URL":"https:\/\/doi.org\/10.1142\/s0218126622501584","relation":{},"ISSN":["0218-1266","1793-6454"],"issn-type":[{"value":"0218-1266","type":"print"},{"value":"1793-6454","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,16]]},"article-number":"2250158"}}