{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T21:50:22Z","timestamp":1792792222471,"version":"4.5.0"},"reference-count":77,"publisher":"SAGE Publications","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["ICA"],"published-print":{"date-parts":[[2024,1,30]]},"abstract":"<jats:p>In this paper, we propose a novel Reinforcement Learning (RL) algorithm for robotic motion control, that is, a constrained Deep Deterministic Policy Gradient (DDPG) deviation learning strategy to assist biped robots in walking safely and accurately. The previous research on this topic highlighted the limitations in the controller\u2019s ability to accurately track foot placement on discrete terrains and the lack of consideration for safety concerns. In this study, we address these challenges by focusing on ensuring the overall system\u2019s safety. To begin with, we tackle the inverse kinematics problem by introducing constraints to the damping least squares method. This enhancement not only addresses singularity issues but also guarantees safe ranges for joint angles, thus ensuring the stability and reliability of the system. Based on this, we propose the adoption of the constrained DDPG method to correct controller deviations. In constrained DDPG, we incorporate a constraint layer into the Actor network, incorporating joint deviations as state inputs. By conducting offline training within the range of safe angles, it serves as a deviation corrector. Lastly, we validate the effectiveness of our proposed approach by conducting dynamic simulations using the CRANE biped robot. Through comprehensive assessments, including singularity analysis, constraint effectiveness evaluation, and walking experiments on discrete terrains, we demonstrate the superiority and practicality of our approach in enhancing walking performance while ensuring safety. Overall, our research contributes to the advancement of biped robot locomotion by addressing gait optimisation from multiple perspectives, including singularity handling, safety constraints, and deviation learning.<\/jats:p>","DOI":"10.3233\/ica-230724","type":"journal-article","created":{"date-parts":[[2023,12,19]],"date-time":"2023-12-19T12:17:10Z","timestamp":1702988230000},"page":"139-156","source":"Crossref","is-referenced-by-count":14,"title":["Deep deterministic policy gradient with constraints for gait optimisation of biped robots"],"prefix":"10.1177","volume":"31","author":[{"given":"Xingyang","family":"Liu","sequence":"first","affiliation":[{"name":"School of Electrical Engineering, Southwest Jiaotong University, Chengdu, Sichuan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haina","family":"Rong","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering, Southwest Jiaotong University, Chengdu, Sichuan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ferrante","family":"Neri","sequence":"additional","affiliation":[{"name":"Nature Inspired Computing and Engineering Research Group, School of Computer Science and Electronic Engineering, University of Surrey, Guildford, UK"},{"name":"School of Software, Nanjing University of Information Science and Technology, Jiangsu, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peng","family":"Yue","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Synthetical Automation for Process Industries, Northeastern University, Shenyang, Liaoning, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gexiang","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Control Engineering, Chengdu University of Information Technology, Chengdu, Sichuan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","reference":[{"issue":"11","key":"10.3233\/ICA-230724_ref4","doi-asserted-by":"crossref","first-page":"11414","DOI":"10.1109\/TIE.2021.3125671","article-title":"Velocity-based gait planning for underactuated bipedal robot on uneven and compliant terrain","volume":"69","author":"Yao","year":"2021","journal-title":"IEEE Transactions on Industrial Electronics"},{"issue":"5","key":"10.3233\/ICA-230724_ref5","doi-asserted-by":"crossref","first-page":"3463","DOI":"10.1109\/TMECH.2021.3139332","article-title":"Resistant compliance control for biped robot inspired by humanlike behavior","volume":"27","author":"Huang","year":"2022","journal-title":"IEEE\/ASME Transactions on Mechatronics"},{"issue":"08","key":"10.3233\/ICA-230724_ref6","doi-asserted-by":"crossref","first-page":"2150028","DOI":"10.1142\/S0129065721500283","article-title":"A neurorobotic embodiment for exploring the dynamical interactions of a spiking cerebellar model and a robot arm during vision-based manipulation tasks","volume":"32","author":"Zahra","year":"2022","journal-title":"International Journal of Neural Systems"},{"issue":"2","key":"10.3233\/ICA-230724_ref9","doi-asserted-by":"crossref","first-page":"3745","DOI":"10.1109\/LRA.2020.2979625","article-title":"LQR-assisted whole-body control of a wheeled bipedal robot with kinematic loops","volume":"5","author":"Klemm","year":"2020","journal-title":"IEEE Robotics and Automation Letters"},{"issue":"4","key":"10.3233\/ICA-230724_ref10","doi-asserted-by":"crossref","first-page":"11831","DOI":"10.1109\/LRA.2022.3204367","article-title":"A sequential mpc approach to reactive planning for bipedal robots using safe corridors in highly cluttered environments","volume":"7","author":"Narkhede","year":"2022","journal-title":"IEEE Robotics and Automation Letters"},{"issue":"5","key":"10.3233\/ICA-230724_ref11","doi-asserted-by":"crossref","first-page":"558","DOI":"10.1111\/mice.12756","article-title":"Gait trajectory-based interactive controller for lower limb exoskeletons for construction workers","volume":"37","author":"Ren","year":"2022","journal-title":"Computer-Aided Civil and Infrastructure Engineering"},{"issue":"12","key":"10.3233\/ICA-230724_ref12","doi-asserted-by":"crossref","first-page":"1521","DOI":"10.1111\/mice.12811","article-title":"Recognizing object surface materials to adapt robotic disinfection in infrastructure facilities","volume":"37","author":"Hu","year":"2022","journal-title":"Computer-Aided Civil and Infrastructure Engineering"},{"issue":"2","key":"10.3233\/ICA-230724_ref13","doi-asserted-by":"crossref","first-page":"683","DOI":"10.1109\/TRO.2021.3088062","article-title":"Toward reactive walking: Control of biped robots exploiting an event-based fsm","volume":"38","author":"Lee","year":"2021","journal-title":"IEEE Transactions on Robotics"},{"issue":"3","key":"10.3233\/ICA-230724_ref14","doi-asserted-by":"crossref","first-page":"8006","DOI":"10.1109\/LRA.2022.3187253","article-title":"Preemptive foot compliance to lower impact during biped robot walking over unknown terrain","volume":"7","author":"Guadarrama-Olvera","year":"2022","journal-title":"IEEE Robotics and Automation Letters"},{"key":"10.3233\/ICA-230724_ref15","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-51591-1_18"},{"issue":"6","key":"10.3233\/ICA-230724_ref16","doi-asserted-by":"crossref","first-page":"18881930","DOI":"10.1017\/S0263574723000097","article-title":"A review on gait generation of the biped robot on various terrains","volume":"41","author":"Khan","year":"2023","journal-title":"Robotica"},{"issue":"2","key":"10.3233\/ICA-230724_ref17","doi-asserted-by":"crossref","first-page":"1952","DOI":"10.1109\/LRA.2022.3141763","article-title":"Convex iteration for distance-geometric inverse kinematics","volume":"7","author":"Giamou","year":"2022","journal-title":"IEEE Robotics and Automation Letters"},{"issue":"3","key":"10.3233\/ICA-230724_ref18","doi-asserted-by":"crossref","first-page":"7177","DOI":"10.1109\/LRA.2022.3181374","article-title":"IKFlow: Generating diverse inverse kinematics solutions","volume":"7","author":"Ames","year":"2022","journal-title":"IEEE Robotics and Automation Letters"},{"issue":"12","key":"10.3233\/ICA-230724_ref19","doi-asserted-by":"crossref","first-page":"8014","DOI":"10.1109\/TII.2021.3060019","article-title":"A modified DLS scheme with controlled cyclic solution for inverse kinematics in redundant robots","volume":"17","author":"Safeea","year":"2021","journal-title":"IEEE Transactions on Industrial Informatics"},{"key":"10.3233\/ICA-230724_ref20","doi-asserted-by":"crossref","first-page":"101961","DOI":"10.1016\/j.rcim.2020.101961","article-title":"Forward and inverse kinematics of a 5-DOF hybrid robot for composite material machining","volume":"65","author":"Ye","year":"2020","journal-title":"Robotics and Computer-Integrated Manufacturing"},{"issue":"3","key":"10.3233\/ICA-230724_ref21","doi-asserted-by":"crossref","first-page":"257","DOI":"10.3233\/ICA-210660","article-title":"A modified firefly algorithm for the inverse kinematics solutions of robotic manipulators","volume":"28","author":"Hern\u00e1ndez-Barrag\u00e1n","year":"2021","journal-title":"Integrated Computer-Aided Engineering"},{"issue":"6","key":"10.3233\/ICA-230724_ref22","doi-asserted-by":"crossref","first-page":"1564","DOI":"10.1109\/TFUZZ.2022.3157075","article-title":"Fuzzy approximation-based task-space control of robot manipulators with remote center of motion constraint","volume":"30","author":"Su","year":"2022","journal-title":"IEEE Transactions on Fuzzy Systems"},{"issue":"4","key":"10.3233\/ICA-230724_ref23","doi-asserted-by":"crossref","first-page":"1937","DOI":"10.1109\/TASE.2020.2983225","article-title":"Admittance-based controller design for physical human-robot interaction in the constrained task space","volume":"17","author":"He","year":"2020","journal-title":"IEEE Transactions on Automation Science and Engineering"},{"issue":"6","key":"10.3233\/ICA-230724_ref24","doi-asserted-by":"crossref","first-page":"5057","DOI":"10.1109\/TIE.2020.2989711","article-title":"Adaptive-neural-network-based trajectory tracking control for a nonholonomic wheeled mobile robot with velocity constraints","volume":"68","author":"Chen","year":"2020","journal-title":"IEEE Transactions on Industrial Electronics"},{"issue":"12","key":"10.3233\/ICA-230724_ref25","doi-asserted-by":"crossref","first-page":"13237","DOI":"10.1109\/TCYB.2021.3107357","article-title":"Adaptive-constrained impedance control for human-robot co-transportation","volume":"52","author":"Yu","year":"2021","journal-title":"IEEE Transactions on Cybernetics"},{"issue":"2","key":"10.3233\/ICA-230724_ref26","doi-asserted-by":"crossref","first-page":"105","DOI":"10.3233\/ICA-230698","article-title":"A human-simulated fuzzy membrane approach for the joint controller of walking biped robots","volume":"30","author":"Liu","year":"2023","journal-title":"Integrated Computer-Aided Engineering"},{"issue":"1","key":"10.3233\/ICA-230724_ref27","doi-asserted-by":"crossref","first-page":"53","DOI":"10.3233\/ICA-220688","article-title":"Reinforcement learning strategies for vessel navigation","volume":"30","author":"Daranda","year":"2023","journal-title":"Integrated Computer-Aided Engineering"},{"issue":"2","key":"10.3233\/ICA-230724_ref28","doi-asserted-by":"crossref","first-page":"139","DOI":"10.3233\/ICA-190613","article-title":"Routing in congested baggage handling systems using deep reinforcement learning","volume":"27","author":"S\u00f8rensen","year":"2020","journal-title":"Integrated Computer-Aided Engineering"},{"key":"10.3233\/ICA-230724_ref29","doi-asserted-by":"crossref","unstructured":"K\u00fc\u00e7\u00fckoglu B, Rueckauer B, Ahmad N, de Ruyter van Steveninck J, G\u00fc\u00e7l\u00fc U, van Gerven M. Optimization of neuroprosthetic vision via end-to-end deep reinforcement learning. International Journal of Neural Systems. 2022; 32(11): 2250052:1-2250052:16.","DOI":"10.1142\/S0129065722500526"},{"issue":"8","key":"10.3233\/ICA-230724_ref30","doi-asserted-by":"crossref","first-page":"12845","DOI":"10.1111\/exsy.12845","article-title":"Integrating structural control, health monitoring, and energy harvesting for smart cities","volume":"38","author":"Javadinasab Hormozabad","year":"2021","journal-title":"Expert Systems"},{"key":"10.3233\/ICA-230724_ref31","doi-asserted-by":"crossref","first-page":"536","DOI":"10.1016\/j.engstruct.2019.02.031","article-title":"Semi-active vibration control of smart isolated highway bridge structures using replicator dynamics","volume":"186","author":"Gutierrez Soto","year":"2019","journal-title":"Engineering Structures"},{"issue":"6","key":"10.3233\/ICA-230724_ref32","doi-asserted-by":"crossref","first-page":"12354","DOI":"10.1111\/exsy.12354","article-title":"Control methodologies for vibration control of smart civil and mechanical structures","volume":"35","author":"Li","year":"2018","journal-title":"Expert Systems"},{"key":"10.3233\/ICA-230724_ref33","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1016\/j.engstruct.2017.09.037","article-title":"Vibration control of smart base-isolated irregular buildings using neural dynamic optimization model and replicator dynamics","volume":"156","author":"Gutierrez Soto","year":"2018","journal-title":"Engineering Structures"},{"key":"10.3233\/ICA-230724_ref35","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1016\/j.engappai.2015.01.018","article-title":"Self-constructing wavelet neural network algorithm for nonlinear control of large structures","volume":"41","author":"Wang","year":"2015","journal-title":"Engineering Applications of Artificial Intelligence"},{"key":"10.3233\/ICA-230724_ref36","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.engappai.2016.05.008","article-title":"New discrete-time robust H2\/H\u221e algorithm for vibration control of smart structures using linear matrix inequalities","volume":"55","author":"Li","year":"2016","journal-title":"Engineering Applications of Artificial Intelligence"},{"issue":"5","key":"10.3233\/ICA-230724_ref37","doi-asserted-by":"crossref","first-page":"3564","DOI":"10.21595\/jve.2017.18900","article-title":"Invited Review: Recent developments in vibration control of building and bridge structures","volume":"19","author":"Ghaedi","year":"2017","journal-title":"Journal of Vibroengineering"},{"issue":"2","key":"10.3233\/ICA-230724_ref38","doi-asserted-by":"crossref","first-page":"e12205","DOI":"10.1111\/exsy.12205","article-title":"Recent advances in control algorithms for smart structures and machines","volume":"34","author":"Gutierrez Soto","year":"2017","journal-title":"Expert Systems"},{"issue":"6","key":"10.3233\/ICA-230724_ref39","doi-asserted-by":"crossref","first-page":"4300","DOI":"10.21595\/jve.2017.18924","article-title":"Multi-agent replicator controller for sustainable vibration control of smart structures","volume":"19","author":"Soto","year":"2017","journal-title":"Journal of Vibroengineering"},{"key":"10.3233\/ICA-230724_ref40","doi-asserted-by":"crossref","first-page":"1521","DOI":"10.1007\/s00158-017-1835-9","article-title":"Many-objective control optimization of high-rise building structures using replicator dynamics and neural dynamics model","volume":"56","author":"Gutierrez Soto","year":"2017","journal-title":"Structural and Multidisciplinary Optimization"},{"issue":"2","key":"10.3233\/ICA-230724_ref41","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1177\/109434209300700206","article-title":"A concurrent adaptive conjugate gradient learning algorithm on MIMD shared-memory machines","volume":"7","author":"Adeli","year":"1993","journal-title":"The International Journal of Supercomputing Applications"},{"issue":"6","key":"10.3233\/ICA-230724_ref42","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1016\/0925-2312(93)90042-2","article-title":"Parallel backpropagation learning algorithms on Cray Y-MP8\/864 supercomputer","volume":"5","author":"Hung","year":"1993","journal-title":"Neurocomputing"},{"issue":"6","key":"10.3233\/ICA-230724_ref43","doi-asserted-by":"crossref","first-page":"900","DOI":"10.1109\/72.329686","article-title":"A parallel genetic\/neural network learning algorithm for MIMD shared memory machines","volume":"5","author":"Hung","year":"1994","journal-title":"IEEE Transactions on Neural Networks"},{"issue":"1","key":"10.3233\/ICA-230724_ref44","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/0096-3003(94)90134-1","article-title":"An adaptive conjugate gradient learning algorithm for efficient training of neural networks","volume":"62","author":"Adeli","year":"1994","journal-title":"Applied Mathematics and Computation"},{"issue":"05","key":"10.3233\/ICA-230724_ref46","doi-asserted-by":"crossref","first-page":"2250021","DOI":"10.1142\/S0129065722500216","article-title":"Deep learning methods for multi-channel EEG-based emotion recognition","volume":"32","author":"Olamat","year":"2022","journal-title":"International Journal of Neural Systems"},{"issue":"1","key":"10.3233\/ICA-230724_ref47","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1111\/mice.12829","article-title":"A hybrid spatial-temporal deep learning architecture for lane detection","volume":"38","author":"Dong","year":"2023","journal-title":"Computer-Aided Civil and Infrastructure Engineering"},{"issue":"6","key":"10.3233\/ICA-230724_ref48","doi-asserted-by":"crossref","first-page":"e12494","DOI":"10.1111\/exsy.12494","article-title":"A novel end-to-end deep learning scheme for classifying multi-class motor imagery electroencephalography signals","volume":"36","author":"Hassanpour","year":"2019","journal-title":"Expert Systems"},{"issue":"4","key":"10.3233\/ICA-230724_ref49","doi-asserted-by":"crossref","first-page":"8807","DOI":"10.1109\/LRA.2022.3188100","article-title":"Energy-based legged robots terrain traversability modeling via deep inverse reinforcement learning","volume":"7","author":"Gan","year":"2022","journal-title":"IEEE Robotics and Automation Letters"},{"issue":"1","key":"10.3233\/ICA-230724_ref50","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1109\/TRO.2021.3084374","article-title":"Cat-like jumping and landing of legged robots in low gravity using deep reinforcement learning","volume":"38","author":"Rudin","year":"2021","journal-title":"IEEE Transactions on Robotics"},{"issue":"2","key":"10.3233\/ICA-230724_ref51","doi-asserted-by":"crossref","first-page":"3699","DOI":"10.1109\/LRA.2020.2979660","article-title":"Deepgait: Planning and control of quadrupedal gaits using deep reinforcement learning","volume":"5","author":"Tsounis","year":"2020","journal-title":"IEEE Robotics and Automation Letters"},{"issue":"4","key":"10.3233\/ICA-230724_ref52","doi-asserted-by":"crossref","first-page":"536","DOI":"10.1109\/JETCAS.2020.3033135","article-title":"Learning to walk: Bio-mimetic hexapod locomotion via reinforcement-based spiking central pattern generation","volume":"10","author":"Lele","year":"2020","journal-title":"IEEE Journal on Emerging and Selected Topics in Circuits and Systems"},{"issue":"3","key":"10.3233\/ICA-230724_ref53","doi-asserted-by":"crossref","first-page":"6471","DOI":"10.1109\/LRA.2022.3174367","article-title":"Validating robotics simulators on real-world impacts","volume":"7","author":"Acosta","year":"2022","journal-title":"IEEE Robotics and Automation Letters"},{"issue":"4","key":"10.3233\/ICA-230724_ref54","doi-asserted-by":"crossref","first-page":"11958","DOI":"10.1109\/LRA.2022.3207567","article-title":"Learning setup policies: Reliable transition between locomotion behaviours","volume":"7","author":"Tidd","year":"2022","journal-title":"IEEE Robotics and Automation Letters"},{"issue":"4","key":"10.3233\/ICA-230724_ref55","doi-asserted-by":"crossref","first-page":"1022","DOI":"10.1109\/TMRB.2022.3205509","article-title":"Biomechanical trajectory optimization of human sit-to-stand motion with stochastic motion planning framework","volume":"4","author":"Sharma","year":"2022","journal-title":"IEEE Transactions on Medical Robotics and Bionics"},{"issue":"4","key":"10.3233\/ICA-230724_ref56","doi-asserted-by":"crossref","first-page":"10312","DOI":"10.1109\/LRA.2022.3191071","article-title":"Multi-modal legged locomotion framework with automated residual reinforcement learning","volume":"7","author":"Yu","year":"2022","journal-title":"IEEE Robotics and Automation Letters"},{"issue":"3","key":"10.3233\/ICA-230724_ref57","doi-asserted-by":"crossref","first-page":"4376","DOI":"10.1109\/LRA.2020.2990743","article-title":"Data-efficient and safe learning for humanoid locomotion aided by a dynamic balancing model","volume":"5","author":"Ahn","year":"2020","journal-title":"IEEE Robotics and Automation Letters"},{"issue":"6","key":"10.3233\/ICA-230724_ref58","doi-asserted-by":"crossref","first-page":"7686","DOI":"10.1109\/TPAMI.2022.3223407","article-title":"Reward-adaptive reinforcement learning: Dynamic policy gradient optimization for bipedal locomotion","volume":"45","author":"Huang","year":"2022","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"2","key":"10.3233\/ICA-230724_ref59","doi-asserted-by":"crossref","first-page":"121","DOI":"10.3233\/ICA-230702","article-title":"An improved deep learning architecture for multi-object tracking systems","volume":"30","author":"Urdiales","year":"2023","journal-title":"Integrated Computer-Aided Engineering"},{"issue":"2","key":"10.3233\/ICA-230724_ref60","doi-asserted-by":"crossref","first-page":"191","DOI":"10.3233\/ICA-200640","article-title":"Multi-stage deep learning perception system for mobile robots","volume":"28","author":"Macias-Garcia","year":"2021","journal-title":"Integrated Computer-Aided Engineering"},{"issue":"3","key":"10.3233\/ICA-230724_ref61","doi-asserted-by":"crossref","first-page":"221","DOI":"10.3233\/ICA-210649","article-title":"An ensemble deep learning method with optimized weights for drone-based water rescue and surveillance","volume":"28","author":"Gasienica-J\u00f3zkowy","year":"2021","journal-title":"Integrated Computer-Aided Engineering"},{"issue":"3","key":"10.3233\/ICA-230724_ref62","doi-asserted-by":"crossref","first-page":"277","DOI":"10.3233\/ICA-210651","article-title":"Back-propagation of the Mahalanobis istance through a deep triplet learning model for person Re-Identification","volume":"28","author":"G\u00f3mez-Silva","year":"2021","journal-title":"Integrated Computer-Aided Engineering"},{"issue":"6","key":"10.3233\/ICA-230724_ref63","first-page":"2802","article-title":"Parallel deep reinforcement learning method for gait control of biped robot","volume":"69","author":"Tao","year":"2022","journal-title":"IEEE Transactions on Circuits and Systems II: Express Briefs"},{"issue":"3","key":"10.3233\/ICA-230724_ref64","doi-asserted-by":"crossref","first-page":"1658","DOI":"10.1109\/TII.2018.2868859","article-title":"Feedback deep deterministic policy gradient with fuzzy reward for robotic multiple peg-in-hole assembly tasks","volume":"15","author":"Xu","year":"2018","journal-title":"IEEE Transactions on Industrial Informatics"},{"issue":"3","key":"10.3233\/ICA-230724_ref65","doi-asserted-by":"crossref","first-page":"2514","DOI":"10.1109\/TASE.2021.3088004","article-title":"A deep deterministic policy gradient approach for vehicle speed tracking control with a robotic driver","volume":"19","author":"Hao","year":"2021","journal-title":"IEEE Transactions on Automation Science and Engineering"},{"issue":"6","key":"10.3233\/ICA-230724_ref66","doi-asserted-by":"crossref","first-page":"3675","DOI":"10.1109\/TSMC.2022.3230666","article-title":"Improved deep deterministic policy gradient for dynamic obstacle avoidance of mobile robot","volume":"53","author":"Gao","year":"2023","journal-title":"IEEE Transactions on Systems, Man, and Cybernetics: Systems"},{"issue":"6","key":"10.3233\/ICA-230724_ref67","doi-asserted-by":"crossref","first-page":"4643","DOI":"10.1109\/TMECH.2022.3160605","article-title":"Trajectory generation for multiprocess robotic tasks based on nested dual-memory deep deterministic policy gradient","volume":"27","author":"Ying","year":"2022","journal-title":"IEEE\/ASME Transactions on Mechatronics"},{"key":"10.3233\/ICA-230724_ref68","doi-asserted-by":"crossref","first-page":"102570","DOI":"10.1016\/j.rcim.2023.102570","article-title":"Hierarchical multi-robot navigation and formation in unknown environments via deep reinforcement learning and distributed optimization","volume":"83","author":"Chang","year":"2023","journal-title":"Robotics and Computer-Integrated Manufacturing"},{"issue":"1","key":"10.3233\/ICA-230724_ref69","doi-asserted-by":"crossref","first-page":"37","DOI":"10.3233\/ICA-190604","article-title":"An agent-based method for trust graph calculation in resource constrained environments","volume":"27","author":"Bordel","year":"2020","journal-title":"Integrated Computer-Aided Engineering"},{"issue":"2","key":"10.3233\/ICA-230724_ref70","doi-asserted-by":"crossref","first-page":"169","DOI":"10.3233\/ICA-230703","article-title":"Using sensor data to detect time-constraints in ontology evolution","volume":"30","author":"Canito","year":"2023","journal-title":"Integrated Computer-Aided Engineering"},{"issue":"99","key":"10.3233\/ICA-230724_ref71","first-page":"1","article-title":"The hierarchical newtons method for numerically stable prioritized dynamic control","author":"Pfeiffer","year":"2023","journal-title":"IEEE Transactions on Control Systems Technology"},{"issue":"5","key":"10.3233\/ICA-230724_ref72","doi-asserted-by":"crossref","first-page":"1680","DOI":"10.1109\/TRO.2021.3065241","article-title":"Legged robot running using a physics-data hybrid motion template","volume":"37","author":"Yang","year":"2021","journal-title":"IEEE Transactions on Robotics"},{"issue":"4","key":"10.3233\/ICA-230724_ref73","doi-asserted-by":"crossref","first-page":"2246","DOI":"10.1109\/TMECH.2021.3100879","article-title":"Flexible motion framework of the six wheel-legged robot: Experimental results","volume":"27","author":"Wang","year":"2021","journal-title":"IEEE\/ASME Transactions on Mechatronics"},{"key":"10.3233\/ICA-230724_ref75","doi-asserted-by":"crossref","first-page":"108841","DOI":"10.1016\/j.automatica.2020.108841","article-title":"Local stability of PD controlled bipedal walking robots","volume":"114","author":"Kolathaya","year":"2020","journal-title":"Automatica"},{"key":"10.3233\/ICA-230724_ref76","doi-asserted-by":"crossref","unstructured":"Shahabi MS, Shalbaf A, Nobakhsh B, Rostami R, Kazemi R. Attention-based convolutional recurrent deep neural networks for the prediction of response to repetitive transcranial magnetic stimulation for major depressive disorder. International Journal of Neural Systems. 2023; 33(2): 2350007:1-2350007:13.","DOI":"10.1038\/s41598-023-35545-2"},{"key":"10.3233\/ICA-230724_ref77","doi-asserted-by":"crossref","unstructured":"Hu T, Xie L, Zhang L, Li G, Yi Z. Deep multimodal neuralnetwork based on data-feature fusion for patient-specific quality assurance. International Journal of Neural Systems. 2022; 32(1): 2150055:1-2150055:14.","DOI":"10.1142\/S0129065721500556"},{"key":"10.3233\/ICA-230724_ref78","doi-asserted-by":"crossref","unstructured":"Yu Z, Albera L, Jeannes RLB, Kachenoura A, Karfoul A, Yang C, et al. Epileptic seizure prediction using deep neural networks via transfer learning and multi-feature fusion. International Journal of Neural Systems. 2022; 32(7): 2250032:1-2250032:19.","DOI":"10.1142\/S0129065722500320"},{"key":"10.3233\/ICA-230724_ref79","doi-asserted-by":"crossref","unstructured":"Ardakani HA, Taghizadeh M, Shayegh F. Diagnosis of autism disorder based on deep network trained by augmented EEG signals. International Journal of Neural Systems. 2022; 32(11): 2250046:1-2250046:16.","DOI":"10.1142\/S0129065722500460"},{"issue":"12","key":"10.3233\/ICA-230724_ref80","doi-asserted-by":"crossref","first-page":"3074","DOI":"10.1109\/TNNLS.2017.2682102","article-title":"A new neural dynamic classification algorithm","volume":"28","author":"Rafiei","year":"2017","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"10.3233\/ICA-230724_ref81","doi-asserted-by":"crossref","first-page":"6393","DOI":"10.1007\/s00521-019-04146-4","article-title":"FEMa: A finite element machine for fast learning","volume":"32","author":"Pereira","year":"2020","journal-title":"Neural Computing and Applications"},{"key":"10.3233\/ICA-230724_ref82","doi-asserted-by":"crossref","first-page":"8675","DOI":"10.1007\/s00521-019-04359-7","article-title":"A dynamic ensemble learning algorithm for neural networks","volume":"32","author":"Alam","year":"2020","journal-title":"Neural Computing and Applications"},{"issue":"3","key":"10.3233\/ICA-230724_ref84","doi-asserted-by":"crossref","first-page":"809","DOI":"10.1109\/LCSYS.2020.3005957","article-title":"PD tracking for a class of underactuated robotic systems with kinetic symmetry","volume":"5","author":"Kolathaya","year":"2020","journal-title":"IEEE Control Systems Letters"},{"issue":"7","key":"10.3233\/ICA-230724_ref85","doi-asserted-by":"crossref","first-page":"7058","DOI":"10.1109\/TITS.2021.3066586","article-title":"A new lane keeping method based on human-simulated intelligent control","volume":"23","author":"Chen","year":"2021","journal-title":"IEEE Transactions on Intelligent Transportation Systems"},{"key":"10.3233\/ICA-230724_ref86","doi-asserted-by":"crossref","first-page":"125949","DOI":"10.1016\/j.physa.2021.125949","article-title":"Human-machine cooperative scheme for car-following control of the connected and automated vehicles","volume":"573","author":"Chen","year":"2021","journal-title":"Physica A: Statistical Mechanics and its Applications"}],"container-title":["Integrated Computer-Aided Engineering"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/ICA-230724","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:14:51Z","timestamp":1777454091000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/ICA-230724"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,30]]},"references-count":77,"journal-issue":{"issue":"2"},"URL":"https:\/\/doi.org\/10.3233\/ica-230724","relation":{},"ISSN":["1069-2509","1875-8835"],"issn-type":[{"value":"1069-2509","type":"print"},{"value":"1875-8835","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,30]]}}}