{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,11]],"date-time":"2025-12-11T09:24:36Z","timestamp":1765445076955,"version":"3.46.0"},"reference-count":23,"publisher":"Emerald","issue":"6","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,11,25]]},"abstract":"<jats:sec>\n                    <jats:title>Purpose<\/jats:title>\n                    <jats:p>To address the challenge of maintaining stable contact force when a robot end-effector interacts with an unknown environment, this paper aims to propose a force control algorithm based on radial basis function (RBF) neural network stiffness prediction and reinforcement learning.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Design\/methodology\/approach<\/jats:title>\n                    <jats:p>Based on the traditional force controller, reinforcement learning is used to find the optimal control parameters of traditional force control. To enhance the convergence speed of reinforcement learning, an RBF neural network is used to fit the predicted contact environment stiffness, and then the RBF neural network is combined with the Gaussian model, and the predicted stiffness is used to adjust the probability of parameter selection in the selection probability reinforcement learning, thereby accelerating the convergence of the algorithm.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Findings<\/jats:title>\n                    <jats:p>The tracking force error between the normal force and the desired force is consistently maintained within \u00b10.5\u2009N. Compared to PD control with fixed parameters and fuzzy iterative algorithms, the proposed method reduces the average absolute force error by 80% and 45%, respectively.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Research limitations\/implications<\/jats:title>\n                    <jats:p>The reinforcement learning for action prediction in this paper only focuses on the selection of kp value, and the impact on kd will be considered later.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Practical implications<\/jats:title>\n                    <jats:p>This algorithm can be applied to robot processing and inspection scenarios.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Originality\/value<\/jats:title>\n                    <jats:p>The proposed algorithm can improve the search speed for robot force control parameters and enhance force control accuracy.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1108\/ir-01-2025-0033","type":"journal-article","created":{"date-parts":[[2025,3,22]],"date-time":"2025-03-22T07:59:59Z","timestamp":1742630399000},"page":"888-894","source":"Crossref","is-referenced-by-count":0,"title":["Research on robot force control based on RBF neural network stiffness prediction and reinforcement learning"],"prefix":"10.1108","volume":"52","author":[{"given":"Meng","family":"Xiao","sequence":"first","affiliation":[{"name":"Shunde Polytechnic School of Intelligent Manufacturing, , Foshan,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"LikeTing","family":"Li","sequence":"additional","affiliation":[{"name":"Northwestern Polytechnical University School of Software, , Xi\u2019an,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haotian","family":"Jin","sequence":"additional","affiliation":[{"name":"Southwest Jiaotong University School of Computing and Artificial Intelligence, , Chengdu,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Danyang","family":"Bao","sequence":"additional","affiliation":[{"name":"Shenzhen Polytechnic University School of Mechanical and Electrical Engineering, , Shenzhen,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fangting","family":"Huang","sequence":"additional","affiliation":[{"name":"Shenzhen Polytechnic University School of Artificial Intelligence, , Shenzhen,","place":["China"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","published-online":{"date-parts":[[2025,3,25]]},"reference":[{"issue":"6","key":"2025121104212742300_ref001","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/MSP.2017.2743240","article-title":"Deep reinforcement learning: a brief survey","volume":"34","author":"Arulkumaran","year":"2017","journal-title":"IEEE Signal Processing Magazine"},{"issue":"6","key":"2025121104212742300_ref002","doi-asserted-by":"crossref","first-page":"486","DOI":"10.2316\/J.2022.206-0680","article-title":"Design and control of a rehabilitation robot manipulator for head\u2013neck orthopaedic disorders","volume":"37","author":"Bayram","year":"2022","journal-title":"International Journal of Robotics and Automation"},{"issue":"4","key":"2025121104212742300_ref003","doi-asserted-by":"crossref","first-page":"6129","DOI":"10.1109\/LRA.2020.3011379","article-title":"Learning variable impedance control for contact sensitive tasks","volume":"5","author":"Bogdanovic","year":"2020","journal-title":"IEEE Robotics and Automation Letters"},{"issue":"2","key":"2025121104212742300_ref004","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1108\/IR-09-2019-0191","article-title":"Smooth adaptive hybrid impedance control for robotic contact force tracking in dynamic environments","volume":"47","author":"Cao","year":"2020","journal-title":"Industrial Robot: The International Journal of Robotics Research and Application"},{"issue":"24","key":"2025121104212742300_ref005","doi-asserted-by":"crossref","first-page":"30677","DOI":"10.1007\/s10489-023-05156-5","article-title":"Active compliance control of robot peg-in-hole assembly based on combined reinforcement learning","volume":"53","author":"Chen","year":"2023","journal-title":"Applied Intelligence"},{"key":"2025121104212742300_ref006","first-page":"216","article-title":"Impedance control and parameter optimization of surface polishing robot based on reinforcement learning","author":"Ding","year":"2023"},{"issue":"7","key":"2025121104212742300_ref007","doi-asserted-by":"crossref","first-page":"3762","DOI":"10.3390\/s23073762","article-title":"A survey on deep reinforcement learning algorithms for robotic manipulation","volume":"23","author":"Han","year":"2023","journal-title":"Sensors"},{"key":"2025121104212742300_ref008","doi-asserted-by":"crossref","first-page":"117343","DOI":"10.1016\/j.eswa.2022.117343","article-title":"NROWAN-DQN: a stable noisy network with noise reduction and online weight adjustment for exploration","volume":"203","author":"Han","year":"2022","journal-title":"Expert Systems with Applications"},{"key":"2025121104212742300_ref009","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1016\/j.neucom.2021.03.033","article-title":"Adaptive bias RBF neural network control for a robotic manipulator","volume":"447","author":"Liu","year":"2021","journal-title":"Neurocomputing"},{"issue":"1","key":"2025121104212742300_ref010","doi-asserted-by":"crossref","first-page":"22","DOI":"10.3390\/robotics10010022","article-title":"Deep reinforcement learning for the control of robotic manipulation: a focussed mini-review","volume":"10","author":"Liu","year":"2021","journal-title":"Robotics"},{"issue":"9","key":"2025121104212742300_ref011","doi-asserted-by":"crossref","first-page":"2787","DOI":"10.1109\/TBME.2021.3054413","article-title":"Autonomic robotic ultrasound imaging system based on reinforcement learning","volume":"68","author":"Ning","year":"2021","journal-title":"IEEE Transactions on Biomedical Engineering"},{"key":"2025121104212742300_ref012","first-page":"1","article-title":"Deep exploration via bootstrapped DQN","volume":"29","author":"Osband","year":"2016","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2025121104212742300_ref013","first-page":"519","article-title":"Optimization of static performance for robot polishing system based on work stiffness evaluation","author":"Pan","year":"2023"},{"issue":"9","key":"2025121104212742300_ref014","doi-asserted-by":"crossref","first-page":"4551","DOI":"10.1109\/TNNLS.2021.3057958","article-title":"Neural networks enhanced optimal admittance control of robot\u2013environment interaction using reinforcement learning","volume":"33","author":"Peng","year":"2022","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"2025121104212742300_ref015","doi-asserted-by":"crossref","first-page":"103771","DOI":"10.1016\/j.artint.2022.103771","article-title":"Q-Learning-based model predictive variable impedance control for physical human-robot collaboration","volume":"312","author":"Roveda","year":"2022","journal-title":"Artificial Intelligence"},{"issue":"2","key":"2025121104212742300_ref016","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1109\/TRA.2002.999642","article-title":"Adaptive force control of position\/velocity controlled robots: theory and experiment","volume":"18","author":"Roy","year":"2002","journal-title":"IEEE Transactions on Robotics and Automation"},{"issue":"10","key":"2025121104212742300_ref017","doi-asserted-by":"crossref","first-page":"4702","DOI":"10.3390\/s23104702","article-title":"Research on surface tracking and constant force control of a grinding robot","volume":"23","author":"Shi","year":"2023","journal-title":"Sensors"},{"key":"2025121104212742300_ref018","doi-asserted-by":"crossref","first-page":"101996","DOI":"10.1016\/j.rcim.2020.101996","article-title":"A peg-in-hole robot assembly system based on Gauss mixture model","volume":"67","author":"Song","year":"2021","journal-title":"Robotics and Computer-Integrated Manufacturing"},{"key":"2025121104212742300_ref019","doi-asserted-by":"crossref","first-page":"104224","DOI":"10.1016\/j.robot.2022.104224","article-title":"A survey of robot manipulation in contact","volume":"156","author":"Suomalainen","year":"2022","journal-title":"Robotics and Autonomous Systems"},{"key":"2025121104212742300_ref020","doi-asserted-by":"crossref","first-page":"103870","DOI":"10.1016\/j.robot.2021.103870","article-title":"Hybrid force\/position control in workspace of robotic manipulator in uncertain environments based on adaptive fuzzy control","volume":"145","author":"Wang","year":"2021","journal-title":"Robotics and Autonomous Systems"},{"issue":"2","key":"2025121104212742300_ref021","doi-asserted-by":"crossref","first-page":"561","DOI":"10.3390\/s18020561","article-title":"Force modeling, identification, and feedback control of robot-assisted needle insertion: a survey of the literature","volume":"18","author":"Yang","year":"2018","journal-title":"Sensors"},{"issue":"4","key":"2025121104212742300_ref022","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1007\/s10846-022-01688-z","article-title":"Online optimization method of controller parameters for robot constant force grinding based on deep reinforcement learning rainbow","volume":"105","author":"Zhang","year":"2022","journal-title":"Journal of Intelligent & Robotic Systems"},{"key":"2025121104212742300_ref023","first-page":"e3491845","article-title":"Constant force PID control for robotic manipulator based on fuzzy neural network algorithm","volume":"2020","author":"Zhu","year":"2020","journal-title":"Complexity"}],"container-title":["Industrial Robot: the international journal of robotics research and application"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IR-01-2025-0033\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/ir\/article-pdf\/52\/6\/888\/10834173\/ir-01-2025-0033en.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/www.emerald.com\/ir\/article-pdf\/52\/6\/888\/10834173\/ir-01-2025-0033en.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,11]],"date-time":"2025-12-11T09:21:39Z","timestamp":1765444899000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.emerald.com\/ir\/article\/52\/6\/888\/1251324\/Research-on-robot-force-control-based-on-RBF"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,25]]},"references-count":23,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2025,11,25]]}},"URL":"https:\/\/doi.org\/10.1108\/ir-01-2025-0033","relation":{},"ISSN":["0143-991X","1758-5791"],"issn-type":[{"type":"print","value":"0143-991X"},{"type":"electronic","value":"1758-5791"}],"subject":[],"published":{"date-parts":[[2025,3,25]]}}}