{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T15:15:14Z","timestamp":1775229314964,"version":"3.50.1"},"reference-count":42,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,3,12]],"date-time":"2024-03-12T00:00:00Z","timestamp":1710201600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neurorobot."],"abstract":"<jats:p>This paper addresses the limitations of current neural ordinary differential equations (NODEs) in modeling and predicting complex dynamics by introducing a novel framework called higher-order-derivative-supervised (HiDeS) NODE. This method extends traditional NODE frameworks by incorporating higher-order derivatives and their interactions into the modeling process, thereby enabling the capture of intricate system behaviors. In addition, the HiDeS NODE employs both the state vector and its higher-order derivatives as supervised signals, which is different from conventional NODEs that utilize only the state vector as a supervised signal. This approach is designed to enhance the predicting capability of NODEs. Through extensive experiments in the complex fields of multi-robot systems and opinion dynamics, the HiDeS NODE demonstrates improved modeling and predicting capabilities over existing models. This research not only proposes an expressive and predictive framework for dynamic systems but also marks the first application of NODEs to the fields of multi-robot systems and opinion dynamics, suggesting broad potential for future interdisciplinary work. The code is available at <jats:ext-link>https:\/\/github.com\/MengLi-Thea\/HiDeS-A-Higher-Order-Derivative-Supervised-Neural-Ordinary-Differential-Equation<\/jats:ext-link>.<\/jats:p>","DOI":"10.3389\/fnbot.2024.1382305","type":"journal-article","created":{"date-parts":[[2024,3,12]],"date-time":"2024-03-12T04:35:32Z","timestamp":1710218132000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["HiDeS: a higher-order-derivative-supervised neural ordinary differential equation for multi-robot systems and opinion dynamics"],"prefix":"10.3389","volume":"18","author":[{"given":"Meng","family":"Li","sequence":"first","affiliation":[]},{"given":"Wenyu","family":"Bian","sequence":"additional","affiliation":[]},{"given":"Liangxiong","family":"Chen","sequence":"additional","affiliation":[]},{"given":"Mei","family":"Liu","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2024,3,12]]},"reference":[{"key":"B1","first-page":"8522","article-title":"\u201cA PID controller approach for stochastic optimization of deep networks,\u201d","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"An","year":"2018"},{"key":"B2","doi-asserted-by":"publisher","first-page":"790060","DOI":"10.3389\/fnbot.2021.790060","article-title":"Control framework for sloped walking with a powered transfemoral prosthesis","volume":"15","author":"Anil Kumar","year":"2022","journal-title":"Front. Neurorobot"},{"key":"B3","doi-asserted-by":"publisher","first-page":"1100","DOI":"10.1109\/TCNS.2022.3220709","article-title":"Agents attraction competition in an extended Friedkin-Johnsen social network","volume":"10","author":"Ao","year":"2023","journal-title":"IEEE Transact. Cont. Netw. Syst"},{"key":"B4","first-page":"8295","article-title":"\u201cAdapt: efficient multi-agent trajectory prediction with adaptation,\u201d","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Aydemir","year":"2023"},{"key":"B5","doi-asserted-by":"publisher","first-page":"048301","DOI":"10.1103\/PhysRevLett.124.048301","article-title":"Modeling echo chambers and polarization dynamics in social networks","volume":"124","author":"Baumann","year":"2020","journal-title":"Phys. Rev. Lett"},{"key":"B6","doi-asserted-by":"publisher","first-page":"6572","DOI":"10.5555\/3327757.3327764","article-title":"Neural ordinary differential equations","volume":"31","author":"Chen","year":"2018","journal-title":"Adv. Neural Inf. Process. Syst"},{"key":"B7","doi-asserted-by":"publisher","first-page":"576","DOI":"10.1016\/j.ins.2023.03.049","article-title":"On robustness of neural ODEs image classifiers","volume":"632","author":"Cui","year":"2023","journal-title":"Inf. Sci"},{"key":"B8","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1145\/2661829.2662064","article-title":"\u201cLearning a linear influence model from transient opinion dynamics,\u201d","volume-title":"Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management","author":"De","year":"2014"},{"key":"B9","doi-asserted-by":"publisher","first-page":"397","DOI":"10.5555\/3157096.3157141","article-title":"Learning and forecasting opinion dynamics in social networks","volume":"29","author":"De","year":"2016","journal-title":"Adv. Neural Inf. Process. Syst"},{"key":"B10","article-title":"\u201cIncorporating Nesterov momentum into Adam,\u201d","author":"Dozat","year":"2016","journal-title":"International Conference on Learning Representations"},{"key":"B11","doi-asserted-by":"publisher","first-page":"3140","DOI":"10.5555\/3454287.3454569","article-title":"Augmented neural ODEs","volume":"32","author":"Dupont","year":"2019","journal-title":"Adv. Neural Inf. Process. Syst"},{"key":"B12","doi-asserted-by":"publisher","first-page":"e2201573119","DOI":"10.1073\/pnas.2201573119","article-title":"Opinion dynamics in financial markets via random networks","volume":"119","author":"Granha","year":"2022","journal-title":"Proc. Nat. Acad. Sci. U. S. A"},{"key":"B13","doi-asserted-by":"publisher","first-page":"4257","DOI":"10.1017\/S0263574722000893","article-title":"Mobile robots path planning and mobile multirobots control: a review","volume":"40","author":"Hichri","year":"2022","journal-title":"Robotica"},{"key":"B14","doi-asserted-by":"publisher","first-page":"1190977","DOI":"10.3389\/fnbot.2023.1190977","article-title":"Advances on intelligent algorithms for scientific computing: an overview","volume":"17","author":"Hua","year":"2023","journal-title":"Front. Neurorobot"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1109\/TASE.2023.3296201.","article-title":"Series PID control with higher-order derivatives for processes approximated by IPDT models","author":"Huba","year":"2023","journal-title":"IEEE Transact. Automat. Sci. Eng"},{"key":"B16","doi-asserted-by":"publisher","first-page":"1065256","DOI":"10.3389\/fnbot.2022.1065256","article-title":"A robust zeroing neural network and its applications to dynamic complex matrix equation solving and robotic manipulator trajectory tracking","volume":"16","author":"Jin","year":"2022","journal-title":"Front. Neurorobot"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1109\/TIV.2024.3358229.","article-title":"Physical-informed neural network for MPC-based trajectory tracking of vehicles with noise considered","author":"Jin","year":"2024","journal-title":"IEEE Transact. Intell. Vehicl"},{"key":"B18","doi-asserted-by":"publisher","first-page":"266","DOI":"10.1109\/TSMC.2020.3018325","article-title":"Deep learning in robotics: survey on model structures and training strategies","volume":"51","author":"K\u00e1roly","year":"2021","journal-title":"IEEE Transact. Syst. Man Cybernet. Syst"},{"key":"B19","doi-asserted-by":"publisher","first-page":"420","DOI":"10.1109\/TNNLS.2019.2904277","article-title":"Distributed fault-tolerant control of multiagent systems: an adaptive learning approach","volume":"31","author":"Khalili","year":"2020","journal-title":"IEEE Transact. Neural Netw. Learn. Syst"},{"key":"B20","volume-title":"On Neural Differential Equations","author":"Kidger","year":"2021"},{"key":"B21","doi-asserted-by":"publisher","first-page":"1174","DOI":"10.1109\/TAC.2020.2994284","article-title":"Macroscopic noisy bounded confidence models with distributed radical opinions","volume":"66","author":"Kolarijani","year":"2021","journal-title":"IEEE Trans. Automat. Contr"},{"key":"B22","first-page":"931","article-title":"\u201cSLANT+: a nonlinear model for opinion dynamics in social networks,\u201d","volume-title":"IEEE International Conference on Data Mining","author":"Kulkarni","year":"2017"},{"key":"B23","doi-asserted-by":"publisher","first-page":"771520","DOI":"10.3389\/frobt.2021.771520","article-title":"Balancing collective exploration and exploitation in multi-agent and multi-robot systems: a review","volume":"8","author":"Kwa","year":"2022","journal-title":"Front. Robot. AI"},{"key":"B24","doi-asserted-by":"publisher","first-page":"6999","DOI":"10.1109\/TNNLS.2021.3084827","article-title":"A survey of convolutional neural networks: analysis, applications, and prospects","volume":"33","author":"Li","year":"2022","journal-title":"IEEE Transact. Neural Netw. Learn. Syst"},{"key":"B25","doi-asserted-by":"publisher","first-page":"120254","DOI":"10.1016\/j.eswa.2023.120254","article-title":"Path planning techniques for mobile robots: review and prospect","volume":"227","author":"Liu","year":"2023","journal-title":"Expert Syst. Appl"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1109\/TIV.2023.3348632.","article-title":"ACP-incorporated perturbation-resistant neural dynamics controller for autonomous vehicles","author":"Liufu","year":"2024","journal-title":"IEEE Transact. Intell. Vehicl"},{"key":"B27","doi-asserted-by":"crossref","first-page":"764","DOI":"10.1145\/3394486.3403119","article-title":"\u201cLearning opinion dynamics from social traces,\u201d","volume-title":"Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery & Data Mining","author":"Monti","year":"2020"},{"key":"B28","doi-asserted-by":"publisher","first-page":"5911","DOI":"10.5555\/3495724.3496220","article-title":"On second order behaviour in augmented neural ODEs","volume":"33","author":"Norcliffe","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst"},{"key":"B29","doi-asserted-by":"crossref","first-page":"1306","DOI":"10.1145\/3534678.3539228","article-title":"\u201cPredicting opinion dynamics via sociologically-informed neural networks,\u201d","volume-title":"Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining","author":"Okawa","year":"2022"},{"key":"B30","doi-asserted-by":"publisher","first-page":"672","DOI":"10.1016\/j.ins.2022.11.101","article-title":"On the role of community structure in evolution of opinion formation: a new bounded confidence opinion dynamics","volume":"621","author":"Peng","year":"2023","journal-title":"Inf. Sci"},{"key":"B31","doi-asserted-by":"publisher","first-page":"864","DOI":"10.1109\/TRO.2020.3036628","article-title":"A sequential composition framework for coordinating multirobot behaviors","volume":"37","author":"Pierpaoli","year":"2021","journal-title":"IEEE Transact. Robot"},{"key":"B32","doi-asserted-by":"publisher","first-page":"735","DOI":"10.1137\/21M1411433","article-title":"Neural ODE control for classification, approximation, and transport","volume":"65","author":"Ruiz-Balet","year":"2023","journal-title":"SIAM Rev"},{"key":"B33","first-page":"9276","article-title":"\u201cMomentum residual neural networks,\u201d","volume-title":"International Conference on Machine Learning","author":"Sander","year":"2021"},{"key":"B34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.5555\/2946645.3053435","article-title":"A differential equation for modeling Nesterov's accelerated gradient method: theory and insights","volume":"17","author":"Su","year":"2016","journal-title":"J. Mach. Learn. Res"},{"key":"B35","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1038\/s42256-023-00627-3","article-title":"Predicting metabolomic profiles from microbial composition through neural ordinary differential equations","volume":"5","author":"Wang","year":"2023","journal-title":"Nat. Mach. Intell"},{"key":"B36","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s40304-017-0103-z","article-title":"A proposal on machine learning via dynamical systems","volume":"1","author":"Weinan","year":"2017","journal-title":"Commun. Math. Stat"},{"key":"B37","doi-asserted-by":"publisher","first-page":"296","DOI":"10.1109\/TSMC.2022.3178230","article-title":"Mixed opinion dynamics based on degroot model and hegselmann-krause model in social networks","volume":"53","author":"Wu","year":"2023","journal-title":"IEEE Transact. Syst. Man Cybernet. Syst"},{"key":"B38","doi-asserted-by":"publisher","first-page":"18646","DOI":"10.48550\/arXiv.2110.04840","article-title":"Heavy ball neural ordinary differential equations","volume":"34","author":"Xia","year":"2021","journal-title":"Adv. Neural Inf. Process. Syst"},{"key":"B39","doi-asserted-by":"publisher","first-page":"6053","DOI":"10.1109\/TCYB.2023.3269773","article-title":"A robot motion learning method using broad learning system verified by small-scale fish-like robot","volume":"53","author":"Xu","year":"2023","journal-title":"IEEE Trans. Cybern"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2023.3281479.","article-title":"Distributed iterative learning control of nonlinear multiagent systems using controller-based dynamic linearization method","author":"Yu","year":"2023","journal-title":"IEEE Transact. Cybernet"},{"key":"B41","doi-asserted-by":"publisher","first-page":"602","DOI":"10.3390\/fractalfract7080602","article-title":"Investigating the effects of a fractional operator on the evolution of the enso model: bifurcations, stability and numerical analysis","volume":"7","author":"Zhang","year":"2023","journal-title":"Fract. Fract"},{"key":"B42","doi-asserted-by":"publisher","first-page":"102031","DOI":"10.1016\/j.ipm.2019.03.010","article-title":"Neural opinion dynamics model for the prediction of user-level stance dynamics","volume":"57","author":"Zhu","year":"2020","journal-title":"Inf. Process. Manag"}],"container-title":["Frontiers in Neurorobotics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2024.1382305\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,12]],"date-time":"2024-03-12T04:35:40Z","timestamp":1710218140000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2024.1382305\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,12]]},"references-count":42,"alternative-id":["10.3389\/fnbot.2024.1382305"],"URL":"https:\/\/doi.org\/10.3389\/fnbot.2024.1382305","relation":{},"ISSN":["1662-5218"],"issn-type":[{"value":"1662-5218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,12]]},"article-number":"1382305"}}