{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:33:47Z","timestamp":1760236427062,"version":"build-2065373602"},"reference-count":50,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2021,11,20]],"date-time":"2021-11-20T00:00:00Z","timestamp":1637366400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The incremental least-mean-square (ILMS) algorithm is a useful method to perform distributed adaptation and learning in Hamiltonian networks. To implement the ILMS algorithm, each node needs to receive the local estimate of the previous node on the cycle path to update its own local estimate. However, in some practical situations, perfect data exchange may not be possible among the nodes. In this paper, we develop a new version of ILMS algorithm, wherein in its adaptation step, only a random subset of the coordinates of update vector is available. We draw a comparison between the proposed coordinate-descent incremental LMS (CD-ILMS) algorithm and the ILMS algorithm in terms of convergence rate and computational complexity. Employing the energy conservation relation approach, we derive closed-form expressions to describe the learning curves in terms of excess mean-square-error (EMSE) and mean-square deviation (MSD). We show that, the CD-ILMS algorithm has the same steady-state error performance compared with the ILMS algorithm. However, the CD-ILMS algorithm has a faster convergence rate. Numerical examples are given to verify the efficiency of the CD-ILMS algorithm and the accuracy of theoretical analysis.<\/jats:p>","DOI":"10.3390\/s21227732","type":"journal-article","created":{"date-parts":[[2021,11,21]],"date-time":"2021-11-21T21:00:50Z","timestamp":1637528450000},"page":"7732","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Coordinate-Descent Adaptation over Hamiltonian Multi-Agent Networks"],"prefix":"10.3390","volume":"21","author":[{"given":"Azam","family":"Khalili","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering, Malayer University, Malayer 65719-95863, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8362-8263","authenticated-orcid":false,"given":"Vahid","family":"Vahidpour","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Malayer University, Malayer 65719-95863, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Amir","family":"Rastegarnia","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Malayer University, Malayer 65719-95863, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8618-7256","authenticated-orcid":false,"given":"Ali","family":"Farzamnia","sequence":"additional","affiliation":[{"name":"Faculty of Engineering, Universiti Malaysia Sabah, Kota Kinabalu 88400, Malaysia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kenneth","family":"Teo Tze Kin","sequence":"additional","affiliation":[{"name":"Faculty of Engineering, Universiti Malaysia Sabah, Kota Kinabalu 88400, Malaysia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Saeid","family":"Sanei","sequence":"additional","affiliation":[{"name":"Science and Technology, Nottingham Trent University, Clifton Lane, Nottingham NG11 8NS, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,20]]},"reference":[{"key":"ref_1","unstructured":"Rossi, L.A., Krishnamachari, B., and Kuo, C.C. (2004, January 4\u20137). Distributed parameter estimation for monitoring diffusion phenomena using physical models. Proceedings of the 2004 First Annual IEEE Communications Society Conference on Sensor and Ad Hoc Communications and Networks, Santa Clara, CA, USA."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1109\/79.985674","article-title":"Detection, classification, and tracking of targets","volume":"19","author":"Li","year":"2002","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1109\/MCOM.2002.1024422","article-title":"A survey on sensor networks","volume":"40","author":"Akyildiz","year":"2002","journal-title":"IEEE Commun. Mag."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1109\/MCS.2007.338264","article-title":"Information consensus in multivehicle cooperative control","volume":"27","author":"Ren","year":"2007","journal-title":"IEEE Control Syst. Mag."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"678","DOI":"10.1109\/TRO.2011.2114734","article-title":"Multirobot active target tracking with combinations of relative observations","volume":"27","author":"Zhou","year":"2011","journal-title":"IEEE Trans. Robot."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/MPAE.2005.1507024","article-title":"Toward a smart grid: Power delivery for the 21st century","volume":"3","author":"Amin","year":"2005","journal-title":"IEEE Power Energy Mag."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Ibars, C., Navarro, M., and Giupponi, L. (2010, January 4\u20136). Distributed demand management in smart grid with a congestion game. Proceedings of the 2010 First IEEE International Conference on Smart Grid Communications, Gaithersburg, MD, USA.","DOI":"10.1109\/SMARTGRID.2010.5622091"},{"key":"ref_8","unstructured":"Kim, H., Kim, Y.J., Yang, K., and Thottan, M. (2011, January 17\u201320). Cloud-based demand response for smart grid: Architecture and distributed algorithms. Proceedings of the 2011 IEEE International Conference on Smart Grid Communications (SmartGridComm), Brussels, Belgium."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1109\/MSP.2013.2245726","article-title":"Monitoring and optimization for power grids: A signal processing perspective","volume":"30","author":"Giannakis","year":"2013","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"592","DOI":"10.1109\/TAC.2011.2161027","article-title":"Dual averaging for distributed optimization: Convergence analysis and network scaling","volume":"57","author":"Duchi","year":"2011","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1001","DOI":"10.1109\/TSP.2014.2385045","article-title":"Dictionary learning over distributed models","volume":"63","author":"Chen","year":"2014","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"5412","DOI":"10.1109\/TSP.2012.2204987","article-title":"A sparsity promoting adaptive algorithm for distributed learning","volume":"60","author":"Chouvardas","year":"2012","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3285","DOI":"10.1109\/TSP.2015.2415755","article-title":"Distributed clustering and learning over networks","volume":"63","author":"Zhao","year":"2015","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2733","DOI":"10.1109\/TSP.2015.2412918","article-title":"Diffusion LMS over multitask networks","volume":"63","author":"Chen","year":"2015","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"674","DOI":"10.1109\/JSTSP.2011.2127446","article-title":"Convergence rate analysis of distributed gossip (linear parameter) estimation: Fundamental limits and tradeoffs","volume":"5","author":"Kar","year":"2011","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/MSP.2007.361599","article-title":"Bio-inspired sensor network design","volume":"24","author":"Barbarossa","year":"2007","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"4919","DOI":"10.1109\/TSP.2008.927480","article-title":"Distributing the Kalman filter for large-scale systems","volume":"56","author":"Khan","year":"2008","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2365","DOI":"10.1109\/TSP.2009.2016226","article-title":"Distributed LMS for consensus-based in-network adaptive processing","volume":"57","author":"Schizas","year":"2009","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"4064","DOI":"10.1109\/TSP.2007.896034","article-title":"Incremental adaptive strategies over distributed networks","volume":"55","author":"Lopes","year":"2007","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"798","DOI":"10.1109\/JSAC.2005.843546","article-title":"Quantized incremental algorithms for distributed optimization","volume":"23","author":"Rabbat","year":"2005","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1109\/TSP.2009.2025074","article-title":"Distributed estimation over an adaptive incremental network based on the affine projection algorithm","volume":"58","author":"Li","year":"2009","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1465","DOI":"10.1109\/TSP.2010.2100386","article-title":"Analysis of spatial and incremental LMS processing for distributed estimation","volume":"59","author":"Cattivelli","year":"2010","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2416","DOI":"10.1109\/TSP.2011.2112654","article-title":"Steady-state analysis of incremental LMS adaptive networks with noisy links","volume":"59","author":"Khalili","year":"2011","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1109\/TCNS.2016.2516826","article-title":"Performance analysis of incremental LMS over flat fading channels","volume":"4","author":"Khalili","year":"2016","journal-title":"IEEE Trans. Control Netw. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1109\/JPROC.2014.2306253","article-title":"Adaptive networks","volume":"102","author":"Sayed","year":"2014","journal-title":"Proc. IEEE"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1561\/2200000051","article-title":"Adaptation, learning, and optimization over networks","volume":"7","author":"Sayed","year":"2014","journal-title":"Found. Trends Mach. Learn."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"4289","DOI":"10.1109\/TSP.2012.2198470","article-title":"Diffusion adaptation strategies for distributed optimization and learning over networks","volume":"60","author":"Chen","year":"2012","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3487","DOI":"10.1109\/TIT.2015.2427360","article-title":"On the learning behavior of adaptive networks\u2014Part I: Transient analysis","volume":"61","author":"Chen","year":"2015","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"3518","DOI":"10.1109\/TIT.2015.2427352","article-title":"On the learning behavior of adaptive networks\u2014Part II: Performance analysis","volume":"61","author":"Chen","year":"2015","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"811","DOI":"10.1109\/TSP.2014.2385046","article-title":"Asynchronous adaptation and learning over networks\u2014Part I: Modeling and stability analysis","volume":"63","author":"Zhao","year":"2014","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1109\/TSP.2014.2385041","article-title":"Asynchronous adaptation and learning over networks\u2014Part II: Performance analysis","volume":"63","author":"Zhao","year":"2014","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"843","DOI":"10.1109\/TSP.2014.2385037","article-title":"Asynchronous adaptation and learning over networks\u2014Part III: Comparison analysis","volume":"63","author":"Zhao","year":"2014","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"3510","DOI":"10.1109\/TSP.2014.2327005","article-title":"Adaptive distributed estimation based on recursive least-squares and partial diffusion","volume":"62","author":"Arablouei","year":"2014","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"472","DOI":"10.1109\/TSP.2013.2292035","article-title":"Distributed least mean-square estimation with partial diffusion","volume":"62","author":"Arablouei","year":"2014","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1109\/TNSE.2017.2742360","article-title":"Analysis of partial diffusion LMS for adaptive estimation over networks with noisy links","volume":"5","author":"Vahidpour","year":"2018","journal-title":"IEEE Trans. Netw. Sci. Eng."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1049\/iet-spr.2016.0544","article-title":"Analysis of partial diffusion recursive least squares adaptation over noisy links","volume":"11","author":"Vahidpour","year":"2017","journal-title":"IET Signal Process."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"3839","DOI":"10.1109\/TNNLS.2019.2899052","article-title":"Partial Diffusion Kalman Filtering for Distributed State Estimation in Multiagent Networks","volume":"30","author":"Vahidpour","year":"2019","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1767","DOI":"10.1109\/TAES.2019.2933961","article-title":"Performance Analysis of Distributed Kalman Filtering with Partial Diffusion Over Noisy Network","volume":"56","author":"Vahidpour","year":"2019","journal-title":"IEEE Trans. Aerosp. Netw. Electron. Syst."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Gholami, M.R., Str\u00f6m, E.G., and Sayed, A.H. (2013, January 3\u20135). Diffusion estimation over cooperative networks with missing data. Proceedings of the 2013 IEEE Global Conference on Signal and Information Processing, Austin, TX, USA.","DOI":"10.1109\/GlobalSIP.2013.6736902"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1109\/82.558455","article-title":"Adaptive filters employing partial updates","volume":"44","author":"Douglas","year":"1997","journal-title":"IEEE Trans. Circuits Syst. II Analog. Digit. Signal Process."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"2382","DOI":"10.1109\/TSP.2005.849167","article-title":"Partial update LMS algorithms","volume":"53","author":"Godavarti","year":"2005","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Werner, S., Mohammed, M., Huang, Y.F., and Koivunen, V. (April, January 31). Decentralized set-membership adaptive estimation for clustered sensor networks. Proceedings of the 2008 IEEE International Conference on Acoustics, Speech and Signal Processing, Las Vegas, NV, USA.","DOI":"10.1109\/ICASSP.2008.4518424"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Werner, S., and Huang, Y.F. (2010, January 7\u201310). Time-and coefficient-selective diffusion strategies for distributed parameter estimation. Proceedings of the 2010 Conference Record of the Forty Fourth Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, USA.","DOI":"10.1109\/ACSSC.2010.5757651"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1109\/JSTSP.2013.2246762","article-title":"Trading off complexity with communication costs in distributed adaptive learning via Krylov subspaces for dimensionality reduction","volume":"7","author":"Chouvardas","year":"2013","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1109\/MSP.2010.938752","article-title":"Adaptive learning in a world of projections","volume":"28","author":"Theodoridis","year":"2010","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1109\/JSTSP.2013.2266318","article-title":"Distributed energy-aware diffusion least mean squares: Game-theoretic learning","volume":"7","author":"Gharehshiran","year":"2013","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Vahidpour, V., Rastegarnia, A., Khalili, A., Bazzi, W.M., and Sanei, S. (2019). Variants of Partial Update Augmented CLMS Algorithm and Their Performance Analysis. arXiv.","DOI":"10.1109\/TSP.2020.2993938"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1109\/TSP.2017.2757903","article-title":"Coordinate-descent diffusion learning by networked agents","volume":"66","author":"Wang","year":"2017","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Horn, R.A., and Johnson, C.R. (2012). Matrix Analysis, Cambridge University Press.","DOI":"10.1017\/CBO9781139020411"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Abadir, K.M., and Magnus, J.R. (2005). Matrix Algebra, Cambridge University Press.","DOI":"10.1017\/CBO9780511810800"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/22\/7732\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:33:17Z","timestamp":1760167997000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/22\/7732"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,20]]},"references-count":50,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["s21227732"],"URL":"https:\/\/doi.org\/10.3390\/s21227732","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,11,20]]}}}