{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T18:35:26Z","timestamp":1787337326959,"version":"build-2736575974"},"reference-count":56,"publisher":"Society for Industrial & Applied Mathematics (SIAM)","issue":"4","funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["ECCS-1462397"],"award-info":[{"award-number":["ECCS-1462397"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SIAM J. Sci. Comput."],"published-print":{"date-parts":[[2017,1]]},"abstract":"<jats:p>Many problems reduce to the fixed-point problem of solving $x=T(x)$, where $T$ is a mapping from a Hilbert space to itself. To this problem we apply the coordinate-update algorithms, which update only one or a few components of $x$ at each step. When each step is cheap, these algorithms are faster than the full fixed-point iteration (which updates all the components). In this paper, we focus on cyclic coordinate selection rules, where the ordering of coordinates in each cycle is arbitrary. The corresponding algorithms are fast, but their convergence is unknown in the fixed-point setting. When $T$ is a nonexpansive operator and has a fixed point, we show that the sequence of coordinate-update iterates converges to a fixed point under proper step sizes. This result applies to the primal-dual coordinate-update algorithms, which have wide applications to optimization problems with nonseparable nonsmooth objectives, and\/or global linear constraints. Numerically, we apply coordinate-update algorithms with cyclic, shuffled cyclic, and random selection rules to $\\ell_1$-robust least squares, total variation minimization, and nonnegative matrix factorization. These algorithms converge much faster than the standard fixed-point iteration. Among the three rules, cyclic and shuffled cyclic rules are overall faster than the random rule.<\/jats:p>","DOI":"10.1137\/16m1102653","type":"journal-article","created":{"date-parts":[[2017,7,20]],"date-time":"2017-07-20T11:01:59Z","timestamp":1500548519000},"page":"A1280-A1300","source":"Crossref","is-referenced-by-count":13,"title":["Cyclic Coordinate-Update Algorithms for Fixed-Point Problems: Analysis and Applications"],"prefix":"10.1137","volume":"39","author":[{"given":"Yat Tin","family":"Chow","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tianyu","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wotao","family":"Yin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"351","published-online":{"date-parts":[[2017,7,20]]},"reference":[{"key":"atypb1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4419-9467-7"},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1137\/120887679"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1007\/BF02591967"},{"key":"atypb4","volume-title":"Parallel and Distributed Computation: Numerical Methods","author":"Bertsekas D. P.","year":"1989"},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1007\/s10851-010-0251-1"},{"key":"atypb6","volume-title":"Extended ADMM and BCD for Nonseparable Convex Minimization Models with Quadratic Coupling Terms: Convergence Analysis and Insights, preprint, https:\/\/arxiv.org\/abs\/1508.00193","author":"Chen C.","year":"2015"},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1137\/110859063"},{"key":"atypb8","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2014.7025841"},{"key":"atypb9","doi-asserted-by":"publisher","DOI":"10.1137\/140971233"},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1007\/s10957-012-0245-9"},{"key":"atypb11","doi-asserted-by":"publisher","DOI":"10.1007\/s10589-008-9167-8"},{"key":"atypb12","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.1986.4307748"},{"key":"atypb13","unstructured":"D. Davis and W. Yin,\n                      A Three-Operator Splitting Scheme and Its Optimization Applications\n                      , UCLA CAM Report 15-13, 2015."},{"key":"atypb14","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-41589-5_4"},{"key":"atypb15","volume-title":"A Coordinate Descent Primal-Dual Algorithm with Large Step Size and Possibly Non Separable Functions, preprint, https:\/\/arxiv.org\/abs\/1508.04625","author":"Fercoq O.","year":"2015"},{"key":"atypb16","doi-asserted-by":"publisher","DOI":"10.1214\/07-AOAS131"},{"key":"atypb17","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v033.i01"},{"key":"atypb18","doi-asserted-by":"publisher","DOI":"10.1016\/0898-1221(76)90003-1"},{"key":"atypb19","first-page":"257","volume-title":"Regularization, Optimization, Kernels, and Support Vector Machines","author":"Gillis N.","year":"2014"},{"key":"atypb20","first-page":"41","volume":"9","author":"Glowinski R.","year":"1975","journal-title":"ESAIM Math. Model. Numer. Anal."},{"key":"atypb21","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2012.2190406"},{"key":"atypb22","doi-asserted-by":"publisher","DOI":"10.7153\/oam-03-02"},{"key":"atypb23","doi-asserted-by":"publisher","DOI":"10.1007\/s002110050158"},{"key":"atypb24","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-007-0602-6_13"},{"key":"atypb25","doi-asserted-by":"publisher","DOI":"10.1007\/s10107-016-1057-8"},{"key":"atypb26","doi-asserted-by":"publisher","DOI":"10.1080\/02331931003603133"},{"key":"atypb27","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btm134"},{"key":"atypb28","doi-asserted-by":"publisher","DOI":"10.1007\/s10898-013-0035-4"},{"key":"atypb29","doi-asserted-by":"publisher","DOI":"10.1137\/110821172"},{"key":"atypb30","first-page":"123","volume":"10","author":"Krasnosel'ski\u012d M.","year":"1955","journal-title":"S.)"},{"key":"atypb31","first-page":"556","volume-title":"Advances in Neural Information Processing Systems 13 (NIPS","author":"Lee D. D.","year":"2000"},{"key":"atypb32","doi-asserted-by":"publisher","DOI":"10.1007\/s10589-013-9576-1"},{"key":"atypb33","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2007.19.10.2756"},{"key":"atypb34","doi-asserted-by":"publisher","DOI":"10.1137\/0716071"},{"key":"atypb35","doi-asserted-by":"publisher","DOI":"10.1007\/s10107-014-0800-2"},{"key":"atypb36","doi-asserted-by":"publisher","DOI":"10.1007\/BF00939948"},{"key":"atypb37","doi-asserted-by":"publisher","DOI":"10.1090\/S0002-9939-1953-0054846-3"},{"key":"atypb38","doi-asserted-by":"publisher","DOI":"10.1137\/100802001"},{"key":"atypb39","doi-asserted-by":"publisher","DOI":"10.4310\/AMSA.2016.v1.n1.a2"},{"key":"atypb40","doi-asserted-by":"publisher","DOI":"10.1137\/15M1024950"},{"key":"atypb41","first-page":"2453","volume":"16","author":"Pesquet J.-C.","year":"2015","journal-title":"J. Nonlinear Convex Anal."},{"key":"atypb42","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126441"},{"key":"atypb43","doi-asserted-by":"publisher","DOI":"10.1137\/120891009"},{"key":"atypb44","doi-asserted-by":"publisher","DOI":"10.1007\/s10107-012-0614-z"},{"key":"atypb45","volume-title":"A Primer on Coordinate Descent Algorithms, preprint, https:\/\/arxiv.org\/abs\/1610.00040","author":"Shi H.-J. M.","year":"2016"},{"key":"atypb46","doi-asserted-by":"publisher","DOI":"10.1118\/1.595715"},{"key":"atypb47","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-41589-5_11"},{"key":"atypb48","doi-asserted-by":"publisher","DOI":"10.1023\/A:1017501703105"},{"key":"atypb49","doi-asserted-by":"publisher","DOI":"10.1007\/s10444-011-9254-8"},{"key":"atypb50","doi-asserted-by":"publisher","DOI":"10.1137\/0111043"},{"key":"atypb51","doi-asserted-by":"publisher","DOI":"10.1007\/s10107-015-0892-3"},{"key":"atypb52","doi-asserted-by":"publisher","DOI":"10.1007\/s10957-011-9825-3"},{"key":"atypb53","doi-asserted-by":"publisher","DOI":"10.1137\/120887795"},{"key":"atypb54","doi-asserted-by":"crossref","unstructured":"Y. Xu and W. Yin,\n                      A globally convergent algorithm for nonconvex optimization based on block coordinate update\n                      , J. Sci. Comput., to appear,https:\/\/doi.org\/10.1007\/s10915-017-0376-0.","DOI":"10.1007\/s10915-017-0376-0"},{"key":"atypb55","first-page":"3183","volume":"11","author":"Yuan G.-X.","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"atypb56","doi-asserted-by":"publisher","DOI":"10.1007\/11785231_91"}],"container-title":["SIAM Journal on Scientific Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/epubs.siam.org\/doi\/pdf\/10.1137\/16M1102653","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T17:57:52Z","timestamp":1787335072000},"score":1,"resource":{"primary":{"URL":"https:\/\/epubs.siam.org\/doi\/10.1137\/16M1102653"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,1]]},"references-count":56,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2017,1]]}},"alternative-id":["10.1137\/16M1102653"],"URL":"https:\/\/doi.org\/10.1137\/16m1102653","relation":{},"ISSN":["1064-8275","1095-7197"],"issn-type":[{"value":"1064-8275","type":"print"},{"value":"1095-7197","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,1]]}}}