{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T12:39:55Z","timestamp":1771677595050,"version":"3.50.1"},"reference-count":25,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,2,25]],"date-time":"2022-02-25T00:00:00Z","timestamp":1645747200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Axioms"],"abstract":"<jats:p>Let A be an arbitrary matrix in which the number of rows, m, is considerably larger than the number of columns, n. Let the submatrix Ai,i=1,\u2026,m, be composed of the first i rows of A. Let \u03b2i denote the smallest singular value of Ai, and let ki denote the condition number of Ai. In this paper, we examine the behavior of the sequences \u03b21,\u2026,\u03b2m, and k1,\u2026,km. The behavior of the smallest singular values sequence is somewhat surprising. The first part of this sequence, \u03b21,\u2026,\u03b2n, is descending, while the second part, \u03b2n,\u2026,\u03b2m, is ascending. This phenomenon is called \u201cthe smallest singular value anomaly\u201d. The sequence of the condition numbers has a different character. The first part of this sequence, k1,\u2026,kn, always ascends toward kn, which can be very large. The condition number anomaly occurs when the second part, kn,\u2026,km, descends toward a value of km, which is considerably smaller than kn. It is shown that this is likely to happen whenever the rows of A satisfy two conditions: all the rows are about the same size, and the directions of the rows scatter in some random way. These conditions hold in a wide range of random matrices, as well as other types of matrices. The practical importance of these phenomena lies in the use of iterative methods for solving large linear systems, since several iterative solvers have the property that a large condition number results in a slow rate of convergence, while a small condition number yields fast convergence. Consequently, a condition number anomaly leads to a similar anomaly in the number of iterations. The paper ends with numerical experiments that illustrate the above phenomena.<\/jats:p>","DOI":"10.3390\/axioms11030099","type":"journal-article","created":{"date-parts":[[2022,2,25]],"date-time":"2022-02-25T10:00:40Z","timestamp":1645783240000},"page":"99","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["The Smallest Singular Value Anomaly and the Condition Number Anomaly"],"prefix":"10.3390","volume":"11","author":[{"given":"Achiya","family":"Dax","sequence":"first","affiliation":[{"name":"Hydrological Service, P.O. Box 36118, Jerusalem 91360, Israel"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Demmel, J.W. (1997). Applied Numerical Linear Algebra, SIAM.","DOI":"10.1137\/1.9781611971446"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Golub, G.H., and Loan, C.F.V. (2013). Matrix Computations, Johns Hopkins University Press. [4th ed.].","DOI":"10.56021\/9781421407944"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Trefethen, L.N., and Bau, D. (1997). Numerical Linear Algebra, SIAM.","DOI":"10.1137\/1.9780898719574"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1007\/s11856-016-1287-8","article-title":"The smallest singular value of random rectangular matrices with no moment assumptions on entries","volume":"212","author":"Tikhomirov","year":"2016","journal-title":"Israel J. Math."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1275","DOI":"10.1214\/aop\/1176989118","article-title":"Limit of the smallest eigenvalue of a large-dimensional sample covariance matrix","volume":"21","author":"Bai","year":"1993","journal-title":"Ann. Probab."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1137\/040616413","article-title":"Condition numbers of Gaussian random matrices","volume":"27","author":"Chen","year":"2005","journal-title":"SIAM J. Matrix Anal. Appl."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"543","DOI":"10.1137\/0609045","article-title":"Eigenvalues and condition numbers of random matrices","volume":"9","author":"Edelman","year":"1988","journal-title":"SIAM J. Matrix Anal. Appl."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1070\/SM1967v001n04ABEH001994","article-title":"Distribution of eigenvalues of some sets of random matrices","volume":"1","author":"Marchenko","year":"1967","journal-title":"Math. USSR-Sb."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"823","DOI":"10.4171\/jems\/448","article-title":"On the singular values of random matrices","volume":"16","author":"Mendelson","year":"2014","journal-title":"J. Eur. Math. Soc."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1707","DOI":"10.1002\/cpa.20294","article-title":"Smallest singular value of a random rectangular matrix","volume":"62","author":"Rudelson","year":"2009","journal-title":"Commun. Pure Appl. Math."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1016\/0047-259X(89)90042-0","article-title":"On the weak limit of the largest eigenvalue of a large dimensional sample covariance matrix","volume":"30","author":"Silverstein","year":"1989","journal-title":"J. Multivar. Anal."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/0885-064X(91)90002-F","article-title":"Condition numbers of random matrices","volume":"7","author":"Szarek","year":"1991","journal-title":"J. Complex."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.jco.2018.06.002","article-title":"An upper bound on the smallest singular value of a square random matrix","volume":"48","author":"Tatarko","year":"2018","journal-title":"J. Complex."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"512","DOI":"10.1016\/j.laa.2014.10.038","article-title":"On the condition number anomaly of Gaussian correlation matrices","volume":"466","author":"Zimmermann","year":"2014","journal-title":"Linear Algebr. Appl."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1137\/1023097","article-title":"Row-action methods for huge and sparse systems and their applications","volume":"23","author":"Censor","year":"1981","journal-title":"SIAM Rev."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1137\/1032122","article-title":"The convergence of linear stationary iterative processes for solving singular unstructured systems of linear equations","volume":"32","author":"Dax","year":"1990","journal-title":"SIAM Rev."},{"key":"ref_17","unstructured":"Hageman, L.A., and Young, D.M. (1981). Applied Iterative Methods, Academic Press."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Saad, Y. (2003). Iterative Methods for Sparse Linear Systems, SIAM. [2nd ed.].","DOI":"10.1137\/1.9780898718003"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Horn, R.A., and Johnson, C.R. (1985). Matrix Analysis, Cambridge University Press.","DOI":"10.1017\/CBO9780511810817"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Horn, R.A., and Johnson, C.R. (1991). Topics in Matrix Analysis, Cambridge University Press.","DOI":"10.1017\/CBO9780511840371"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1080\/00029890.2004.11920060","article-title":"Cauchy\u2019s interlace theorem for eigenvalues of Hermitian matrices","volume":"111","author":"Hwang","year":"2004","journal-title":"Am. Math. Mon."},{"key":"ref_22","unstructured":"Parlett, B.N. (1980). The Symmetric Eigenvalue Problem, Prentice-Hall."},{"key":"ref_23","unstructured":"Censor, Y., and Zenios, S.A. (1997). Parallel Optimization, Theory, Algorithms, and Applications, Oxford University Press."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/S0024-3795(01)00600-0","article-title":"The adventures of a simple algorithm","volume":"361","author":"Dax","year":"2003","journal-title":"Linear Algebr. Appl."},{"key":"ref_25","unstructured":"Dax, A. (Kaczmarz Anomaly: A Surprising Feature of Kaczmarz Method, 2021). Kaczmarz Anomaly: A Surprising Feature of Kaczmarz Method, in preparation."}],"container-title":["Axioms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-1680\/11\/3\/99\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:27:18Z","timestamp":1760135238000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-1680\/11\/3\/99"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,25]]},"references-count":25,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["axioms11030099"],"URL":"https:\/\/doi.org\/10.3390\/axioms11030099","relation":{},"ISSN":["2075-1680"],"issn-type":[{"value":"2075-1680","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,25]]}}}