{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,29]],"date-time":"2026-03-29T07:51:33Z","timestamp":1774770693330,"version":"3.50.1"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2021,7,19]],"date-time":"2021-07-19T00:00:00Z","timestamp":1626652800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,7,19]],"date-time":"2021-07-19T00:00:00Z","timestamp":1626652800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100007421","name":"Li Ka Shing Foundation","doi-asserted-by":"publisher","award":["R01EB026859"],"award-info":[{"award-number":["R01EB026859"]}],"id":[{"id":"10.13039\/100007421","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100007421","name":"Li Ka Shing Foundation","doi-asserted-by":"publisher","award":["R01EB026859"],"award-info":[{"award-number":["R01EB026859"]}],"id":[{"id":"10.13039\/100007421","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100004440","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["100309\/Z\/12\/Z"],"award-info":[{"award-number":["100309\/Z\/12\/Z"]}],"id":[{"id":"10.13039\/100004440","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Stat Comput"],"published-print":{"date-parts":[[2021,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The analysis of longitudinal, heterogeneous or unbalanced clustered data is of primary importance to a wide range of applications. The linear mixed model (LMM) is a popular and flexible extension of the linear model specifically designed for such purposes. Historically, a large proportion of material published on the LMM concerns the application of popular numerical optimization algorithms, such as Newton\u2013Raphson, Fisher Scoring and expectation maximization to single-factor LMMs (i.e. LMMs that only contain one \u201cfactor\u201d by which observations are grouped). However, in recent years, the focus of the LMM literature has moved towards the development of estimation and inference methods for more complex, multi-factored designs. In this paper, we present and derive new expressions for the extension of an algorithm classically used for single-factor LMM parameter estimation, Fisher Scoring, to multiple, crossed-factor designs. Through simulation and real data examples, we compare five variants of the Fisher Scoring algorithm with one another, as well as against a baseline established by the R package lme4, and find evidence of correctness and strong computational efficiency for four of the five proposed approaches. Additionally, we provide a new method for LMM Satterthwaite degrees of freedom estimation based on analytical results, which does not require iterative gradient estimation. Via simulation, we find that this approach produces estimates with both lower bias and lower variance than the existing methods.<\/jats:p>","DOI":"10.1007\/s11222-021-10026-6","type":"journal-article","created":{"date-parts":[[2021,7,19]],"date-time":"2021-07-19T21:02:46Z","timestamp":1626728566000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Fisher Scoring for crossed factor linear mixed models"],"prefix":"10.1007","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1890-330X","authenticated-orcid":false,"given":"Thomas","family":"Maullin-Sapey","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4516-5103","authenticated-orcid":false,"given":"Thomas E.","family":"Nichols","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,7,19]]},"reference":[{"issue":"1","key":"10026_CR1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v067.i01","volume":"67","author":"D Bates","year":"2015","unstructured":"Bates, D., Machler, M., Bolker, B., Walker, S.: Fitting linear mixed-effects models using lme4. J. Stat. Softw. 67(1), 1\u201348 (2015)","journal-title":"J. Stat. Softw."},{"key":"10026_CR2","volume-title":"Mixed Models: Theory and Applications with R. Wiley Series in Probability and Statistics","author":"E Demidenko","year":"2013","unstructured":"Demidenko, E.: Mixed Models: Theory and Applications with R. Wiley Series in Probability and Statistics. Wiley, New York (2013)"},{"issue":"1","key":"10026_CR3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.2517-6161.1977.tb01600.x","volume":"39","author":"AP Dempster","year":"1977","unstructured":"Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the em algorithm. J. R. Stat. Soc. Ser. B (Methodol.) 39(1), 1\u201338 (1977)","journal-title":"J. R. Stat. Soc. Ser. B (Methodol.)"},{"issue":"374","key":"10026_CR4","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1080\/01621459.1981.10477653","volume":"76","author":"AP Dempster","year":"1981","unstructured":"Dempster, A.P., Rubin, D.B., Tsutakawa, R.K.: Estimation in covariance components models. J. Am. Stat. Assoc. 76(374), 341\u2013353 (1981). https:\/\/doi.org\/10.1080\/01621459.1981.10477653","journal-title":"J. Am. Stat. Assoc."},{"issue":"2","key":"10026_CR5","doi-asserted-by":"publisher","first-page":"192","DOI":"10.2307\/2527669","volume":"15","author":"CR Henderson","year":"1959","unstructured":"Henderson, C.R., Kempthorne, O., Searle, S.R., von Krosigk, C.M.: The estimation of environmental and genetic trends from records subject to culling. Biometrics 15(2), 192\u2013218 (1959)","journal-title":"Biometrics"},{"issue":"3","key":"10026_CR6","doi-asserted-by":"publisher","first-page":"333","DOI":"10.3102\/1076998607307355","volume":"33","author":"G Hong","year":"2008","unstructured":"Hong, G., Raudenbush, S.W.: Causal inference for time-varying instructional treatments. J. Educ. Behav. Stat. 33(3), 333\u2013362 (2008). https:\/\/doi.org\/10.3102\/1076998607307355","journal-title":"J. Educ. Behav. Stat."},{"key":"10026_CR7","unstructured":"I.B.M. Corp: IBM SPSS Advanced Statistics 23. IBM Corp, Armonk, NY (2015)"},{"key":"10026_CR8","doi-asserted-by":"crossref","unstructured":"Jennrich, R.I., Schluchter, M.D.: Unbalanced repeated-measures models with structured covariance matrices. Biometrics 42(4), 805\u2013820 (1986). http:\/\/www.jstor.org\/stable\/2530695","DOI":"10.2307\/2530695"},{"key":"10026_CR9","doi-asserted-by":"crossref","unstructured":"Kuznetsova, A., Brockhoff, P., Christensen, R.: lmertest package: tests in linear mixed effects models. J. Stat. Softw. 82(13), 1\u201326 (2017). https:\/\/doi.org\/10.18637\/jss.v082.i13","DOI":"10.18637\/jss.v082.i13"},{"issue":"397","key":"10026_CR10","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1080\/01621459.1987.10478395","volume":"82","author":"N Laird","year":"1987","unstructured":"Laird, N., Lange, N., Stram, D.: Maximum likelihood computations with repeated measures: application of the em algorithm. J. Am. Stat. Assoc. 82(397), 97\u2013105 (1987). https:\/\/doi.org\/10.1080\/01621459.1987.10478395","journal-title":"J. Am. Stat. Assoc."},{"key":"10026_CR11","doi-asserted-by":"crossref","unstructured":"Laird, N.M., Ware, J.H.: Random-effects models for longitudinal data. Biometrics 38(4), 963\u2013974 (1982). http:\/\/www.jstor.org\/stable\/2529876","DOI":"10.2307\/2529876"},{"issue":"4","key":"10026_CR12","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1016\/j.gpb.2018.11.005","volume":"17","author":"X Li","year":"2019","unstructured":"Li, X., Guo, N., Li, Q.: Functional neuroimaging in the new era of big data. Genom. Proteomics Bioinform. 17(4), 393\u2013401 (2019). https:\/\/doi.org\/10.1016\/j.gpb.2018.11.005. big Data in Brain Science","journal-title":"Genom. Proteomics Bioinform."},{"key":"10026_CR13","doi-asserted-by":"crossref","unstructured":"Lindstrom, M.J., Bates, D.M.: Newton\u2013Raphson and em algorithms for linear mixed-effects models for repeated-measures data. J. Am. Stat. Assoc. 83(404), 1014\u20131022 (1988). http:\/\/www.jstor.org\/stable\/2290128","DOI":"10.1080\/01621459.1988.10478693"},{"issue":"4","key":"10026_CR14","doi-asserted-by":"publisher","first-page":"422","DOI":"10.1137\/0601049","volume":"1","author":"JR Magnus","year":"1980","unstructured":"Magnus, J.R., Neudecker, H.: The elimination matrix: some lemmas and applications. SIAM J. Algebraic Discrete Methods 1(4), 422\u2013449 (1980). https:\/\/doi.org\/10.1137\/0601049","journal-title":"SIAM J. Algebraic Discrete Methods"},{"key":"10026_CR15","first-page":"1986","volume":"46","author":"JR Magnus","year":"1986","unstructured":"Magnus, J.R., Neudecker, H.: Symmetry, 0\u20131 matrices, and Jacobians: a review. Econom. Theory 46, 1986 (1986)","journal-title":"Econom. Theory"},{"key":"10026_CR16","volume-title":"Matrix differential calculus with applications in statistics and econometrics. Wiley Series in Probability and Statistics. Rev edn","author":"JR Magnus","year":"1999","unstructured":"Magnus, J.R., Neudecker, H.: Matrix differential calculus with applications in statistics and econometrics. Wiley Series in Probability and Statistics. Rev edn. Wiley, New York (1999)"},{"issue":"3","key":"10026_CR17","doi-asserted-by":"publisher","first-page":"221","DOI":"10.2307\/3314625","volume":"11","author":"H Neudecker","year":"1983","unstructured":"Neudecker, H., Wansbeek, T.: Some results on commutation matrices, with statistical applications. Can. J. Stat. 11(3), 221\u2013231 (1983). https:\/\/doi.org\/10.2307\/3314625","journal-title":"Can. J. Stat."},{"key":"10026_CR18","unstructured":"Pinheiro, J., Bates, D.: Mixed-effects models in S and S-PLUS. Springer, Statistics and Computing (2009)"},{"key":"10026_CR19","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1007\/BF00140873","volume":"6","author":"JC Pinheiro","year":"1996","unstructured":"Pinheiro, J.C., Bates, D.M.: Unconstrained parametrizations for variance-covariance matrices. Stat. Comput. 6, 289\u2013296 (1996)","journal-title":"Stat. Comput."},{"key":"10026_CR20","unstructured":"Powell, M.: The bobyqa algorithm for bound constrained optimization without derivatives. Technical Report, Department of Applied Mathematics and Theoretical Physics (2009)"},{"issue":"2","key":"10026_CR21","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1093\/comjnl\/7.2.155","volume":"7","author":"MJD Powell","year":"1964","unstructured":"Powell, M.J.D.: An efficient method for finding the minimum of a function of several variables without calculating derivatives. Comput. J. 7(2), 155\u2013162 (1964). https:\/\/doi.org\/10.1093\/comjnl\/7.2.155","journal-title":"Comput. J."},{"key":"10026_CR22","doi-asserted-by":"crossref","unstructured":"Rao, C., Mitra, S.K.: Generalized Inverse of Matrices and Its Applications. Wiley, Probability and Statistics Series (1972)","DOI":"10.1525\/9780520325883-032"},{"key":"10026_CR23","unstructured":"Raudenbush, S.W., Bryk, A.S.: Hierarchical Linear Models: Applications and Data Analysis Methods, 2nd edn. Advanced Quantitative Techniques in the Social Sciences 1. SAGE Publications (2002)"},{"key":"10026_CR24","unstructured":"SAS Institute Inc: SAS\/STATR 14.1 User\u2019s Guide The MIXED Procedure. Springer Berlin Heidelberg, SAS Institute Inc, Cary, NC (2015)"},{"key":"10026_CR25","doi-asserted-by":"crossref","unstructured":"Satterthwaite, F.E.: An approximate distribution of estimates of variance components. Biometrics Bull. 2(6), 110\u2013114 (1946). http:\/\/www.jstor.org\/stable\/3002019","DOI":"10.2307\/3002019"},{"issue":"7","key":"10026_CR26","doi-asserted-by":"publisher","first-page":"3283","DOI":"10.1016\/j.csda.2007.10.022","volume":"52","author":"F Scheipl","year":"2008","unstructured":"Scheipl, F., Greven, S., K\u00fcchenhoff, H.: Size and power of tests for a zero random effect variance or polynomial regression in additive and linear mixed models. Comput. Stat. Data Anal. 52(7), 3283\u20133299 (2008). https:\/\/doi.org\/10.1016\/j.csda.2007.10.022","journal-title":"Comput. Stat. Data Anal."},{"issue":"2","key":"10026_CR27","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1016\/j.neuron.2017.12.018","volume":"97","author":"SM Smith","year":"2018","unstructured":"Smith, S.M., Nichols, T.E.: Statistical challenges in big data human neuroimaging. Neuron 97(2), 263\u2013268 (2018). https:\/\/doi.org\/10.1016\/j.neuron.2017.12.018","journal-title":"Neuron"},{"issue":"2","key":"10026_CR28","doi-asserted-by":"publisher","first-page":"351","DOI":"10.1348\/000711006X110562","volume":"60","author":"FS Tibaldi","year":"2007","unstructured":"Tibaldi, F.S., Verbeke, G., Molenberghs, G., Renard, D., Van den Noortgate, W., de Boeck, P.: Conditional mixed models with crossed random effects. Br. J. Math. Stat. Psychol. 60(2), 351\u2013365 (2007). https:\/\/doi.org\/10.1348\/000711006X110562","journal-title":"Br. J. Math. Stat. Psychol."},{"key":"10026_CR29","doi-asserted-by":"publisher","unstructured":"Turkington, D.A.: Cambridge University Press. Generalized Vectorization, Cross-Products, and Matrix Calculus (2013). https:\/\/doi.org\/10.1017\/CBO9781139424400","DOI":"10.1017\/CBO9781139424400"},{"key":"10026_CR30","unstructured":"Turnbull, B.J., Welsh, M.E., Heid, C.A., Davis, W., Ratnofsky, A.C.: The longitudinal evaluation of school change and performance (lescp) in title i schools. interim report to congress (1999)"},{"key":"10026_CR31","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1016\/j.neuroimage.2013.05.041","volume":"80","author":"D Van Essen","year":"2013","unstructured":"Van Essen, D., Smith, S., Barch, D., Behrens, T., Yacoub, E., Ugurbil, K.: The wu-minn human connectome project: an overview. NeuroImage 80, 20 (2013). https:\/\/doi.org\/10.1016\/j.neuroimage.2013.05.041","journal-title":"NeuroImage"},{"key":"10026_CR32","volume-title":"Linear Mixed Models for Longitudinal Data. Springer Series in Statistics","author":"G Verbeke","year":"2001","unstructured":"Verbeke, G., Molenberghs, G.: Linear Mixed Models for Longitudinal Data. Springer Series in Statistics. Springer, New York (2001)"},{"issue":"1\/2","key":"10026_CR33","doi-asserted-by":"publisher","first-page":"28","DOI":"10.2307\/2332510","volume":"34","author":"BL Welch","year":"1947","unstructured":"Welch, B.L.: The generalization of \u2018student\u2019s\u2019 problem when several different population variances are involved. Biometrika 34(1\/2), 28\u201335 (1947)","journal-title":"Biometrika"},{"key":"10026_CR34","doi-asserted-by":"publisher","DOI":"10.1201\/b17198","volume-title":"Linear Mixed Models: A Practical Guide Using Statistical Software","author":"B West","year":"2014","unstructured":"West, B., Welch, K., Galecki, A.: Linear Mixed Models: A Practical Guide Using Statistical Software. CRC Press, Boca Raton (2014)"},{"key":"10026_CR35","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1016\/j.neuroimage.2015.05.092","volume":"123","author":"AM Winkler","year":"2015","unstructured":"Winkler, A.M., Webster, M.A., Vidaurre, D., Nichols, T.E., Smith, S.M.: Multi-level block permutation. NeuroImage 123, 253\u2013268 (2015). https:\/\/doi.org\/10.1016\/j.neuroimage.2015.05.092","journal-title":"NeuroImage"},{"key":"10026_CR36","doi-asserted-by":"publisher","first-page":"205","DOI":"10.2307\/1400366","volume":"1","author":"R Wolfinger","year":"1996","unstructured":"Wolfinger, R.: Heterogeneous variance: Covariance structures for repeated measures. J. Agric. Biol. Environ. Stat. 1, 205 (1996). https:\/\/doi.org\/10.2307\/1400366","journal-title":"J. Agric. Biol. Environ. Stat."},{"key":"10026_CR37","doi-asserted-by":"publisher","first-page":"1994","DOI":"10.1137\/0915079","volume":"15","author":"R Wolfinger","year":"1994","unstructured":"Wolfinger, R., Tobias, R., Sall, J.: Computing gaussian likelihoods and their derivatives for general linear mixed models. SIAM J. Sci. Comput. 15, 1994 (1994). https:\/\/doi.org\/10.1137\/0915079","journal-title":"SIAM J. Sci. Comput."},{"key":"10026_CR38","unstructured":"Zhu, S., Wathen, A.J.: Essential formulae for restricted maximum likelihood and its derivatives associated with the linear mixed models. 1805.05188 (2018)"}],"container-title":["Statistics and Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-021-10026-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11222-021-10026-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-021-10026-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,4]],"date-time":"2024-09-04T14:47:31Z","timestamp":1725461251000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11222-021-10026-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,19]]},"references-count":38,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2021,9]]}},"alternative-id":["10026"],"URL":"https:\/\/doi.org\/10.1007\/s11222-021-10026-6","relation":{},"ISSN":["0960-3174","1573-1375"],"issn-type":[{"value":"0960-3174","type":"print"},{"value":"1573-1375","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,19]]},"assertion":[{"value":"12 March 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 June 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 July 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declaration"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"53"}}