{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T06:18:07Z","timestamp":1770704287683,"version":"3.49.0"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2023,3,16]],"date-time":"2023-03-16T00:00:00Z","timestamp":1678924800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,3,16]],"date-time":"2023-03-16T00:00:00Z","timestamp":1678924800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Stat Comput"],"published-print":{"date-parts":[[2023,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Maximum likelihood estimation in logistic regression with mixed effects is known to often result in estimates on the boundary of the parameter space. Such estimates, which include infinite values for fixed effects and singular or infinite variance components, can cause havoc to numerical estimation procedures and inference. We introduce an appropriately scaled additive penalty to the log-likelihood function, or an approximation thereof, which penalizes the fixed effects by the Jeffreys\u2019 invariant prior for the model with no random effects and the variance components by a composition of negative Huber loss functions. The resulting maximum penalized likelihood estimates are shown to lie in the interior of the parameter space. Appropriate scaling of the penalty guarantees that the penalization is soft enough to preserve the optimal asymptotic properties expected by the maximum likelihood estimator, namely consistency, asymptotic normality, and Cram\u00e9r-Rao efficiency. Our choice of penalties and scaling factor preserves equivariance of the fixed effects estimates under linear transformation of the model parameters, such as contrasts. Maximum softly-penalized likelihood is compared to competing approaches on two real-data examples, and through comprehensive simulation studies that illustrate its superior finite sample performance.<\/jats:p>","DOI":"10.1007\/s11222-023-10217-3","type":"journal-article","created":{"date-parts":[[2023,3,27]],"date-time":"2023-03-27T00:25:14Z","timestamp":1679876714000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Maximum softly-penalized likelihood for mixed effects logistic regression"],"prefix":"10.1007","volume":"33","author":[{"given":"Philipp","family":"Sterzinger","sequence":"first","affiliation":[]},{"given":"Ioannis","family":"Kosmidis","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,3,16]]},"reference":[{"issue":"1","key":"10217_CR1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v067.i01","volume":"67","author":"D Bates","year":"2015","unstructured":"Bates, D., M\u00e4chler, M., Bolker, B., Walker, S.: Fitting linear mixed-effects models using lme4. J. Stat. Softw. 67(1), 1\u201348 (2015)","journal-title":"J. Stat. Softw."},{"key":"10217_CR2","unstructured":"Bates, D., M\u00e4chler, M., Jagan, M.: Matrix: Sparse and Dense Matrix Classes and Methods. R package version 1.5\u20133 (2022)"},{"key":"10217_CR3","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1093\/acprof:oso\/9780199672547.003.0014","volume-title":"Ecological Statistics","author":"BM Bolker","year":"2015","unstructured":"Bolker, B.M.: Linear and generalized linear mixed models. In: Fox, G.A., Negrete-Yankelevich, S., Sosa, V.J. (eds.) Ecological Statistics, pp. 309\u2013333. Oxford University Press, Oxford (2015)"},{"issue":"3","key":"10217_CR4","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1016\/j.tree.2008.10.008","volume":"24","author":"BM Bolker","year":"2009","unstructured":"Bolker, B.M., Brooks, M.E., Clark, C.J., Geange, S.W., Poulsen, J.R., Stevens, M.H.H., White, J.-S.S.: Generalized linear mixed models: a practical guide for ecology and evolution. Trends Ecol. Evol. 24(3), 127\u2013135 (2009)","journal-title":"Trends Ecol. Evol."},{"issue":"421","key":"10217_CR5","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1080\/01621459.1993.10594284","volume":"88","author":"NE Breslow","year":"1993","unstructured":"Breslow, N.E., Clayton, D.G.: Approximate inference in generalized linear mixed models. J. Am. Stat. Assoc. 88(421), 9\u201325 (1993)","journal-title":"J. Am. Stat. Assoc."},{"issue":"3","key":"10217_CR6","doi-asserted-by":"publisher","first-page":"473","DOI":"10.1214\/06-BA117","volume":"1","author":"WJ Browne","year":"2006","unstructured":"Browne, W.J., Draper, D.: A comparison of Bayesian and likelihood-based methods for fitting multilevel models. Bayesian Anal. 1(3), 473\u2013514 (2006)","journal-title":"Bayesian Anal."},{"issue":"4","key":"10217_CR7","doi-asserted-by":"publisher","first-page":"685","DOI":"10.1007\/s11336-013-9328-2","volume":"78","author":"Y Chung","year":"2013","unstructured":"Chung, Y., Rabe-Hesketh, S., Dorie, V., Gelman, A., Liu, J.: A nondegenerate penalized likelihood estimator for variance parameters in multilevel models. Psychometrika 78(4), 685\u2013709 (2013)","journal-title":"Psychometrika"},{"issue":"2","key":"10217_CR8","doi-asserted-by":"publisher","first-page":"136","DOI":"10.3102\/1076998615570945","volume":"40","author":"Y Chung","year":"2015","unstructured":"Chung, Y., Gelman, A., Rabe-Hesketh, S., Liu, J., Dorie, V.: Weakly informative prior for point estimation of covariance matrices in hierarchical models. J. Educ. Behav. Stat. 40(2), 136\u2013157 (2015)","journal-title":"J. Educ. Behav. Stat."},{"issue":"4","key":"10217_CR9","doi-asserted-by":"publisher","first-page":"1360","DOI":"10.1214\/08-AOAS191","volume":"2","author":"A Gelman","year":"2008","unstructured":"Gelman, A., Jakulin, A., Pittau, M.G., Su, Y.-S.: A weakly informative default prior distribution for logistic and other regression models. Ann. Appl. Stat. 2(4), 1360\u20131383 (2008)","journal-title":"Ann. Appl. Stat."},{"issue":"8\u20131","key":"10217_CR10","first-page":"1","volume":"2016","author":"P Gilbert","year":"2019","unstructured":"Gilbert, P., Varadhan, R.: numDeriv: accurate numerical derivatives. R Package Vers. 2016(8\u20131), 1 (2019)","journal-title":"R Package Vers."},{"key":"10217_CR11","doi-asserted-by":"crossref","unstructured":"Harville, D.A.: Matrix algebra from a statistician\u2019s perspective (1998)","DOI":"10.1007\/b98818"},{"issue":"16","key":"10217_CR12","doi-asserted-by":"publisher","first-page":"2409","DOI":"10.1002\/sim.1047","volume":"21","author":"G Heinze","year":"2002","unstructured":"Heinze, G., Schemper, M.: A solution to the problem of separation in logistic regression. Stat. Med. 21(16), 2409\u20132419 (2002)","journal-title":"Stat. Med."},{"key":"10217_CR13","doi-asserted-by":"publisher","DOI":"10.1201\/9781315119281","volume-title":"Asymptotic Analysis of Mixed Effects Models: Theory, Applications, and Open Problems","author":"J Jiang","year":"2017","unstructured":"Jiang, J.: Asymptotic Analysis of Mixed Effects Models: Theory, Applications, and Open Problems. Chapman and Hall\/CRC, Boca Raton (2017)"},{"issue":"3","key":"10217_CR14","doi-asserted-by":"publisher","first-page":"737","DOI":"10.1093\/biomet\/asz080","volume":"107","author":"S Jin","year":"2020","unstructured":"Jin, S., Andersson, B.: A note on the accuracy of adaptive Gauss\u2013Hermite quadrature. Biometrika 107(3), 737\u2013744 (2020)","journal-title":"Biometrika"},{"key":"10217_CR15","unstructured":"Konis, K.: Linear programming algorithms for detecting separated data in binary logistic regression models. Ph.D. thesis, University of Oxford (2007)"},{"issue":"1","key":"10217_CR16","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1093\/biomet\/asaa052","volume":"108","author":"I Kosmidis","year":"2021","unstructured":"Kosmidis, I., Firth, D.: Jeffreys-prior penalty, finiteness and shrinkage in binomial-response generalized linear models. Biometrika 108(1), 71\u201382 (2021)","journal-title":"Biometrika"},{"key":"10217_CR17","doi-asserted-by":"crossref","unstructured":"Kosmidis, I., Schumacher, D.: detectseparation: Detect and Check for Separation and Infinite Maximum Likelihood Estimates. R package version 0.2 (2021)","DOI":"10.32614\/CRAN.package.detectseparation"},{"issue":"3","key":"10217_CR18","first-page":"624","volume":"81","author":"Q Liu","year":"1994","unstructured":"Liu, Q., Pierce, D.A.: A note on Gauss\u2013Hermite quadrature. Biometrika 81(3), 624\u2013629 (1994)","journal-title":"Biometrika"},{"key":"10217_CR19","doi-asserted-by":"publisher","DOI":"10.1002\/9781119541219","volume-title":"Matrix Differential Calculus with Applications in Statistics and Econometrics","author":"JR Magnus","year":"2019","unstructured":"Magnus, J.R., Neudecker, H.: Matrix Differential Calculus with Applications in Statistics and Econometrics. Wiley, Hoboken (2019)"},{"key":"10217_CR20","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4899-3242-6","volume-title":"Generalized Linear Models","author":"P McCullagh","year":"1989","unstructured":"McCullagh, P., Nelder, J.A.: Generalized Linear Models, 2nd edn. Chapman & Hall\/CRC, Boca Raton (1989)","edition":"2"},{"issue":"437","key":"10217_CR21","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1080\/01621459.1997.10473613","volume":"92","author":"CE McCulloch","year":"1997","unstructured":"McCulloch, C.E.: Maximum likelihood algorithms for generalized linear mixed models. J. Am. Stat. Assoc. 92(437), 162\u2013170 (1997)","journal-title":"J. Am. Stat. Assoc."},{"key":"10217_CR22","volume-title":"Generalized, Linear, and Mixed Models","author":"CE McCulloch","year":"2008","unstructured":"McCulloch, C.E., Searle, S.R., Neuhaus, J.M.: Generalized, Linear, and Mixed Models, vol. 2. Wiley, Hoboken (2008)"},{"issue":"4","key":"10217_CR23","doi-asserted-by":"publisher","first-page":"1095","DOI":"10.1007\/s00442-012-2275-2","volume":"169","author":"CS McKeon","year":"2012","unstructured":"McKeon, C.S., Stier, A.C., McIlroy, S.E., Bolker, B.M.: Multiple defender effects: synergistic coral defense by mutualist crustaceans. Oecologia 169(4), 1095\u20131103 (2012)","journal-title":"Oecologia"},{"issue":"2","key":"10217_CR24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v060.i02","volume":"60","author":"JC Nash","year":"2014","unstructured":"Nash, J.C.: On best practice optimization methods in R. J. Stat. Softw. 60(2), 1\u201314 (2014)","journal-title":"J. Stat. Softw."},{"issue":"1","key":"10217_CR25","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1093\/biomet\/asx002","volume":"104","author":"H Ogden","year":"2017","unstructured":"Ogden, H.: On asymptotic validity of Naive inference with an approximate likelihood. Biometrika 104(1), 153\u2013164 (2017)","journal-title":"Biometrika"},{"key":"10217_CR26","doi-asserted-by":"crossref","unstructured":"Ogden, H.: On the error in Laplace approximations of high-dimensional integrals. Stat 10(1), e380 (2021)","DOI":"10.1002\/sta4.380"},{"key":"10217_CR27","doi-asserted-by":"crossref","unstructured":"Pasch, B., Bolker, B.M., Phelps, S.M.: Interspecific dominance via vocal interactions mediates altitudinal zonation in neotropical singing mice. Am. Nat. 182(5), E161\u2013E173 (2013)","DOI":"10.1086\/673263"},{"key":"10217_CR28","doi-asserted-by":"crossref","unstructured":"Pinheiro, J.C., Bates, D.M.: Approximations to the log-likelihood function in the nonlinear mixed-effects model. J. Comput. Graph. Stat. 4(1), 12\u201335 (1995)","DOI":"10.1080\/10618600.1995.10474663"},{"issue":"1","key":"10217_CR29","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1198\/106186006X96962","volume":"15","author":"JC Pinheiro","year":"2006","unstructured":"Pinheiro, J.C., Chao, E.C.: Efficient Laplacian and adaptive Gaussian quadrature algorithms for multilevel generalized linear mixed models. J. Comput. Graph. Stat. 15(1), 58\u201381 (2006)","journal-title":"J. Comput. Graph. Stat."},{"key":"10217_CR30","unstructured":"R Core Team: R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna (2022)"},{"key":"10217_CR31","doi-asserted-by":"crossref","unstructured":"Raudenbush, S.W., Yang, M.-L., Yosef, M.: Maximum likelihood for generalized linear models with nested random effects via high-order, multivariate Laplace approximation. J. Comput. Graph. Stat. 9(1), 141\u2013157 (2000)","DOI":"10.1080\/10618600.2000.10474870"},{"key":"10217_CR32","unstructured":"Revolution Analytics, Weston, S.: doMC: Foreach Parallel Adaptor for \u2018parallel\u2019. R package version 1(3), 8 (2022)"},{"key":"10217_CR33","unstructured":"Rigollet, P.: 18.S997 High-dimensional statistics. Massachusetts Institute of Technology, MIT OpenCourseWare (2015). https:\/\/ocw.mit.edu"},{"issue":"1","key":"10217_CR34","doi-asserted-by":"publisher","first-page":"73","DOI":"10.2307\/2983404","volume":"158","author":"G Rodriguez","year":"1995","unstructured":"Rodriguez, G., Goldman, N.: An assessment of estimation procedures for multilevel models with binary responses. J. R. Stat. Soc. Ser. A (Stat. Soc.) 158(1), 73\u201389 (1995)","journal-title":"J. R. Stat. Soc. Ser. A (Stat. Soc.)"},{"issue":"4","key":"10217_CR35","doi-asserted-by":"publisher","first-page":"719","DOI":"10.1093\/biomet\/78.4.719","volume":"78","author":"R Schall","year":"1991","unstructured":"Schall, R.: Estimation in generalized linear models with random effects. Biometrika 78(4), 719\u2013727 (1991)","journal-title":"Biometrika"},{"key":"10217_CR36","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1016\/j.cogpsych.2016.06.005","volume":"88","author":"H Singmann","year":"2016","unstructured":"Singmann, H., Klauer, K.C., Beller, S.: Probabilistic conditional reasoning: disentangling form and content with the dual-source model. Cogn. Psychol. 88, 61\u201387 (2016)","journal-title":"Cogn. Psychol."},{"key":"10217_CR37","unstructured":"Stringer, A., Bilodeau, B.: Fitting generalized linear mixed models using adaptive quadrature (2022)"},{"key":"10217_CR38","series-title":"Cambridge Series in Statistical and Probabilistic Mathematics","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511802256","volume-title":"Asymptotic Statistics","author":"AW Vaart","year":"1998","unstructured":"Vaart, A.W.: Asymptotic Statistics. Cambridge Series in Statistical and Probabilistic Mathematics, Cambridge University Press, Cambridge (1998)"},{"key":"10217_CR39","doi-asserted-by":"crossref","unstructured":"Venables, W.N., Ripley, B.D.: Modern Applied Statistics with S, 4th edn. Springer, New York. ISBN 0-387-95457-0 (2002)","DOI":"10.1007\/978-0-387-21706-2_14"},{"key":"10217_CR40","first-page":"9","volume":"1","author":"H Wickham","year":"2022","unstructured":"Wickham, H., Fran\u00e7ois, R., Henry, L., Mller, K.: dplyr: a grammar of data manipulation. R Package Vers. 1, 9 (2022)","journal-title":"R Package Vers."},{"issue":"3\u20134","key":"10217_CR41","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1080\/00949659308811554","volume":"48","author":"R Wolfinger","year":"1993","unstructured":"Wolfinger, R., O\u2019connell, M.: Generalized linear mixed models a pseudo-likelihood approach. J. Stat. Comput. Simul. 48(3\u20134), 233\u2013243 (1993)","journal-title":"J. Stat. Comput. Simul."},{"issue":"3","key":"10217_CR42","doi-asserted-by":"publisher","first-page":"744","DOI":"10.1214\/aoms\/1177699475","volume":"37","author":"PW Zehna","year":"1966","unstructured":"Zehna, P.W.: Invariance of maximum likelihood estimators. Ann. Math. Stat. 37(3), 744\u2013744 (1966)","journal-title":"Ann. Math. Stat."},{"issue":"1","key":"10217_CR43","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1214\/088342306000000015","volume":"21","author":"Y Zhao","year":"2006","unstructured":"Zhao, Y., Staudenmayer, J., Coull, B.A., Wand, M.P.: General design Bayesian generalized linear mixed models. Stat. Sci. 21(1), 35\u201351 (2006)","journal-title":"Stat. Sci."}],"container-title":["Statistics and Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-023-10217-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11222-023-10217-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-023-10217-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,17]],"date-time":"2024-10-17T01:51:54Z","timestamp":1729129914000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11222-023-10217-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,16]]},"references-count":43,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,4]]}},"alternative-id":["10217"],"URL":"https:\/\/doi.org\/10.1007\/s11222-023-10217-3","relation":{},"ISSN":["0960-3174","1573-1375"],"issn-type":[{"value":"0960-3174","type":"print"},{"value":"1573-1375","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,16]]},"assertion":[{"value":"6 June 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 February 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 March 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no relevant financial or non-financial interests to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"53"}}