{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T19:22:26Z","timestamp":1792783346321,"version":"4.5.0"},"reference-count":23,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T00:00:00Z","timestamp":1783555200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T00:00:00Z","timestamp":1783555200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100014718","name":"Innovative Research Group Project of the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["12501376"],"award-info":[{"award-number":["12501376"]}],"id":[{"id":"10.13039\/100014718","id-type":"DOI","asserted-by":"publisher"}]},{"name":"R&D Program of Beijing Municipal Education Commission","award":["KM202410038002"],"award-info":[{"award-number":["KM202410038002"]}],"id":[{"id":"https:\/\/ror.org\/04bpn6s66","id-type":"ROR","asserted-by":"crossref"}]},{"name":"Youth Fund for Humanities and Social Science Research by the Ministry of Education","award":["24YJC910003"],"award-info":[{"award-number":["24YJC910003"]}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01 HG006139,R01 DK142026,R35 GM141798"],"award-info":[{"award-number":["R01 HG006139,R01 DK142026,R35 GM141798"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS 2054253,IIS 2205441"],"award-info":[{"award-number":["DMS 2054253,IIS 2205441"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["R01 HG006139, R01 DK142026"],"award-info":[{"award-number":["R01 HG006139, R01 DK142026"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS 2054253,IIS 2205441"],"award-info":[{"award-number":["DMS 2054253,IIS 2205441"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"name":"General Research Fund of Hong Kong","award":["HKBU12300123, HKBU12303421"],"award-info":[{"award-number":["HKBU12300123, HKBU12303421"]}]},{"name":"Initiation Grant for Faculty Niche Research Areas of Hong Kong Baptist University","award":["RC-FNRA-IG\/23-24\/SCI\/03"],"award-info":[{"award-number":["RC-FNRA-IG\/23-24\/SCI\/03"]}],"id":[{"id":"https:\/\/ror.org\/0145fw131","id-type":"ROR","asserted-by":"crossref"}]},{"name":"Initiation Grant for Faculty Niche Research Areas of Hong Kong Baptist University","award":["DMS-2418979"],"award-info":[{"award-number":["DMS-2418979"]}],"id":[{"id":"https:\/\/ror.org\/0145fw131","id-type":"ROR","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Stat Biosci"],"published-print":{"date-parts":[[2026,9]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Data missing caused by non-response or drop-out appears routinely in modern medical studies. With the rapid development of information technology, medical data are becoming more and more massive in volume, and thus usually require distributed analysis in real-world applications, especially for cases where the data are collected from multiple centers or contain patient privacy. In this paper, we focus on developing efficient distributed algorithms to support quantile regression analysis in missing big data, which provides a powerful tool to model the skew and heterogeneous medical samples in reality, but currently remains a challenging issue. We employ the weighted quantile regression (WQR) technique to incorporate the missing information into the model and propose two two-stage distributed algorithms, IPW-ADMM and IPW-renewable, for efficient and privacy-preserving estimation of WQR. Both methods first estimate the missingness mechanism using a logistic model and then solve the WQR problem in a communication-efficient manner without sharing raw individual-level data. The IPW-ADMM algorithm parallelizes estimation using a multi-block alternating direction method of multipliers (ADMM), reformulating the nonsmooth WQR objective into a set of local subproblems. The IPW-renewable algorithm adopts a sequential renewable estimation framework with the\u00a0smoothing technique, making it suitable for streaming or incremental data settings. Simulation studies demonstrate that both proposed methods achieve estimation accuracy comparable to the classical centralized interior point (IP) method, while offering substantial computational speedups in distributed environments. An application to the UK Biobank dataset further illustrates their practical utility in detecting heterogeneous genetic associations across quantiles under covariate missingness.<\/jats:p>","DOI":"10.1007\/s12561-026-09528-6","type":"journal-article","created":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T11:08:09Z","timestamp":1783595289000},"page":"844-875","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Distributed quantile regression for big data with missing covariates"],"prefix":"10.1007","volume":"18","author":[{"given":"Ye","family":"Fan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hua","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jin","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tiejun","family":"Tong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8680-2455","authenticated-orcid":false,"given":"Nan","family":"Lin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,7,9]]},"reference":[{"issue":"28","key":"9528_CR1","doi-asserted-by":"publisher","first-page":"4967","DOI":"10.1002\/sim.5883","volume":"32","author":"B Sherwood","year":"2013","unstructured":"Sherwood B, Wang L, Zhou XH (2013) Weighted quantile regression for analyzing health care cost data with missing covariates. Stat Med 32(28):4967\u20134979. https:\/\/doi.org\/10.1002\/sim.5883","journal-title":"Stat Med"},{"issue":"1","key":"9528_CR2","doi-asserted-by":"publisher","first-page":"33","DOI":"10.2307\/1913643","volume":"46","author":"R Koenker","year":"1978","unstructured":"Koenker R, Bassett G (1978) Regression quantiles. Econometrica 46(1):33\u201350. https:\/\/doi.org\/10.2307\/1913643","journal-title":"Econometrica"},{"issue":"1","key":"9528_CR3","doi-asserted-by":"publisher","first-page":"6460","DOI":"10.1038\/s41467-024-50726-x","volume":"15","author":"C Wang","year":"2024","unstructured":"Wang C, Wang T, Kiryluk K et al (2024) Genome-wide discovery for biomarkers using quantile regression at biobank scale. Nat Commun 15(1):6460. https:\/\/doi.org\/10.1038\/s41467-024-50726-x","journal-title":"Nat Commun"},{"issue":"6","key":"9528_CR4","doi-asserted-by":"publisher","first-page":"3244","DOI":"10.1214\/18-AOS1777","volume":"47","author":"X Chen","year":"2019","unstructured":"Chen X, Liu W, Zhang Y (2019) Quantile regression under memory constraint. Ann Stat 47(6):3244\u20133273. https:\/\/doi.org\/10.1214\/18-AOS1777","journal-title":"Ann Stat"},{"issue":"3","key":"9528_CR5","doi-asserted-by":"publisher","first-page":"1634","DOI":"10.1214\/18-AOS1730","volume":"47","author":"S Volgushev","year":"2019","unstructured":"Volgushev S, Chao SK, Cheng G (2019) Distributed inference for quantile regression processes. Ann Stat 47(3):1634\u20131662. https:\/\/doi.org\/10.1214\/18-AOS1730","journal-title":"Ann Stat"},{"key":"9528_CR6","doi-asserted-by":"publisher","DOI":"10.1016\/j.csda.2019.106892","volume":"144","author":"L Chen","year":"2020","unstructured":"Chen L, Zhou Y (2020) Quantile regression in big data: a divide and conquer based strategy. Comput Stat Data Anal 144:106892. https:\/\/doi.org\/10.1016\/j.csda.2019.106892","journal-title":"Comput Stat Data Anal"},{"issue":"3","key":"9528_CR7","doi-asserted-by":"publisher","first-page":"319","DOI":"10.1080\/00401706.2017.1345703","volume":"60","author":"Y Gu","year":"2018","unstructured":"Gu Y, Fan J, Kong L et al (2018) ADMM for high-dimensional sparse penalized quantile regression. Technometrics 60(3):319\u2013331. https:\/\/doi.org\/10.1080\/00401706.2017.1345703","journal-title":"Technometrics"},{"key":"9528_CR8","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1016\/j.neucom.2021.03.041","volume":"448","author":"A Hu","year":"2021","unstructured":"Hu A, Jiao Y, Liu Y et al (2021) Distributed quantile regression for massive heterogeneous data. Neurocomputing 448:249\u2013262. https:\/\/doi.org\/10.1016\/j.neucom.2021.03.041","journal-title":"Neurocomputing"},{"key":"9528_CR9","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1007\/978-3-7908-2604-3_16","volume-title":"Proceedings of COMPSTAT\u20192010","author":"L Bottou","year":"2010","unstructured":"Bottou L (2010) Large-scale machine learning with stochastic gradient descent. In: Lechevallier Y, Saporta G (eds) Proceedings of COMPSTAT\u20192010. Physica-Verlag HD, Heidelberg, pp 177\u2013186. https:\/\/doi.org\/10.1007\/978-3-7908-2604-3_16"},{"key":"9528_CR10","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1145\/1015330.101533","volume-title":"Proceedings of the twenty-first international conference on machine learning","author":"T Zhang","year":"2004","unstructured":"Zhang T (2004) Solving large scale linear prediction problems using stochastic gradient descent algorithms. Proceedings of the twenty-first international conference on machine learning. IEEE, p 116. https:\/\/doi.org\/10.1145\/1015330.101533"},{"issue":"3","key":"9528_CR11","doi-asserted-by":"publisher","first-page":"494","DOI":"10.1111\/insr.12221","volume":"85","author":"L Yu","year":"2017","unstructured":"Yu L, Lin N (2017) ADMM for penalized quantile regression in big data. Int Stat Rev 85(3):494\u2013518. https:\/\/doi.org\/10.1111\/insr.12221","journal-title":"Int Stat Rev"},{"issue":"2","key":"9528_CR12","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1051\/m2an\/197509R200411","volume":"9","author":"R Glowinski","year":"1975","unstructured":"Glowinski R, Marroco A (1975) Sur l\u2019approximation, par elements finis d\u2019ordre un, et la resolution, par penalisation-dualite, d\u2019une classe de problemes de dirichlet non lineaires. Revue Fran\u00e7aise D\u2019automatique Informatique Recherche Op\u00e9rationnelle Analyse Num\u00e9rique 9(2):41\u201376","journal-title":"Revue Fran\u00e7aise D\u2019automatique Informatique Recherche Op\u00e9rationnelle Analyse Num\u00e9rique"},{"issue":"1","key":"9528_CR13","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1016\/0898-1221(76)90003-1","volume":"2","author":"D Gabay","year":"1976","unstructured":"Gabay D, Mercier B (1976) A dual algorithm for the solution of nonlinear variational problems via finite element approximation. Comput Math Appl 2(1):17\u201340. https:\/\/doi.org\/10.1016\/0898-1221(76)90003-1","journal-title":"Comput Math Appl"},{"issue":"1","key":"9528_CR14","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1007\/s10107-014-0826-5","volume":"155","author":"C Chen","year":"2016","unstructured":"Chen C, He B, Ye Y et al (2016) The direct extension of ADMM for multi-block convex minimization problems is not necessarily convergent. Math Program 155(1):57\u201379. https:\/\/doi.org\/10.1007\/s10107-014-0826-5","journal-title":"Math Program"},{"issue":"1","key":"9528_CR15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1561\/2200000016","volume":"3","author":"S Boyd","year":"2011","unstructured":"Boyd S, Parikh N, Chu E et al (2011) Distributed optimization and statistical learning via the alternating direction method of multipliers. Found Trends Mach Learn 3(1):1\u2013122. https:\/\/doi.org\/10.1561\/2200000016","journal-title":"Found Trends Mach Learn"},{"issue":"2","key":"9528_CR16","doi-asserted-by":"publisher","first-page":"712","DOI":"10.1007\/s10915-016-0318-2","volume":"71","author":"W Deng","year":"2017","unstructured":"Deng W, Lai MJ, Peng Z et al (2017) Parallel multi-block ADMM with $$o(1\/k)$$ convergence. J Sci Comput 71(2):712\u2013736. https:\/\/doi.org\/10.1007\/s10915-016-0318-2","journal-title":"J Sci Comput"},{"issue":"1","key":"9528_CR17","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1111\/rssb.12352","volume":"82","author":"L Luo","year":"2020","unstructured":"Luo L, Song PXK (2020) Renewable estimation and incremental inference in generalized linear models with streaming data sets. J R Stat Soc Ser B Stat Methodol 82(1):69\u201397. https:\/\/doi.org\/10.1111\/rssb.12352","journal-title":"J R Stat Soc Ser B Stat Methodol"},{"issue":"2","key":"9528_CR18","doi-asserted-by":"publisher","first-page":"367","DOI":"10.1016\/j.jeconom.2021.07.010","volume":"232","author":"X He","year":"2023","unstructured":"He X, Pan X, Tan KM et al (2023) Smoothed quantile regression with large-scale inference. J Econom 232(2):367\u2013388. https:\/\/doi.org\/10.1016\/j.jeconom.2021.07.010","journal-title":"J Econom"},{"issue":"1","key":"9528_CR19","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1093\/imanum\/8.1.141","volume":"8","author":"J Barzilai","year":"1988","unstructured":"Barzilai J, Borwein JM (1988) Two-point step size gradient methods. IMA J Numer Anal 8(1):141\u2013148. https:\/\/doi.org\/10.1093\/imanum\/8.1.141","journal-title":"IMA J Numer Anal"},{"key":"9528_CR20","doi-asserted-by":"publisher","DOI":"10.1016\/j.jeconom.2024.105924","volume":"249","author":"J Xie","year":"2025","unstructured":"Xie J, Yan X, Jiang B et al (2025) Statistical inference for smoothed quantile regression with streaming data. J Econom 249:105924. https:\/\/doi.org\/10.1016\/j.jeconom.2024.105924","journal-title":"J Econom"},{"issue":"3","key":"9528_CR21","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1016\/j.ajhg.2022.01.018","volume":"109","author":"S Ko","year":"2022","unstructured":"Ko S, German CA, Jensen A et al (2022) GWAS of longitudinal trajectories at biobank scale. Am J Hum Genet 109(3):433\u2013445. https:\/\/doi.org\/10.1016\/j.ajhg.2022.01.018","journal-title":"Am J Hum Genet"},{"issue":"7","key":"9528_CR22","doi-asserted-by":"publisher","first-page":"1527","DOI":"10.1038\/s41588-024-01793-9","volume":"56","author":"ZR McCaw","year":"2024","unstructured":"McCaw ZR, Gao J, Lin X et al (2024) Synthetic surrogates improve power for genome-wide association studies of partially missing phenotypes in population biobanks. Nat Genet 56(7):1527\u20131536. https:\/\/doi.org\/10.1038\/s41588-024-01793-9","journal-title":"Nat Genet"},{"key":"9528_CR23","unstructured":"Abdel-Azim A, Wang R, Lin X (2026) Harnessing synthetic data from generative AI for statistical inference. Preprint at https:\/\/arxiv.org\/abs\/2603.05396"}],"container-title":["Statistics in Biosciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12561-026-09528-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12561-026-09528-6","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12561-026-09528-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,18]],"date-time":"2026-09-18T10:48:12Z","timestamp":1789728492000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12561-026-09528-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,9]]},"references-count":23,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,9]]}},"alternative-id":["9528"],"URL":"https:\/\/doi.org\/10.1007\/s12561-026-09528-6","relation":{},"ISSN":["1867-1764","1867-1772"],"issn-type":[{"value":"1867-1764","type":"print"},{"value":"1867-1772","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,9]]},"assertion":[{"value":"9 December 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 June 2026","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 June 2026","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 July 2026","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.","order":1,"name":"Ethics","label":"Conflict of interest","group":{"name":"EthicsHeading","label":"Declarations"}}]}}