{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,26]],"date-time":"2026-06-26T23:35:26Z","timestamp":1782516926928,"version":"3.54.5"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2022,7,19]],"date-time":"2022-07-19T00:00:00Z","timestamp":1658188800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,7,19]],"date-time":"2022-07-19T00:00:00Z","timestamp":1658188800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Comput Stat"],"published-print":{"date-parts":[[2023,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Multivariate Bayesian linear regression (MBLR) is a popular statistical tool with many applications in a variety of scientific fields. However, a shortcoming is potential model over-complexity, as the model assumes that all responses depend on the same covariates and that all errors are mutually pairwise correlated. The class of Bayesian seemingly unrelated regression (SUR) models generalizes the class of MBLR models by allowing for response-specific covariate sets. In a recent work it has been proposed to employ Gaussian graphical models for learning sparse SUR (SSUR) models with conditional independencies among the errors. The proposed SSUR model infers undirected edges among the errors, and the proposed Reversible Jump Markov Chain Monte Carlo (RJMCMC) inference algorithm relies on approximations of the marginal likelihoods. In this paper, we propose a new refined SSUR model that replaces the undirected graphs (Gaussian graphical models) by directed acyclic graphs (Gaussian Bayesian networks). Unlike the earlier proposed model, our new model is therefore able to learn some directed edges among the errors. And we derive a RJMCMC algorithm that does not require approximations of the marginal likelihoods. In particular, we present an algorithm for sampling covariance matrices that are coherent with a given directed acyclic graph. The proposed RJMCMC algorithm allows for exact Bayesian model averaging across both: the response-specific covariate sets and the directed acyclic graphs.<\/jats:p>","DOI":"10.1007\/s00180-022-01258-9","type":"journal-article","created":{"date-parts":[[2022,7,19]],"date-time":"2022-07-19T16:09:51Z","timestamp":1658246991000},"page":"779-808","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Model averaging for sparse seemingly unrelated regression using Bayesian networks among the errors"],"prefix":"10.1007","volume":"38","author":[{"given":"Abdul","family":"Salam","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2604-9270","authenticated-orcid":false,"given":"Marco","family":"Grzegorczyk","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,7,19]]},"reference":[{"issue":"7","key":"1258_CR1","doi-asserted-by":"crossref","first-page":"2152","DOI":"10.1002\/qre.2496","volume":"35","author":"A Ahmadi Yazdi","year":"2019","unstructured":"Ahmadi Yazdi A, Zeinal Hamadani A, Amiri A, Grzegorczyk M (2019) A new Bayesian multivariate exponentially weighted moving average control chart for phase II monitoring of multivariate multiple linear profiles. Qual Reliab Eng Int 35(7):2152\u20132177","journal-title":"Qual Reliab Eng Int"},{"issue":"4","key":"1258_CR2","doi-asserted-by":"publisher","first-page":"1568","DOI":"10.1785\/0120090320","volume":"100","author":"D Arroyo","year":"2010","unstructured":"Arroyo D, Ordaz M (2010) Multivariate Bayesian regression analysis applied to ground-motion prediction equations, Part 2: numerical example with actual data. Bull Seismol Soc Am 100(4):1568\u20131577","journal-title":"Bull Seismol Soc Am"},{"issue":"1","key":"1258_CR3","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1002\/jae.1137","volume":"25","author":"M Banbura","year":"2010","unstructured":"Banbura M, Giannone D, Reichlin L (2010) Large Bayesian vector autoregressions. J Appl Economet 25(1):71\u201392","journal-title":"J Appl Economet"},{"issue":"2\u20133","key":"1258_CR4","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1080\/00273171.2016.1151333","volume":"51","author":"A Beltz","year":"2016","unstructured":"Beltz A, Molenaar P (2016) Dealing with multiple solutions in structural vector autoregressive models. Multivar Behav Res 51(2\u20133):357\u2013373","journal-title":"Multivar Behav Res"},{"key":"1258_CR5","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1080\/10618600.1998.10474787","volume":"7","author":"S Brooks","year":"1998","unstructured":"Brooks S, Gelman A (1998) General methods for monitoring convergence of iterative simulations. J Comput Graph Stat 7:434\u2013455","journal-title":"J Comput Graph Stat"},{"issue":"3","key":"1258_CR6","doi-asserted-by":"publisher","first-page":"1311","DOI":"10.1002\/hbm.23456","volume":"38","author":"S Chiang","year":"2017","unstructured":"Chiang S, Guindani M, Yeh H, Haneef Z, Stern J, Vannucci M (2017) Bayesian vector autoregressive model for multi-subject effective connectivity inference using multi-modal neuroimaging data. Hum Brain Mapp 38(3):1311\u20131332","journal-title":"Hum Brain Mapp"},{"issue":"432","key":"1258_CR7","doi-asserted-by":"publisher","first-page":"1313","DOI":"10.1080\/01621459.1995.10476635","volume":"90","author":"S Chib","year":"1995","unstructured":"Chib S (1995) Marginal likelihood from the Gibbs output. J Am Stat Assoc 90(432):1313\u20131321","journal-title":"J Am Stat Assoc"},{"key":"1258_CR8","unstructured":"Chickering DM (1995) A transformational characterization of equivalent Bayesian network structures. In: International conference on uncertainty in artificial intelligence (UAI), vol 11, pp 87\u201398"},{"key":"1258_CR9","first-page":"445","volume":"2","author":"DM Chickering","year":"2002","unstructured":"Chickering DM (2002) Learning equivalence classes of Bayesian-network structures. J Mach Learn Res 2:445\u2013498","journal-title":"J Mach Learn Res"},{"key":"1258_CR10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/ncomms13254","volume":"7","author":"P Dalle Pezze","year":"2016","unstructured":"Dalle Pezze P, Ruf S, Sonntag AG, Langelaar-Makkinje M, Hall P, Heberle AM, Razquin Navas P, van Eunen K, T\u00f6lle RC, Schwarz JJ, Wiese H, Warscheid B, Deitersen J, Stork B, F\u00e4\u00dfler E, Sch\u00e4uble S, Hahn U, Horvatovich P, Shanley DP, Thedieck K (2016) A systems study reveals concurrent activation of AMPK and mTOR by amino acids. Nat Commun 7:1\u20139","journal-title":"Nat Commun"},{"key":"1258_CR11","doi-asserted-by":"publisher","unstructured":"Davis J, Goadrich M (2006) The relationship between precision-recall and ROC curves. In: ICML \u201906: Proceedings of the 23rd international conference on Machine Learning, ACM, New York, NY, USA, pp 233\u2013240. https:\/\/doi.org\/10.1145\/1143844.1143874","DOI":"10.1145\/1143844.1143874"},{"key":"1258_CR12","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1007\/s11222-006-8450-8","volume":"16","author":"P Fearnhead","year":"2006","unstructured":"Fearnhead P (2006) Exact and efficient Bayesian inference for multiple changepoint problems. Stat Comput 16:203\u2013213","journal-title":"Stat Comput"},{"issue":"1","key":"1258_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1111\/insr.12243","volume":"86","author":"T Fragoso","year":"2018","unstructured":"Fragoso T, Bertoli W, Louzada F (2018) Bayesian model averaging: a systematic review and conceptual classification. Int Stat Rev 86(1):1\u201328","journal-title":"Int Stat Rev"},{"key":"1258_CR14","doi-asserted-by":"crossref","unstructured":"Geiger D, Heckerman D (1994) Learning Gaussian networks. In: Proceedings of the tenth conference on uncertainty in artificial intelligence, Morgan Kaufmann, San Francisco, CA, pp 235\u2013243","DOI":"10.1016\/B978-1-55860-332-5.50035-3"},{"issue":"5","key":"1258_CR15","doi-asserted-by":"publisher","first-page":"1412","DOI":"10.1214\/aos\/1035844981","volume":"30","author":"D Geiger","year":"2002","unstructured":"Geiger D, Heckerman D (2002) Parameter priors for directed acyclic graphical models and the characterization of several probability distributions. Ann Stat 30(5):1412\u20131440","journal-title":"Ann Stat"},{"issue":"1","key":"1258_CR16","doi-asserted-by":"publisher","first-page":"150","DOI":"10.1214\/aoms\/1177700279","volume":"36","author":"S Geisser","year":"1965","unstructured":"Geisser S (1965) Bayesian estimation in multivariate analysis. Ann Math Stat 36(1):150\u2013159","journal-title":"Ann Math Stat"},{"issue":"4","key":"1258_CR17","first-page":"473","volume":"7","author":"C Geyer","year":"1992","unstructured":"Geyer C (1992) Practical Markov chain Monte Carlo. Stat Sci 7(4):473\u2013483","journal-title":"Stat Sci"},{"key":"1258_CR18","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1023\/A:1020202028934","volume":"50","author":"P Giudici","year":"2003","unstructured":"Giudici P, Castelo R (2003) Improving Markov chain Monte Carlo model search for data mining. Mach Learn 50:127\u2013158","journal-title":"Mach Learn"},{"key":"1258_CR19","doi-asserted-by":"publisher","first-page":"711","DOI":"10.1093\/biomet\/82.4.711","volume":"82","author":"P Green","year":"1995","unstructured":"Green P (1995) Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 82:711\u2013732","journal-title":"Biometrika"},{"issue":"478","key":"1258_CR20","doi-asserted-by":"publisher","first-page":"507","DOI":"10.1198\/016214507000000121","volume":"102","author":"C Hans","year":"2007","unstructured":"Hans C, Dobra A, West M (2007) Shotgun stochastic search in regression with many predictors. J Am Stat Assoc 102(478):507\u2013516","journal-title":"J Am Stat Assoc"},{"issue":"6","key":"1258_CR21","doi-asserted-by":"publisher","first-page":"471","DOI":"10.1016\/j.knosys.2008.03.005","volume":"21","author":"E Hatzikos","year":"2008","unstructured":"Hatzikos E, Tsoumakas G, Tzanis G, Bassiliades N, Vlahavas I (2008) An empirical study on sea water quality prediction. Knowl Based Syst 21(6):471\u2013478","journal-title":"Knowl Based Syst"},{"issue":"4","key":"1258_CR22","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1214\/ss\/1009212519","volume":"14","author":"J Hoeting","year":"1999","unstructured":"Hoeting J, Madigan D, Raftery A, Volinsky C (1999) Bayesian model averaging: a tutorial. Stat Sci 14(4):382\u2013401","journal-title":"Stat Sci"},{"issue":"3","key":"1258_CR23","doi-asserted-by":"publisher","first-page":"533","DOI":"10.1198\/106186002475","volume":"11","author":"C Holmes","year":"2002","unstructured":"Holmes C, Denison D, Mallick B (2002) Accounting for model uncertainty in seemingly unrelated regressions. J Comput Graph Stat 11(3):533\u2013551","journal-title":"J Comput Graph Stat"},{"issue":"2","key":"1258_CR24","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1016\/j.jeconom.2013.04.007","volume":"177","author":"G Koop","year":"2013","unstructured":"Koop G, Korobilis D (2013) Large time-varying parameter VARs. J Econom. 177(2):185\u2013198","journal-title":"J Econom."},{"issue":"4","key":"1258_CR25","doi-asserted-by":"publisher","first-page":"1689","DOI":"10.1214\/14-AOS1217","volume":"42","author":"J Kuipers","year":"2014","unstructured":"Kuipers J, Moffa G, Heckerman D (2014) Addendum on the scoring of Gaussian directed acyclic graphical models. Ann Stat 42(4):1689\u20131691","journal-title":"Ann Stat"},{"key":"1258_CR26","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780198522195.001.0001","volume-title":"Graphical Models","author":"S Lauritzen","year":"1996","unstructured":"Lauritzen S (1996) Graphical Models. Clarendon Press, Oxford"},{"key":"1258_CR27","doi-asserted-by":"publisher","first-page":"215","DOI":"10.2307\/1403615","volume":"63","author":"D Madigan","year":"1995","unstructured":"Madigan D, York J (1995) Bayesian graphical models for discrete data. Int Stat Rev 63:215\u2013232","journal-title":"Int Stat Rev"},{"key":"1258_CR28","unstructured":"MATLAB (2020) 9.9.0.1538559 (R2020b) Update 3. The MathWorks Inc., Natick, Massachusetts"},{"key":"1258_CR29","volume-title":"Applied Multivariate Analysis","author":"J Press","year":"1972","unstructured":"Press J (1972) Applied Multivariate Analysis. Holt, Rinehart and Winston, New York"},{"issue":"437","key":"1258_CR30","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1080\/01621459.1997.10473615","volume":"92","author":"A Raftery","year":"1997","unstructured":"Raftery A, Madigan D, Hoeting J (1997) Bayesian model averaging for linear regression models. J Am Stat Assoc 92(437):179\u2013191","journal-title":"J Am Stat Assoc"},{"key":"1258_CR31","doi-asserted-by":"crossref","unstructured":"Rossi PE, Allenby GM, McCulloch R (2005) Bayesian statistics and marketing. Wiley Series in Probability and Statistics. Wiley & Sons, Ltd. ISBN 0-470-86367-6","DOI":"10.1002\/0470863692"},{"key":"1258_CR32","doi-asserted-by":"publisher","unstructured":"Saputro D, Amalia F, Widyaningsih P, Affan R (2018) Parameter estimation of multivariate multiple regression model using Bayesian with non-informative Jeffreys\u2019 prior distribution. In: Journal of Physics: Conference Series, vol 1022, p 012002. https:\/\/doi.org\/10.1088\/1742-6596\/1022\/1\/012002","DOI":"10.1088\/1742-6596\/1022\/1\/012002"},{"key":"1258_CR33","doi-asserted-by":"publisher","first-page":"W08401","DOI":"10.1029\/2005WR004835","volume":"43","author":"O Seidou","year":"2007","unstructured":"Seidou O, Asselin J, Ouarda T (2007) Bayesian multivariate linear regression with application to change point models in hydrometeorological variables. Water Resour Res 43:W08401. https:\/\/doi.org\/10.1029\/2005WR004835","journal-title":"Water Resour Res"},{"key":"1258_CR34","doi-asserted-by":"publisher","first-page":"527","DOI":"10.1287\/mnsc.35.5.527","volume":"35","author":"RD Shachter","year":"1989","unstructured":"Shachter RD, Kenley R (1989) Gaussian influence diagrams. Manag Sci 35:527\u2013550","journal-title":"Manag Sci"},{"issue":"12","key":"1258_CR35","doi-asserted-by":"publisher","first-page":"2108","DOI":"10.1093\/bioinformatics\/bty917","volume":"35","author":"M Shafiee Kamalabad","year":"2019","unstructured":"Shafiee Kamalabad M, Heberle AM, Thedieck K, Grzegorczyk M (2019) Partially non-homogeneous dynamic Bayesian networks based on Bayesian regression models with partitioned design matrices. Bioinformatics 35(12):2108\u20132117","journal-title":"Bioinformatics"},{"key":"1258_CR36","doi-asserted-by":"crossref","unstructured":"Sinay MS, Hsu JS (2014) Bayesian inference of a multivariate regression model. J Probab Stat 2014","DOI":"10.1155\/2014\/673657"},{"issue":"1","key":"1258_CR37","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1007\/s10994-016-5546-z","volume":"104","author":"E Spyromitros-Xioufis","year":"2016","unstructured":"Spyromitros-Xioufis E, Tsoumakas G, Groves W, Vlahavas I (2016) Multi-target regression via input space expansion: treating targets as inputs. Mach Learn 104(1):55\u201398","journal-title":"Mach Learn"},{"key":"1258_CR38","doi-asserted-by":"publisher","unstructured":"Talarico E, Lopes H, Barbosa S, Pesco S (2017) Multiple response nonlinear regression applied to simultaneous density, vp and vs rock physics calibration and related statistical analysis. In: 15th International Congress of the Brazilian Geophysical Society & EXPOGEF, Society of Exploration Geophysicists, Tulsa, Oklahoma (USA), pp 11\u201316. https:\/\/doi.org\/10.1190\/sbgf2017-003","DOI":"10.1190\/sbgf2017-003"},{"issue":"2","key":"1258_CR39","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1111\/j.2517-6161.1964.tb00560.x","volume":"26","author":"GC Tiao","year":"1964","unstructured":"Tiao GC, Zellner A (1964) On the Bayesian estimation of multivariate regression. J R Stat Soc Ser B (Methodological) 26(2):277\u2013285","journal-title":"J R Stat Soc Ser B (Methodological)"},{"issue":"2","key":"1258_CR40","doi-asserted-by":"publisher","first-page":"667","DOI":"10.1214\/20-BA1221","volume":"16","author":"A Vehtari","year":"2021","unstructured":"Vehtari A, Gelman A, Simpson D, Carpenter B, B\u00fcrkner PC (2021) Rank-normalization, folding, and localization: an improved $$\\hat{R}$$ for assessing convergence of MCMC (with Discussion). Bayesian Anal 16(2):667\u2013718","journal-title":"Bayesian Anal"},{"issue":"11","key":"1258_CR41","doi-asserted-by":"publisher","first-page":"2866","DOI":"10.1016\/j.csda.2010.03.028","volume":"54","author":"H Wang","year":"2010","unstructured":"Wang H (2010) Sparse seemingly unrelated regression modelling: applications in finance and econometrics. Comput Stat Data Anal 54(11):2866\u20132877","journal-title":"Comput Stat Data Anal"},{"issue":"1","key":"1258_CR42","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1006\/jmps.1999.1278","volume":"44","author":"L Wasserman","year":"2000","unstructured":"Wasserman L (2000) Bayesian model selection and model averaging. J Math Psychol 44(1):92\u2013107","journal-title":"J Math Psychol"},{"issue":"298","key":"1258_CR43","doi-asserted-by":"publisher","first-page":"348","DOI":"10.1080\/01621459.1962.10480664","volume":"57","author":"A Zellner","year":"1962","unstructured":"Zellner A (1962) An efficient method of estimating seemingly unrelated regressions and tests for aggregation bias. J Am Stat Assoc 57(298):348\u2013368","journal-title":"J Am Stat Assoc"},{"issue":"1","key":"1258_CR44","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1016\/j.jeconom.2010.04.005","volume":"159","author":"A Zellner","year":"2010","unstructured":"Zellner A, Ando T (2010) A direct Monte Carlo approach for Bayesian analysis of the seemingly unrelated regression model. J Econom 159(1):33\u201345","journal-title":"J Econom"},{"issue":"3","key":"1258_CR45","doi-asserted-by":"publisher","first-page":"300","DOI":"10.2307\/2525396","volume":"3","author":"A Zellner","year":"1962","unstructured":"Zellner A, Huang DS (1962) Further properties of efficient estimators for seemingly unrelated regression equations. Int Econ Rev 3(3):300\u2013313","journal-title":"Int Econ Rev"}],"container-title":["Computational Statistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00180-022-01258-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00180-022-01258-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00180-022-01258-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,29]],"date-time":"2024-09-29T11:48:31Z","timestamp":1727610511000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00180-022-01258-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,19]]},"references-count":45,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,6]]}},"alternative-id":["1258"],"URL":"https:\/\/doi.org\/10.1007\/s00180-022-01258-9","relation":{},"ISSN":["0943-4062","1613-9658"],"issn-type":[{"value":"0943-4062","type":"print"},{"value":"1613-9658","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,19]]},"assertion":[{"value":"12 November 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 June 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 July 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}