{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:01:34Z","timestamp":1760144494586,"version":"build-2065373602"},"reference-count":57,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2024,4,25]],"date-time":"2024-04-25T00:00:00Z","timestamp":1714003200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Constructing Bayesian networks (BN) for practical applications presents significant challenges, especially in domains with limited empirical data available. In such situations, field experts are often consulted to estimate the model\u2019s parameters, for instance, rank correlations in Gaussian copula-based Bayesian networks (GCBN). Because there is no consensus on a \u2018best\u2019 approach for eliciting these correlations, this paper proposes a framework that uses probabilities of concordance for assessing dependence, and the dependence calibration score to aggregate experts\u2019 judgments. To demonstrate the relevance of our approach, the latter is implemented to populate a GCBN intended to estimate the condition of air handling units\u2019 components\u2014a key challenge in building asset management. While the elicitation of concordance probabilities was well received by the questionnaire respondents, the analysis of the results reveals notable disparities in the experts\u2019 ability to quantify uncertainty. Moreover, the application of the dependence calibration aggregation method was hindered by the absence of relevant seed variables, thus failing to evaluate the participants\u2019 field expertise. All in all, while the authors do not recommend to use the current model in practice, this study suggests that concordance probabilities should be further explored as an alternative approach for the elicitation of dependence.<\/jats:p>","DOI":"10.3390\/e26050360","type":"journal-article","created":{"date-parts":[[2024,4,25]],"date-time":"2024-04-25T08:08:32Z","timestamp":1714032512000},"page":"360","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Elicitation of Rank Correlations with Probabilities of Concordance: Method and Application to Building Management"],"prefix":"10.3390","volume":"26","author":[{"given":"Benjamin","family":"Ramousse","sequence":"first","affiliation":[{"name":"Department of Hydraulic Engineering, Delft University of Technology, 2628 CN Delft, The Netherlands"},{"name":"Linesight, 75014 Paris, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8488-1447","authenticated-orcid":false,"given":"Miguel Angel","family":"Mendoza-Lugo","sequence":"additional","affiliation":[{"name":"Department of Hydraulic Engineering, Delft University of Technology, 2628 CN Delft, The Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2246-9355","authenticated-orcid":false,"given":"Guus","family":"Rongen","sequence":"additional","affiliation":[{"name":"Department of Hydraulic Engineering, Delft University of Technology, 2628 CN Delft, The Netherlands"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6764-4674","authenticated-orcid":false,"given":"Oswaldo","family":"Morales-N\u00e1poles","sequence":"additional","affiliation":[{"name":"Department of Hydraulic Engineering, Delft University of Technology, 2628 CN Delft, The Netherlands"}]}],"member":"1968","published-online":{"date-parts":[[2024,4,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"838","DOI":"10.1080\/09613218.2019.1704208","article-title":"A probabilistic performance evaluation for buildings and constructed assets","volume":"48","author":"Bortolini","year":"2020","journal-title":"Build. Res. Inf."},{"key":"ref_2","unstructured":"CEN (2010). Maintenance. Maintenance Terminology, CEN. OCLC: 9521555828."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Sullivan, G., Pugh, R., Melendez, A.P., and Hunt, W.D. (2010). Operations & Maintenance Best Practices\u2014A Guide to Achieving Operational Efficiency (Release 3), Technical Report PNNL-19634, 1034595.","DOI":"10.2172\/1034595"},{"key":"ref_4","unstructured":"Straub, A. (2012). International Encyclopedia of Housing and Home, Elsevier."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"638","DOI":"10.1109\/59.962408","article-title":"The present status of maintenance strategies and the impact of maintenance on reliability","volume":"16","author":"Endrenyi","year":"2001","journal-title":"IEEE Trans. Power Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.ejor.2016.04.020","article-title":"New stochastic models for preventive maintenance and maintenance optimization","volume":"255","author":"Lee","year":"2016","journal-title":"Eur. J. Oper. Res."},{"key":"ref_7","first-page":"14","article-title":"Building maintenance strategies: Planning under uncertainty","volume":"30","author":"Lind","year":"2012","journal-title":"Prop. Manag."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"103814","DOI":"10.1016\/j.jobe.2021.103814","article-title":"Condition assessment of buildings in Romania: A proposed method and case study","volume":"47","year":"2022","journal-title":"J. Build. Eng."},{"key":"ref_9","unstructured":"NEN (2006). NEN 2767 Conditiemeting van bouw- en Installatiedelen\u2014Deel 1: Methodiek (Condition Assessment of Building and Installation Components\u2014Part 1: Methodology), NEN."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"04021004","DOI":"10.1061\/(ASCE)CF.1943-5509.0001569","article-title":"Facility Defect and Cost Reduction by Incorporating Maintainability Knowledge Transfer Using Maintenance Management System Data","volume":"35","author":"Weeks","year":"2021","journal-title":"J. Perform. Constr. Facil."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1108\/IJBPA-09-2018-0077","article-title":"Defects in newly constructed residential buildings: Owners\u2019 perspective","volume":"37","author":"Zalejska","year":"2019","journal-title":"Int. J. Build. Pathol. Adapt."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.buildenv.2016.03.003","article-title":"Climate change and building ageing impact on building energy performance and mitigation measures application: A case study in Turin, northern Italy","volume":"102","author":"Waddicor","year":"2016","journal-title":"Build. Environ."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"117720","DOI":"10.1016\/j.jclepro.2019.117720","article-title":"A probabilistic-based approach to support the comfort performance assessment of existing buildings","volume":"237","author":"Bortolini","year":"2019","journal-title":"J. Clean. Prod."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"04019036","DOI":"10.1061\/(ASCE)CF.1943-5509.0001284","article-title":"Factors Influencing Facilities Management Cost Performance in Building Projects","volume":"33","author":"Islam","year":"2019","journal-title":"J. Perform. Constr. Facil."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1016\/j.ecolmodel.2006.11.033","article-title":"Advantages and challenges of Bayesian networks in environmental modelling","volume":"203","author":"Uusitalo","year":"2007","journal-title":"Ecol. Model."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.envsoft.2016.08.006","article-title":"Applications of Bayesian belief networks in water resource management: A systematic review","volume":"85","author":"Phan","year":"2016","journal-title":"Environ. Model. Softw."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1002\/ieam.4332","article-title":"Bayesian Networks in Environmental Risk Assessment: A Review","volume":"17","author":"Kaikkonen","year":"2021","journal-title":"Integr. Environ. Assess. Manag."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"699","DOI":"10.1016\/j.ress.2007.03.020","article-title":"Eliciting conditional and unconditional rank correlations from conditional probabilities","volume":"93","author":"Kurowicka","year":"2008","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_19","unstructured":"Morales-N\u00e1poles, O., Hanea, A.M., and Worm, D.T. (2014). Safety, Reliability and Risk Analysis: Beyond the Horizon, Proceedings of the European Safety and Reliability Conference, ESREL 2013, Amsterdam, The Netherlands, 29 September\u20132 October 2013, CRC Press."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1016\/j.tra.2019.07.006","article-title":"Structured expert judgement to understand the intrinsic vulnerability of traffic networks","volume":"127","author":"Nogal","year":"2019","journal-title":"Transp. Res. Part A Policy Pract."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1080\/15732479.2012.757789","article-title":"A continuous Bayesian network for earth dams\u2019 risk assessment: Methodology and quantification","volume":"10","year":"2014","journal-title":"Struct. Infrastruct. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/j.ress.2012.01.002","article-title":"Analysis of the Schiphol Cell Complex fire using a Bayesian belief net based model","volume":"100","author":"Hanea","year":"2012","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1017\/S0269888900003039","article-title":"Building large-scale Bayesian networks","volume":"15","author":"Neil","year":"2000","journal-title":"Knowl. Eng. Rev."},{"key":"ref_24","unstructured":"Sklar, M. (1959). Annales de l\u2019ISUP, ISUP."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"544","DOI":"10.1016\/j.jmva.2005.11.007","article-title":"On rank correlation measures for non-continuous random variables","volume":"98","year":"2007","journal-title":"J. Multivar. Anal."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1016\/j.ress.2015.07.027","article-title":"Non-parametric Bayesian networks: Improving theory and reviewing applications","volume":"144","author":"Hanea","year":"2015","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1002\/qre.808","article-title":"Hybrid Method for Quantifying and Analyzing Bayesian Belief Nets","volume":"22","author":"Hanea","year":"2006","journal-title":"Qual. Reliab. Eng. Int."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1016\/j.ress.2007.03.005","article-title":"TU Delft expert judgment data base","volume":"93","author":"Cooke","year":"2008","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1287\/mnsc.45.2.208","article-title":"Correlations and Copulas for Decision and Risk Analysis","volume":"45","author":"Clemen","year":"1999","journal-title":"Manag. Sci."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"801","DOI":"10.1016\/j.ejor.2016.10.018","article-title":"Expert judgement for dependence in probabilistic modelling: A systematic literature review and future research directions","volume":"258","author":"Werner","year":"2017","journal-title":"Eur. J. Oper. Res."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1093\/biomet\/30.1-2.81","article-title":"A new measure of rank correlation","volume":"30","author":"Kendall","year":"1938","journal-title":"Biometrika"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1100","DOI":"10.1287\/mnsc.46.8.1100.12023","article-title":"Assessing Dependence: Some Experimental Results","volume":"46","author":"Clemen","year":"2000","journal-title":"Manag. Sci."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.csda.2019.01.013","article-title":"A classification point-of-view about conditional Kendall\u2019s tau","volume":"135","author":"Derumigny","year":"2019","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1006\/jmva.2001.2017","article-title":"The Meta-elliptical Distributions with Given Marginals","volume":"82","author":"Fang","year":"2002","journal-title":"J. Multivar. Anal."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Kurowicka, D., and Cooke, R.M. (2006). Uncertainty Analysis with High Dimensional Dependence Modelling, John Wiley & Sons. Google-Books-ID: DRVGNYU7RskC.","DOI":"10.1002\/0470863072"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"101693","DOI":"10.1016\/j.softx.2024.101693","article-title":"Matlatzinca: A PyBANSHEE-based graphical user interface for elicitation of non-parametric Bayesian networks from experts","volume":"26","author":"Rongen","year":"2024","journal-title":"SoftwareX"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"100588","DOI":"10.1016\/j.softx.2020.100588","article-title":"BANSHEE\u2013A MATLAB toolbox for non-parametric Bayesian networks","volume":"12","author":"Paprotny","year":"2020","journal-title":"SoftwareX"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"101279","DOI":"10.1016\/j.softx.2022.101279","article-title":"PyBanshee version (1.0): A Python implementation of the MATLAB toolbox BANSHEE for Non-Parametric Bayesian Networks with updated features","volume":"21","author":"Koot","year":"2023","journal-title":"SoftwareX"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"101479","DOI":"10.1016\/j.softx.2023.101479","article-title":"Version 1.3-BANSHEE\u2014A MATLAB toolbox for Non-Parametric Bayesian Networks","volume":"23","year":"2023","journal-title":"SoftwareX"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2569","DOI":"10.1007\/s11069-020-04413-x","article-title":"A probabilistic approach to estimating residential losses from different flood types","volume":"105","author":"Paprotny","year":"2021","journal-title":"Nat. Hazards"},{"key":"ref_41","first-page":"100552","article-title":"A Non-parametric Bayesian Network for multivariate probabilistic modelling of Weigh-in-Motion System Data","volume":"13","year":"2022","journal-title":"Transp. Res. Interdiscip. Perspect."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1111\/j.1539-6924.1999.tb00399.x","article-title":"Combining probability distributions from experts in risk analysis","volume":"19","author":"Clemen","year":"1999","journal-title":"Risk Anal."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1007\/s13398-011-0018-6","article-title":"Aggregating expert judgement","volume":"105","author":"French","year":"2011","journal-title":"Rev. De La Real Acad. De Cienc. Exactas Fis. Y Naturales. Ser. A Mat."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Cooke, R.M. (1991). Experts in Uncertainty: Opinion and Subjective Probability in Science, Oxford University Press.","DOI":"10.1093\/oso\/9780195064650.001.0001"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"04017012","DOI":"10.1061\/AJRUA6.0000914","article-title":"Characterization of precipitation through copulas and expert judgement for risk assessment of infrastructure","volume":"3","author":"Paprotny","year":"2017","journal-title":"ASCE-ASME J. Risk Uncertain. Eng. Syst. Part A Civ. Eng."},{"key":"ref_46","unstructured":"Rongen, G., Morales-N\u00e1poles, O., and Kok, M. (2023). Structured expert elicitation of dependence between river tributaries using Non-Parametric Bayesian Networks, Unpublished work."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"901","DOI":"10.1016\/j.apenergy.2009.06.010","article-title":"Cooling output optimization of an air handling unit","volume":"87","author":"Kusiak","year":"2010","journal-title":"Appl. Energy"},{"key":"ref_48","unstructured":"Ramousse, B. (2023). Development of a Framework to Estimate the Condition of Mechanical, Electrical and Plumbing Systems with Bayesian Networks. [Master\u2019s Thesis, Delft University of Technology]."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"110875","DOI":"10.1016\/j.enbuild.2021.110875","article-title":"Fault prognosis of HVAC air handling unit and its components using hidden-semi Markov model and statistical process control","volume":"240","author":"Yan","year":"2021","journal-title":"Energy Build."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1108\/02630800910941665","article-title":"Dutch standard for condition assessment of buildings","volume":"27","author":"Straub","year":"2009","journal-title":"Struct. Surv."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1111\/risa.13718","article-title":"Uncertainty Quantification with Experts: Present Status and Research Needs","volume":"42","author":"Hanea","year":"2022","journal-title":"Risk Anal."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1111\/risa.12272","article-title":"The Aggregation of Expert Judgment: Do Good Things Come to Those Who Weight?","volume":"35","author":"Bolger","year":"2015","journal-title":"Risk Anal."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"1142","DOI":"10.1016\/j.ssci.2011.03.006","article-title":"Experts, Bayesian Belief Networks, rare events and aviation risk estimates","volume":"49","author":"Brooker","year":"2011","journal-title":"Saf. Sci."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"1140","DOI":"10.1016\/j.envsoft.2006.03.006","article-title":"Parameterisation and evaluation of a Bayesian network for use in an ecological risk assessment","volume":"22","author":"Pollino","year":"2007","journal-title":"Environ. Model. Softw."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1016\/j.envsoft.2012.03.012","article-title":"Good practice in Bayesian network modelling","volume":"37","author":"Chen","year":"2012","journal-title":"Environ. Model. Softw."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1016\/j.eswa.2012.07.026","article-title":"A proposed validation framework for expert elicited Bayesian Networks","volume":"40","author":"Pitchforth","year":"2013","journal-title":"Expert Syst. Appl."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"106529","DOI":"10.1016\/j.ress.2019.106529","article-title":"Knowledge representation using non-parametric Bayesian networks for tunneling risk analysis","volume":"191","author":"Wang","year":"2019","journal-title":"Reliab. Eng. Syst. Saf."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/26\/5\/360\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:33:54Z","timestamp":1760106834000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/26\/5\/360"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,25]]},"references-count":57,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2024,5]]}},"alternative-id":["e26050360"],"URL":"https:\/\/doi.org\/10.3390\/e26050360","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2024,4,25]]}}}