{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T02:05:51Z","timestamp":1762999551570,"version":"3.41.0"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2020,2,24]],"date-time":"2020-02-24T00:00:00Z","timestamp":1582502400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Commun. ACM"],"published-print":{"date-parts":[[2020,2,24]]},"abstract":"<jats:p>Exploring the vision of a model-based framework that may enable broader engagement with and informed decision making about sustainability issues.<\/jats:p>","DOI":"10.1145\/3371906","type":"journal-article","created":{"date-parts":[[2020,2,24]],"date-time":"2020-02-24T18:34:54Z","timestamp":1582569294000},"page":"80-91","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":16,"title":["Toward model-driven sustainability evaluation"],"prefix":"10.1145","volume":"63","author":[{"given":"J\u00f6rg","family":"Kienzle","sequence":"first","affiliation":[{"name":"McGill University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gunter","family":"Mussbacher","sequence":"additional","affiliation":[{"name":"McGill University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Benoit","family":"Combemale","sequence":"additional","affiliation":[{"name":"University of Toulouse and Inria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lucy","family":"Bastin","sequence":"additional","affiliation":[{"name":"Aston University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nelly","family":"Bencomo","sequence":"additional","affiliation":[{"name":"Aston University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jean-Michel","family":"Bruel","sequence":"additional","affiliation":[{"name":"University of Toulouse"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christoph","family":"Becker","sequence":"additional","affiliation":[{"name":"University of Toronto"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stefanie","family":"Betz","sequence":"additional","affiliation":[{"name":"Furtwangen University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ruzanna","family":"Chitchyan","sequence":"additional","affiliation":[{"name":"University of Bristol"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Betty H. C.","family":"Cheng","sequence":"additional","affiliation":[{"name":"Michigan State University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sonja","family":"Klingert","sequence":"additional","affiliation":[{"name":"University of Mannheim"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Richard F.","family":"Paige","sequence":"additional","affiliation":[{"name":"McMaster University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Birgit","family":"Penzenstadler","sequence":"additional","affiliation":[{"name":"Chalmers University of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Norbert","family":"Seyff","sequence":"additional","affiliation":[{"name":"FHNW and University of Zurich"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eugene","family":"Syriani","sequence":"additional","affiliation":[{"name":"Universite de Montreal"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Colin C.","family":"Venters","sequence":"additional","affiliation":[{"name":"University of Huddersfield"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,2,24]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"236","article-title":"User experience for model-driven engineering: Challenges and future directions","volume":"229","author":"Abrahao S.","year":"2017","unstructured":"Abrahao , S. . User experience for model-driven engineering: Challenges and future directions . Model Driven Engineering Languages and Systems , 2017 , 229 -- 236 . Abrahao, S. et al. User experience for model-driven engineering: Challenges and future directions. Model Driven Engineering Languages and Systems, 2017, 229--236.","journal-title":"Model Driven Engineering Languages and Systems"},{"key":"e_1_2_1_2_1","volume-title":"MoDSE-MCCM Workshop at MoDELS","author":"Altmanninger K.","year":"2009","unstructured":"Altmanninger , K. et al. Why model versioning research is needed! An experience report . MoDSE-MCCM Workshop at MoDELS , 2009 , 1--12. Altmanninger, K. et al. Why model versioning research is needed! An experience report. MoDSE-MCCM Workshop at MoDELS, 2009, 1--12."},{"key":"e_1_2_1_3_1","volume-title":"et al. Managing uncertainty in integrated environmental modelling: The uncertweb framework. Environmental Modelling and Software 39","author":"Bastin L.","year":"2013","unstructured":"Bastin , L. et al. Managing uncertainty in integrated environmental modelling: The uncertweb framework. Environmental Modelling and Software 39 , 2013 . Elsevier , 116--134. Bastin, L. et al. Managing uncertainty in integrated environmental modelling: The uncertweb framework. Environmental Modelling and Software 39, 2013. Elsevier, 116--134."},{"key":"e_1_2_1_4_1","first-page":"11","author":"Bastin L.","year":"2017","unstructured":"Bastin , L. . Good Practices for Data Management. Chapt. 11 , 2017 . Bastin, L. et al. Good Practices for Data Management. Chapt. 11, 2017.","journal-title":"Good Practices for Data Management. Chapt."},{"key":"e_1_2_1_5_1","volume-title":"et al. Volunteered Metadata, and Metadata on VGI: Challenges and Current Practices","author":"Bastin L.","year":"2017","unstructured":"Bastin , L. et al. Volunteered Metadata, and Metadata on VGI: Challenges and Current Practices . Springer , 2017 . Bastin, L. et al. Volunteered Metadata, and Metadata on VGI: Challenges and Current Practices. Springer, 2017."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/eScience.2010.21"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2015.158"},{"key":"e_1_2_1_8_1","volume-title":"Proc. of Intern. Conf. on Computational Science","author":"Bruel J.M.","year":"2015","unstructured":"Bruel , J.M. et al. MDE in practice for computational science . In Proc. of Intern. Conf. on Computational Science , June 2015 . Bruel, J.M. et al. MDE in practice for computational science. In Proc. of Intern. Conf. on Computational Science, June 2015."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1138304.1138307"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1108\/09590551311304338"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-44503-X_20"},{"key":"e_1_2_1_12_1","volume-title":"Open research problems: Systems dynamics, complex systems. Theory of Modeling and Simulation","author":"Castro R.","year":"2019","unstructured":"Castro , R. Open research problems: Systems dynamics, complex systems. Theory of Modeling and Simulation ( 3 rd Edition), chapt. 24. Academic Press , 2019 . Castro, R. Open research problems: Systems dynamics, complex systems. Theory of Modeling and Simulation (3rd Edition), chapt. 24. Academic Press, 2019.","edition":"3"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.18564\/jasss.2651"},{"key":"e_1_2_1_14_1","first-page":"26","article-title":"Software engineering for self-adaptive systems: A research roadmap","volume":"1","author":"Cheng B.H.C.","year":"2009","unstructured":"Cheng , B.H.C. . Software engineering for self-adaptive systems: A research roadmap . Software Engineering for SAS , 2009 , 1 -- 26 . Cheng, B.H.C. et al. Software engineering for self-adaptive systems: A research roadmap. Software Engineering for SAS, 2009, 1--26.","journal-title":"Software Engineering for SAS"},{"key":"e_1_2_1_15_1","volume-title":"Proc. of Intern. Conf. Software Engineering","author":"Clavreul M.","year":"2010","unstructured":"Clavreul , M. et al. Integrating legacy systems with mde . In Proc. of Intern. Conf. Software Engineering , 2010 , 69--78. Clavreul, M. et al. Integrating legacy systems with mde. In Proc. of Intern. Conf. Software Engineering, 2010, 69--78."},{"key":"e_1_2_1_16_1","volume-title":"Computer, (June","author":"Combemale B.","year":"2014","unstructured":"Combemale , B. et al. Globalizing modeling languages . Computer, (June 2014 ), 68--71. Combemale, B. et al. Globalizing modeling languages. Computer, (June 2014), 68--71."},{"key":"e_1_2_1_17_1","volume-title":"Modeling in Software Engineering","author":"Combemale B.","year":"2016","unstructured":"Combemale , B. et al. Modeling for sustainability . Modeling in Software Engineering , 2016 . Combemale, B. et al. Modeling for sustainability. Modeling in Software Engineering, 2016."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8809(00)00169-9"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10502-015-9252-6"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3158191.3158206"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1376616.1376772"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-13953-6_1"},{"key":"e_1_2_1_23_1","volume-title":"Proc. of Workshop on Comparison and Versioning of Software Models","author":"Dimitrios S.","year":"2009","unstructured":"Dimitrios , S. et al. Different models for model matching: An analysis of approaches to support model differencing . In Proc. of Workshop on Comparison and Versioning of Software Models , 2009 . Dimitrios, S. et al. Different models for model matching: An analysis of approaches to support model differencing. In Proc. of Workshop on Comparison and Versioning of Software Models, 2009."},{"key":"e_1_2_1_24_1","first-page":"202","article-title":"Automatically searching for metamodel well-formedness rules in examples and counter-examples. Model Driven Engineering Languages and Systems","volume":"187","author":"Faunes M.","year":"2013","unstructured":"Faunes , M. . Automatically searching for metamodel well-formedness rules in examples and counter-examples. Model Driven Engineering Languages and Systems , LNCS , 2013 , 187 -- 202 . Faunes, M. et al. Automatically searching for metamodel well-formedness rules in examples and counter-examples. Model Driven Engineering Languages and Systems, LNCS, 2013, 187--202.","journal-title":"LNCS"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/FOSE.2007.14"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/EDOC.2007.42"},{"key":"e_1_2_1_27_1","first-page":"100","volume":"47","author":"Giese H.","year":"2014","unstructured":"Giese , H. . Living with Uncertainty in the Age of Runtime Models , 2014 , 47 -- 100 . Giese, H. et al. Living with Uncertainty in the Age of Runtime Models, 2014, 47--100.","journal-title":"Living with Uncertainty in the Age of Runtime Models"},{"key":"e_1_2_1_28_1","first-page":"365","article-title":"Documenting social simulation models: The ODD protocol as a standard. Simulating Social Complexity","volume":"349","author":"Grimm V.","year":"2017","unstructured":"Grimm , V. , Polhill , G. , and Touza , J . Documenting social simulation models: The ODD protocol as a standard. Simulating Social Complexity , Springer , 2017 , 349 -- 365 . Grimm, V., Polhill, G., and Touza, J. Documenting social simulation models: The ODD protocol as a standard. Simulating Social Complexity, Springer, 2017, 349--365.","journal-title":"Springer"},{"key":"e_1_2_1_29_1","first-page":"2197","article-title":"From big data to knowledge: Issues of provenance, trust, and scientific computing integrity","volume":"2018","author":"Huang J","unstructured":"Huang , J . From big data to knowledge: Issues of provenance, trust, and scientific computing integrity . Big Data 2018 , 2197 -- 2205 . Huang, J. From big data to knowledge: Issues of provenance, trust, and scientific computing integrity. Big Data 2018, 2197--2205.","journal-title":"Big Data"},{"key":"e_1_2_1_30_1","volume-title":"Systems Thinking: Creative Holism for Managers","author":"Jackson M.C.","year":"2003","unstructured":"Jackson , M.C. Systems Thinking: Creative Holism for Managers . Wiley Chichester , 2003 . Jackson, M.C. Systems Thinking: Creative Holism for Managers. Wiley Chichester, 2003."},{"key":"e_1_2_1_31_1","first-page":"93","article-title":"2---Concepts of modelling. Fundamentals of Ecological Modelling vol. 23","volume":"19","author":"Jorgensen S.E.","year":"2011","unstructured":"Jorgensen , S.E. and Fath , B.D . 2---Concepts of modelling. Fundamentals of Ecological Modelling vol. 23 , Developments in Environmental Modelling. Elsevier , 2011 , 19 -- 93 . Jorgensen, S.E. and Fath, B.D. 2---Concepts of modelling. Fundamentals of Ecological Modelling vol. 23, Developments in Environmental Modelling. Elsevier, 2011, 19--93.","journal-title":"Developments in Environmental Modelling. Elsevier"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2003.1160055"},{"key":"e_1_2_1_33_1","volume-title":"MODELS 2015","author":"Larsen V.","year":"2015","unstructured":"Larsen , V. et al. A behavioral coordination operator language (BCOoL) . MODELS 2015 , Aug. 2015 . Larsen, V. et al. A behavioral coordination operator language (BCOoL). MODELS 2015, Aug. 2015."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/WSC.1994.717509"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00547132"},{"key":"e_1_2_1_36_1","volume-title":"Groping in the Dark: The First Decade of Global Modelling","author":"Meadows D.","year":"1982","unstructured":"Meadows , D. , Richardson , J. , and Bruckmann , G . Groping in the Dark: The First Decade of Global Modelling . John Wiley & Sons , 1982 . Meadows, D., Richardson, J., and Bruckmann, G. Groping in the Dark: The First Decade of Global Modelling. John Wiley & Sons, 1982."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1002\/sdr.239"},{"key":"e_1_2_1_38_1","first-page":"20","article-title":"Promobox: A framework for generating domain-specific property languages","volume":"1","author":"Meyers B.","year":"2014","unstructured":"Meyers , B. . Promobox: A framework for generating domain-specific property languages . Software Language Engineering , 2014 , 1 -- 20 . Meyers, B. et al. Promobox: A framework for generating domain-specific property languages. Software Language Engineering, 2014, 1--20.","journal-title":"Software Language Engineering"},{"key":"e_1_2_1_39_1","volume-title":"What is this thing called CST? Critical Systems Thinking","author":"Midgley G.","year":"1996","unstructured":"Midgley , G. What is this thing called CST? Critical Systems Thinking . Springer , Boston, MA , 1996 , 11--24. Midgley, G. What is this thing called CST? Critical Systems Thinking. Springer, Boston, MA, 1996, 11--24."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10723-006-9055-3"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1330311.1330323"},{"key":"e_1_2_1_42_1","volume-title":"Proc. of CMA Workshop","author":"Mussbacher G.","year":"2012","unstructured":"Mussbacher , G. et al. Assessing composition in modeling approaches . In Proc. of CMA Workshop , 2012 , 1: 1--1:26. Mussbacher, G. et al. Assessing composition in modeling approaches. In Proc. of CMA Workshop, 2012, 1:1--1:26."},{"key":"e_1_2_1_43_1","volume-title":"MODELS","author":"Mussbacher G.","year":"2014","unstructured":"Mussbacher , G. et al. The relevance of model-driven engineering 30 years from now . MODELS 2014 , LNCS 8767, 183--200. Mussbacher, G. et al. The relevance of model-driven engineering 30 years from now. MODELS 2014, LNCS 8767, 183--200."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01405730"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1038\/461472a"},{"key":"e_1_2_1_46_1","volume-title":"Proc. of Intern. Symp. Mass Storage Systems and Technology","author":"Rusbridge C.","year":"2005","unstructured":"Rusbridge , C. et al. The digital curation centre: A vision for digital curation . In Proc. of Intern. Symp. Mass Storage Systems and Technology , 2005 , 31--41. Rusbridge, C. et al. The digital curation centre: A vision for digital curation. In Proc. of Intern. Symp. Mass Storage Systems and Technology, 2005, 31--41."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1084805.1084812"},{"key":"e_1_2_1_48_1","volume-title":"Proc. of the IEEE Int. Geoscience and Remote Sensing Symposium","author":"Simonis I.","year":"2016","unstructured":"Simonis , I. et al. Sensor Web Enablement (SWE) for citizen science . In Proc. of the IEEE Int. Geoscience and Remote Sensing Symposium , 2016 . Simonis, I. et al. Sensor Web Enablement (SWE) for citizen science. In Proc. of the IEEE Int. Geoscience and Remote Sensing Symposium, 2016."},{"key":"e_1_2_1_49_1","volume-title":"Software Language Engineering","author":"Tikhonova U.","year":"2018","unstructured":"Tikhonova , U. et al. Constraint-based run-time state migration for live modeling . Software Language Engineering , 2018 . Tikhonova, U. et al. Constraint-based run-time state migration for live modeling. Software Language Engineering, 2018."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01409778"},{"volume-title":"Proc. of the 16th Conf. GISRUK 2008, 275--279","author":"Williams M.","key":"e_1_2_1_51_1","unstructured":"Williams , M. et al. Uncertml: An XML schema for exchanging uncertainty . In Proc. of the 16th Conf. GISRUK 2008, 275--279 . Williams, M. et al. Uncertml: An XML schema for exchanging uncertainty. In Proc. of the 16th Conf. GISRUK 2008, 275--279."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.envsoft.2016.10.003"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1108\/10650750710831466"},{"key":"e_1_2_1_54_1","first-page":"159","article-title":"Chapter 5: Addressing the uncertainty in modeling watershed nonpoint source pollution. Developments in Environmental Modelling","volume":"113","author":"Zheng Y.","year":"2014","unstructured":"Zheng , Y. , Han , F. , Tian , Y. , Wu , B. , and Lin , Z . Chapter 5: Addressing the uncertainty in modeling watershed nonpoint source pollution. Developments in Environmental Modelling , Ecological Modelling and Engineering of Lakes and Wetlands. Elsevier , 2014 , 113 -- 159 . Zheng, Y., Han, F., Tian, Y., Wu, B., and Lin, Z. Chapter 5: Addressing the uncertainty in modeling watershed nonpoint source pollution. Developments in Environmental Modelling, Ecological Modelling and Engineering of Lakes and Wetlands. Elsevier, 2014, 113--159.","journal-title":"Ecological Modelling and Engineering of Lakes and Wetlands. Elsevier"}],"container-title":["Communications of the ACM"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3371906","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3371906","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:19Z","timestamp":1750203859000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3371906"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,24]]},"references-count":54,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,2,24]]}},"alternative-id":["10.1145\/3371906"],"URL":"https:\/\/doi.org\/10.1145\/3371906","relation":{},"ISSN":["0001-0782","1557-7317"],"issn-type":[{"type":"print","value":"0001-0782"},{"type":"electronic","value":"1557-7317"}],"subject":[],"published":{"date-parts":[[2020,2,24]]},"assertion":[{"value":"2020-02-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}