{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,12]],"date-time":"2026-08-12T19:39:02Z","timestamp":1786563542837,"version":"3.56.0"},"reference-count":61,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2026,1,4]],"date-time":"2026-01-04T00:00:00Z","timestamp":1767484800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Durban University of Technology Research Capacity Development Grant Allocation: Emerging Researcher\u2019s Grant"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Cross-impact analysis is frequently used in scenario-analogous studies to identify critical factors influencing ecological change, strategic planning, technology foresight, resource allocation, risk mitigation, cost optimization, and decision support. Scenarios enable different organizations to comprehend prevailing situations, prepare for probable futures, and mitigate conceivable risks. Unfortunately, cross-impact analysis methods are often criticized for their difficulty in handling complex interactions, cognitive bias, time-intensiveness, heavy reliance on a limited pool of experts, and inconsistency in assigning judgment, which can affect the expected outcomes. This paper introduces a novel method for constructing consistent scenarios that addresses these criticisms and those associated with scenario methods. The method is based on cross-impact analysis and crowdsourcing for constructing consistent scenarios. The cross-impact analysis component of the method is based on advanced impact analysis and cross-impact balance analysis to, respectively, provide a time-efficient reduction in complex interdependent factors and construct consistent scenarios from a set of reduced factors. The crowdsourcing element leverages the cumulative intelligence of a group of experts to help mitigate cognitive bias and transparently give a more inclusive analysis. The method was implemented and validated with a practical case of renewable energy adoption, a vital challenge for socioeconomic progress and climate change resilience. While the method provides a sturdy foundation for writing scenario narratives, the result confirms its robustness for constructing consistent scenarios and suggests that the future of renewable energy adoption can be enhanced through careful cogitation of best-case, base-case, and worst-case scenarios, which include varying states of perceived value, awareness, and perceived support. These findings contribute to a more nuanced understanding of how socio-cognitive and institutional factors interact to influence the pace and direction of sustainable energy transitions.<\/jats:p>","DOI":"10.3390\/a19010041","type":"journal-article","created":{"date-parts":[[2026,1,5]],"date-time":"2026-01-05T12:38:56Z","timestamp":1767616736000},"page":"41","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Cross-Impact Analysis with Crowdsourcing for Constructing Consistent Scenarios"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6679-5040","authenticated-orcid":false,"given":"Robyn C.","family":"Thompson","sequence":"first","affiliation":[{"name":"Information Communications Technology and Society Research Group, Durban University of Technology, Durban 4001, South Africa"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1633-7583","authenticated-orcid":false,"given":"Oludayo O.","family":"Olugbara","sequence":"additional","affiliation":[{"name":"Media Information and Communication Technologies Sector Education and Training Authority (MICTSETA) Fourth Industrial Revolution Centre of Excellence, Durban University of Technology, Durban 4001, South Africa"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alveen","family":"Singh","sequence":"additional","affiliation":[{"name":"Department of Computer Science, School of Engineering, Physics and Computer Science, University of Hertfordshire, College Campus Lane, Hatfield AL10 9AB, Hertfordshire, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,1,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"103153","DOI":"10.1016\/j.futures.2023.103153","article-title":"Types of Scenario Planning and Their Effectiveness: A Review of Reviews","volume":"149","author":"Rouwette","year":"2023","journal-title":"Futures"},{"key":"ref_2","first-page":"151","article-title":"Scenarios: Process and Outcome","volume":"13","author":"Hiltunen","year":"2009","journal-title":"J. Futures Stud."},{"key":"ref_3","first-page":"7","article-title":"A Review of Scenario Planning Literature","volume":"17","author":"Chermack","year":"2001","journal-title":"Futures Res. Q."},{"key":"ref_4","unstructured":"Kahn, H., and Wiener, A.J. (1967). The Year 2000: A Framework for Speculation on the Next Thirty-Three Years, MacMillan."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1002\/for.3980100602","article-title":"When and How to Use Scenario Planning: A Heuristic Approach with Illustration","volume":"10","author":"Schoemaker","year":"1991","journal-title":"J. Forecast."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1002\/smj.4250140304","article-title":"Multiple Scenario Development: Its Conceptual and Behavioral Foundation","volume":"14","author":"Schoemaker","year":"1993","journal-title":"Strateg. Manag. J."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2049","DOI":"10.1007\/s11229-013-0353-6","article-title":"Objectivity and a Comparison of Methodological Scenario Approaches for Climate Change Research","volume":"191","author":"Lloyd","year":"2014","journal-title":"Synthese"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1016\/j.techfore.2005.06.005","article-title":"Cross-Impact Balances: A System-Theoretical Approach to Cross-Impact Analysis","volume":"73","year":"2006","journal-title":"Technol. Forecast. Soc. Change"},{"key":"ref_9","unstructured":"Heinonen, S., Osmo, K., and Salminen, H. (2017). How Do We Explore Our Futures?: Methods of Futures Research, Finnish Society for Futures Study."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"103191","DOI":"10.1016\/j.erss.2023.103191","article-title":"Automated and Absent: How People and Households Are Accounted for in Industry Energy Scenarios","volume":"102","author":"Kaviani","year":"2023","journal-title":"Energy Res. Soc. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/j.techfore.2009.05.002","article-title":"The Advian\u00ae Classification\u2014A New Classification Approach for the Rating of Impact Factors","volume":"77","author":"Linss","year":"2010","journal-title":"Technol. Forecast. Soc. Change"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"768","DOI":"10.1093\/ntr\/ntq086","article-title":"Reaching Young Adult Smokers through the Internet: Comparison of Three Recruitment Mechanisms","volume":"12","author":"Danielle","year":"2010","journal-title":"Nicotine Tob. Res."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/j.techfore.2014.03.008","article-title":"Online Foresight Platforms: Evidence for Their Impact on Scenario Planning & Strategic Foresight","volume":"97","author":"Raford","year":"2015","journal-title":"Technol. Forecast. Soc. Change"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1038\/s41746-024-01095-8","article-title":"Real-Time near Infrared Artificial Intelligence Using Scalable Non-Expert Crowdsourcing in Colorectal Surgery","volume":"7","author":"Skinner","year":"2024","journal-title":"NPJ Digit. Med."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"114157","DOI":"10.1016\/j.socscimed.2021.114157","article-title":"From Causal Loop Diagrams to Future Scenarios: Using the Cross-Impact Balance Method to Augment Understanding of Urban Health in Latin America","volume":"282","author":"Stankov","year":"2021","journal-title":"Soc. Sci. Med."},{"key":"ref_16","first-page":"1097","article-title":"Imagenet Classification with Deep Convolutional Neural Networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_17","unstructured":"Inel, O., Tommaso, C., and Aroyo, L. (2016, January 23\u201328). Crowdsourcing Salient Information from News and Tweets. Proceedings of the The Tenth International Conference on Language Resources and Evaluation (LREC\u201916), Portoro\u017e, Slovenia."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1109\/MIC.2015.96","article-title":"Crowdsourcing Processes: A Survey of Approaches and Opportunities","volume":"20","author":"Kucherbaev","year":"2015","journal-title":"IEEE Internet Comput."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Rowe, M., Marta, P., and Thomson, J.D. (2015, January 22\u201326). Creating Value through Crowdsourcing: The Antecedent Conditions. Proceedings of the International Conference on Group Decision and Negotiation, Warsaw, Poland.","DOI":"10.1007\/978-3-319-19515-5_27"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Seeber, I., Alexander, M., Gert-Jan, D.V., Ronald, M., and Weber, B. (2017, January 4\u20137). Convergence on Self-Generated Vs. Crowdsourced Ideas in Crisis Response: Comparing Social Exchange Processes and Satisfaction with Process. Proceedings of the 50th Hawaii International Conference on System Sciences, Waikoloa Village, HI, USA.","DOI":"10.24251\/HICSS.2017.083"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Belfiglio, A., Page, S.D., Pettersson, S., van Rijn, M., Vellone, E., Westland, H., Freedland, K.E., Lee, C., Str\u00f6mberg, A., and Wiebe, D. (2024). Lessons Learned from the Moment Study on How to Recruit and Retain a Target Population Online, across Borders, and with Automated Remote Data Collection. PLoS ONE, 19.","DOI":"10.1371\/journal.pone.0307440"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Van Notten, P. (2006). Scenario Development: A Typology of Approaches. Schooling for Tomorrow Think Scenarios, Rethink Education, Organization for Economic.","DOI":"10.1787\/9789264023642-en"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Thompson, R.C., Oludayo, O.O., and Singh, A. (2020, January 11\u201312). Cimgen Method for Generating Cross Impact Matrix in Impact Factor Analysis. Proceedings of the 2020 Conference on Information Communications Technology and Society (ICTAS), Durban, South Africa.","DOI":"10.1109\/ICTAS47918.2020.233990"},{"key":"ref_24","unstructured":"Weimer-Jehle, W. (2009). Properties of Cross-Impact Balance Analysis. arXiv."},{"key":"ref_25","unstructured":"Linss, V., and Fried, A. (2009). Advanced Impact Analysis: The Advian\u00ae Method-an Enhanced Approach for the Analysis of Impact Strengths with the Consideration of Indirect Relations. Dep. Innov. Res. Sustain. Resour. Manag., Preprint."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1016\/j.techfore.2014.09.004","article-title":"Supply Risk Interrelationships and the Derivation of Key Supply Risk Indicators","volume":"92","author":"Guertler","year":"2015","journal-title":"Technol. Forecast. Soc. Change"},{"key":"ref_27","first-page":"2","article-title":"Deriving Critical Success Factors for Implementation of Enterprise Resource Planning Systems in Higher Education Institution","volume":"10","author":"Thompson","year":"2018","journal-title":"Afr. J. Inf. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"120086","DOI":"10.1016\/j.techfore.2020.120086","article-title":"Scenario Development Using Web Mining for Outlining Technology Futures","volume":"156","author":"Kayser","year":"2020","journal-title":"Technol. Forecast. Soc. Change"},{"key":"ref_29","first-page":"101136","article-title":"Twitter (X) in Medicine: Friend or Foe to the Field of Interventional Cardiology?","volume":"6","author":"Rana","year":"2023","journal-title":"J. Soc. Cardiovasc. Angiogr. Interv."},{"key":"ref_30","first-page":"1","article-title":"Cultivating Engagement in Research Using Social Media Networks to Recruit Participants for Health Related Research","volume":"1","author":"MacDermott","year":"2020","journal-title":"J. Curr. Trends Nurs. Health Care"},{"key":"ref_31","unstructured":"Weimer-Jehle, W. (2024, October 01). ScenarioWizard, Available online: https:\/\/www.cross-impact.org\/english\/CIB_e_ScW.htm."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"e141","DOI":"10.1002\/ffo2.141","article-title":"Computer-Aided Scenario Design Using Participatory Backcasting: A Case Study of Sustainable Vision Creation in a Japanese City","volume":"5","author":"Kishita","year":"2023","journal-title":"Futures Foresight Sci."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1007\/s11625-015-0340-6","article-title":"Research Needs and Challenges Faced in Supporting Scenario Design in Sustainability Science: A Literature Review","volume":"11","author":"Kishita","year":"2016","journal-title":"Sustain. Sci."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.jclinepi.2021.02.003","article-title":"Updating Guidance for Reporting Systematic Reviews: Development of the Prisma 2020 Statement","volume":"134","author":"Page","year":"2021","journal-title":"J. Clin. Epidemiol."},{"key":"ref_35","unstructured":"Gordon, T.J. (1994). Cross-Impact Method, American Council for the United Nations University."},{"key":"ref_36","unstructured":"Bollen, K.A. (2014). Structural Equations with Latent Variables, John Wiley & Sons."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1186\/s13717-016-0063-3","article-title":"Applications of Structural Equation Modeling (Sem) in Ecological Studies: An Updated Review","volume":"5","author":"Yi","year":"2016","journal-title":"Ecol. Process."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"319","DOI":"10.2307\/249008","article-title":"Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology","volume":"13","author":"Davis","year":"1989","journal-title":"Mis Q."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Mehrolhassani, M.H., Mostafa, M., and Rahimisadegh, R. (2024). Key Factors in the Future of Oral and Dental Health in Iran Using Scenario Writing Approach. BMC Oral Health, 24.","DOI":"10.1186\/s12903-024-04354-y"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"102815","DOI":"10.1016\/j.erss.2022.102815","article-title":"Towards Participatory Cross-Impact Balance Analysis: Leveraging Morphological Analysis for Data Collection in Energy Transition Scenario Workshops","volume":"93","author":"Kurniawan","year":"2022","journal-title":"Energy Res. Soc. Sci."},{"key":"ref_41","first-page":"61","article-title":"Should Probabilities Be Used with Scenarios?","volume":"13","author":"Millett","year":"2009","journal-title":"J. Futures Stud."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"103160","DOI":"10.1016\/j.futures.2023.103160","article-title":"Building Scenarios for Urban Mobility in 2030: The Combination of Cross-Impact Balance Analysis with Participatory Stakeholder Workshops","volume":"150","author":"Tori","year":"2023","journal-title":"Futures"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"101492","DOI":"10.1016\/j.mex.2021.101492","article-title":"Using Cause-Effect Graphs to Elicit Expert Knowledge for Cross-Impact Balance Analysis","volume":"8","author":"Stankov","year":"2021","journal-title":"MethodsX"},{"key":"ref_44","first-page":"2","article-title":"The Delphi Method Research Strategy in Studies of Information Systems","volume":"37","author":"Skinner","year":"2015","journal-title":"Commun. Assoc. Inf. Syst."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"e22810","DOI":"10.2196\/22810","article-title":"The Role of Social Media in Enhancing Clinical Trial Recruitment: Scoping Review","volume":"22","author":"Darmawan","year":"2020","journal-title":"J. Med. Internet Res."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"120207","DOI":"10.1016\/j.techfore.2020.120207","article-title":"Scenario Structuring Methodology for Computer-Aided Scenario Design: An Application to Envisioning Sustainable Futures","volume":"160","author":"Kishita","year":"2020","journal-title":"Technol. Forecast. Soc. Change"},{"key":"ref_47","first-page":"44","article-title":"Crowdsourcing Surveys: Alternative Approaches to Survey Collection","volume":"10","author":"Cummings","year":"2017","journal-title":"J. Inf. Syst. Appl. Res."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Anguera, M.T., Mariona, P., Salvador, C.-M., and Sanduvete-Chaves, S. (2018). Indirect Observation in Everyday Contexts: Concepts and Methodological Guidelines within a Mixed Methods Framework. Front. Psychol., 9.","DOI":"10.3389\/fpsyg.2018.00013"},{"key":"ref_49","unstructured":"Murdock, H.E., Gibb, T.D., Andre, J.L., Sawin, A., Brown, L., Ranalder, U., Collier, C., Dent, B., Epp, C., and Kumar, H. (2021). Renewables 2021-Global Status Report, REN21."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1080\/14486563.2022.2108514","article-title":"Scenarios for the Rapid Phase-out of Fossil Fuels in Australia in the Absence of Co2 Removal","volume":"29","author":"Diesendorf","year":"2022","journal-title":"Australas. J. Environ. Manag."},{"key":"ref_51","unstructured":"UN DESA (2024). The Sustainable Development Goals Report 2024, UNDESA."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Wijaya, D.I., and Kokchang, P. (2023). Factors Influencing Generation Z\u2019s Pro-Environmental Behavior Towards Indonesia\u2019s Energy Transition. Sustainability, 15.","DOI":"10.3390\/su151813485"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1108\/JAMR-08-2023-0242","article-title":"Factors Influencing the Adoption of Renewable Energy in India: Supplementing Technology-Driven Drivers and Barriers with Sustainable Development Goals","volume":"21","author":"Kar","year":"2024","journal-title":"J. Adv. Manag. Res."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/j.accinf.2012.03.003","article-title":"Exploring the use of the Delphi method in accounting information systems research","volume":"14","author":"Worrell","year":"2013","journal-title":"Int. J. Account. Inf. Syst."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Emami-Naeini, P., Agarwal, Y., Cranor, L.F., and Hibshi, H. (2020, January 18\u201320). Ask the experts: What should be on an IoT privacy and security label?. Proceedings of the 2020 IEEE Symposium on Security and Privacy (SP), San Francisco, CA, USA.","DOI":"10.1109\/SP40000.2020.00043"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Lindgren, M., and Bandhold, H. (2009). Scenario Planning-Revised and Updated: The Link Between Future and Strategy, Springer.","DOI":"10.1057\/9780230233584"},{"key":"ref_57","first-page":"243","article-title":"Steps Towards Scenario Planning","volume":"8","author":"Finlay","year":"1998","journal-title":"Eng. Manag. J."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1016\/0010-0285(92)90014-S","article-title":"Common Region: A New Principle of Perceptual Grouping","volume":"24","author":"Palmer","year":"1992","journal-title":"Cogn. Psychol."},{"key":"ref_59","unstructured":"Chermack, T.J. (2011). Scenario Planning in Organizations: How to Create, Use, and Assess Scenarios, Berrett-Koehler Publishers."},{"key":"ref_60","unstructured":"Gold, N. (2024, September 05). Using Twitter Data in Research: Guidance for Researchers and Ethics Reviewers. Available online: https:\/\/www.ucl.ac.uk\/data-protection\/sites\/data-protection\/files\/using-twitter-research-v1.0.pdf."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"e23021","DOI":"10.2196\/23021","article-title":"Threats of Bots and Other Bad Actors to Data Quality Following Research Participant Recruitment through Social Media: Cross-Sectional Questionnaire","volume":"22","author":"Pozzar","year":"2020","journal-title":"J. Med. Internet Res."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/19\/1\/41\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,5]],"date-time":"2026-01-05T12:46:42Z","timestamp":1767617202000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/19\/1\/41"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,4]]},"references-count":61,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,1]]}},"alternative-id":["a19010041"],"URL":"https:\/\/doi.org\/10.3390\/a19010041","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,4]]}}}