{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:40:39Z","timestamp":1760125239253,"version":"build-2065373602"},"reference-count":72,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,3,20]],"date-time":"2023-03-20T00:00:00Z","timestamp":1679270400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Provincial Health Services Authority (PHSA) of British Columbia"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Background: despite a broad consensus on their importance, applications of systems thinking in policymaking and practice have been limited. This is partly caused by the longstanding practice of developing systems maps and software in the intention of supporting policymakers, but without knowing their needs and practices. Objective: we aim to ensure the effective use of a systems mapping software by policymakers seeking to understand and manage the complex system around obesity, physical, and mental well-being. Methods: we performed a usability study with eight policymakers in British Columbia based on a software tool (ActionableSystems) that supports interactions with a map of obesity. Our tasks examine different aspects of systems thinking (e.g., unintended consequences, loops) at several levels of mastery and cover common policymaking needs (identification, evaluation, understanding). Video recordings provided quantitative usability metrics (correctness, time to completion) individually and for the group, while pre- and post-usability interviews yielded qualitative data for thematic analysis. Results: users knew the many different factors that contribute to mental and physical well-being in obesity; however, most were only familiar with lower-level systems thinking concepts (e.g., interconnectedness) rather than higher-level ones (e.g., feedback loops). Most struggles happened at the lowest level of the mastery taxonomy, and predominantly on network representation. Although participants completed tasks on loops and multiple pathways mostly correctly, this was at the detriment of spending significant time on these aspects. Results did not depend on the participant, as their experiences with the software were similar. The thematic analysis revealed that policymakers did not have a typical workflow and did not use any special software or tools in their policy work; hence, the integration of a new tool would heavily depend on individual practices. Conclusions: there is an important discrepancy between what constitutes systems thinking to policymakers and what parts of systems thinking are supported by software. Tools may be more successfully integrated when they include tutorials (e.g., case studies), facilitate access to evidence, and can be linked to a policymaker\u2019s portfolio.<\/jats:p>","DOI":"10.3390\/info14030196","type":"journal-article","created":{"date-parts":[[2023,3,20]],"date-time":"2023-03-20T05:46:42Z","timestamp":1679291202000},"page":"196","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Human Factors in Leveraging Systems Science to Shape Public Policy for Obesity: A Usability Study"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6816-355X","authenticated-orcid":false,"given":"Philippe J.","family":"Giabbanelli","sequence":"first","affiliation":[{"name":"Department of Computer Science & Software Engineering, Miami University, Oxford, OH 45056, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chirag X.","family":"Vesuvala","sequence":"additional","affiliation":[{"name":"Independent Researcher, Vancouver, BC V6B 1Y0, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Bryan, C.J. (2021). Rethinking Suicide: Why Prevention Fails, and How We Can do Better, Oxford University Press.","DOI":"10.1093\/med-psych\/9780190050634.001.0001"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1007\/s13278-022-00886-9","article-title":"Pathways to suicide or collections of vicious cycles? Understanding the complexity of suicide through causal mapping","volume":"12","author":"Giabbanelli","year":"2022","journal-title":"Soc. Netw. Anal. Min."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.landurbplan.2014.08.013","article-title":"Climate change adaptation in the world\u2019s best places: A wicked problem in need of immediate attention","volume":"133","author":"Perry","year":"2015","journal-title":"Landsc. Urban Plan."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1159\/000341308","article-title":"The importance of systems thinking to address obesity","volume":"Volume 73","author":"Finegood","year":"2012","journal-title":"Obesity Treatment and Prevention: New Directions"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1108\/JSOCM-03-2017-0021","article-title":"Approaching the wicked problem of obesity: An introduction to the food system compass","volume":"7","author":"Parkinson","year":"2017","journal-title":"J. Soc. Mark."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"El-Sayed, A.M., and Galea, S. (2017). Systems Science and Population Health, Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780190492397.001.0001"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/j.evalprogplan.2016.05.012","article-title":"Interfacing theories of program with theories of evaluation for advancing evaluation practice: Reductionism, systems thinking, and pragmatic synthesis","volume":"59","author":"Chen","year":"2016","journal-title":"Eval. Program Plan."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"538","DOI":"10.2105\/AJPH.2005.066001","article-title":"Practical challenges of systems thinking and modeling in public health","volume":"96","author":"Trochim","year":"2006","journal-title":"Am. J. Public Health"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"El-Sayed, A.M., and Galea, S. (2017). Systems Science and Population Health, Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780190492397.001.0001"},{"key":"ref_10","first-page":"14761270211038635","article-title":"Tackling wicked problems in strategic management with systems thinking","volume":"2021","author":"Grewatsch","year":"2021","journal-title":"Strateg. Organ."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"El-Sayed, A.M., and Galea, S. (2017). Systems Science and Population Health, Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780190492397.001.0001"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Barbrook-Johnson, P., and Penn, A.S. (2022). Systems Mapping, Palgrave Macmillan.","DOI":"10.1007\/978-3-031-01919-7"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Giabbanelli, P.J., and Baniukiewicz, M. (2018). Advanced Data Analytics in Health, Springer.","DOI":"10.1007\/978-3-319-77911-9"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"102268","DOI":"10.1016\/j.simpat.2020.102268","article-title":"The application of modeling and simulation to public health: Assessing the quality of agent-based models for obesity","volume":"108","author":"Giabbanelli","year":"2021","journal-title":"Simul. Model. Pract. Theory"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1057\/s41271-018-0126-z","article-title":"Presenting models to policymakers: Intention and perception","volume":"39","author":"Naumova","year":"2018","journal-title":"J. Public Health Policy"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Gittelsohn, J., Novotny, R., Trude, A.C.B., Butel, J., and Mikkelsen, B.E. (2019). Challenges and lessons learned from multi-level multi-component interventions to prevent and reduce childhood obesity. Int. J. Environ. Res. Public Health, 16.","DOI":"10.3390\/ijerph16010030"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1177\/1090198118778323","article-title":"Process evaluation and lessons learned from engaging local policymakers in the B\u2019More Healthy Communities for Kids trial","volume":"46","author":"Nam","year":"2019","journal-title":"Health Educ. Behav."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1057\/s41271-018-0125-0","article-title":"Simulation modeling to assist with childhood obesity control: Perceptions of Baltimore City policymakers","volume":"39","author":"Seifu","year":"2018","journal-title":"J. Public Health Policy"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2521","DOI":"10.3389\/fpubh.2022.910055","article-title":"Pivoting from systems \u201cthinking\u201d to systems \u201cdoing\u201d in health systems\u2014Documenting stakeholder perspectives from Southeast Asia","volume":"10","author":"Srivastava","year":"2022","journal-title":"Front. Public Health"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"S12","DOI":"10.1016\/j.jcjd.2015.01.058","article-title":"Exploring the interactions between physical well-being, and obesity","volume":"39","author":"Drasic","year":"2015","journal-title":"Can. J. Diabetes"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1755","DOI":"10.1016\/S0140-6736(07)61740-1","article-title":"Foresight report on obesity","volume":"370","author":"McPherson","year":"2007","journal-title":"Lancet"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1002\/osp4.306","article-title":"Comparing complex perspectives on obesity drivers: Action-driven communities and evidence-oriented experts","volume":"4","author":"McGlashan","year":"2018","journal-title":"Obes. Sci. Pract."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"e2511404","DOI":"10.17061\/phrp2511404","article-title":"Group model building: A participatory approach to understanding and acting on systems","volume":"25","author":"Siokou","year":"2014","journal-title":"Public Health Res. Pract."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1755","DOI":"10.1016\/S0140-6736(07)61741-3","article-title":"Foresight report on obesity\u2013Author\u2019s reply","volume":"370","author":"Jack","year":"2007","journal-title":"Lancet"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Allender, S., Owen, B., Kuhlberg, J., Lowe, J., Nagorcka-Smith, P., Whelan, J., and Bell, C. (2015). A community based systems diagram of obesity causes. PloS ONE, 10.","DOI":"10.1371\/journal.pone.0129683"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"103","DOI":"10.3390\/obesities2010010","article-title":"Weight-Biased Language across 30 Years of Australian News Reporting on Obesity: Associations with Public Health Policy","volume":"2","author":"Grant","year":"2022","journal-title":"Obesities"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1177\/1049732320968779","article-title":"We need to talk about complexity in health research: Findings from a focused ethnography","volume":"31","author":"Papoutsi","year":"2021","journal-title":"Qual. Health Res."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1715","DOI":"10.1093\/heapol\/czab062","article-title":"Applied systems thinking: Unlocking theory, evidence and practice for health policy and systems research","volume":"36","author":"Kwamie","year":"2021","journal-title":"Health Policy Plan."},{"key":"ref_29","first-page":"585","article-title":"Systems thinking in public health: A bibliographic contribution to a meta-narrative review","volume":"32","author":"Chughtai","year":"2017","journal-title":"Health Policy Plan."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1016\/j.compedu.2014.06.002","article-title":"Concept maps: A useful and usable tool for computer-based knowledge assessment? A literature review with a focus on usability","volume":"78","author":"Weinerth","year":"2014","journal-title":"Comput. Educ."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1080\/15391523.2022.2119449","article-title":"Designing the next generation of map assessment systems: Open questions and opportunities to automatically assess a student\u2019s knowledge as a map","volume":"55","author":"Giabbanelli","year":"2023","journal-title":"J. Res. Technol. Educ."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Giabbanelli, P.J., and Tawfik, A.A. (2020, January 19\u201324). Reducing the gap between the conceptual models of students and experts using graph-based adaptive instructional systems. Proceedings of the International Conference on Human-Computer Interaction, Copenhagen, Denmark.","DOI":"10.1007\/978-3-030-60128-7_40"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1080\/07377363.2020.1712579","article-title":"Concept mapping: Benefits and challenges in higher education","volume":"68","author":"Machado","year":"2020","journal-title":"J. Contin. High. Educ."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1097\/00001888-200402000-00012","article-title":"Physicians\u2019 weight loss counseling in two public hospital primary care clinics","volume":"79","author":"Huang","year":"2004","journal-title":"Acad. Med."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"482","DOI":"10.1016\/j.ypmed.2009.09.015","article-title":"Weight management advice: What do doctors recommend to their patients?","volume":"49","author":"Shiffman","year":"2009","journal-title":"Prev. Med."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Giabbanelli, P.J. (2018). Advanced Data Analytics in Health, Springer.","DOI":"10.1007\/978-3-319-77911-9"},{"key":"ref_37","unstructured":"Verigin, T., Giabbanelli, P.J., and Davidsen, P.I. (2016, January 3\u20136). Supporting a systems approach to healthy weight interventions in british columbia by modeling weight and well-being. Proceedings of the 49th Annual Simulation Symposium, Pasadena, CA, USA."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1186\/s12966-022-01271-7","article-title":"Evaluation proposal of a national community-based obesity prevention programme: A novel approach considering the complexity perspective","volume":"19","author":"Huiberts","year":"2022","journal-title":"Int. J. Behav. Nutr. Phys. Act."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1111\/nyas.12511","article-title":"From policy coherence to 21st century convergence: A whole-of-society paradigm of human and economic development","volume":"1331","author":"Addy","year":"2014","journal-title":"Ann. N. Y. Acad. Sci."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"12356","DOI":"10.1073\/pnas.0913003109","article-title":"A systems science perspective and transdisciplinary models for food and nutrition security","volume":"109","author":"Hammond","year":"2012","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Giabbanelli, P.J., and Crutzen, R. (2014). Creating groups with similar expected behavioural response in randomized controlled trials: A fuzzy cognitive map approach. BMC Med. Res. Methodol., 14.","DOI":"10.1186\/1471-2288-14-130"},{"key":"ref_42","unstructured":"Dube, L., Wolfert, S., Zimmerman, K., Yang, N., Diaz-Lopez, F., Arvanitis, R., Sandra Schillo, R., Hamalova, S., Nie, J.Y., and Brown, S. (2020). How is Digitalization Affecting Agri-food?, Routledge."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"5742629","DOI":"10.1155\/2017\/5742629","article-title":"Using agent-based models to develop public policy about food behaviours: Future directions and recommendations","volume":"2017","author":"Giabbanelli","year":"2017","journal-title":"Comput. Math. Methods Med."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"832","DOI":"10.1007\/s11121-021-01319-3","article-title":"High-fidelity agent-based modeling to support prevention decision-making: An open science approach","volume":"23","author":"Vermeer","year":"2022","journal-title":"Prev. Sci."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"e009002","DOI":"10.1136\/bmjopen-2015-009002","article-title":"Systems science and systems thinking for public health: A systematic review of the field","volume":"5","author":"Carey","year":"2015","journal-title":"BMJ Open"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"667","DOI":"10.1002\/jrsm.1595","article-title":"Using systems perspectives in evidence synthesis: A methodological mapping review","volume":"13","author":"Hong","year":"2022","journal-title":"Res. Synth. Methods"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1186\/s12966-022-01267-3","article-title":"The ENCOMPASS framework: A practical guide for the evaluation of public health programmes in complex adaptive systems","volume":"19","author":"Stronks","year":"2022","journal-title":"Int. J. Behav. Nutr. Phys. Act."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Malbon, E., and Parkhurst, J. (2022). System dynamics modelling and the use of evidence to inform policymaking. Policy Stud., 1\u201319.","DOI":"10.1080\/01442872.2022.2080814"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Hamid, T.K. (2009). Thinking in Circles about Obesity: Applying Systems Thinking to Weight Management, Springer Science & Business Media.","DOI":"10.1007\/978-0-387-09469-4"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Axelrod, R. (2015). Structure of Decision: The Cognitive Maps of Political Elites, Princeton University Press.","DOI":"10.1515\/9781400871957"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1002\/(SICI)1099-1727(199621)12:1<39::AID-SDR94>3.0.CO;2-K","article-title":"Group model-building to facilitate organizational change: An exploratory study","volume":"12","author":"Vennix","year":"1996","journal-title":"Syst. Dyn. Rev. J. Syst. Dyn. Soc."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Giabbanelli, P.J., and Tawfik, A.A. (2021). How Perspectives of a System Change Based on Exposure to Positive or Negative Evidence. Systems, 9.","DOI":"10.3390\/systems9020023"},{"key":"ref_53","unstructured":"Meadows, D.H. (2008). Thinking in Systems: A Primer, Chelsea Green Publishing."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"466","DOI":"10.1080\/19320240903346448","article-title":"Places to intervene to make complex food systems more healthy, green, fair, and affordable","volume":"4","author":"Malhi","year":"2009","journal-title":"J. Hunger. Environ. Nutr."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"1270","DOI":"10.2105\/AJPH.2014.301884","article-title":"Systems science and obesity policy: A novel framework for analyzing and rethinking population-level planning","volume":"104","author":"Johnston","year":"2014","journal-title":"Am. J. Public Health"},{"key":"ref_56","unstructured":"Provincial Health Services Authority (2013). From Weight to Well-Being: Time for a Shift in Paradigm?, Provincial Health Services Authority."},{"key":"ref_57","first-page":"194","article-title":"Developing technology to support policymakers in taking a systems science approach to obesity and well-being","volume":"17","author":"Giabbanelli","year":"2016","journal-title":"Obes. Rev."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1002\/9781118976005.ch14","article-title":"Usability Testing","volume":"1","author":"Riihiaho","year":"2018","journal-title":"Wiley Handb. Hum. Comput. Interact."},{"key":"ref_59","first-page":"i-105","article-title":"Usability Testing: A Practitioner\u2019s Guide to Evaluating the User Experience","volume":"13","author":"Hertzum","year":"2020","journal-title":"Synth. Lect. Hum.-Cent. Inform."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Gappa, H., Nordbrock, G., Mohamad, Y., and Velasco, C.A. (2018, January 11\u201313). Group-based expert walkthroughs to compensate for limited access to target user groups as in case of chronically ill patients. Proceedings of the International Conference on Computers Helping People with Special Needs, Linz, Austria.","DOI":"10.1007\/978-3-319-94277-3_13"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1145\/2729103","article-title":"The big hole in HCI research","volume":"22","author":"Kostakos","year":"2015","journal-title":"Interactions"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3325281","article-title":"Concurrent think-aloud verbalizations and usability problems","volume":"26","author":"Fan","year":"2019","journal-title":"ACM Trans. Comput. -Hum. Interact. (TOCHI)"},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1207\/s15430421tip4104_2","article-title":"A revision of Bloom\u2019s taxonomy: An overview","volume":"41","author":"Krathwohl","year":"2002","journal-title":"Theory Into Pract."},{"key":"ref_64","first-page":"346","article-title":"The creative use of Thinking Maps to embed Blooms\u2019 Taxonomy within teaching, learning and assessment","volume":"6","author":"McGrath","year":"2022","journal-title":"EDUCATIO J. Educ."},{"key":"ref_65","unstructured":"Gorman, J. (2018, January 26\u201328). Learning Objectives for Concept Mapping Based on the Complete Bloom\u2019s Taxonomy to Promote Meaningful Learning. Proceedings of the Eighth International Conference on Concept Mapping, Medell\u00edn, Colombia."},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Deep, A., Pathan, R., and Mitra, R. (2018, January 8\u20139). Comparing Experts\u2019 Systems Thinking Skill Across Contexts. Proceedings of the 2018 IEEE Tenth International Conference on Technology for Education(T4E), Kuala Lumpur, Malaysia.","DOI":"10.1109\/T4E.2018.00041"},{"key":"ref_67","unstructured":"Hogan, K., and Pressley, M. (1997). Scaffolding Student Learning: Instructional Approaches and Issues, Brookline Books."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1111\/j.1467-789X.2009.00689.x","article-title":"Obesity is a sign\u2014over-eating is a symptom: An aetiological framework for the assessment and management of obesity","volume":"11","author":"Sharma","year":"2009","journal-title":"Obes. Rev."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"614","DOI":"10.1007\/s11606-007-0149-9","article-title":"What are the essential elements to enable patient participation in medical decision making?","volume":"22","author":"Fraenkel","year":"2007","journal-title":"J. Gen. Intern. Med."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"1087","DOI":"10.1016\/S0277-9536(00)00098-8","article-title":"Patient-centredness: A conceptual framework and review of the empirical literature","volume":"51","author":"Mead","year":"2000","journal-title":"Soc. Sci. Med."},{"key":"ref_71","doi-asserted-by":"crossref","unstructured":"Giabbanelli, P.J., Adams, J., and Pillutla, V.S. (2016, January 17\u201322). Feasibility and framing of interventions based on public support: Leveraging text analytics for policymakers. Proceedings of the Human-Computer Interaction conference, Toronto, ON, Canada.","DOI":"10.1007\/978-3-319-39910-2_18"},{"key":"ref_72","unstructured":"Prpic, J., Taeihag, A., and Melton, J. (2014, January 24\u201326). Crowdsourcing the policy cycle. Proceedings of the Collective Intelligence conference, Seoul, Korea."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/3\/196\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:59:18Z","timestamp":1760122758000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/3\/196"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,20]]},"references-count":72,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["info14030196"],"URL":"https:\/\/doi.org\/10.3390\/info14030196","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2023,3,20]]}}}