{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T01:07:33Z","timestamp":1775783253479,"version":"3.50.1"},"reference-count":52,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2023,12,31]],"date-time":"2023-12-31T00:00:00Z","timestamp":1703980800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["ASI"],"abstract":"<jats:p>Accreditation bodies call for curriculum development processes that are open to all stakeholders, reflecting viewpoints of students, industry, university faculty, and society. However, communication difficulties between faculty and non-faculty groups leave an immense collaboration potential unexplored. Using the classification of learning objectives, natural language processing, and data visualization, this paper presents a quantitative method that delivers program plan representations that are universal, self-explanatory, and empowering; promoting stronger links between program courses and curriculum development open to all stakeholders. A simple example shows how the method contributes to representative program planning experiences and a case study is used to confirm the method\u2019s accuracy and utility.<\/jats:p>","DOI":"10.3390\/asi7010007","type":"journal-article","created":{"date-parts":[[2023,12,31]],"date-time":"2023-12-31T06:37:12Z","timestamp":1704004632000},"page":"7","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Broader Terms Curriculum Mapping: Using Natural Language Processing and Visual-Supported Communication to Create Representative Program Planning Experiences"],"prefix":"10.3390","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3880-5440","authenticated-orcid":false,"given":"Rog\u00e9rio","family":"Duarte","sequence":"first","affiliation":[{"name":"CINEA, Department of Mechanical Engineering, Instituto Polit\u00e9cnico de Set\u00fabal, ESTSet\u00fabal, Campus do IPS, Estefanilha, 2914-508 Setubal, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7250-764X","authenticated-orcid":false,"given":"\u00c2ngela","family":"Lacerda Nobre","sequence":"additional","affiliation":[{"name":"Department of Economics and Management, Instituto Polit\u00e9cnico de Set\u00fabal, ESCE, Campus do IPS, Estefanilha, 2914-503 Setubal, Portugal"}]},{"given":"Fernando","family":"Pimentel","sequence":"additional","affiliation":[{"name":"CINEA, Department of Mechanical Engineering, Instituto Polit\u00e9cnico de Set\u00fabal, ESTSet\u00fabal, Campus do IPS, Estefanilha, 2914-508 Setubal, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1157-060X","authenticated-orcid":false,"given":"Marc","family":"Jacquinet","sequence":"additional","affiliation":[{"name":"Department of Social Sciences and Management, Universidade Aberta, Rua da Escola Polit\u00e9cnica, 141-147, 1269-001 Lisboa, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2023,12,31]]},"reference":[{"key":"ref_1","unstructured":"ABET (2020, July 23). ABET Homepage. Available online: https:\/\/www.abet.org\/accreditation\/accreditation-criteria\/."},{"key":"ref_2","unstructured":"Crawley, E., Malmqvist, J., \u00d6stlund, S., and Brodeur, D. (2007). Rethinking Engineering Education: The CDIO Approach, Springer Science."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1080\/1360144X.2018.1524571","article-title":"Holistic academic development: Is it time to think more broadly about the academic development project?","volume":"23","author":"Sutherland","year":"2018","journal-title":"Int. J. Acad. Dev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1080\/1360144X.2019.1584897","article-title":"From consultation and collaboration to consensus: Introducing an alternative model of curriculum development","volume":"25","author":"Wilson","year":"2020","journal-title":"Int. J. Acad. Dev."},{"key":"ref_5","unstructured":"Ornstein, A., and Hunkins, F. (2018). Curriculum: Foundations, Principles and Issues, Pearson."},{"key":"ref_6","unstructured":"Burns, R. (2020, October 17). Curriculum Mapping. Association for Supervision and Curriculum Development. Available online: http:\/\/www.ascd.org\/publications\/curriculum-handbook\/421\/chapters\/Overview.aspx."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1080\/1360144X.2018.1462187","article-title":"Improving curriculum alignment and achieving learning goals by making the curriculum visible","volume":"23","author":"Meij","year":"2018","journal-title":"Int. J. Acad. Dev."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1002\/j.2168-9830.2003.tb00734.x","article-title":"Designing and teaching courses to satisfy the ABET engineering criteria","volume":"1","author":"Felder","year":"2003","journal-title":"J. Eng. Educ."},{"key":"ref_9","first-page":"15","article-title":"Three strategies for moving curriculum mapping online","volume":"17","author":"Dyjur","year":"2016","journal-title":"Educ. Dev."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1080\/01421590120036547","article-title":"AMEE Guide No. 21: Curriculum mapping: A tool for transparent and authentic teaching and learning","volume":"23","author":"Harden","year":"2001","journal-title":"Med. Teach."},{"key":"ref_11","first-page":"4","article-title":"Organising the results: The basis of authentic restructuring and reform","volume":"46","author":"Spady","year":"1988","journal-title":"Educ. Leadersh."},{"key":"ref_12","unstructured":"Biggs, J., and Tang, C. (2011). Teaching for Quality Learning at University, McGraw-Hill & Open University Press."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"e18","DOI":"10.1017\/dsj.2017.18","article-title":"Network models for mapping educational data","volume":"3","author":"Willcox","year":"2017","journal-title":"Des. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"757","DOI":"10.1111\/j.1551-6709.2012.01245.x","article-title":"The knowledge-learning-instruction framework: Bridging the science-practice chasm to enhance robust student learning","volume":"36","author":"Koedinger","year":"2012","journal-title":"Cogn. Sci."},{"key":"ref_15","unstructured":"Seering, J., Huang, L., and Willcox, K. (2015, January 14\u201317). Mapping outcomes in an undergraduate aerospace engineering program. Proceedings of the 2015 ASEE Annual Conference & Exposition, Seattle, WD, USA."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"344","DOI":"10.1080\/03043797.2019.1710465","article-title":"Graph-theoretic approaches and tools for quantitatively assessing curricula coherence","volume":"46","author":"Varagnolo","year":"2020","journal-title":"Eur. J. Eng. Educ."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1639","DOI":"10.1101\/gr.092759.109","article-title":"Circos: An information aesthetic for comparative genomics","volume":"19","author":"Krzywinski","year":"2009","journal-title":"Genome Res."},{"key":"ref_18","unstructured":"Rosen, K. (2009). Discrete Mathematics and Its Applications, McGraw-Hill."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Duarte, R. (2023, December 29). Supplementary Material for the Paper \u201cBroader Terms Curriculum Mapping: Using Natural Language Processing and Visual-Supported Communication to Create Representative Program Planning Experiences\u201d. Zenodo. Available online: https:\/\/zenodo.org\/records\/4313364.","DOI":"10.3390\/asi7010007"},{"key":"ref_20","unstructured":"Wikipedia Contributors (2020, October 30). Wikipedia Indices\u2014Wikipedia, The Free Encyclopedia. Available online: https:\/\/en.wikipedia.org\/w\/index.php?search=wikipedia&title=Special%3ASearch&profile=advanced&fulltext=1&advancedSearch-current=%7B%7D&ns0=1."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1080\/15228835.2019.1609386","article-title":"Mapping and Visualizing the Social Work Curriculum","volume":"37","author":"Ballantyne","year":"2019","journal-title":"J. Technol. Hum. Serv."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"682","DOI":"10.1080\/02615479.2015.1048217","article-title":"Whole Curriculum Mapping of Assessment: Cartographies of Assessment and Learning","volume":"34","author":"Watts","year":"2015","journal-title":"Soc. Work. Educ."},{"key":"ref_23","unstructured":"Adam, S. (2004). Using Learning Outcomes: A Consideration of the Nature, Role, Application and Implications for European Education of Emplying Learning Outcomes at the Local, National and International Levels, United Kingdom Bologna Seminar, Heriot-Watt University. Available online: http:\/\/www.aic.lv\/ace\/ace{_}disk\/Bologna\/Bol{_}semin\/Edinburgh\/."},{"key":"ref_24","unstructured":"Bloom, B. (1956). Taxonomy of Educational Objectives, Book I: The Cognitive Domain, Addison-Wesley Longman Ltd."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1080\/13562510309399","article-title":"The uses of learning Outcomes","volume":"8","author":"Hussey","year":"2003","journal-title":"Teach. High. Educ."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1371","DOI":"10.1080\/03075079.2014.968539","article-title":"Curriculum mapping as deliberation: Examining the alignment of subject learning outcomes and course curricula","volume":"41","author":"Lam","year":"2016","journal-title":"Stud. High. Educ."},{"key":"ref_27","unstructured":"Lancaster, F. (2003). Indexing and Abstracting in Theory and Practice, Facet. [3rd ed.]."},{"key":"ref_28","unstructured":"Library of Congress (2020, July 23). Library of Congress Subject Headings, S\/D, Available online: https:\/\/id.loc.gov\/authorities\/subjects.html."},{"key":"ref_29","unstructured":"UNESCO (2020, July 23). Unesco Thesaurus, S\/D. Available online: http:\/\/vocabularies.unesco.org\/browser\/thesaurus\/en\/."},{"key":"ref_30","unstructured":"EUROVOC (2020, July 23). Eurovoc Thesaurus, S\/D. Available online: https:\/\/op.europa.eu\/en\/web\/eu-vocabularies\/th-top-concept-scheme\/-\/resource\/eurovoc\/100141?target=Browse."},{"key":"ref_31","unstructured":"IEEE (2020, July 23). IEEE Thesaurus: Version 1.0. Available online: https:\/\/www.ieee.org\/publications\/services\/thesaurus-access-page.html."},{"key":"ref_32","unstructured":"Bergman, M. (2020, July 23). Shaping Wikipedia into a Computable Knowledge Base. AI3, Adaptive Information Blog. Available online: https:\/\/www.mkbergman.com\/1847\/shaping-wikipedia-into-a-computable-knowledge-base\/."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1177\/0165551513514932","article-title":"Towards linking libraries and Wikipedia: Automatic subject indexing of library records with Wikipedia concepts","volume":"40","author":"Joorabchi","year":"2013","journal-title":"J. Inf. Sci."},{"key":"ref_34","unstructured":"Hjorland, B., and Gnoli, C. Automatic Subject Indexing of Text, S\/D, Encyclopedia of Knowledge Organization. Available online: https:\/\/www.isko.org\/cyclo\/automatic."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1080\/09585176.2016.1261719","article-title":"Validating curriculum development using text mining","volume":"28","author":"West","year":"2016","journal-title":"Curric. J."},{"key":"ref_36","unstructured":"Manning, C., and Sch\u00fctze, H. (1999). Foundations of Statistical Natural Language Processing, The MIT Press. [2nd ed.]."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1080\/08993408.2018.1486120","article-title":"Teaching data science: An objective approach to curriculum validation","volume":"28","author":"West","year":"2018","journal-title":"Comput. Sci. Educ."},{"key":"ref_38","unstructured":"R Core Team (2019). R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing. Available online: https:\/\/www.R-project.org\/."},{"key":"ref_39","unstructured":"Fellows, I. (2023, December 29). Wordcloud: Word Clouds. R Package Version 2.6. Available online: https:\/\/CRAN.R-project.org\/package=wordcloud."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2811","DOI":"10.1093\/bioinformatics\/btu393","article-title":"circlize implements and enhances circular visualization in r","volume":"30","author":"Gu","year":"2014","journal-title":"Bioinformatics"},{"key":"ref_41","unstructured":"Csardi, G., and Nepusz, T. (2023, December 29). The Igraph Software Package for Complex Network Research. InterJournal, Complex Systems: 1695. Available online: http:\/\/igraph.org."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1129","DOI":"10.1002\/spe.4380211102","article-title":"Graph drawing by force-directed placement","volume":"21","author":"Fruchterman","year":"1991","journal-title":"Softw.-Pract. Exp."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1162\/152417399570287","article-title":"Kurt Lewin\u2019s change theory in the field and in the classroom: Notes toward a model of managed learning","volume":"1","author":"Schein","year":"1999","journal-title":"Reflections"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1080\/0309877X.2014.1000278","article-title":"Curriculum mapping in higher education: A case study and proposed content scope and sequence mapping tool","volume":"40","author":"Arafeh","year":"2016","journal-title":"J. Furth. High. Educ."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"944","DOI":"10.1080\/14783363.2014.906110","article-title":"Identifying at-risk students in higher education","volume":"25","author":"Duarte","year":"2014","journal-title":"Total Qual. Manag. Bus. Excell."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Duarte, R., Pires, A.L.O., and Nobre, A.L. (2018). Mature Learners\u2019 Participation in Higher Education and Flexible Learning Pathways: Lessons Learned from an Exploratory Experimental Research, Springer. Chapter 2.","DOI":"10.1007\/978-981-10-8917-6_2"},{"key":"ref_47","unstructured":"Louren\u00e7o, R., Ferreira, E., Duarte, R., Gon\u00e7alves, H., and Duarte, H. (2013, January 18\u201319). IPS\u2019 technology and industrial management graduate course: A curriculum follow-up analysis. Proceedings of the 1st European Conference on Curriculum Studies, Future Directions: Uncertainty and Possibility, Braga, Portugal."},{"key":"ref_48","unstructured":"A3ES (2020, November 27). Regulations on the Assessment and Accreditation Procedures\u2014[Portuguese] Agency for the Assessment and Accreditation of Higher Education. Available online: https:\/\/www.a3es.pt\/en\/accreditation-and-audit\/normative-framework\/regulations-assessment-and-accreditation-procedures."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1550","DOI":"10.1080\/03075079.2014.899343","article-title":"Mapping or tracing? Rethinking curriculum mapping in higher education","volume":"40","author":"Wang","year":"2015","journal-title":"Stud. High. Educ."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Bagui, S., and Earp, R. (2003). Database Design Using Entity-Relationship Diagrams, Auerbach Publications.","DOI":"10.1201\/9780203486054"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1145\/320434.320440","article-title":"The Entity Relationship Model: Toward a Unified View of Data","volume":"1","author":"Chen","year":"1976","journal-title":"ACM Trans. Database Syst."},{"key":"ref_52","unstructured":"Leff, A., and Rayfield, J. (2001, January 4\u20137). Web-application development using the model\/view\/controller design pattern. Proceedings of the Fifth IEEE International Enterprise Distributed Object Computing Conference, EDOC\u201901, Seattle, WA, USA."}],"container-title":["Applied System Innovation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2571-5577\/7\/1\/7\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:45:13Z","timestamp":1760132713000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2571-5577\/7\/1\/7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,31]]},"references-count":52,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,2]]}},"alternative-id":["asi7010007"],"URL":"https:\/\/doi.org\/10.3390\/asi7010007","relation":{},"ISSN":["2571-5577"],"issn-type":[{"value":"2571-5577","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,31]]}}}