{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,5]],"date-time":"2026-03-05T12:15:56Z","timestamp":1772712956916,"version":"3.50.1"},"reference-count":52,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2022,12,9]],"date-time":"2022-12-09T00:00:00Z","timestamp":1670544000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001871","name":"FCT\u2013Funda\u00e7\u00e3o para a Ci\u00eancia e Tecnologia","doi-asserted-by":"publisher","award":["UIDB\/00319\/2020"],"award-info":[{"award-number":["UIDB\/00319\/2020"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Education Sciences"],"abstract":"<jats:p>Assessment rubrics are recognized for their positive effects, being defined as an evaluative instrument that establishes assessment criteria and performance levels. In this sense, assessment rubrics can be associated with professional practices for more authentic assessment processes. In the context of Project Management, the International Project Management Association (IPMA) has developed a framework that establishes the individual competences for professionals working in the area, the Individual Competence Baseline (ICB). The objective of this study is to propose a process of rubric development for competence assessment in Project Management. A rubric for Leadership competence was developed to show the applicability and relevance of the proposed process. The research methodology adopted in the study was Design Science Research. The application and evaluation of this rubric in a pilot study show that the rubric development process allowed the creation of a specific rubric for the assessment of leadership competence. This paper guides those who need to develop and assess project management competences, and it is intended to propose a replicable process for the other ICB competences.<\/jats:p>","DOI":"10.3390\/educsci12120902","type":"journal-article","created":{"date-parts":[[2022,12,9]],"date-time":"2022-12-09T04:46:46Z","timestamp":1670561206000},"page":"902","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Rubric\u2019s Development Process for Assessment of Project Management Competences"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2070-7073","authenticated-orcid":false,"given":"Mariane","family":"Souza","sequence":"first","affiliation":[{"name":"ALGORITMI Research Centre\/LASI, Department of Production and Systems, School of Engineering, University of Minho, 4800-058 Guimar\u00e3es, Portugal"},{"name":"School of Engineering, Federal University of Rio Grande (FURG), Rio Grande 96201-900, Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6649-4029","authenticated-orcid":false,"given":"\u00c9lida","family":"Margalho","sequence":"additional","affiliation":[{"name":"ALGORITMI Research Centre\/LASI, Department of Production and Systems, School of Engineering, University of Minho, 4800-058 Guimar\u00e3es, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7991-0132","authenticated-orcid":false,"given":"Rui M.","family":"Lima","sequence":"additional","affiliation":[{"name":"ALGORITMI Research Centre\/LASI, Department of Production and Systems, School of Engineering, University of Minho, 4800-058 Guimar\u00e3es, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3896-6348","authenticated-orcid":false,"given":"Diana","family":"Mesquita","sequence":"additional","affiliation":[{"name":"Research Centre for Human Development (CEDH), Faculty of Education and Psychology, Universidade Cat\u00f3lica Portuguesa (FEP-UCP), 4169-005 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5255-4257","authenticated-orcid":false,"given":"Manuel Jo\u00e3o","family":"Costa","sequence":"additional","affiliation":[{"name":"School of Medicine, University of Minho, 4710-057 Braga, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Magano, J., Silva, C., Figueiredo, C., Vit\u00f3ria, A., Nogueira, T., and Dinis, M.A.P. (2020). Generation Z: Fitting project management soft skills competencies\u2014A mixed-method approach. Educ. Sci., 10.","DOI":"10.3390\/educsci10070187"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.ijproman.2017.07.008","article-title":"Projectification in Western economies: A comparative study of Germany, Norway and Iceland","volume":"36","author":"Schoper","year":"2018","journal-title":"Int. J. Proj. Manag."},{"key":"ref_3","unstructured":"IPMA (2015). Individual Competence Baseline for Project, Programme & Portfolio Management. International Project Management Association, IPMA. Available online: https:\/\/www.ipma.world\/."},{"key":"ref_4","unstructured":"Burke, R., and Barron, S. (2014). Project Management Leadership: Building Creative Teams, John Wiley & Sons. [2nd ed.]."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1016\/j.jradnu.2013.10.001","article-title":"Designing nursing staff competency assessment using simulation","volume":"32","author":"Hagler","year":"2013","journal-title":"J. Radiol. Nurs."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1016\/j.edurev.2007.06.001","article-title":"Evaluating assessment quality in competence-based education: A qualitative comparison of two frameworks","volume":"2","author":"Baartman","year":"2007","journal-title":"Educ. Res. Rev."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Petrov, M. (2020). An Approach to Changing Competence Assessment for Human Resources in Expert Networks. Future Internet, 12.","DOI":"10.3390\/fi12100169"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Oh, M., and Choi, S. (2020). The competence of project team members and success factors with open innovation. J. Open Innov. Technol. Mark. Complex., 6.","DOI":"10.3390\/joitmc6030051"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1002\/pmj.20174","article-title":"PMP certification as a core competency: Necessary but not sufficient","volume":"42","author":"Starkweather","year":"2011","journal-title":"Proj. Manag. J."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.ijproman.2018.09.005","article-title":"Exploring the value of project management certification in selection and recruiting","volume":"37","author":"Farashah","year":"2019","journal-title":"Int. J. Proj. Manag."},{"key":"ref_11","unstructured":"Tinoco, E., Lima, R., Mesquita, D., and Souza, M. (2022, October 01). Using scenarios for the development of personal communication competence in project management, Int. J. Proj. Organ. Manag., Available online: https:\/\/www.inderscience.com\/info\/ingeneral\/forthcoming.php?jcode=ijpom."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1108\/09684881111107771","article-title":"Design and development of rubrics to improve assessment outcomes: A pilot study in a Master\u2019s level business program in India","volume":"9","author":"Reddy","year":"2011","journal-title":"Qual. Assur. Educ."},{"key":"ref_13","unstructured":"Salinas, J., and Erochko, J. (June, January 31). Using Weighted Scoring Rubrics in Engineering Assessment. Proceedings of the Canadian Engineering Education Association (CEEA), Hamilton, ON, Canada."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1080\/03075079.2015.1004241","article-title":"The International state of Research on Measurement of Competency in Higher Education","volume":"40","author":"Shavelson","year":"2015","journal-title":"Stud. High. Educ."},{"key":"ref_15","first-page":"84","article-title":"Competency benchmarks: Practical steps toward a culture of competence","volume":"7","author":"Hatcher","year":"2013","journal-title":"Train. Educ. Prof. Psychol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1111\/j.1365-2929.2005.02094.x","article-title":"Assessing professional competence: From methods to programmes","volume":"39","author":"Schuwirth","year":"2005","journal-title":"Med. Educ."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1016\/j.autcon.2013.05.016","article-title":"An integrated approach to BIM competency assessment, acquisition and application","volume":"35","author":"Succar","year":"2013","journal-title":"Autom. Constr."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.ece.2018.11.006","article-title":"Development and application of scoring rubrics for evaluating students\u2019 competencies and learning outcomes in Chemical Engineering experimental courses","volume":"26","author":"Tobajas","year":"2019","journal-title":"Educ. Chem. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Sillat, L., Tammets, K., and Laanpere, M. (2021). Digital competence assessment methods in higher education: A systematic literature review. Educ. Sci., 11.","DOI":"10.3390\/educsci11080402"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1007\/s11625-020-00855-1","article-title":"Current practice of assessing students\u2019 sustainability competencies: A review of tools","volume":"16","author":"Redman","year":"2021","journal-title":"Sustain. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"414","DOI":"10.1080\/10437797.2014.917927","article-title":"Competencies and their assessment","volume":"50","author":"Drisko","year":"2014","journal-title":"J. Soc. Work. Educ."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1016\/j.ijproman.2014.04.001","article-title":"What is a good project manager? An Aristotelian perspective","volume":"33","author":"Bredillet","year":"2015","journal-title":"Int. J. Proj. Manag."},{"key":"ref_23","first-page":"307","article-title":"Addressing the \u201ctwo disciplines\u201d problem: Linking theories of cognition and learning with assessment and instructional practice","volume":"24","author":"Pellegrino","year":"1999","journal-title":"Rev. Res. Educ."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Arcuria, P., Morgan, W., and Fikes, T. (2019, January 4\u20138). Validating the use of LMS-derived rubric structural features to facilitate automated measurement of rubric quality. Proceedings of the 9th International Conference on Learning Analytics & Knowledge, New York, NY, USA.","DOI":"10.1145\/3303772.3303829"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1016\/j.nedt.2011.04.007","article-title":"Using the analytic rubric as an evaluation tool in nursing education: The positive and the negative","volume":"32","author":"Shipman","year":"2012","journal-title":"Nurse Educ. Today"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1080\/02602938.2015.1111294","article-title":"Assessment rubrics: Towards clearer and more replicable design, research and practice","volume":"42","author":"Dawson","year":"2017","journal-title":"Assess. Eval. High. Educ."},{"key":"ref_27","first-page":"3","article-title":"Avalia\u00e7\u00e3o de Rubricas","volume":"1","author":"Fernandes","year":"2021","journal-title":"Crit\u00e9rio"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1080\/00131911.2014.929565","article-title":"The quality and effectiveness of descriptive rubrics","volume":"67","author":"Brookhart","year":"2015","journal-title":"Educ. Rev."},{"key":"ref_29","first-page":"199","article-title":"Rubric-referenced self-assessment and middle school students\u2019 writing","volume":"17","author":"Andrade","year":"2010","journal-title":"Assess. Educ. Princ. Policy Pract."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"3147","DOI":"10.1007\/s10639-017-9579-0","article-title":"Designing and creating an educational app rubric for preschool teachers","volume":"22","author":"Papadakis","year":"2017","journal-title":"Educ. Inf. Technol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1007\/s10734-017-0220-3","article-title":"Developing evaluative judgement: Enabling students to make decisions about the quality of work","volume":"76","author":"Tai","year":"2018","journal-title":"High. Educ."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"105544","DOI":"10.1016\/j.nedt.2022.105544","article-title":"Development and learning efficacy of a simulation rubric in childhood pneumonia for nursing students: A mixed methods study","volume":"119","author":"Lo","year":"2022","journal-title":"Nurse Educ. Today"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"189","DOI":"10.3200\/JOEB.82.4.189-195","article-title":"Assessing student learning: Are business schools making the grade?","volume":"82","author":"Martell","year":"2007","journal-title":"J. Educ. Bus."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Brookhart, S. (2013). How to Create and Use Rubrics for Formative Assessment and Grading, ASCD.","DOI":"10.4135\/9781452218649.n15"},{"key":"ref_35","first-page":"72","article-title":"What\u2019s Wrong\u2014and What\u2019s Right\u2014With Rubrics","volume":"55","author":"Popham","year":"1997","journal-title":"Educ. Leadersh."},{"key":"ref_36","first-page":"1","article-title":"Leveling the field: Using Rubrics to achieve greater equity in teaching and grading","volume":"17","author":"Stevens","year":"2005","journal-title":"Essays Teach. Excell."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"412","DOI":"10.1016\/j.ijproman.2006.02.009","article-title":"Three conceptual levels of construction project management work","volume":"24","author":"Chen","year":"2006","journal-title":"Int. J. Proj. Manag."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"867","DOI":"10.1108\/IJMPB-01-2020-0002","article-title":"Evolution of project management studies in the XXI century","volume":"13","author":"Wawak","year":"2020","journal-title":"Int. J. Manag. Proj. Bus."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"796","DOI":"10.1108\/IJMPB-01-2017-0004","article-title":"Evaluation of project success: A structured literature review","volume":"10","author":"Albert","year":"2017","journal-title":"Int. J. Manag. Proj. Bus."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1703","DOI":"10.1016\/j.ijproman.2016.09.011","article-title":"IPMA ICB 4.0\u2014A global standard for project, programme and portfolio management competences","volume":"34","author":"Young","year":"2016","journal-title":"Int. J. Proj. Manag."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1080\/03043797.2018.1498459","article-title":"Design science research\u2013a powerful tool for improving methods in engineering education research","volume":"44","author":"Carstensen","year":"2019","journal-title":"Eur. J. Eng. Educ."},{"key":"ref_42","first-page":"1116","article-title":"Uma an\u00e1lise distintiva entre o estudo de caso, a pesquisa-a\u00e7\u00e3o e a design science research","volume":"17","author":"Dresch","year":"2015","journal-title":"Rev. Bras. Gest\u00e3o Neg\u00f3cios"},{"key":"ref_43","first-page":"37","article-title":"Modeling design process","volume":"11","author":"Takeda","year":"1990","journal-title":"AI Mag."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1007\/BF02310555","article-title":"Coefficient alpha and the internal structure of tests","volume":"16","author":"Cronbach","year":"1951","journal-title":"Psychometrika"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"649","DOI":"10.5123\/S1679-49742017000300022","article-title":"Propriedades psicom\u00e9tricas na avalia\u00e7\u00e3o de instrumentos: Avalia\u00e7\u00e3o da fiabilidade e validade","volume":"26","author":"Souza","year":"2017","journal-title":"Epidemiol. Servi\u00e7os Sa\u00fade"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1002\/nur.20147","article-title":"The content validity index: Are you sure you know what\u2019s being reported? Critique and recommendations","volume":"29","author":"Polit","year":"2006","journal-title":"Res. Nurs. Health"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"2158244018821751","DOI":"10.1177\/2158244018821751","article-title":"Content validity of assessment instrument for employee engagement","volume":"9","author":"Shrotryia","year":"2019","journal-title":"Sage Open"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"467","DOI":"10.4300\/JGME-D-16-00848.1","article-title":"A novel scenario-based interview tool to evaluate nontechnical skills and competencies in global health delivery","volume":"9","author":"Wroe","year":"2017","journal-title":"J. Grad. Med. Educ."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1473","DOI":"10.1108\/BPMJ-01-2019-0040","article-title":"A systematic literature review on BPMN extensions","volume":"26","author":"Zarour","year":"2019","journal-title":"Bus. Process Manag. J."},{"key":"ref_50","unstructured":"PMI (2021). A Guide to the Project Management Body of Knowledge PMBOK\u00aeGUIDE, Project Management Institute, Inc.. [7th ed.]."},{"key":"ref_51","first-page":"285","article-title":"Use of Cronbach\u2019s alpha in dental research","volume":"4","author":"Jain","year":"2017","journal-title":"Med. Res. Chron."},{"key":"ref_52","first-page":"443","article-title":"Avalia\u00e7\u00e3o educacional: A abordagem por compet\u00eancias","volume":"20","author":"Rabelo","year":"2015","journal-title":"Avalia\u00e7\u00e3o Rev. Avalia\u00e7\u00e3o Educ. Super. (Campinas)"}],"container-title":["Education Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-7102\/12\/12\/902\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:37:05Z","timestamp":1760146625000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-7102\/12\/12\/902"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,9]]},"references-count":52,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["educsci12120902"],"URL":"https:\/\/doi.org\/10.3390\/educsci12120902","relation":{},"ISSN":["2227-7102"],"issn-type":[{"value":"2227-7102","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,9]]}}}