{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T15:50:16Z","timestamp":1753890616039,"version":"3.41.2"},"reference-count":40,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,5,9]],"date-time":"2024-05-09T00:00:00Z","timestamp":1715212800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Big Data"],"abstract":"<jats:p>The evaluation of performance using competencies within a structured framework holds significant importance across various professional domains, particularly in roles like project manager. Typically, this assessment process, overseen by senior evaluators, involves scoring competencies based on data gathered from interviews, completed forms, and evaluation programs. However, this task is tedious and time-consuming, and requires the expertise of qualified professionals. Moreover, it is compounded by the inconsistent scoring biases introduced by different evaluators. In this paper, we propose a novel approach to automatically predict competency scores, thereby facilitating the assessment of project managers' performance. Initially, we performed data fusion to compile a comprehensive dataset from various sources and modalities, including demographic data, profile-related data, and historical competency assessments. Subsequently, NLP techniques were used to pre-process text data. Finally, recommender systems were explored to predict competency scores. We compared four different recommender system approaches: content-based filtering, demographic filtering, collaborative filtering, and hybrid filtering. Using assessment data collected from 38 project managers, encompassing scores across 67 different competencies, we evaluated the performance of each approach. Notably, the content-based approach yielded promising results, achieving a precision rate of 81.03%. Furthermore, we addressed the challenge of cold-starting, which in our context involves predicting scores for either a new project manager lacking competency data or a newly introduced competency without historical records. Our analysis revealed that demographic filtering achieved an average precision of 54.05% when dealing with new project managers. In contrast, content-based filtering exhibited remarkable performance, achieving a precision of 85.79% in predicting scores for new competencies. These findings underscore the potential of recommender systems in competency assessment, thereby facilitating more effective performance evaluation process.<\/jats:p>","DOI":"10.3389\/fdata.2024.1295009","type":"journal-article","created":{"date-parts":[[2024,5,9]],"date-time":"2024-05-09T05:13:58Z","timestamp":1715231638000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Multi-modal recommender system for predicting project manager performance within a competency-based framework"],"prefix":"10.3389","volume":"7","author":[{"given":"Imene","family":"Jemal","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wilfried Armand","family":"Naoussi Sijou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Belkacem","family":"Chikhaoui","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2024,5,9]]},"reference":[{"key":"B1","unstructured":"Global Student Learning Data Model2023"},{"key":"B2","first-page":"49","article-title":"Model of employee performance: competence analysis and motivation","volume":"4","author":"Aima","year":"2017","journal-title":"J. Res. Bus. Manage"},{"key":"B3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1049\/cp.2018.1409","article-title":"\u201cHandling data analytics on unstructured data using MongoDB,\u201d","volume-title":"Smart Cities Symposium 2018","author":"Aluvalu","year":"2018"},{"key":"B4","article-title":"Multifactor leadership questionnaire","author":"Bass","year":"1996","journal-title":"West. J. Nurs. Res"},{"key":"B5","doi-asserted-by":"publisher","first-page":"993","DOI":"10.5555\/944919.944937","article-title":"Latent dirichlet allocation","volume":"3","author":"Blei","year":"2003","journal-title":"J. Machine Learn. Res"},{"key":"B6","doi-asserted-by":"publisher","first-page":"1574","DOI":"10.1109\/TVCG.2011.280","article-title":"Multimodal data fusion based on mutual information","volume":"18","author":"Bramon","year":"2011","journal-title":"IEEE Trans. Visual. Comput. Graph"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1803.11175","article-title":"Universal sentence encoder","author":"Cer","year":"2018","journal-title":"arXiv preprint arXiv:1803.11175"},{"key":"B8","doi-asserted-by":"crossref","first-page":"644","DOI":"10.1109\/WAINA.2011.12","article-title":"\u201cAn improved hybrid recommender system by combining predictions,\u201d","volume-title":"2011 IEEE Workshops of International Conference on Advanced Information Networking and Applications","author":"Chikhaoui","year":"2011"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.2478\/v10006-012-0059-9","article-title":"ReSySTER: a hybrid recommender system for Scrum team roles based on fuzzy and rough sets","author":"Colomo Palacios","year":"2012","journal-title":"Int. J. Appl. Math. Comput. Sci"},{"key":"B10","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1061\/(ASCE)0742-597X(2005)21:1(2)","article-title":"Competency-based model for predicting construction project managers' performance","volume":"21","author":"Dainty","year":"2005","journal-title":"J. Manag. Eng"},{"volume-title":"Skill and Competency Data Translation and Analysis","year":"2020","author":"Danielle","key":"B11"},{"key":"B12","doi-asserted-by":"publisher","first-page":"106168","DOI":"10.1016\/j.chb.2019.106168","article-title":"MoodleREC: a recommendation system for creating courses using the moodle e-learning platform","volume":"104","author":"De Medio","year":"2020","journal-title":"Comput. Hum. Behav"},{"key":"B13","first-page":"34","article-title":"Project management competency framework","volume":"10","author":"De Rezende","year":"2019","journal-title":"Iberoam. J. Proj. Manag"},{"key":"B14","first-page":"7","article-title":"Design of a new instrument to assess leadership dimensions and styles","volume":"20","author":"Dulewicz","year":"2004","journal-title":"Sel. Dev. Rev."},{"key":"B15","doi-asserted-by":"publisher","first-page":"434","DOI":"10.1007\/s12063-021-00204-0","article-title":"Project management for supply chains 4.0: a conceptual framework proposal based on PMBOK methodology","volume":"14","author":"Frederico","year":"2021","journal-title":"Operat. Manag. Res"},{"volume-title":"The Inwald Personality Inventory (IPI) and Law Enforcement Officer Response to Domestic Violence","year":"1998","author":"Gardner","key":"B16"},{"key":"B17","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1142\/S1793351X23610019","article-title":"A scalable recommendation system approach for a companies\u2014seniors matching","volume":"17","author":"Guyard","year":"2023","journal-title":"Int. J. Semant. Comput"},{"key":"B18","doi-asserted-by":"publisher","first-page":"676","DOI":"10.3109\/0142159X.2010.500704","article-title":"The role of assessment in competency-based medical education","volume":"32","author":"Holmboe","year":"2010","journal-title":"Med. Teacher"},{"key":"B19","unstructured":"Unified clustering locality preserving matrix factorization for student performance prediction245253\n            HwangC. S.\n            SuY. C.\n          IAENG Int. J. Comput. Sci422015"},{"key":"B20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/IEEESTD.2022.9967810","article-title":"\u201cIEEE recommended practice for defining competencies,\u201d","year":"2022","journal-title":"IEEE Std 1484.20.2-2022"},{"key":"B21","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1109\/AINA.2010.168","article-title":"\u201cRecommender systems for human resources task assignment,\u201d","volume-title":"2010 24th IEEE International Conference on Advanced Information Networking and Applications","author":"Isaias","year":"2010"},{"key":"B22","doi-asserted-by":"publisher","first-page":"28","DOI":"10.55612\/s-5002-038-002","article-title":"University-industry interoperability framework for developing the future competences of industry 4.0","volume":"38","author":"Kusmin","year":"2018","journal-title":"Interact. Design Architect"},{"key":"B23","doi-asserted-by":"crossref","first-page":"788","DOI":"10.1038\/44565","article-title":"Learning the parts of objects by non-negative matrix factorization","volume":"401","author":"Lee","year":"1999","journal-title":"Nature"},{"volume-title":"Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT) Users Manual.","year":"2002","author":"Mayer","key":"B24"},{"key":"B25","doi-asserted-by":"publisher","first-page":"103777","DOI":"10.1016\/j.compedu.2019.103777","article-title":"Adaptive learning path recommender approach using auxiliary learning objects","volume":"147","author":"Nabizadeh","year":"2020","journal-title":"Comput. Educ"},{"key":"B26","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1186\/s40561-021-00160-z","article-title":"A new competency ontology for learning environments personalization","volume":"8","author":"Paquette","year":"2021","journal-title":"Smart Learn. Environ"},{"key":"B27","unstructured":"Improve your Performance PMGS Inc2021"},{"key":"B28","unstructured":"Project Management Institution\u2013Online2023"},{"volume-title":"A Conceptual Framework for Competencies Assessment. In-progress Reflection No. 4 on \u201cCurrent and Critical Issues in the Curriculum and Learning\u201d","year":"2016","author":"Roegiers","key":"B29"},{"key":"B30","doi-asserted-by":"publisher","first-page":"809","DOI":"10.3390\/electronics12040809","article-title":"Deep learning recommendations of e-education based on clustering and sequence","volume":"12","author":"Safarov","year":"2023","journal-title":"Electronics"},{"key":"B31","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1109\/ICSC45622.2019.8938371","article-title":"\u201cFeature extraction: a survey of the types, techniques, applications,\u201d","volume-title":"2019 International Conference on Signal Processing and Communication (ICSC)","author":"Salau","year":"2019"},{"key":"B32","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1037\/0022-3514.86.1.162","article-title":"General mental ability in the world of work: occupational attainment and job performance","volume":"86","author":"Schmidt","year":"2004","journal-title":"J. Personal. Soc. Psychol"},{"key":"B33","doi-asserted-by":"crossref","first-page":"853","DOI":"10.1109\/5.664275","article-title":"Toward multimodal human-computer interface","volume":"86","author":"Sharma","year":"1998","journal-title":"Proc. IEEE"},{"key":"B34","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1080\/10429247.2005.11431667","article-title":"Toward a NASA\u2014specific project management framework","volume":"17","author":"Shenhar","year":"2005","journal-title":"Eng. Manag. J"},{"key":"B35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/ICIC50835.2020.9288580","article-title":"\u201cCompetency evaluation of project manager performance in network construction projects,\u201d","volume-title":"2020 Fifth International Conference on Informatics and Computing (ICIC)","author":"Sitohang","year":"2020"},{"key":"B36","doi-asserted-by":"publisher","first-page":"784","DOI":"10.1016\/j.ijproman.2014.10.013","article-title":"Competency mapping in project management: an action research study in an engineering company","volume":"33","author":"Takey","year":"2015","journal-title":"Int. J. Project Manag"},{"key":"B37","doi-asserted-by":"publisher","first-page":"2811","DOI":"10.1016\/j.procs.2010.08.006","article-title":"Recommender system for predicting student performance","volume":"1","author":"Thai-Nghe","year":"2010","journal-title":"Proc. Comput. Sci"},{"key":"B38","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1155\/2016\/2174613","article-title":"Motivation classification and grade prediction for moocs learners","volume":"2016","author":"Xu","year":"2016","journal-title":"Comput. Intell. Neurosci"},{"key":"B39","doi-asserted-by":"publisher","first-page":"958","DOI":"10.1080\/0144929X.2018.1496276","article-title":"Competence-based recommender systems: a systematic literature review","volume":"37","author":"Yago","year":"2018","journal-title":"Behav. Inform. Technol"},{"key":"B40","doi-asserted-by":"publisher","first-page":"716","DOI":"10.1109\/JSTSP.2017.2700227","article-title":"Behavior-based grade prediction for MOOCs via time series neural networks","volume":"11","author":"Yang","year":"2017","journal-title":"IEEE J. Select. Top. Sign. Process"}],"container-title":["Frontiers in Big Data"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdata.2024.1295009\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,9]],"date-time":"2024-05-09T05:14:13Z","timestamp":1715231653000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdata.2024.1295009\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,9]]},"references-count":40,"alternative-id":["10.3389\/fdata.2024.1295009"],"URL":"https:\/\/doi.org\/10.3389\/fdata.2024.1295009","relation":{},"ISSN":["2624-909X"],"issn-type":[{"type":"electronic","value":"2624-909X"}],"subject":[],"published":{"date-parts":[[2024,5,9]]},"article-number":"1295009"}}