{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T19:34:50Z","timestamp":1767209690865,"version":"build-2238731810"},"posted":{"date-parts":[[2019,3,12]]},"group-title":"PeerJ Preprints","reference-count":0,"publisher":"PeerJ","license":[{"start":{"date-parts":[[2019,3,12]],"date-time":"2019-03-12T00:00:00Z","timestamp":1552348800000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:p>\n                  <jats:bold>Background.<\/jats:bold>\n                  The 2010 reform of the Italian university system introduced the National Scientific Habilitation (ASN) as a requirement for applying to permanent professor positions. Since the CVs of the 59149 candidates and the results of their assessments have been made publicly available, the ASN constitutes an opportunity to perform analyses about a nation-wide evaluation process.\n                <\/jats:p>\n                <jats:p>\n                  <jats:bold>Objective.<\/jats:bold>\n                  The main goals of this paper are: (i) predicting the ASN results using the information contained in the candidates\u2019 CVs; (ii) identifying a small set of quantitative indicators that can be used to perform accurate predictions.\n                <\/jats:p>\n                <jats:p>\n                  <jats:bold>Approach.<\/jats:bold>\n                  Semantic technologies are used to extract, systematize and enrich the information contained in the applicants\u2019 CVs, and machine learning methods are used to predict the ASN results and to identify a subset of relevant predictors.\n                <\/jats:p>\n                <jats:p>\n                  <jats:bold>Results.<\/jats:bold>\n                  For predicting the success in the role of associate professor, our best models using all and the top 15 predictors make accurate predictions (F-measure values higher than 0.6) in 88% and 88.6% of the cases, respectively. Similar results have been achieved for the role of full professor.\n                <\/jats:p>\n                <jats:p>\n                  <jats:bold>Evaluation.<\/jats:bold>\n                  The proposed approach outperforms the other models developed to predict the results of researchers\u2019 evaluation procedures.\n                <\/jats:p>\n                <jats:p>\n                  <jats:bold>Conclusions.<\/jats:bold>\n                  Such results allow the development of an automated system for supporting both candidates and committees in the future ASN sessions and other scholars\u2019 evaluation procedures.\n                <\/jats:p>","DOI":"10.7287\/peerj.preprints.27582v1","type":"posted-content","created":{"date-parts":[[2019,3,12]],"date-time":"2019-03-12T15:22:01Z","timestamp":1552404121000},"source":"Crossref","is-referenced-by-count":0,"title":["Predicting the results of evaluation procedures of academics"],"prefix":"10.7287","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6577-5606","authenticated-orcid":true,"given":"Francesco","family":"Poggi","sequence":"first","affiliation":[{"name":"Computer Science and Engineering - DISI, Universit\u00e0 di Bologna, Bologna, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paolo","family":"Ciancarini","sequence":"additional","affiliation":[{"name":"Computer Science and Engineering - DISI, Universit\u00e0 di Bologna, Bologna, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5568-2684","authenticated-orcid":true,"given":"Aldo","family":"Gangemi","sequence":"additional","affiliation":[{"name":"Department of Classical Philology and Italian Studies, University of Bologna, Bologna, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2928-9496","authenticated-orcid":true,"given":"Andrea Giovanni","family":"Nuzzolese","sequence":"additional","affiliation":[{"name":"STLab, Institute of Cognitive Science and Technologies, National Research Council, Roma, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0530-4305","authenticated-orcid":true,"given":"Silvio","family":"Peroni","sequence":"additional","affiliation":[{"name":"Department of Classical Philology and Italian Studies, University of Bologna, Bologna, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9380-5160","authenticated-orcid":true,"given":"Valentina","family":"Presutti","sequence":"additional","affiliation":[{"name":"STLab, Institute of Cognitive Science and Technologies, National Research Council, Roma, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"4443","container-title":[],"original-title":[],"link":[{"URL":"https:\/\/peerj.com\/preprints\/27582v1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/preprints\/27582v1.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/preprints\/27582v1.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/preprints\/27582v1.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,12,23]],"date-time":"2019-12-23T20:30:37Z","timestamp":1577133037000},"score":1,"resource":{"primary":{"URL":"https:\/\/peerj.com\/preprints\/27582v1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,12]]},"references-count":0,"aliases":["10.7287\/peerj.preprints.27582"],"URL":"https:\/\/doi.org\/10.7287\/peerj.preprints.27582v1","relation":{},"subject":[],"published":{"date-parts":[[2019,3,12]]},"subtype":"preprint"}}