{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,15]],"date-time":"2026-06-15T14:37:34Z","timestamp":1781534254152,"version":"3.54.5"},"reference-count":38,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T00:00:00Z","timestamp":1775001600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"University of Jeddah, Jeddah, Saudi Arabia","award":["UJ-24-DR-1290-1"],"award-info":[{"award-number":["UJ-24-DR-1290-1"]}]},{"award":["UJ-24-DR-1290-1"],"award-info":[{"award-number":["UJ-24-DR-1290-1"]}],"id":[{"id":"https:\/\/ror.org\/015ya8798","id-type":"ROR","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>This work addresses critical challenges to academic integrity, including plagiarism, fabrication, and verification of authorship of educational content, by proposing a Natural Language Processing (NLP)-based framework for authenticating students\u2019 content through author attribution and style change detection. Despite some initial efforts, several aspects of the topic are yet to be explored. In contrast to existing solutions, the paper provides a comprehensive analyzis of the topic by targeting four relevant tasks, including (i) classification of human and machine text, (ii) differentiating in single and multi-authored documents, (iii) author change detection within multi-authored documents, and (iv) author recognition in collaboratively produced documents. The solutions proposed for the tasks are evaluated on two datasets generated with Gemini using two different prompts, including a normal and a strict set of instructions. During experiments, some performance reduction is observed for the proposed solutions on the dataset generated by the strict prompt, demonstrating the complexities involved in detecting machine-generated text with cleverly crafted prompts. The generated datasets, code, and other relevant materials are made publicly available on GitHub, which are expected to provide a baseline for future research in the domain.<\/jats:p>","DOI":"10.3390\/computers15040217","type":"journal-article","created":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T14:59:01Z","timestamp":1775055541000},"page":"217","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Stylometry Analyzis of Human and Machine Text for Academic Integrity"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4404-9204","authenticated-orcid":false,"given":"Hezam","family":"Albaqami","sequence":"first","affiliation":[{"name":"Department of Computer Science and Artificial Intelligence, College of Computer Science and Engineering, University of Jeddah, Jeddah 21493, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Muhammad Asif","family":"Ayub","sequence":"additional","affiliation":[{"name":"Department of Computer Systems Engineering, University of Engineering and Technology, Peshawar 25120, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nasir","family":"Ahmad","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Munster Technological University, T12 P928 Cork, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yaseen","family":"Ahmad","sequence":"additional","affiliation":[{"name":"Department of Computer Systems Engineering, University of Engineering and Technology, Peshawar 25120, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9403-1286","authenticated-orcid":false,"given":"Mohammad M.","family":"Alqahtani","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Artificial Intelligence, College of Computer Science and Engineering, University of Jeddah, Jeddah 21493, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9828-0335","authenticated-orcid":false,"given":"Abdullah M.","family":"Algamdi","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Artificial Intelligence, College of Computer Science and Engineering, University of Jeddah, Jeddah 21493, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9519-4439","authenticated-orcid":false,"given":"Almoaid A.","family":"Owaidah","sequence":"additional","affiliation":[{"name":"Department of Management Information Systems, Faculty of Economics and Administration, King Abdulaziz University, P.O. Box 80200, Jeddah 21589, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kashif","family":"Ahmad","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Munster Technological University, T12 P928 Cork, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,4,1]]},"reference":[{"key":"ref_1","first-page":"6","article-title":"Distinguishing Human from Machine: A Review of Advances and Challenges in AI-Generated Text Detection","volume":"9","author":"Fariello","year":"2025","journal-title":"Int. J. Interact. Multimed. Artif. Intell."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"30","DOI":"10.53623\/apga.v3i1.337","article-title":"Academic integrity in higher education: Understanding and addressing plagiarism","volume":"3","author":"Mulenga","year":"2024","journal-title":"Acta Pedagog. Asiana"},{"key":"ref_3","unstructured":"Jones, B., Luger, E., and Jones, R. (2023). Generative AI & Journalism: A Rapid Risk-Based Review, University of Edinburgh."},{"key":"ref_4","first-page":"1338","article-title":"When art meets technology or vice versa: Key challenges at the crossroads of AI-generated artworks and copyright law","volume":"52","year":"2021","journal-title":"IIC-Int. Rev. Intellect. Prop. Compet. Law"},{"key":"ref_5","unstructured":"Silva, E.C.d.M., and Vaz, J.C. (2024). How disinformation and fake news impact public policies?: A review of international literature. arXiv."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"103144","DOI":"10.1016\/j.ijdrr.2022.103144","article-title":"Infodemic and fake news \u2013 A comprehensive overview of its global magnitude during the COVID-19 pandemic in 2021: A scoping review","volume":"78","author":"Balakrishnan","year":"2022","journal-title":"Int. J. Disaster Risk Reduct."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zhou, Y., He, B., and Sun, L. (2024, January 20\u201325). Humanizing machine-generated content: Evading AI-text detection through adversarial attack. Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), Turin, Italy.","DOI":"10.63317\/5ocyse7sux8y"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"6479","DOI":"10.1007\/s00521-024-10966-w","article-title":"Stylometry-driven framework for Urdu intrinsic plagiarism detection: A comprehensive analyzis using machine learning, deep learning, and large language models","volume":"37","author":"Manzoor","year":"2025","journal-title":"Neural Comput. Appl."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"140519","DOI":"10.1109\/ACCESS.2023.3338855","article-title":"Exploring the landscape of intrinsic plagiarism detection: Benchmarks, techniques, evolution, and challenges","volume":"11","author":"Manzoor","year":"2023","journal-title":"IEEE Access"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"37","DOI":"10.17081\/just.26.39.4818","article-title":"Academic honesty: Current status and ways of improvement","volume":"26","author":"Shapoval","year":"2021","journal-title":"Justicia"},{"key":"ref_11","first-page":"4","article-title":"Trust as a foundation for ethics and integrity in educational contexts","volume":"13","author":"Eaton","year":"2025","journal-title":"Crit. Stud. Teach. Learn."},{"key":"ref_12","unstructured":"Fundamental, T. (1999). Values of Academic Integrity, The Center for Academic Integrity."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1007\/s10805-014-9209-z","article-title":"The role of virtue ethics principles in academic integrity breach decision-making","volume":"12","author":"Bretag","year":"2014","journal-title":"J. Acad. Ethics"},{"key":"ref_14","first-page":"101299","article-title":"Reassessing academic integrity in the age of AI: A systematic literature review on AI and academic integrity","volume":"11","author":"Balalle","year":"2025","journal-title":"Soc. Sci. Humanit. Open"},{"key":"ref_15","first-page":"151","article-title":"Are AI detection and plagiarism similarity scores worthwhile in the age of ChatGPT and other Generative AI?","volume":"8","author":"Baron","year":"2024","journal-title":"Scholarsh. Teach. Learn. South (SOTL) South"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1002\/tl.20624","article-title":"Generative AI detection in higher education assessments","volume":"2025","author":"Ardito","year":"2025","journal-title":"New Dir. Teach. Learn."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1007\/s40979-023-00140-5","article-title":"Evaluating the efficacy of AI content detection tools in differentiating between human and AI-generated text","volume":"19","author":"Elkhatat","year":"2023","journal-title":"Int. J. Educ. Integr."},{"key":"ref_18","first-page":"91","article-title":"AI vs AI: How effective are Turnitin, ZeroGPT, GPTZero, and Writer AI in detecting text generated by ChatGPT, Perplexity, and Gemini?","volume":"8","author":"Malik","year":"2025","journal-title":"J. Appl. Learn. Teach."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Michailidis, P.D. (2022). A scientometric study of the stylometric research field. Informatics, 9.","DOI":"10.3390\/informatics9030060"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zamir, M.T., Ayub, M.A., Khan, J., Ikram, M.J., Ahmad, N., and Ahmad, K. (2023). Document provenance and authentication through authorship classification. Proceedings of the 2023 1st International Conference on Advanced Innovations in Smart Cities (ICAISC), IEEE.","DOI":"10.1109\/ICAISC56366.2023.10085330"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3756","DOI":"10.1016\/j.eswa.2012.12.082","article-title":"Text mining applied to plagiarism detection: The use of words for detecting deviations in the writing style","volume":"40","author":"Oberreuter","year":"2013","journal-title":"Expert Syst. Appl."},{"key":"ref_22","unstructured":"Zamir, M.T., Ayub, M.A., Gul, A., Ahmad, N., and Ahmad, K. (2024). Stylometry analyzis of multi-authored documents for authorship and author style change detection. arXiv."},{"key":"ref_23","unstructured":"Zangerle, E., Mayerl, M., Tschuggnall, M., Potthast, M., and Stein, B. (2021, January 21\u201324). Pan21 Authorship analyzis: Style Change Detection. Proceedings of the CEUR Workshop Proceedings, Bucharest, Romania."},{"key":"ref_24","unstructured":"Str\u00f8m, E. (2021, January 21\u201324). Multi-label Style Change Detection by Solving a Binary Classification Problem. Proceedings of the CLEF 2021\u2014Conference and Labs of the Evaluation Forum, Bucharest, Romania."},{"key":"ref_25","unstructured":"Kestemont, M., Tschuggnall, M., Stamatatos, E., Daelemans, W., Specht, G., Stein, B., and Potthast, M. (2018, January 10\u201314). Overview of the author identification task at PAN-2018: Cross-domain authorship attribution and style change detection. Proceedings of the Working Notes Papers of the CLEF 2018 Evaluation Labs, Avignon, France."},{"key":"ref_26","unstructured":"Zangerle, E., Mayerl, M., Potthast, M., and Stein, B. (2020). Overview of the Style Change Detection Task at PAN 2020. CLEF (Work. Notes), 93."},{"key":"ref_27","unstructured":"Kumarage, T., Garland, J., Bhattacharjee, A., Trapeznikov, K., Ruston, S., and Liu, H. (2023). Stylometric detection of ai-generated text in twitter timelines. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Opara, C. (2024). StyloAI: Distinguishing AI-generated content with stylometric analyzis. Proceedings of the International Conference on Artificial Intelligence in Education, Springer.","DOI":"10.1007\/978-3-031-64312-5_13"},{"key":"ref_29","unstructured":"Fabien, M., Villatoro-Tello, E., Motlicek, P., and Parida, S. (2020, January 18\u201321). BertAA: BERT fine-tuning for Authorship Attribution. Proceedings of the 17th International Conference on Natural Language Processing (ICON), Patna, India."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Almutairi, A., Kang, B., and Al Hashimy, N. (2023). Bibert-av: Enhancing authorship verification through siamese networks with pre-trained bert and bi-lstm. Proceedings of the International Conference on Ubiquitous Security, Springer.","DOI":"10.1007\/978-981-97-1274-8_2"},{"key":"ref_31","unstructured":"Grootendorst, M. (2022). BERTopic: Neural topic modeling with a class-based TF-IDF procedure. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3462478","article-title":"Topic modeling using latent Dirichlet allocation: A survey","volume":"54","author":"Chauhan","year":"2021","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_33","first-page":"535","article-title":"Algorithms for non-negative matrix factorization","volume":"13","author":"Lee","year":"2000","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1613\/jair.953","article-title":"SMOTE: Synthetic minority over-sampling technique","volume":"16","author":"Chawla","year":"2002","journal-title":"J. Artif. Intell. Res."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1145\/1007730.1007735","article-title":"A study of the behavior of several methods for balancing machine learning training data","volume":"6","author":"Batista","year":"2004","journal-title":"ACM SIGKDD Explor. Newsl."},{"key":"ref_36","unstructured":"He, H., Bai, Y., Garcia, E.A., and Li, S. (2008). ADASYN: Adaptive synthetic sampling approach for imbalanced learning. Proceedings of the 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), IEEE."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Nayan, N.M., Islam, A., Islam, M.U., Ahmed, E., Hossain, M.M., and Alam, M.Z. (2023). Smote oversampling and near miss undersampling based diabetes diagnosis from imbalanced dataset with xai visualization. Proceedings of the 2023 IEEE Symposium on Computers and Communications (ISCC), IEEE.","DOI":"10.1109\/ISCC58397.2023.10218281"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1007\/978-981-96-5123-8_20","article-title":"Japanese Author Attribution Using BERT Finetuning with Stylometric","volume":"Volume 2395","author":"Konuma","year":"2025","journal-title":"Intelligent Multilingual Information Processing: First International Conference, IMLIP 2024, Beijing, China, 16\u201317 November 2024, Proceedings"}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/15\/4\/217\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T15:06:38Z","timestamp":1775055998000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/15\/4\/217"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,1]]},"references-count":38,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2026,4]]}},"alternative-id":["computers15040217"],"URL":"https:\/\/doi.org\/10.3390\/computers15040217","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,1]]}}}