{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,24]],"date-time":"2026-08-24T13:46:48Z","timestamp":1787579208860,"version":"build-2736575974"},"reference-count":29,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,27]],"date-time":"2021-12-27T00:00:00Z","timestamp":1640563200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100005357","name":"Slovak Research and Development Agency","doi-asserted-by":"publisher","award":["APVV-16-0213"],"award-info":[{"award-number":["APVV-16-0213"]}],"id":[{"id":"10.13039\/501100005357","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Slovak Grant Agency of the Ministry of Education and Academy of Science of the Slovak Republic","award":["1\/0685\/21"],"award-info":[{"award-number":["1\/0685\/21"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The article focuses on solving an important problem of detecting suspicious reviewers in online discussions on social networks. We have concentrated on a special type of suspicious authors, on trolls. We have used methods of machine learning for generation of detection models to discriminate a troll reviewer from a common reviewer, but also methods of sentiment analysis to recognize the sentiment typical for troll\u2019s comments. The sentiment analysis can be provided also using machine learning or lexicon-based approach. We have used lexicon-based sentiment analysis for its better ability to detect a dictionary typical for troll authors. We have achieved Accuracy = 0.95 and F1 = 0.80 using sentiment analysis. The best results using machine learning methods were achieved by support vector machine, Accuracy = 0.986 and F1 = 0.988, using a dataset with the set of all selected attributes. We can conclude that detection model based on machine learning is more successful than lexicon-based sentiment analysis, but the difference in accuracy is not so large as in F1 measure.<\/jats:p>","DOI":"10.3390\/s22010155","type":"journal-article","created":{"date-parts":[[2021,12,28]],"date-time":"2021-12-28T01:20:43Z","timestamp":1640654443000},"page":"155","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["Comparison of Machine Learning and Sentiment Analysis in Detection of Suspicious Online Reviewers on Different Type of Data"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7741-4039","authenticated-orcid":false,"given":"Kristina","family":"Machova","sequence":"first","affiliation":[{"name":"Department of Cybernetics and Artificial Intelligence, Faculty of Electrical Engineering and Informatics, Technical University of Ko\u0161ice, Letn\u00e1 9, 04200 Kosice, Slovakia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7612-9204","authenticated-orcid":false,"given":"Marian","family":"Mach","sequence":"additional","affiliation":[{"name":"Department of Cybernetics and Artificial Intelligence, Faculty of Electrical Engineering and Informatics, Technical University of Ko\u0161ice, Letn\u00e1 9, 04200 Kosice, Slovakia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matej","family":"Vasilko","sequence":"additional","affiliation":[{"name":"Department of Cybernetics and Artificial Intelligence, Faculty of Electrical Engineering and Informatics, Technical University of Ko\u0161ice, Letn\u00e1 9, 04200 Kosice, Slovakia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Mutlu, B., Mutlu, M., Oztoprak, K., and Dogdu, E. (2016, January 5\u20138). Identifying Trolls and Determining Terror Awareness Level in Social Networks Using a Scalable Framework. Proceedings of the IEEE International Conference on Big Data, Washington, DC, USA.","DOI":"10.1109\/BigData.2016.7840796"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1109\/MIS.2016.5","article-title":"Suspicious Behavior Detection: Current Trends and Future Direction","volume":"31","author":"Jiang","year":"2016","journal-title":"IEEE Intell. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Bhatt, U., Iyyani, D., Jani, K., and Mali, S. (2018, January 6\u20138). Troll-Detection Systems Limitations of Troll Detective Systems and AI\/ML Anti-trolling Solution. Proceedings of the 3rd International Conference for Convergence in Technology (I2CT), Pune, India.","DOI":"10.1109\/I2CT.2018.8529342"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1109\/MC.2018.3191256","article-title":"The Online Trolling Ecosystem","volume":"51","author":"Berghel","year":"2018","journal-title":"Computer"},{"key":"ref_5","first-page":"1","article-title":"The Crisis of Social Media. Freedom on the Net 2019","volume":"5","author":"Shahbaz","year":"2019","journal-title":"Freedom House J."},{"key":"ref_6","first-page":"42","article-title":"Supervised Machine Learning for Detection of Troll profiles in Twitter Social Network: Application to a Real Case of Cyberbullying","volume":"24","author":"Santos","year":"2016","journal-title":"Log. J. IGPL"},{"key":"ref_7","unstructured":"Skowronski, J. (2019). Identifying Trolls and Bots on Reddit with Machine Learning. Towards Data Science, Towards Data Science. Available online: https:\/\/towardsdatascience.com\/identifying-trolls-and-bots-on-reddit-with-machine-learning-709da5970af1."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Chun, S.A., Holowdzak, R., Dharan, K.N., Wang, R., Basu, S., and Geller, J. (2019, January 18\u201320). Detecting Political Bias Trolls in Twitter Data. Proceedings of the 15th International Conference on Web Information Systems and Technologies (WEBIST 2019), Vienna, Austria.","DOI":"10.5220\/0008350300002366"},{"key":"ref_9","unstructured":"Weller, H., and Woo, J. (2019). Identifying Russian Trolls on Reddit with Deep Learning and BERT Word Embeddings. Comput. Sci., 1\u201311."},{"key":"ref_10","first-page":"1","article-title":"A Novel Context-aware Multimodal Framework for Persian Sentiment Analysis","volume":"2103","author":"Dashtipour","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.neucom.2019.10.009","article-title":"A Hybrid Persian Sentiment Analysis Framework: Integrating Dependency Grammar Based Rules and Deep Neural Networks","volume":"380","author":"Dashtipour","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2021\/9923374","article-title":"Fast Detection of Deceptive Reviews by Combining the Time Series and Machine Learning","volume":"2021","author":"Zhong","year":"2021","journal-title":"Complexity"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"102658","DOI":"10.1016\/j.ijhm.2020.102658","article-title":"Identifying Unreliable Online Hospitality Reviews with Biased User-given Ratings: A Deep Learning Forecasting Approach","volume":"92","author":"Zheng","year":"2021","journal-title":"Int. J. Hosp. Manag."},{"key":"ref_14","first-page":"18","article-title":"K-nearest Neighbor Based URL Identification Model for Phishing Attack Detection","volume":"1","author":"Assegie","year":"2021","journal-title":"Indian J. Artif. Intell. Neural Netw."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1007\/s10618-020-00725-5","article-title":"Detecting Singleton Spams in Reviews via Learning Deep Anomalous Temporal Aspect-sentiment Patterns","volume":"35","author":"Shaalan","year":"2021","journal-title":"Data Min. Knowl. Discov."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"105685","DOI":"10.1016\/j.knosys.2020.105685","article-title":"Monitoring Online Reviews for Reputation Fraud Campaigns","volume":"195","author":"Wang","year":"2020","journal-title":"Knowl.-Based Syst."},{"key":"ref_17","unstructured":"Ma, L., Huang, M., Yang, S., Wang, R., and Wang, X. (2021). An Adaptive Localized Decision Variable Analysis Approach to Large-Scale Multi-objective and Many-objective Optimization. IEEE Trans. Cybern., 1\u201313."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Machova, K., Mach, M., and Demkova, G. (2020). Modelling of the Fake Posting Recognition in On-line Media Using Machine Learning. Proceedings of the International Conference on Current Trends in Theory and Practice of Informatics (SOFSEM 2020), Limassol, Cyprus, 20\u201324 January 2020, Springer.","DOI":"10.1007\/978-3-030-38919-2_56"},{"key":"ref_19","unstructured":"Machova, K., and Kolesar, D. (2019). Recognition of Antisocial Behavior in Online Discussions. Information Systems Architecture and Technology, Proceedings of the 40th Anniversary International Conference on Information Systems Architecture and Technology (ISAT 2019), Wroclaw, Poland, 15\u201317 September 2019, Springer."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Maslej-Kre\u0161\u0148\u00e1kov\u00e1, V., Sarnovsk\u00fd, M., Butka, P., and Machova, K. (2020). Comparison of Deep Learning Models and Various Text Pre-Processing Techniques for the Toxic Comments Classification. Appl. Sci., 10.","DOI":"10.3390\/app10238631"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Hastie, T., Tibshirani, R., and Friedman, J.H. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Springer.","DOI":"10.1007\/978-0-387-84858-7"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"James, G., Witten, D., Hastie, T., and Tibshirani, R. (2014). An Introduction to Statistical Learning\u2014With Applications in R., Springer.","DOI":"10.1007\/978-1-4614-7138-7"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1001","DOI":"10.1038\/nbt0908-1011","article-title":"What Are Decision Trees?","volume":"26","author":"Kingsford","year":"2008","journal-title":"Nat. Biotechnol."},{"key":"ref_24","first-page":"143","article-title":"Generalization and network design strategies","volume":"19","author":"LeCun","year":"1989","journal-title":"Connect. Perspect."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Kandasamy, V., Trojovsk\u00fd, P., Machot, F.A., Kyamakya, K., Bacanin, N., Askar, S., and Abouhawwash, M. (2021). Sentimental Analysis of COVID-19 Related Messages in Social Networks by Involving an N-Gram Stacked Autoencoder Integrated in an Ensemble Learning Scheme. Sensors, 21.","DOI":"10.3390\/s21227582"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Dang, C.N., Moreno-Garcia, M.N., and De la Prieta, F. (2021). An Approach to Integrating Sentiment Analysis into Recommender Systems. Sensors, 21.","DOI":"10.20944\/preprints202107.0070.v1"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Jiang, Z., Di Troia, F., and Stamp, M. (2021). Sentiment Analysis for Troll Detection on Weibo. Malware Analysis Using Artificial Intelligence and Deep Learning, Springer.","DOI":"10.1007\/978-3-030-62582-5_22"},{"key":"ref_28","unstructured":"Jansson, F., and Casselryd, O. (2018). Troll Detection with Sentiment Analysis and Nearest Neighbor Search. [Bachelor\u2019s Thesis, KTH]."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Machova, K., Mikula, M., Gao, X., and Mach, M. (2020). Lexicon-based Sentiment Analysis Using the Particle Swarm Optimization. Electronics, 9.","DOI":"10.3390\/electronics9081317"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/1\/155\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:54:11Z","timestamp":1760169251000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/1\/155"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,27]]},"references-count":29,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["s22010155"],"URL":"https:\/\/doi.org\/10.3390\/s22010155","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,27]]}}}