{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,25]],"date-time":"2026-07-25T00:20:30Z","timestamp":1784938830395,"version":"3.55.0"},"reference-count":45,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2021,5,31]],"date-time":"2021-05-31T00:00:00Z","timestamp":1622419200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>The proposed paper introduces an innovative methodology useful to assign intelligent scores to web pages. The approach is based on the simultaneous use of User eXperience (UX), Artificial Neural Network (ANN), and Long Short-Term Memory (LSTM) algorithms, providing the web page scoring and taking into account outlier conditions to construct the training dataset. Specifically, the UX tool analyses different parameters addressing the score, such as navigation time, number of clicks, and mouse movements for page, finding possible outliers, the ANN are able to predict outliers, and the LSTM processes the web pages tags together with UX and user scores. The final web page score is assigned by the LSTM model corrected by the UX output and improved by the navigation user score. This final score is useful for the designer by suggesting the tags typologies structuring a new web page layout of a specific topic. By using the proposed methodology, the web designer is addressed to allocate contents in the web page layout. The work has been developed within a framework of an industry project oriented on the formulation of an innovative AI interface for web designers.<\/jats:p>","DOI":"10.3390\/fi13060145","type":"journal-article","created":{"date-parts":[[2021,5,31]],"date-time":"2021-05-31T21:42:06Z","timestamp":1622497326000},"page":"145","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["An Innovative Approach for the Evaluation of the Web Page Impact Combining User Experience and Neural Network Score"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1744-783X","authenticated-orcid":false,"given":"Alessandro","family":"Massaro","sequence":"first","affiliation":[{"name":"Dyrecta Lab, Research Institute, 70014 Conversano, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniele","family":"Giannone","sequence":"additional","affiliation":[{"name":"Dyrecta Lab, Research Institute, 70014 Conversano, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vitangelo","family":"Birardi","sequence":"additional","affiliation":[{"name":"Dyrecta Lab, Research Institute, 70014 Conversano, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Angelo Maurizio","family":"Galiano","sequence":"additional","affiliation":[{"name":"Dyrecta Lab, Research Institute, 70014 Conversano, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Gonzalez-Rodriguez, M., Diez-Diaz, F., and Vidau, A. (2007, January 22\u201327). Remote navigability testing using data gathering agents. Proceedings of the 4th International Conference on Universal Access in Human Computer Interaction (UAHCI), Beijing, China.","DOI":"10.1007\/978-3-540-73283-9_4"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Obendorf, H., Weinreich, H., and Hass, T. (2004, January 24\u201329). Automatic support for web user studies with SCONE and TEA. Proceedings of the Conference on Human Factors in Computing Systems (CHI), Vienna, Austria.","DOI":"10.1145\/985921.986007"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ivory, M., and Hearst, M. (2002, January 20\u201325). Statistical profiles of highly-rated web sites. Proceedings of the Conference on Human Factors in Computing Systems (CHI), Minneapolis, MN, USA.","DOI":"10.1145\/503376.503442"},{"key":"ref_4","unstructured":"Katsanos, C., Tselios, N., and Avouris, N. (2006, January 20\u201324). InfoScent evaluator: A semi-automated tool to evaluate semantic appropriateness of hyperlinks in a web site. Proceedings of the OZCHI 2006, Sydney, Australia."},{"key":"ref_5","first-page":"47","article-title":"Webuse: Website usability evaluation tool","volume":"16","author":"Chiew","year":"2003","journal-title":"Malays. J. Comp. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Cybulski, P., and Horbi\u0144ski, T. (2020). User Experience in Using Graphical User Interfaces of Web Maps. ISPRS Int. J. Geo-Inf., 9.","DOI":"10.3390\/ijgi9070412"},{"key":"ref_7","first-page":"13","article-title":"Intelligent Real-time 3D Configuration Platform for Customizing E-commerce Products","volume":"9","author":"Massaro","year":"2019","journal-title":"Int. J. Comp. Grsph. Animat. (IJCGA)"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Atterer, R., Wnuk, M., and Schmidt, A. (2006, January 22). Knowing the user\u2019s every move\u2014User activity tracking for website usability evaluation and implicit interaction. Proceedings of the International World Wide Web Conference Committee (IW3C2), Edinburgh, Scotland.","DOI":"10.1145\/1135777.1135811"},{"key":"ref_9","unstructured":"Liu, L., Chen, J., and Song, H. (2002, January 10\u201314). The Research of web mining. Proceedings of the 4th World Congress on Intelligent Control and Automation, Shanghai, China."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1163","DOI":"10.1109\/TNN.2002.1031947","article-title":"Web Mining in soft computing framework: Relevance, state of the art and future directions","volume":"13","author":"Pal","year":"2002","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Filippi, S. (2020). PERSEL, a Ready-to-Use PERsonality-Based User SELection Tool to Maximize User Experience Redesign Effectiveness. Multimodal Technol. Interact., 4.","DOI":"10.3390\/mti4020013"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Alonso-Virg\u00f3s, L., Rodr\u00edguez Baena, L., Pascual Espada, J., and Gonz\u00e1lez Crespo, R. (2018). Web Page Design Recommendations for People with Down Syndrome Based on Users\u2019 Experiences. Sensors, 18.","DOI":"10.3390\/s18114047"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Oyibo, K., and Vassileva, J. (2020). The Effect of Layout and Colour Temperature on the Perception of Tourism Websites for Mobile Devices. Multimodal Technol. Interact., 4.","DOI":"10.3390\/mti4010008"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/j.procs.2019.06.011","article-title":"Web Page Classification Using RNN","volume":"154","author":"Buber","year":"2019","journal-title":"Proc. Comp. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1016\/j.eswa.2005.09.079","article-title":"Web page Classification based on a Support Vector Machine using a Weighted Vote Schema","volume":"31","author":"Chen","year":"2006","journal-title":"Exp. Syst. Appl."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1109\/TKDE.2018.2839599","article-title":"Webpage Depth Viewability Prediction Using Deep Sequential Neural Networks","volume":"31","author":"Wang","year":"2019","journal-title":"IEEE Trans. Know. Data Eng."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Spiliotopoulos, K., Rigou, M., and Sirmakessis, S. (2018). A Comparative Study of Skeuomorphic and Flat Design from a UX Perspective. Multimodal Technol. Interact., 2.","DOI":"10.3390\/mti2020031"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Khrais, L.T. (2020). Role of Artificial Intelligence in Shaping Consumer Demand in E-Commerce. Future Internet, 12.","DOI":"10.3390\/fi12120226"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Li, R., and Sun, T. (2020). Assessing Factors for Designing a Successful B2C E-Commerce Website Using Fuzzy AHP and TOPSIS-Grey Methodology. Symmetry, 12.","DOI":"10.3390\/sym12030363"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Chaudhary, N., and Roy Chowdhury, D. (2019). Data Preprocessing for Evaluation of Recommendation Models in E-Commerce. Data, 4.","DOI":"10.20944\/preprints201901.0294.v2"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Saura, J.R., Palos-S\u00e1nchez, P., and Cerd\u00e1 Su\u00e1rez, L.M. (2017). Understanding the Digital Marketing Environment with KPIs and Web Analytics. Future Internet, 9.","DOI":"10.3390\/fi9040076"},{"key":"ref_22","unstructured":"Kaushik, A. (2009). Web Analytics 2.0: The Art of Online Accountability and Science of Customer Centricity, John Wiley & Sons."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Veglis, A., and Giomelakis, D. (2020). Search Engine Optimization. Future Internet, 12.","DOI":"10.3390\/fi12010006"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"L\u00f3pez Garc\u00eda, J.J., Lizcano, D., Ramos, C.M., and Matos, N. (2019). Digital Marketing Actions That Achieve a Better Attraction and Loyalty of Users: An Analytical Study. Future Internet, 11.","DOI":"10.3390\/fi11060130"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Huang, G., Chen, Q., and Deng, C. (2020). A New Click-Through Rates Prediction Model Based on Deep&Cross Network. Algorithms, 13.","DOI":"10.3390\/a13120342"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1016\/j.indmarman.2006.11.001","article-title":"Measurement of return on marketing investment: A conceptual framework and the future of marketing metrics","volume":"36","author":"Seggie","year":"2017","journal-title":"Ind. Mark. Manag."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.acalib.2013.06.005","article-title":"The suitability of web analytics key performance indicators in the academic library environment","volume":"40","author":"Fagan","year":"2014","journal-title":"J. Acad. Librariansh."},{"key":"ref_28","first-page":"1","article-title":"Using web traffic analysis for customer acquisition and retention programs in marketing","volume":"26","author":"Wilson","year":"2004","journal-title":"Serv. Mark. Q."},{"key":"ref_29","unstructured":"Booth, D., and Jansen, B.J. (2010). A Review of Methodologies for Analyzing Websites. Web Technologies: Concepts, Methodologies, Tools, and Applications, IGI Global."},{"key":"ref_30","unstructured":"Toleu, A., Makazhanov, A., and Tolegen, G. (2017, January 18\u201321). Character-based Deep Learning Models for Token and Sentence Segmentation. Proceedings of the 5th International Conference on Turkic Languages Processing (TurkLang)."},{"key":"ref_31","unstructured":"(2021, February 05). Keras. Available online: https:\/\/keras.io\/."},{"key":"ref_32","unstructured":"(2021, February 04). User Behavior Library. Available online: https:\/\/github.com\/shnere\/user-behavior."},{"key":"ref_33","first-page":"39","article-title":"Data Mining Model Performance of Sales Predictive Algorithms Based on RapiMiner Workflow","volume":"10","author":"Massaro","year":"2018","journal-title":"Int. J. Comp. Sci. Inf. Technol. (IJCSIT)"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Yi, D., Ahn, J., and Ji, S. (2020). An Effective Optimization Method for Machine Learning Based on ADAM. Appl. Sci., 10.","DOI":"10.3390\/app10031073"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Lee, S., and Chung, J.Y. (2019). The Machine Learning-Based Dropout Early Warning System for Improving the Performance of Dropout Prediction. Appl. Sci., 9.","DOI":"10.3390\/app9153093"},{"key":"ref_36","first-page":"1","article-title":"Model of Multiple Artificial Neural Networks oriented on Sales Prediction and Product Shelf Design","volume":"7","author":"Massaro","year":"2018","journal-title":"Int. J. Soft Comput. Artif. Intell. Appl. (IJSCAI)"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Wang, B., Ye, F., and Xu, J. (2018). A Personalized Recommendation Algorithm Based on the User\u2019s Implicit Feedback in E-Commerce. Future Internet, 10.","DOI":"10.3390\/fi10120117"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Alsulami, M.M., and Al-Aama, A.Y. (2020). Employing Behavioral Analysis to Predict User Attitude towards Unwanted Content in Online Social Network Services: The Case of Makkah Region in Saudi Arabia. Computers, 9.","DOI":"10.3390\/computers9020034"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Yu, X., Li, M., Kim, K.A., Chung, J., and Ryu, K.H. (2016). Emerging Pattern-Based Clustering of Web Users Utilizing a Simple Page-Linked Graph. Sustainability, 8.","DOI":"10.3390\/su8030239"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Mato\u0161evi\u0107, G., Dob\u0161a, J., and Mladeni\u0107, D. (2021). Using Machine Learning for Web Page Classification in Search Engine Optimization. Future Internet, 13.","DOI":"10.3390\/fi13010009"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"839","DOI":"10.1109\/TII.2020.3007152","article-title":"Deep Recurrent Entropy Adaptive Model for System Reliability Monitoring","volume":"17","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1177\/0018720819881008","article-title":"Memory Pattern Identification for Feedback Tracking Control in Human\u2013Machine Systems","volume":"63","author":"Zhang","year":"2021","journal-title":"Hum. Factors"},{"key":"ref_43","unstructured":"Reinecke, K., Yeh, T., Miratrix, L., Mardiko, R., Zhao, Y., Liu, J., and Gajos, K.Z. (May, January 27). Predicting Users\u2019 First Impressions of Website Aesthetics with a Quantification of Perceived Visual Complexity and Colorfulness. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI\u201913), Paris, France."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1016\/j.compositesb.2016.03.066","article-title":"Analytical Model based on Artificial Neural Network for Masonry Shear Walls Strengthned with FRM Systems","volume":"95","author":"Cascardi","year":"2016","journal-title":"Compos. Part B Eng."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Massaro, A., Maritati, V., Giannone, D., Convertini, D., and Galiano, A. (2019). LSTM DSS Automatism and Dataset Optimization for Diabetes Prediction. Appl. Sci., 9.","DOI":"10.3390\/app9173532"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/13\/6\/145\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:09:24Z","timestamp":1760162964000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/13\/6\/145"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,31]]},"references-count":45,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["fi13060145"],"URL":"https:\/\/doi.org\/10.3390\/fi13060145","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,31]]}}}