{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,21]],"date-time":"2026-07-21T02:01:55Z","timestamp":1784599315570,"version":"3.55.0"},"reference-count":49,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2022,6,29]],"date-time":"2022-06-29T00:00:00Z","timestamp":1656460800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>With the improvement of intelligence and interconnection, Internet of Things (IoT) devices tend to become more vulnerable and exposed to many threats. Device identification is the foundation of many cybersecurity operations, such as asset management, vulnerability reaction, and situational awareness, which are important for enhancing the security of IoT devices. The more information sources and the more angles of view we have, the more precise identification results we obtain. This study proposes a novel and alternative method for IoT device identification, which introduces commonly available WebUI login pages with distinctive characteristics specific to vendors as the data source and uses an ensemble learning model based on a combination of Convolutional Neural Networks (CNN) and Deep Neural Networks (DNN) for device vendor identification and develops an Optical Character Recognition (OCR) based method for device type and model identification. The experimental results show that the ensemble learning model can achieve 99.1% accuracy and 99.5% F1-Score in the determination of whether a device is from a vendor that appeared in the training dataset, and if the answer is positive, 98% accuracy and 98.3% F1-Score in identifying which vendor it is from. The OCR-based method can identify fine-grained attributes of the device and achieve an accuracy of 99.46% in device model identification, which is higher than the results of the Shodan cyber search engine by a considerable margin of 11.39%.<\/jats:p>","DOI":"10.3390\/s22134892","type":"journal-article","created":{"date-parts":[[2022,6,29]],"date-time":"2022-06-29T03:26:37Z","timestamp":1656473197000},"page":"4892","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["WYSIWYG: IoT Device Identification Based on WebUI Login Pages"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8899-2478","authenticated-orcid":false,"given":"Ruimin","family":"Wang","sequence":"first","affiliation":[{"name":"State Key Laboratory of Mathematical Engineering and Advanced Computing, Zhengzhou 450000, China"},{"name":"Key Laboratory of Cyberspace Situation Awareness of Henan Province, Zhengzhou 450000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haitao","family":"Li","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Mathematical Engineering and Advanced Computing, Zhengzhou 450000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jing","family":"Jing","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Mathematical Engineering and Advanced Computing, Zhengzhou 450000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liehui","family":"Jiang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Mathematical Engineering and Advanced Computing, Zhengzhou 450000, China"},{"name":"Key Laboratory of Cyberspace Situation Awareness of Henan Province, Zhengzhou 450000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weiyu","family":"Dong","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Mathematical Engineering and Advanced Computing, Zhengzhou 450000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,6,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Hariri, A.Y., Giannelos, N., and Arief, B. (2019). Selective Forwarding Attack on IoT Home Security Kits. Computer Security. CyberICPS\/SECPRE\/SPOSE\/ADIoT@ESORICS, Springer.","DOI":"10.1007\/978-3-030-42048-2_23"},{"key":"ref_2","unstructured":"Antonakakis, M., April, T., Bailey, M., Bernhard, M., Bursztein, E., Cochran, J., Durumeric, Z., Halderman, J.A., Invernizzi, L., and Kallitsis, M. (2017, January 16\u201318). Understanding the Mirai Botnet. Proceedings of the 26th USENIX Security Symposium, Vancouver, BC, Canada."},{"key":"ref_3","unstructured":"Lyon, G.F. (2009). Nmap Network Scanning: The Official Nmap Project Guide to Network Discovery and Security Scanning, Insecure.Com LLC. Nmap Project."},{"key":"ref_4","unstructured":"Durumeric, Z., Wustrow, E., and Halderman, J.A. (2013, January 14\u201316). ZMap: Fast Internet-wide scanning and its security applications. Proceedings of the 22nd USENIX Security Symposiu, Washington, DC, USA."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1007\/s11416-008-0107-z","article-title":"SinFP, unification of active and passive operating system fingerprinting","volume":"6","author":"Auffret","year":"2010","journal-title":"J. Comput. Virol."},{"key":"ref_6","unstructured":"Goldman, D. (2022, June 22). Shodan: The Scariest Search Engine on the Internet. Available online: https:\/\/money.cnn.com\/2013\/04\/08\/technology\/security\/shodan\/."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Durumeric, Z., Adrian, D., Mirian, A., Bailey, M., and Halderman, J.A. (2015, January 12\u201316). A search engine backed by internet-wide scanning. Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security, New York, NY, USA.","DOI":"10.1145\/2810103.2813703"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1007\/978-981-33-4922-3_15","article-title":"A Survey on Cyberspace Search Engines","volume":"Volume 1299","author":"Li","year":"2020","journal-title":"Communications in Computer and Information Science (CCIS)"},{"key":"ref_9","unstructured":"Feng, X., Li, Q., Wang, H., and Sun, L.M. (2020, January 15\u201317). Acquisitional Rule-based Engine for Discovering Internet-of-Things Devices. Proceedings of the 27th USENIX Security Symposium, Baltimore, MD, USA."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Kohno, T., Broido, A., and Claffy, K. (2005, January 8\u201311). Remote physical device fingerprinting. Proceedings of the IEEE Symposium on Security and Privacy (S&P\u201905), Oakland, CA, USA.","DOI":"10.1109\/SP.2005.18"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1109\/TDSC.2014.2369033","article-title":"GTID: A Technique for Physical Device and Device Type Fingerprinting","volume":"12","author":"Radhakrishnan","year":"2015","journal-title":"IEEE Trans. Dependable Secur. Comput."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Jafari, H., Omotere, O., Adesina, D., Wu, H.H., and Qian, L.J. (2018, January 29\u201331). IoT Devices Fingerprinting Using Deep Learning. Proceedings of the IEEE Military Communications Conference, Los Angeles, CA, USA.","DOI":"10.1109\/MILCOM.2018.8599826"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Bassey, J., Adesina, D., Li, X.F., Qian, L.J., and Aved, A. (2019, January 10\u201313). Intrusion Detection for IoT Devices based on RF Fingerprinting using Deep Learning. Proceedings of the Fourth International Conference on Fog and Mobile Edge Computing (FMEC), Rome, Italy.","DOI":"10.1109\/FMEC.2019.8795319"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Meidan, Y., Bohadana, M., Shabtai, A., and Guarnizo, J. (2017, January 3\u20137). ProfilIoT: A machine learning approach for IoT device identification based on network traffic analysis. Proceedings of the 32nd ACM Symposium on Applied Computing, New York, NY, USA.","DOI":"10.1145\/3019612.3019878"},{"key":"ref_15","unstructured":"Jordan, H., Ross, T., Paul, S., Kevin, B., and Jennifer, R. (2020). Classifying network vendors at internet scale. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Cheng, H., Dong, W.Y., Zheng, Y., and Lv, B. (2021, January 23\u201326). Identify IoT Devices through Web Interface Characteristics. Proceedings of the IEEE 6th International Conference on Computer and Communication Systems (ICCCS), Chengdu, China.","DOI":"10.1109\/ICCCS52626.2021.9449258"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Miettinen, M., Marchal, S., Hafeez, I., Asokan, N., and Sadeghi, A.R. (2017, January 5\u20138). IoT Sentinel: Automated Device-Type Identification for Security Enforcement in IoT. Proceedings of the 37th IEEE International Conference on Distributed Computing Systems, Atlanta, GA, USA.","DOI":"10.1109\/ICDCS.2017.283"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Babun, L., Aksu, H., Ryan, L., Akkaya, K., and Bentley, E.S. (2020, January 7\u201311). Z-IoT: Passive Device-class Fingerprinting of ZigBee and Z-Wave IoT Devices. Proceedings of the IEEE International Conference on Communications (ICC), Dublin, Ireland.","DOI":"10.1109\/ICC40277.2020.9149285"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1402","DOI":"10.1109\/JSAC.2019.2904364","article-title":"AuDI: Toward Autonomous IoT Device-Type Identification Using Periodic Communication","volume":"37","author":"Marchal","year":"2019","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Li, Q., Feng, X., Li, Z., Wang, H.N., and Sun, L.M. (2016, January 8\u201311). GUIDE: Graphical User Interface Fingerprints Physical Devices. Proceedings of the IEEE 24th International Conference on Network Protocols (ICNP), Singapore.","DOI":"10.1109\/ICNP.2016.7784468"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Li, Q., Feng, X., Wang, H., and Sun, L. (2017, January 20\u201323). Automatically Discovering Surveillance Devices in the Cyberspace. Proceedings of the 8th ACM on Multimedia Systems Conference (MMSys), Taipei, Taiwan.","DOI":"10.1145\/3083187.3084020"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Yousefnezhad, N., Malhi, A., and Fr\u00e4mling, K. (2021). Automated IoT Device Identification Based on Full Packet Information Using Real-Time Network Traffic. Sensors, 21.","DOI":"10.3390\/s21082660"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Bezawada, B., Bachani, M., Peterson, J., Shirazi, H., and Ray, I. (2018, January 19). Behavioral Fingerprinting of IoT Devices. Proceedings of the 2018 Workshop on Attacks and Solutions in Hardware Security (ASHES), Toronto, ON, Canada.","DOI":"10.1145\/3266444.3266452"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Formby, D., Srinivasan, P., Leonard, A., Rogers, J., and Beyah, R. (2016, January 21\u201324). Who\u2019s in Control of Your Control System? Device Fingerprinting for Cyber-Physical Systems. Proceedings of the Network and Distributed System Security Symposium (NDSS), San Diego, CA, USA.","DOI":"10.14722\/ndss.2016.23142"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Lavrenovs, A., and Graf, R. (2021, January 25\u201328). Explainable AI for Classifying Devices on the Internet. Proceedings of the 13th International Conference on Cyber Conflict (CyCon), Tallinn, Estonia.","DOI":"10.23919\/CyCon51939.2021.9467804"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Chowdhury, R.R., Aneja, S., Aneja, N., and Abas, E. (2020, January 22\u201324). Network Traffic Analysis based IoT Device Identification. Proceedings of the 4th International Conference on Big Data and Internet of Things, Singapore.","DOI":"10.1145\/3421537.3421545"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Agarwal, S., Oser, P., and Lueders, S. (2019). Detecting IoT Devices and How They Put Large Heterogeneous Networks at Security Risk. Sensors, 19.","DOI":"10.20944\/preprints201908.0295.v1"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wang, X., Wang, Y.C., Feng, X., Zhu, H.S., and Sun, L.M. (2019, January 10\u201312). IoTTracker: An Enhanced Engine for Discovering Internet-of-Thing Devices. Proceedings of the 2019 IEEE 20th International Symposium on \u201cA World of Wireless, Mobile and Multimedia Networks\u201d (WoWMoM), Arlington, TX, USA.","DOI":"10.1109\/WoWMoM.2019.8793012"},{"key":"ref_29","unstructured":"Trimananda, R., Varmarken, J., Markopoulou, A., and Demsky, B. (2020, January 23\u201326). For Smart Home Device Events. Proceedings of the Network and Distributed Systems Security (NDSS) Symposium 2020, San Diego, CA, USA."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"940","DOI":"10.1109\/JIOT.2018.2865604","article-title":"DEFT: A Distributed IoT Fingerprinting Technique","volume":"6","author":"Thangavelu","year":"2019","journal-title":"IEEE Internet Things J."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Sivanathan, A., Sherratt, D., Gharakheili, H.H., Radford, A., and Wijenayake, C. (2017, January 1\u20134). Characterizing and Classifying IoT Traffic in Smart Cities and Campuses. Proceedings of the 2017 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), Atlanta, GA, USA.","DOI":"10.1109\/INFCOMW.2017.8116438"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1745","DOI":"10.1109\/TMC.2018.2866249","article-title":"Classifying IoT Devices in Smart Environments Using Network Traffic Characteristics","volume":"18","author":"Sivanathan","year":"2019","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ortiz, J., Crawford, C., and Le, F. (2019, January 15\u201318). DeviceMien: Network device behavior modeling for identifying unknown IoT devices. Proceedings of the International Conference on Internet-of-Things Design and Implementation (IoTDI), Montreal, QC, Canada.","DOI":"10.1145\/3302505.3310073"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Qaddoura, R., Al-Zoubi, A.M., Faris, H., and Almomani, I. (2021). A Multi-Layer Classification Approach for Intrusion Detection in IoT Networks Based on Deep Learning. Sensors, 21.","DOI":"10.3390\/s21092987"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1016\/j.comnet.2018.11.013","article-title":"Towards automatic fingerprinting of IoT devices in the cyberspace","volume":"148","author":"Yang","year":"2019","journal-title":"Comput. Netw."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Lavrenovs, A., Graf, R., and Heinaaro, K. (2020, January 26\u201329). Towards Classifying Devices on the Internet Using Artificial Intelligence. Proceedings of the 12th International Conference on Cyber Conflict (CyCon), Tallinn, Estonia.","DOI":"10.23919\/CyCon49761.2020.9131713"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Chen, Z.T., He, K., Li, J., and Chen, Y.H. (2017, January 11\u201314). Seq2Img: A sequence-to-image based approach towards IP traffic classification using convolutional neural networks. Proceedings of the IEEE International Conference on Big Data (Big Data), Boston, MA, USA.","DOI":"10.1109\/BigData.2017.8258054"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Aneja, S., Aneja, N., and Islam, M.S. (2018, January 1\u20133). IoT Device Fingerprint using Deep Learning. Proceedings of the 2018 IEEE International Conference on Internet of Things and Intelligence System (IOTAIS), Bali, Indonesia.","DOI":"10.1109\/IOTAIS.2018.8600824"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/j.scienta.2019.109133","article-title":"Classification of Sour Lemons Based on Apparent Defects Using Stochastic Pooling Mechanism in Deep Convolutional Neural Networks","volume":"263","author":"Jahanbakhshi","year":"2020","journal-title":"Sci. Hortic."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Pathmaperuma, M.H., Rahulamathavan, Y., Dogan, S., and Kondoz, A. (2022). CNN for User Activity Detection Using Encrypted In-App Mobile Data. Future Internet, 14.","DOI":"10.3390\/fi14020067"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10462-009-9124-7","article-title":"Ensemble-Based Classifiers","volume":"33","author":"Rokach","year":"2009","journal-title":"Artif. Intell. Rev."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"830","DOI":"10.1016\/j.knosys.2018.10.009","article-title":"Multi-step forecasting for big data time series based on ensemble learning","volume":"163","author":"Galicia","year":"2018","journal-title":"Knowl.-Based Syst."},{"key":"ref_43","first-page":"1265","article-title":"Green cover change detection using a modified adaptive ensemble of extreme learning machines for North-Western India","volume":"33","author":"Khurana","year":"2021","journal-title":"J. King Saud Univ.\u2014Comput. Inf. Sci."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1007\/978-981-13-9939-8_33","article-title":"Comparative Analysis of Ensemble Methods for Classification of Android Malicious Applications","volume":"1045","author":"Dhalaria","year":"2019","journal-title":"Adv. Comput. Data Sci."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"109025","DOI":"10.1016\/j.measurement.2021.109025","article-title":"A stacking ensemble classification model for detection and classification of power quality disturbances in PV integrated power network","volume":"175","author":"Radhakrishnan","year":"2021","journal-title":"Measurement"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Sathyanarayanan, A., Srivatsan, M., and Meenakshi, K. (2022, January 1\u20133). Smart Web Dictionary using OCR. Proceedings of the 2022 International Conference on Computer Communication and Informatics (ICCCI), Coimbatore, India.","DOI":"10.1109\/ICCCI54379.2022.9741021"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Sharma, H. (2021). A Survey on Solution of Imbalanced Data Classification Problem Using SMOTE and Extreme Learning Machine. Communication and Intelligent Systems, Springer.","DOI":"10.1007\/978-981-16-1089-9"},{"key":"ref_48","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"Maaten","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/0169-7439(87)80084-9","article-title":"Principal component analysis","volume":"2","author":"Wold","year":"1987","journal-title":"Chemom. Intell. Lab. Syst."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/13\/4892\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:40:04Z","timestamp":1760139604000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/13\/4892"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,29]]},"references-count":49,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["s22134892"],"URL":"https:\/\/doi.org\/10.3390\/s22134892","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,29]]}}}