{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,1]],"date-time":"2025-11-01T09:35:33Z","timestamp":1761989733932,"version":"3.37.3"},"reference-count":65,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,7,2]],"date-time":"2023-07-02T00:00:00Z","timestamp":1688256000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,7,2]],"date-time":"2023-07-02T00:00:00Z","timestamp":1688256000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R &D Program of China","doi-asserted-by":"crossref","award":["2020AAA0140001"],"award-info":[{"award-number":["2020AAA0140001"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"crossref","award":["U1836211"],"award-info":[{"award-number":["U1836211"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Beijing Natural Science Foundation","award":["M22004"],"award-info":[{"award-number":["M22004"]}]},{"DOI":"10.13039\/501100010816","name":"Anhui Department of Science and Technology","doi-asserted-by":"crossref","award":["202103a05020009"],"award-info":[{"award-number":["202103a05020009"]}],"id":[{"id":"10.13039\/501100010816","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Cybersecurity"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Clone detection has received much attention in many fields such as malicious code detection, vulnerability hunting, and code copyright infringement detection. However, cyber criminals may obfuscate code to impede violation detection. To date, few studies have investigated the robustness of clone detectors, especially in-fashion deep learning-based ones, against obfuscation. Meanwhile, most of these studies only measure the difference between one code snippet and its obfuscation version. However, in reality, the attackers may modify the original code before obfuscating it. Then what we should evaluate is the detection of obfuscated code from cloned code, not the original code. For this, we conduct a comprehensive study evaluating 3 popular deep-learning based clone detectors and 6 commonly used traditional ones. Regarding the data, we collect 6512 clone pairs of five types from the dataset BigCloneBench and obfuscate one program of each pair via 64 strategies of 6 state-of-art commercial obfuscators. We also collect 1424 non-clone pairs to evaluate the false positives. In sum, a benchmark of 524,148 code pairs (either clone or not) are generated, which are passed to clone detectors for evaluation. To automate the evaluation, we develop one uniform evaluation framework, integrating the clone detectors and obfuscators. The results bring us interesting findings on how obfuscation affects the performance of clone detection and what is the difference between traditional and deep learning-based clone detectors. In addition, we conduct manual code reviews to uncover the root cause of the phenomenon and give suggestions to users from different perspectives.<\/jats:p>","DOI":"10.1186\/s42400-023-00148-x","type":"journal-article","created":{"date-parts":[[2023,7,2]],"date-time":"2023-07-02T01:01:54Z","timestamp":1688259714000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Are our clone detectors good enough? An empirical study of code effects by obfuscation"],"prefix":"10.1186","volume":"6","author":[{"given":"Weihao","family":"Huang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6388-2571","authenticated-orcid":false,"given":"Guozhu","family":"Meng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chaoyang","family":"Lin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qiucun","family":"Yan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kai","family":"Chen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhuo","family":"Ma","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,7,2]]},"reference":[{"key":"148_CR1","doi-asserted-by":"publisher","first-page":"86121","DOI":"10.1109\/ACCESS.2019.2918202","volume":"7","author":"QU Ain","year":"2019","unstructured":"Ain QU, Butt WH, Anwar MW, Azam F, Maqbool B (2019) A systematic review on code clone detection. IEEE Access 7:86121\u201386144","journal-title":"IEEE Access"},{"key":"148_CR2","unstructured":"Anonymous: CloneVsObf. https:\/\/github.com\/CloneVsObf\/CloneVsObf (2021)"},{"key":"148_CR3","unstructured":"Anonymous: Impacts of obfuscation on clone detection. https:\/\/sites.google.com\/view\/obf-clone-eval\/ (2022)"},{"key":"148_CR4","unstructured":"Apache: The Apache Ant Project. https:\/\/ant.apache.org\/ (2020)"},{"key":"148_CR5","unstructured":"Balakrishnan A, Schulze C (2005) Code obfuscation literature survey. CS701 Construction of compilers, 19"},{"issue":"9","key":"148_CR6","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1109\/TSE.2007.70725","volume":"33","author":"S Bellon","year":"2007","unstructured":"Bellon S, Koschke R, Antoniol G, Krinke J, Merlo E (2007) Comparison and evaluation of clone detection tools. IEEE Trans Softw Eng 33(9):577\u2013591","journal-title":"IEEE Trans Softw Eng"},{"key":"148_CR7","unstructured":"Ben-Nun T, Jakobovits AS, Hoefler T (2018) Neural code comprehension: a learnable representation of code semantics. In: Advances in neural information processing systems, pp 3585\u20133597"},{"key":"148_CR8","unstructured":"Cao L, Sun G, Wang H, WANG S (2006) Logic invariability study of junk code transformation. Computer Engineering 20, 048"},{"issue":"5","key":"148_CR9","doi-asserted-by":"publisher","first-page":"942","DOI":"10.1007\/s11390-015-1573-7","volume":"30","author":"J Chen","year":"2015","unstructured":"Chen J, Alalfi MH, Dean TR, Zou Y (2015) Detecting android malware using clone detection. J Comput Sci Technol 30(5):942\u2013956","journal-title":"J Comput Sci Technol"},{"issue":"1","key":"148_CR10","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1016\/j.jss.2004.11.019","volume":"78","author":"S Cimato","year":"2005","unstructured":"Cimato S, De Santis A, Petrillo UF (2005) Overcoming the obfuscation of java programs by identifier renaming. J Syst Softw 78(1):60\u201372","journal-title":"J Syst Softw"},{"key":"148_CR11","doi-asserted-by":"crossref","unstructured":"Cimitile A, Martinelli F, Mercaldo F, Nardone V, Santone A (2017) Formal methods meet mobile code obfuscation identification of code reordering technique. In: 2017 IEEE 26th International conference on enabling technologies: infrastructure for collaborative enterprises (WETICE), pp 263\u2013268. IEEE","DOI":"10.1109\/WETICE.2017.23"},{"key":"148_CR12","unstructured":"clone: overview of clone detection tools for java. https:\/\/github.com\/c-oberle\/clone-detection-tools (2020)"},{"key":"148_CR13","unstructured":"Collberg C, Thomborson C, Low D (1997) A taxonomy of obfuscating transformations. http:\/\/www.cs.auckland.ac.nz\/staff-cgi-bin\/mjd\/csTRcgi.pl?serial"},{"key":"148_CR14","doi-asserted-by":"crossref","unstructured":"Crussell J, Gibler C, Chen H (2012) Attack of the clones: Detecting cloned applications on android markets. In: Computer Security\u2014ESORICS 2012, pp 37\u201354. Springer, Berlin, Heidelberg","DOI":"10.1007\/978-3-642-33167-1_3"},{"key":"148_CR15","doi-asserted-by":"crossref","unstructured":"Datar M, Immorlica N, Indyk P, Mirrokni VS (2004) Locality-sensitive hashing scheme based on p-stable distributions. In: Proceedings of the twentieth annual symposium on computational geometry, pp 253\u2013262","DOI":"10.1145\/997817.997857"},{"key":"148_CR16","doi-asserted-by":"crossref","unstructured":"Duala-Ekoko E, Robillard MP (2007) Tracking code clones in evolving software. In: 29th international conference on software engineering (ICSE\u201907), pp 158\u2013167. IEEE","DOI":"10.1109\/ICSE.2007.90"},{"key":"148_CR17","doi-asserted-by":"publisher","first-page":"2627","DOI":"10.1016\/S1352-2310(97)00447-0","volume":"32","author":"MW Gardner","year":"1998","unstructured":"Gardner MW, Dorling SR (1998) Artificial neural networks (the multilayer perceptron)-a review of applications in the atmospheric sciences. Atmos Environ 32:2627\u20132636","journal-title":"Atmos Environ"},{"key":"148_CR18","doi-asserted-by":"crossref","unstructured":"G\u00f6de N, Koschke R (2011) Frequency and risks of changes to clones. In: Proceedings of the 33rd international conference on software engineering, pp 311\u2013320","DOI":"10.1145\/1985793.1985836"},{"key":"148_CR19","unstructured":"Google: Google Code Jam. https:\/\/codingcompetitions.withgoogle.com\/codejam (2020)"},{"key":"148_CR20","unstructured":"Guardsquare: ProGuard. https:\/\/github.com\/Guardsquare\/proguard (2020)"},{"key":"148_CR21","doi-asserted-by":"crossref","unstructured":"Hammad M, Garcia J, Malek S (2018) A large-scale empirical study on the effects of code obfuscations on android apps and anti-malware products. In: Proceedings of the 40th international conference on software engineering, pp 421\u2013431","DOI":"10.1145\/3180155.3180228"},{"key":"148_CR22","unstructured":"Hoenicke J (2020) JODE. http:\/\/jode.sourceforge.net\/"},{"key":"148_CR23","unstructured":"ItzSomebody: radon. https:\/\/github.com\/ItzSomebody\/Radon (2020)"},{"key":"148_CR24","unstructured":"JavaParser: tools for your Java code Transform. https:\/\/javaparser.org\/ (2020)"},{"key":"148_CR25","doi-asserted-by":"crossref","unstructured":"Jiang L, Misherghi G, Su Z, Glondu S (2007) Deckard: Scalable and accurate tree-based detection of code clones. In: 29th international conference on software engineering (ICSE\u201907), 96\u2013105","DOI":"10.1109\/ICSE.2007.30"},{"issue":"7","key":"148_CR26","doi-asserted-by":"publisher","first-page":"654","DOI":"10.1109\/TSE.2002.1019480","volume":"28","author":"T Kamiya","year":"2002","unstructured":"Kamiya T, Kusumoto S, Inoue K (2002) Ccfinder: a multilinguistic token-based code clone detection system for large scale source code. IEEE Trans Softw Eng 28(7):654\u2013670","journal-title":"IEEE Trans Softw Eng"},{"key":"148_CR27","doi-asserted-by":"crossref","unstructured":"Kim S, Woo S, Lee H, Oh H (2017) Vuddy: A scalable approach for vulnerable code clone discovery. In: 2017 IEEE symposium on security and privacy (SP), pp 595\u2013614. IEEE","DOI":"10.1109\/SP.2017.62"},{"key":"148_CR28","doi-asserted-by":"crossref","unstructured":"Krinke J (2001) Identifying similar code with program dependence graphs. In: Proceedings eighth working conference on reverse engineering, pp 301\u2013309. IEEE","DOI":"10.1109\/WCRE.2001.957835"},{"issue":"3","key":"148_CR29","doi-asserted-by":"publisher","first-page":"230","DOI":"10.1016\/j.infsof.2006.10.017","volume":"49","author":"A Kuhn","year":"2007","unstructured":"Kuhn A, Ducasse S, G\u00edrba T (2007) Semantic clustering: identifying topics in source code. Inf Softw Technol 49(3):230\u2013243","journal-title":"Inf Softw Technol"},{"key":"148_CR30","doi-asserted-by":"crossref","unstructured":"Lee S, Jeong I (2005) Sdd: high performance code clone detection system for large scale source code. In: Companion to the 20th annual ACM SIGPLAN conference on object-oriented programming, systems, languages, and applications, pp 140\u2013141","DOI":"10.1145\/1094855.1094903"},{"key":"148_CR31","doi-asserted-by":"crossref","unstructured":"Li L, Feng H, Zhuang W, Meng N, Ryder B (2017) Cclearner: A deep learning-based clone detection approach. In: 2017 IEEE international conference on software maintenance and evolution (ICSME), pp 249\u2013260. IEEE","DOI":"10.1109\/ICSME.2017.46"},{"key":"148_CR32","doi-asserted-by":"crossref","unstructured":"Liu Z, Wei Q, Cao Y (2017) Vfdetect: A vulnerable code clone detection system based on vulnerability fingerprint. In: 2017 IEEE 3rd information technology and mechatronics engineering conference (ITOEC), pp 548\u2013553. IEEE","DOI":"10.1109\/ITOEC.2017.8122356"},{"key":"148_CR33","doi-asserted-by":"crossref","unstructured":"Livieri S, Higo Y, Matsushita M, Inoue K (2007) Analysis of the linux kernel evolution using code clone coverage. In: Fourth international workshop on mining software repositories (MSR\u201907: ICSE Workshops 2007), pp 22\u201322. IEEE","DOI":"10.1109\/MSR.2007.1"},{"key":"148_CR34","doi-asserted-by":"crossref","unstructured":"Meyer D, Schulze D-IS (2012) Analyzing the robustness of clone detection tools regarding code obfuscation. Bachelor thesis, University of Magdeburg","DOI":"10.1109\/IWSC.2013.6613045"},{"key":"148_CR35","doi-asserted-by":"crossref","unstructured":"Monden A, Nakae D, Kamiya T, Sato S-i, Matsumoto K-i (2002) Software quality analysis by code clones in industrial legacy software. In: Proceedings eighth IEEE symposium on software metrics, pp 87\u201394. IEEE","DOI":"10.1109\/METRIC.2002.1011328"},{"key":"148_CR36","doi-asserted-by":"crossref","unstructured":"Nguyen HA, Nguyen TT, Pham NH, Al-Kofahi JM, Nguyen TN (2009) Accurate and efficient structural characteristic feature extraction for clone detection. In: International conference on fundamental approaches to software engineering, pp 440\u2013455. Springer","DOI":"10.1007\/978-3-642-00593-0_31"},{"issue":"5","key":"148_CR37","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1109\/MSP.2011.98","volume":"9","author":"P OKane","year":"2011","unstructured":"OKane P, Sezer S, McLaughlin K (2011) Obfuscation: the hidden malware. IEEE Secur Priv 9(5):41\u201347","journal-title":"IEEE Secur Priv"},{"key":"148_CR38","doi-asserted-by":"crossref","unstructured":"Ragkhitwetsagul C, Krinke J (2017) Using compilation\/decompilation to enhance clone detection. In: 2017 IEEE 11th international workshop on software clones (IWSC), pp 1\u20137. IEEE","DOI":"10.1109\/IWSC.2017.7880502"},{"key":"148_CR39","doi-asserted-by":"crossref","unstructured":"Ragkhitwetsagul C, Krinke J, Clark D (2016) Similarity of source code in the presence of pervasive modifications. In: 2016 IEEE 16th international working conference on source code analysis and manipulation (SCAM), pp 117\u2013126. IEEE","DOI":"10.1109\/SCAM.2016.13"},{"key":"148_CR40","doi-asserted-by":"crossref","unstructured":"Roy CK, Cordy JR (2009) A mutation\/injection-based automatic framework for evaluating code clone detection tools. In: 2009 International conference on software testing, verification, and validation workshops, pp 157\u2013166. IEEE","DOI":"10.1109\/ICSTW.2009.18"},{"issue":"115","key":"148_CR41","first-page":"64","volume":"541","author":"CK Roy","year":"2007","unstructured":"Roy CK, Cordy JR (2007) A survey on software clone detection research. Queen\u2019s Sch Comput TR 541(115):64\u201368","journal-title":"Queen\u2019s Sch Comput TR"},{"key":"148_CR42","unstructured":"Sable: JBCO. http:\/\/www.sable.mcgill.ca\/JBCO\/ (2020)"},{"key":"148_CR43","doi-asserted-by":"crossref","unstructured":"Saini V, Farmahinifarahani F, Lu Y, Baldi P, Lopes CV (2018) Oreo: Detection of clones in the twilight zone. In: Proceedings of the 2018 26th ACM joint meeting on european software engineering conference and symposium on the foundations of software engineering, pp 354\u2013365","DOI":"10.1145\/3236024.3236026"},{"key":"148_CR44","doi-asserted-by":"crossref","unstructured":"Sajnani H, Saini V, Lopes CV (2013) A parallel and efficient approach to large scale clone detection. 2013 7th international workshop on software clones (IWSC), 46\u201352","DOI":"10.1109\/IWSC.2013.6613042"},{"key":"148_CR45","doi-asserted-by":"crossref","unstructured":"Sajnani H, Saini V, Svajlenko J, Roy CK, Lopes CV (2016) Sourcerercc: Scaling code clone detection to big-code. In: Proceedings of the 38th international conference on software engineering, pp 1157\u20131168","DOI":"10.1145\/2884781.2884877"},{"key":"148_CR46","doi-asserted-by":"crossref","unstructured":"Schulze S, Meyer D (2013) On the robustness of clone detection to code obfuscation. In: 2013 7th international workshop on software clones (IWSC), pp 62\u201368","DOI":"10.1109\/IWSC.2013.6613045"},{"key":"148_CR47","doi-asserted-by":"publisher","first-page":"2673","DOI":"10.1109\/78.650093","volume":"45","author":"M Schuster","year":"1997","unstructured":"Schuster M, Paliwal KK (1997) Bidirectional recurrent neural networks. IEEE Trans Signal Process 45:2673\u20132681","journal-title":"IEEE Trans Signal Process"},{"key":"148_CR48","first-page":"1","volume":"137","author":"A Sheneamer","year":"2016","unstructured":"Sheneamer A, Kalita JK (2016) A survey of software clone detection techniques. Int J Comput Appl 137:1\u201321","journal-title":"Int J Comput Appl"},{"key":"148_CR49","unstructured":"Soot: Soot: a Java Optimization Framework. https:\/\/www.sable.mcgill.ca\/soot\/ (2020)"},{"key":"148_CR50","unstructured":"Steiger S (2020) Procyon. https:\/\/github.com\/ststeiger\/procyon"},{"key":"148_CR51","unstructured":"superblaubeere27: Obfuscator. https:\/\/github.com\/superblaubeere27\/obfuscator\/ (2020)"},{"key":"148_CR52","doi-asserted-by":"crossref","unstructured":"Svajlenko J, Islam JF, Keivanloo I, Roy CK, Mia MM (2014) Towards a big data curated benchmark of inter-project code clones. In: 2014 IEEE international conference on software maintenance and evolution, pp 476\u2013480. IEEE","DOI":"10.1109\/ICSME.2014.77"},{"key":"148_CR53","unstructured":"Szegedy C, Toshev A, Erhan D (2013) Deep neural networks for object detection. Adv Neural Inf Proces Syst 26"},{"key":"148_CR54","doi-asserted-by":"crossref","unstructured":"Tufano M, Watson C, Bavota G, Di\u00a0Penta M, White M, Poshyvanyk D (2018) Deep learning similarities from different representations of source code. In: 2018 IEEE\/ACM 15th international conference on mining software repositories (MSR), pp 542\u2013553. IEEE","DOI":"10.1145\/3196398.3196431"},{"key":"148_CR55","doi-asserted-by":"crossref","unstructured":"Viticchi\u00e9 A, Regano L, Torchiano M, Basile C, Ceccato M, Tonella P, Tiella R (2016) Assessment of source code obfuscation techniques. In: 2016 IEEE 16th international working conference on source code analysis and manipulation (SCAM), pp 11\u201320. IEEE","DOI":"10.1109\/SCAM.2016.17"},{"key":"148_CR56","doi-asserted-by":"publisher","unstructured":"Wang H, Guo Y, Ma Z, Chen X (2015) Wukong: A scalable and accurate two-phase approach to android app clone detection. In: Proceedings of the 2015 international symposium on software testing and analysis, pp. 71\u201382. Association for Computing Machinery, New York, NY, USA. https:\/\/doi.org\/10.1145\/2771783.2771795","DOI":"10.1145\/2771783.2771795"},{"key":"148_CR57","doi-asserted-by":"crossref","unstructured":"Wang W, Meng G, Wang H, Chen K, Ge W, Li X (2020) A 3 ident: a two-phased approach to identify the leading authors of android apps. In: 2020 IEEE international conference on software maintenance and evolution (ICSME), pp 617\u2013628. IEEE","DOI":"10.1109\/ICSME46990.2020.00064"},{"key":"148_CR58","doi-asserted-by":"crossref","unstructured":"Wang P, Svajlenko J, Wu Y, Xu Y, Roy CK (2018) Ccaligner: a token based large-gap clone detector. In: 2018 IEEE\/ACM 40th international conference on software engineering (ICSE), pp 1066\u20131077","DOI":"10.1145\/3180155.3180179"},{"key":"148_CR59","doi-asserted-by":"crossref","unstructured":"Wei H, Li M (2017) Supervised deep features for software functional clone detection by exploiting lexical and syntactical information in source code. In: IJCAI, pp 3034\u20133040","DOI":"10.24963\/ijcai.2017\/423"},{"key":"148_CR60","doi-asserted-by":"crossref","unstructured":"White M, Tufano M, Vendome C, Poshyvanyk D (2016) Deep learning code fragments for code clone detection. In: 2016 31st IEEE\/ACM international conference on automated software engineering (ASE), pp 87\u201398. IEEE","DOI":"10.1145\/2970276.2970326"},{"key":"148_CR61","doi-asserted-by":"crossref","unstructured":"Wu Y, Manabe Y, Kanda T, German DM, Inoue K (2015) A method to detect license inconsistencies in large-scale open source projects. In: 2015 IEEE\/ACM 12th working conference on mining software repositories, pp 324\u2013333. IEEE","DOI":"10.1109\/MSR.2015.37"},{"key":"148_CR62","doi-asserted-by":"crossref","unstructured":"You I, Yim K (2010) Malware obfuscation techniques: a brief survey. In: 2010 international conference on broadband, wireless computing, communication and applications, pp 297\u2013300. IEEE","DOI":"10.1109\/BWCCA.2010.85"},{"key":"148_CR63","unstructured":"yWorks: yGuard. https:\/\/www.yworks.com\/products\/yguard (2020)"},{"key":"148_CR64","doi-asserted-by":"crossref","unstructured":"Zhang J, Wang X, Zhang H, Sun H, Wang K, Liu X (2019) A novel neural source code representation based on abstract syntax tree. In: 2019 IEEE\/ACM 41st international conference on software engineering (ICSE), 783\u2013794","DOI":"10.1109\/ICSE.2019.00086"},{"key":"148_CR65","doi-asserted-by":"publisher","unstructured":"Zhao G, Huang J (2018) Deepsim: Deep learning code functional similarity. In: Proceedings of the 2018 26th ACM joint meeting on european software engineering conference and symposium on the foundations of software engineering. ESEC\/FSE 2018, pp. 141\u2013151. Association for Computing Machinery, New York, NY, USA. https:\/\/doi.org\/10.1145\/3236024.3236068","DOI":"10.1145\/3236024.3236068"}],"container-title":["Cybersecurity"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s42400-023-00148-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s42400-023-00148-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s42400-023-00148-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,23]],"date-time":"2024-10-23T13:49:48Z","timestamp":1729691388000},"score":1,"resource":{"primary":{"URL":"https:\/\/cybersecurity.springeropen.com\/articles\/10.1186\/s42400-023-00148-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,2]]},"references-count":65,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["148"],"URL":"https:\/\/doi.org\/10.1186\/s42400-023-00148-x","relation":{},"ISSN":["2523-3246"],"issn-type":[{"type":"electronic","value":"2523-3246"}],"subject":[],"published":{"date-parts":[[2023,7,2]]},"assertion":[{"value":"22 December 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 February 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 July 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no competing interests","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"14"}}