{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T19:04:28Z","timestamp":1772823868743,"version":"3.50.1"},"reference-count":8,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2020,7,22]],"date-time":"2020-07-22T00:00:00Z","timestamp":1595376000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGCOMM Comput. Commun. Rev."],"published-print":{"date-parts":[[2020,7,22]]},"abstract":"<jats:p>In this paper, we re-implement a recent work published in Usenix Security 2018: \"Acquistional Rule Based Engine for Discovering Internet-of-Things Devices\". The paper introduced an NLP-based engine for automatically identifying the type, vendor, and product of IoT devices given banner data as input. We report on our efforts to reproduce the original implementation of the engine, documenting ambiguities around implementation and evaluation details that we encountered, as well as how we addressed them in our work. We evaluate our implementation on two ground truth datasets, finding that it fails to achieve the accuracy reported by the original authors. Our findings highlight the importance of recent community efforts towards a culture of reproducibility by presenting an example of how ambiguities in a research paper combined with lack of access to the original datasets can significantly affect a faithful re-implementation and evaluation.<\/jats:p>","DOI":"10.1145\/3411740.3411744","type":"journal-article","created":{"date-parts":[[2020,7,22]],"date-time":"2020-07-22T22:16:55Z","timestamp":1595456215000},"page":"23-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Using application layer banner data to automatically identify IoT devices"],"prefix":"10.1145","volume":"50","author":[{"given":"Talha","family":"Javed","sequence":"first","affiliation":[{"name":"NUST Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Muhammad","family":"Haseeb","sequence":"additional","affiliation":[{"name":"LUMS Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Muhammad","family":"Abdullah","sequence":"additional","affiliation":[{"name":"LUMS Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mobin","family":"Javed","sequence":"additional","affiliation":[{"name":"LUMS Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,7,22]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/3241189.3241275"},{"key":"e_1_2_1_2_1","first-page":"10","article-title":"Encouraging Reproducibility in Scientific Research of the Internet","volume":"8","author":"Bajpai Vaibhav","year":"2019","unstructured":"Vaibhav Bajpai , Olivier Bonaventure , kc claffy, and Daniel Karrenberg . 2019 . Encouraging Reproducibility in Scientific Research of the Internet . Dagstuhl Reports 8 , 10 (Jan 2019), 41--62. Vaibhav Bajpai, Olivier Bonaventure, kc claffy, and Daniel Karrenberg. 2019. Encouraging Reproducibility in Scientific Research of the Internet. Dagstuhl Reports 8, 10 (Jan 2019), 41--62.","journal-title":"Dagstuhl Reports"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3314212.3314217"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/3277203.3277228"},{"key":"e_1_2_1_5_1","unstructured":"IEEE. 2019. IEEE Registration Authority: Assignments. https:\/\/regauth.standards.ieee.org\/standards-ra-web\/pub\/view.html#registries.  IEEE. 2019. IEEE Registration Authority: Assignments. https:\/\/regauth.standards.ieee.org\/standards-ra-web\/pub\/view.html#registries."},{"key":"e_1_2_1_6_1","unstructured":"Talha Javed. 2020. Accompanying Source Code and Datasets for this Work. https:\/\/github.com\/talhajavedmukhtar\/ARE-rt.  Talha Javed. 2020. Accompanying Source Code and Datasets for this Work. https:\/\/github.com\/talhajavedmukhtar\/ARE-rt."},{"key":"e_1_2_1_7_1","unstructured":"Nmap. 2019. Nmap: the Network Mapper - Free Security Scanner. https:\/\/nmap.org.  Nmap. 2019. Nmap: the Network Mapper - Free Security Scanner. https:\/\/nmap.org."},{"key":"e_1_2_1_8_1","unstructured":"ZTag. 2019. Zmap\/Ztag: Tagging and Annotation Framework for Scan Data. https:\/\/github.com\/zmap\/ztag.  ZTag. 2019. Zmap\/Ztag: Tagging and Annotation Framework for Scan Data. https:\/\/github.com\/zmap\/ztag."}],"container-title":["ACM SIGCOMM Computer Communication Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411740.3411744","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3411740.3411744","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:02:39Z","timestamp":1750197759000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411740.3411744"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,22]]},"references-count":8,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,7,22]]}},"alternative-id":["10.1145\/3411740.3411744"],"URL":"https:\/\/doi.org\/10.1145\/3411740.3411744","relation":{},"ISSN":["0146-4833"],"issn-type":[{"value":"0146-4833","type":"print"}],"subject":[],"published":{"date-parts":[[2020,7,22]]},"assertion":[{"value":"2020-07-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}