{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:17:30Z","timestamp":1750220250164,"version":"3.41.0"},"reference-count":69,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2022,2,1]],"date-time":"2022-02-01T00:00:00Z","timestamp":1643673600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Australian Research Council Linkage Project","award":["LP150100892"],"award-info":[{"award-number":["LP150100892"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Internet Technol."],"published-print":{"date-parts":[[2022,8,31]]},"abstract":"<jats:p>Having precise specifications of service APIs is essential for many Software Engineering activities. Unfortunately, available documentation of services is often inadequate and\/or imprecise and, hence, cannot be fully relied upon. Generating service documentation manually is a tedious and error-prone task, especially in light of changes to services. Therefore, there is a need for automated support in generating service documentation. In this work, we present a novel approach to infer the API of a service by analyzing recorded messages sent to and received from this service. Our approach includes a novel, two-level clustering technique to cluster messages, a step that many existing approaches to infer message formats fail to perform precisely in the presence of significant variation of payload information of the available messages. We have evaluated our approach on message traces from four different real-world services. The experimental result shows that our approach is more effective than existing techniques in extracting correct message formats from recorded messages.<\/jats:p>","DOI":"10.1145\/3503159","type":"journal-article","created":{"date-parts":[[2022,2,1]],"date-time":"2022-02-01T17:37:06Z","timestamp":1643737026000},"page":"1-31","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Extracting Formats of Service Messages with Varying Payloads"],"prefix":"10.1145","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8146-3821","authenticated-orcid":false,"given":"Md Arafat","family":"Hossain","sequence":"first","affiliation":[{"name":"Swinburne University of Technology, Melbourne, VIC, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Han","sequence":"additional","affiliation":[{"name":"Swinburne University of Technology, Melbourne, VIC, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jean-Guy","family":"Schneider","sequence":"additional","affiliation":[{"name":"Deakin University, Geelong, Melbourne, VIC, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiaojiao","family":"Jiang","sequence":"additional","affiliation":[{"name":"University of New South Wales, Sydney, NSW, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Muhammad Ashad","family":"Kabir","sequence":"additional","affiliation":[{"name":"Charles Sturt University, Sydney, NSW, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Steve","family":"Versteeg","sequence":"additional","affiliation":[{"name":"Swinburne University of Technology, Melbourne, VIC, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,2]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.5555\/645920.672836"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/WCRE.2011.28"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/34.494647"},{"key":"e_1_3_2_5_2","unstructured":"Subodh Bapat. 1994. Automatic storage of persistent ASN.1 objects in a relational schema. (March 1994). U.S. Patent 5 291 583."},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2008.4639084"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/2025113.2025188"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2002.1007487"},{"key":"e_1_3_2_9_2","unstructured":"Don Box David Ehnebuske Gopal Kakivaya Andrew Layman Noah Mendelsohn Henrik Frystyk Nielsen Satish Thatte and Dave Winer. 2000. Simple object access protocol (SOAP) 1.1. (May 2000). Retrieved January 8 2022 from https:\/\/www.w3.org\/TR\/soap\/."},{"key":"e_1_3_2_10_2","unstructured":"CA Technologies Inc.2019. CA Identity Manager. (Dec. 2019). Retrieved January 4 2020 from https:\/\/techdocs.broadcom.com\/content\/broadcom\/techdocs\/us\/en\/ca-enterprise-software\/layer7-identity-and-access-management\/identity-manager\/14-3.html."},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/1315245.1315286"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.5555\/1251375.1251397"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.5555\/1251375.1251397"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2009.14"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/1095810.1095824"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/MICRO.2004.26"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.5555\/1362903.1362917"},{"key":"e_1_3_2_18_2","first-page":"Citeseer, 1\u201315","volume-title":"Proceedings of the 13th Annual Network and Distributed System Security Symposium (NDSS\u201906)","author":"Cui Weidong","year":"2006","unstructured":"Weidong Cui, Vern Paxson, Nicholas Weaver, and Randy H. Katz. 2006. Protocol-independent adaptive replay of application dialog. In Proceedings of the 13th Annual Network and Distributed System Security Symposium (NDSS\u201906). San Diego, CA. Citeseer, 1\u201315."},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2020.3007554"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2016.0103"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/2693208.2693221"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2009.60"},{"key":"e_1_3_2_23_2","unstructured":"Google LLC. Google Books API. ([n.d.]). Retrieved January 8 2022 from https:\/\/developers.google.com\/books\/docs\/overview"},{"key":"e_1_3_2_24_2","article-title":"A directed acyclic graph approach to online log parsing","author":"He Pinjia","year":"2018","unstructured":"Pinjia He, Jieming Zhu, Pengcheng Xu, Zibin Zheng, and Michael R. Lyu. 2018. A directed acyclic graph approach to online log parsing. arXiv:1806.04356","journal-title":"arXiv:1806.04356"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICWS.2017.13"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3460345"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/2896941.2896947"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/2970276.2970321"},{"key":"e_1_3_2_29_2","unstructured":"MD Arafat Hossain. 2020. Discovering Context Dependent Service Models for Stateful Service Virtualization . Ph.D. Dissertation. Swinburne University of Technology Victoria Australia."},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/SANER.2018.8330215"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2019.08.011"},{"key":"e_1_3_2_32_2","volume-title":"Kendall\u2019s Advanced Theory of Statistics: Classical Inference and Relationship","author":"Kendall Maurice George","year":"1991","unstructured":"Maurice George Kendall, Alan Stuart, and John Keith Ord. 1991. Kendall\u2019s Advanced Theory of Statistics: Classical Inference and Relationship. Vol. 2. Oxford University Press (5th edition), New York, NY."},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1038\/234034a0"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/WCRE.2006.29"},{"key":"e_1_3_2_35_2","first-page":"1","volume-title":"Proceedings of the Symposium on Network and Distributed System Security (NDSS\u201908)","author":"Lin Zhiqiang","year":"2008","unstructured":"Zhiqiang Lin, Xuxian Jiang, Dongyan Xu, and Xiangyu Zhang. 2008. Automatic protocol format reverse engineering through context-aware monitored execution. In Proceedings of the Symposium on Network and Distributed System Security (NDSS\u201908), San Diego, CA. The Internet Society, 1\u201315."},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jnca.2013.01.013"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDIM.2014.6991396"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/1557019.1557154"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.5555\/1394399"},{"key":"e_1_3_2_40_2","unstructured":"McAfee LLC. 2004. Network Protocol Analysis using Bioinformatics Algorithms. (2004). Retrieved August 20 2019 from www.4tphi.net\/~awalters\/PI\/pi.pdf."},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1002\/047172842X"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3196321.3196340"},{"key":"e_1_3_2_43_2","unstructured":"Mike Mintz and Andrew Sayers. 2003. MSN Messenger protocol. (2003). Retrieved January 8 2022 from http:\/\/www.hypothetic.org\/docs\/msn\/index.php."},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/SCC.2013.73"},{"key":"e_1_3_2_45_2","first-page":"129","article-title":"Gedanken-experiments on sequential machines","volume":"34","author":"Moore Edward F.","year":"1956","unstructured":"Edward F. Moore. 1956. Gedanken-experiments on sequential machines. Automata Studies 34 (1956), 129\u2013153.","journal-title":"Automata Studies"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSR.2010.5463281"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1016\/0022-2836(70)90057-4"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF02300753"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.5555\/1795943"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/584091.584093"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/2063576.2063690"},{"key":"e_1_3_2_52_2","unstructured":"Philip S. Tellis Steve McAndrewSmith Micha\u00ebl Kamp Wayne Parrott Ray Van Dolson and Siddhesh Poyarekar. 2010. libyahoo2: A C library for Yahoo! Messenger. (July 2010). Retrieved January 8 2022 from http:\/\/libyahoo2.sourceforge.net\/."},{"key":"e_1_3_2_53_2","first-page":"1","volume-title":"Proceedings of the International Federation for Information Processing (IFIP\u201913) Networking Conference","author":"Tongaonkar Alok","year":"2013","unstructured":"Alok Tongaonkar, Ram Keralapura, and Antonio Nucci. 2013. Santaclass: A self adaptive network traffic classification system. In Proceedings of the International Federation for Information Processing (IFIP\u201913) Networking Conference.Brooklyn, NY. IEEE, 1\u20139."},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.comcom.2014.03.026"},{"key":"e_1_3_2_55_2","unstructured":"Andrew Tridgell. 2003. How Samba was written. Retrieved January 8 2022 from https:\/\/www.samba.org\/ftp\/tridge\/misc\/french_cafe.txt."},{"key":"e_1_3_2_56_2","unstructured":"Twitter Inc.2014. Twitter REST API. Retrieved March 22 2018 from https:\/\/developer.twitter.com\/en\/docs\/api-reference-index."},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/IPOM.2003.1251233"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1109\/CNSM.2015.7367331"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1145\/2896941.2896950"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/2889160.2889242"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1089\/cmb.1994.1.337"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1109\/PDCAT.2011.25"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICNP.2012.6459963"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-53917-6_40"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.5555\/2025968.2025970"},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.5555\/1813084.1813102"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0186188"},{"key":"e_1_3_2_68_2","first-page":"1","volume-title":"Proceedings of the Network and Distributed System Security Symposium (NDSS\u201908)","author":"Wondracek Gilbert","year":"2008","unstructured":"Gilbert Wondracek, Paolo Milani Comparetti, Christopher Kruegel, Engin Kirda, and Scuola Superiore S. Anna. 2008. Automatic network protocol analysis. In Proceedings of the Network and Distributed System Security Symposium (NDSS\u201908). San Diego, CA. The Internet Society, 1\u201314."},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.17487\/RFC1487"},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISITAE.2007.4409343"}],"container-title":["ACM Transactions on Internet Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3503159","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3503159","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:39Z","timestamp":1750188639000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3503159"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2]]},"references-count":69,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,8,31]]}},"alternative-id":["10.1145\/3503159"],"URL":"https:\/\/doi.org\/10.1145\/3503159","relation":{},"ISSN":["1533-5399","1557-6051"],"issn-type":[{"type":"print","value":"1533-5399"},{"type":"electronic","value":"1557-6051"}],"subject":[],"published":{"date-parts":[[2022,2]]},"assertion":[{"value":"2021-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-02-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}