{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T13:14:11Z","timestamp":1775913251726,"version":"3.50.1"},"reference-count":109,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2022,3,15]],"date-time":"2022-03-15T00:00:00Z","timestamp":1647302400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2022,7,31]]},"abstract":"<jats:p>\n            Design-time evaluation is essential to build the initial software architecture to be deployed. However, experts\u2019 assumptions made at design-time are unlikely to remain true indefinitely in systems that are characterized by scale, hyperconnectivity, dynamism, and uncertainty in operations (e.g. IoT). Therefore, experts\u2019 design-time decisions can be challenged at run-time. A continuous architecture evaluation that systematically assesses and intertwines design-time and run-time decisions is thus necessary. This paper proposes the first proactive approach to continuous architecture evaluation of the system leveraging the support of simulation. The approach evaluates software architectures by not only tracking their performance over time, but also forecasting their likely future performance through machine learning of\n            <jats:italic>simulated<\/jats:italic>\n            instances of the architecture. This enables architects to make cost-effective informed decisions on potential changes to the architecture. We perform an IoT case study to show how machine learning on simulated instances of architecture can fundamentally guide the continuous evaluation process and influence the outcome of architecture decisions. A series of experiments is conducted to demonstrate the applicability and effectiveness of the approach. We also provide the architect with recommendations on how to best benefit from the approach through choice of learners and input parameters, grounded on experimentation and evidence.\n          <\/jats:p>","DOI":"10.1145\/3492762","type":"journal-article","created":{"date-parts":[[2022,3,15]],"date-time":"2022-03-15T11:56:00Z","timestamp":1647345360000},"page":"1-54","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Continuous and Proactive Software Architecture Evaluation: An IoT Case"],"prefix":"10.1145","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9709-7731","authenticated-orcid":false,"given":"Dalia","family":"Sobhy","sequence":"first","affiliation":[{"name":"Computer Engineering Department, Arab Academy of Science and Technologyand Maritime Transport, Alexandria, Egypt"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Leandro","family":"Minku","sequence":"additional","affiliation":[{"name":"University of Birmingham, Birmingham, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rami","family":"Bahsoon","sequence":"additional","affiliation":[{"name":"FRSA and University of Birmingham, Birmingham, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rick","family":"Kazman","sequence":"additional","affiliation":[{"name":"SEI\/CMU and University of Hawaii, Honolulu, United States, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,3,15]]},"reference":[{"key":"e_1_3_3_2_2","volume-title":"Fog Computing and the Internet of Things: Extend the Cloud to Where the Things Are","year":"2016","unstructured":"2016. Fog Computing and the Internet of Things: Extend the Cloud to Where the Things Are. Technical Report. Cisco Systems."},{"key":"e_1_3_3_3_2","unstructured":"2018. Application Performance Monitoring and Management | AppDynamics."},{"key":"e_1_3_3_4_2","unstructured":"2018. New Relic."},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/1062455.1062508"},{"key":"e_1_3_3_6_2","article-title":"13th Annual Worldwide Infrastructure Security Report","author":"Alcoy P.","year":"2018","unstructured":"P. Alcoy, S. Bjarnason, P. Bowen, C. F. Chui, K. Kasavchenko, and G. Sockrider. 2018. 13th Annual Worldwide Infrastructure Security Report. NETSCOUT Arbor (2018).","journal-title":"NETSCOUT Arbor"},{"key":"e_1_3_3_7_2","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1109\/MOMPES.2009.5069138","volume-title":"Model-Based Methodologies for Pervasive and Embedded Software, 2009. MOMPES\u201909. ICSE Workshop on","author":"Aleti Aldeida","year":"2009","unstructured":"Aldeida Aleti, Stefan Bjornander, Lars Grunske, and Indika Meedeniya. 2009. ArcheOpterix: An extendable tool for architecture optimization of AADL models. In Model-Based Methodologies for Pervasive and Embedded Software, 2009. MOMPES\u201909. ICSE Workshop on. IEEE, 61\u201371."},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/tse.2012.64"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/1985793.1985795"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.1984.1659219"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/TDSC.2004.2"},{"key":"e_1_3_3_12_2","article-title":"Deploy an End-to-End IoT Application","year":"2018","unstructured":"AWS. 2018. Deploy an End-to-End IoT Application. https:\/\/aws.amazon.com\/getting-started\/projects\/deploy-iot-application\/services-costs\/.","journal-title":"https:\/\/aws.amazon.com\/getting-started\/projects\/deploy-iot-application\/services-costs\/"},{"key":"e_1_3_3_13_2","unstructured":"Amazon AWS. 2018. Cloud Watch."},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-75632-5_1"},{"key":"e_1_3_3_15_2","volume-title":"DevOps: A Software Architect\u2019s Perspective","author":"Bass Len","year":"2015","unstructured":"Len Bass, Ingo Weber, and Liming Zhu. 2015. DevOps: A Software Architect\u2019s Perspective. Addison-Wesley Professional."},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/CSMR-WCRE.2014.6747203"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2008.03.066"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.5555\/551789.853528"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/CSMR.1999.756691"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0164-1212(03)00080-3"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/WICSA.2016.26"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2017.62"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.5555\/1756006.1859903"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1186\/s13174-014-0013-1"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCC.2017.27"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2009.326"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/336512.336584"},{"key":"e_1_3_3_28_2","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1007\/978-3-540-24769-2_14","volume-title":"European Workshop on Software Architecture","author":"Bosch Jan","year":"2004","unstructured":"Jan Bosch. 2004. Software architecture: The next step. In European Workshop on Software Architecture. Springer, 194\u2013199."},{"key":"e_1_3_3_29_2","first-page":"161","volume-title":"Advances in Neural Information Processing Systems","author":"Bottou L\u00e9on","year":"2008","unstructured":"L\u00e9on Bottou and Olivier Bousquet. 2008. The tradeoffs of large scale learning. In Advances in Neural Information Processing Systems. 161\u2013168."},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30217-9_73"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/2000259.2000274"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2017.57"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1002\/spe.995"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-36249-1_11"},{"key":"e_1_3_3_35_2","volume-title":"Designing Software Architectures: A Practical Approach","author":"Cervantes Humberto","year":"2016","unstructured":"Humberto Cervantes and Rick Kazman. 2016. Designing Software Architectures: A Practical Approach. Addison-Wesley Professional."},{"key":"e_1_3_3_36_2","first-page":"26","volume-title":"MoDELS@ Run. time","author":"Chauvel Franck","year":"2013","unstructured":"Franck Chauvel, Nicolas Ferry, Brice Morin, Alessandro Rossini, and Arnor Solberg. 2013. Models@ runtime to support the iterative and continuous design of autonomic reasoners. In MoDELS@ Run. time. 26\u201338."},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/MoWNet.2016.7496622"},{"key":"e_1_3_3_38_2","volume-title":"Rainbow: Cost-effective Software Architecture-based Self-adaptation","author":"Cheng Shang-Wen","year":"2008","unstructured":"Shang-Wen Cheng. 2008. Rainbow: Cost-effective Software Architecture-based Self-adaptation. Ph.D. Dissertation. Pittsburgh, PA, USA. Advisor(s) Garlan, David. AAI3305807."},{"key":"e_1_3_3_39_2","article-title":"Reports: As the IoT grows, so do its threats to DNS","author":"Cooney Michael","year":"2019","unstructured":"Michael Cooney. 2019. Reports: As the IoT grows, so do its threats to DNS. https:\/\/www.networkworld.com\/article\/3411437\/reports-as-the-iot-grows-so-do-its-threats-to-dns.html.","journal-title":"https:\/\/www.networkworld.com\/article\/3411437\/reports-as-the-iot-grows-so-do-its-threats-to-dns.html"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2013.36"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jnca.2011.05.009"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2014.2300753"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-35813-5_1"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/4235.996017"},{"key":"e_1_3_3_45_2","first-page":"1","article-title":"Statistical comparisons of classifiers over multiple data sets","volume":"7","author":"Dem\u0161ar Janez","year":"2006","unstructured":"Janez Dem\u0161ar. 2006. Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research 7, Jan (2006), 1\u201330.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/mci.2015.2471196"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2002.1019479"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/1882291.1882296"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-31095-9_40"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2009.5070513"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2013.37"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.5555\/2486788.2486795"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCI.2017.2670461"},{"key":"e_1_3_3_54_2","first-page":"286","volume-title":"Advances in Artificial Intelligence\u2013SBIA 2004","author":"Gama Joao","year":"2004","unstructured":"Joao Gama, Pedro Medas, Gladys Castillo, and Pedro Rodrigues. 2004. Learning with drift detection. In Advances in Artificial Intelligence\u2013SBIA 2004. Springer, 286\u2013295."},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/2523813"},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2004.175"},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/TDSC.2007.4"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2013.01.010"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.simpat.2013.04.007"},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1002\/spe.2509"},{"key":"e_1_3_3_61_2","volume-title":"An Introduction to Neural Networks","author":"Gurney Kevin","year":"2014","unstructured":"Kevin Gurney. 2014. An Introduction to Neural Networks. CRC press."},{"key":"e_1_3_3_62_2","volume-title":"DSN 2004 Workshop on Architecting Dependable Systems, (DSN-WADS\u201904)","author":"Hawthorne Matthew J.","year":"2004","unstructured":"Matthew J. Hawthorne and Dewayne E. Perry. 2004. Applying design diversity to aspects of system architectures and deployment configurations to enhance system dependability. In DSN 2004 Workshop on Architecting Dependable Systems, (DSN-WADS\u201904)."},{"key":"e_1_3_3_63_2","volume-title":"Options, Futures, and Other Derivatives","author":"Hull John C.","year":"2006","unstructured":"John C. Hull. 2006. Options, Futures, and Other Derivatives. Pearson Education India."},{"key":"e_1_3_3_64_2","volume-title":"Continuous Delivery: Reliable Software Releases Through Build, Test, and Deployment Automation","author":"Humble Jez","year":"2010","unstructured":"Jez Humble and David Farley. 2010. Continuous Delivery: Reliable Software Releases Through Build, Test, and Deployment Automation. Pearson Education."},{"key":"e_1_3_3_65_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-010-0201-y"},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46295-0_1"},{"key":"e_1_3_3_67_2","doi-asserted-by":"publisher","DOI":"10.1109\/SEAMS.2017.11"},{"key":"e_1_3_3_68_2","doi-asserted-by":"publisher","DOI":"10.1109\/WICSA.2005.61"},{"key":"e_1_3_3_69_2","doi-asserted-by":"publisher","DOI":"10.1109\/SEAMS.2019.00024"},{"key":"e_1_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2007.256943"},{"key":"e_1_3_3_71_2","doi-asserted-by":"publisher","DOI":"10.5555\/381473.381504"},{"key":"e_1_3_3_72_2","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2018.3571227"},{"key":"e_1_3_3_73_2","doi-asserted-by":"publisher","DOI":"10.21236\/ADA382629"},{"key":"e_1_3_3_74_2","doi-asserted-by":"publisher","DOI":"10.1109\/SEAMS.2009.5069076"},{"key":"e_1_3_3_75_2","doi-asserted-by":"publisher","DOI":"10.1145\/1102351.1102408"},{"key":"e_1_3_3_76_2","doi-asserted-by":"publisher","DOI":"10.1145\/2000259.2000263"},{"key":"e_1_3_3_77_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmcj.2014.09.009"},{"key":"e_1_3_3_78_2","first-page":"777","article-title":"Sparse online learning via truncated gradient","volume":"10","author":"Langford John","year":"2009","unstructured":"John Langford, Lihong Li, and Tong Zhang. 2009. Sparse online learning via truncated gradient. Journal of Machine Learning Research 10, Mar (2009), 777\u2013801.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_3_79_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jlap.2008.08.004"},{"key":"e_1_3_3_80_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-10-5861-5_5"},{"key":"e_1_3_3_81_2","doi-asserted-by":"publisher","DOI":"10.1145\/2000259.2000275"},{"key":"e_1_3_3_82_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICAC.2016.59"},{"key":"e_1_3_3_83_2","first-page":"42","volume-title":"Software Engineering for Adaptive and Self-Managing Systems (SEAMS), 2017 IEEE\/ACM 12th International Symposium on","author":"Moreno Gabriel A.","year":"2017","unstructured":"Gabriel A. Moreno, Alessandro Vittorio Papadopoulos, Konstantinos Angelopoulos, Javier C\u00e1mara, and Bradley Schmerl. 2017. Comparing model-based predictive approaches to self-adaptation: CobRA and PLA. In Software Engineering for Adaptive and Self-Managing Systems (SEAMS), 2017 IEEE\/ACM 12th International Symposium on. IEEE, 42\u201353."},{"key":"e_1_3_3_84_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2009.327"},{"key":"e_1_3_3_85_2","doi-asserted-by":"publisher","DOI":"10.1109\/IoTDI.2015.41"},{"key":"e_1_3_3_86_2","doi-asserted-by":"publisher","DOI":"10.21236\/ADA421615"},{"key":"e_1_3_3_87_2","first-page":"239","volume-title":"Tools with Artificial Intelligence (ICTAI), 2017 IEEE 29th International Conference on","author":"Oliveira Gustavo HFM","year":"2017","unstructured":"Gustavo HFM Oliveira, Rodolfo C. Cavalcante, George G. Cabral, Leandro L. Minku, and Adriano L. I. Oliveira. 2017. Time series forecasting in the presence of concept drift: A PSO-based approach. In Tools with Artificial Intelligence (ICTAI), 2017 IEEE 29th International Conference on. IEEE, 239\u2013246."},{"key":"e_1_3_3_88_2","unstructured":"Steffen Opel. 2018. AWS Streamlines Amazon EC2 Spot Instance Pricing Model and Operational Complexity."},{"key":"e_1_3_3_89_2","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1109\/ESC.2007.8","volume-title":"Economics of Software and Computation, 2007. ESC\u201907. First International Workshop on the","author":"Ozkaya Ipek","year":"2007","unstructured":"Ipek Ozkaya, Rick Kazman, and Mark Klein. 2007. Quality-attribute based economic valuation of architectural patterns. In Economics of Software and Computation, 2007. ESC\u201907. First International Workshop on the. IEEE, 5\u20135."},{"key":"e_1_3_3_90_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2009.191"},{"key":"e_1_3_3_91_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2014.12.041"},{"key":"e_1_3_3_92_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2015.03.007"},{"key":"e_1_3_3_93_2","doi-asserted-by":"publisher","DOI":"10.1109\/ECBS.2010.16"},{"key":"e_1_3_3_94_2","doi-asserted-by":"publisher","DOI":"10.1145\/3071178.3071261"},{"key":"e_1_3_3_95_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-35623-0_17"},{"key":"e_1_3_3_96_2","volume-title":"Real Options and Investment Under Uncertainty: Classical Readings and Recent Contributions","author":"Schwartz Eduardo S.","year":"2004","unstructured":"Eduardo S. Schwartz and Lenos Trigeorgis. 2004. Real Options and Investment Under Uncertainty: Classical Readings and Recent Contributions. MIT press."},{"key":"e_1_3_3_97_2","volume-title":"Reduce Risk with Architecture Evaluation","author":"(SEI) Software Engineering Institute","year":"2018","unstructured":"Software Engineering Institute (SEI). 2018. Reduce Risk with Architecture Evaluation. Technical Report. SEI\/CMU."},{"key":"e_1_3_3_98_2","first-page":"1865","article-title":"Stochastic methods for l1-regularized loss minimization","volume":"12","author":"Shalev-Shwartz Shai","year":"2011","unstructured":"Shai Shalev-Shwartz and Ambuj Tewari. 2011. Stochastic methods for l1-regularized loss minimization. Journal of Machine Learning Research 12, Jun (2011), 1865\u20131892.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_3_99_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2012.07.020"},{"key":"e_1_3_3_100_2","article-title":"Diversifying software architecture for sustainability: A value-based perspective","author":"Sobhy Dalia","year":"2016","unstructured":"Dalia Sobhy, Rami Bahsoon, Leandro Minku, and Rick Kazman. 2016. Diversifying software architecture for sustainability: A value-based perspective. Proceedings of 2016 the European Conference on Software Architecture (ECSA) (2016).","journal-title":"Proceedings of 2016 the European Conference on Software Architecture (ECSA)"},{"key":"e_1_3_3_101_2","first-page":"110428","article-title":"Run-time evaluation of architectures: A case study of diversification in IoT","author":"Sobhy Dalia","year":"2019","unstructured":"Dalia Sobhy, Leandro Minku, Rami Bahsoon, Tao Chen, and Rick Kazman. 2019. Run-time evaluation of architectures: A case study of diversification in IoT. Journal of Systems and Software (2019), 110428.","journal-title":"Journal of Systems and Software"},{"key":"e_1_3_3_102_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-013-0394-9"},{"key":"e_1_3_3_103_2","volume-title":"Software Architecture: Foundations, Theory, and Practice","author":"Taylor Richard N.","year":"2009","unstructured":"Richard N. Taylor, Nenad Medvidovic, and Eric M. Dashofy. 2009. Software Architecture: Foundations, Theory, and Practice. Wiley Publishing."},{"key":"e_1_3_3_104_2","doi-asserted-by":"publisher","DOI":"10.1145\/2934466.2934472"},{"key":"e_1_3_3_105_2","doi-asserted-by":"publisher","DOI":"10.1109\/MIC.2007.21"},{"key":"e_1_3_3_106_2","first-page":"329","volume-title":"Rationale Management in Software Engineering","author":"Ven Jan Salvador van der","year":"2006","unstructured":"Jan Salvador van der Ven, Anton G. J. Jansen, Jos A. G. Nijhuis, and Jan Bosch. 2006. Design decisions: The bridge between rationale and architecture. In Rationale Management in Software Engineering. Springer, 329\u2013348."},{"key":"e_1_3_3_107_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSC.2013.2295791"},{"key":"e_1_3_3_108_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2014.2345380"},{"key":"e_1_3_3_109_2","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45017-3_45"},{"key":"e_1_3_3_110_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2006.12.019"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3492762","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3492762","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:53Z","timestamp":1750188653000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3492762"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,15]]},"references-count":109,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,7,31]]}},"alternative-id":["10.1145\/3492762"],"URL":"https:\/\/doi.org\/10.1145\/3492762","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,15]]},"assertion":[{"value":"2019-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-03-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}