{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,28]],"date-time":"2026-03-28T09:29:55Z","timestamp":1774690195902,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":27,"publisher":"ACM","license":[{"start":{"date-parts":[[2018,5,29]],"date-time":"2018-05-29T00:00:00Z","timestamp":1527552000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001807","name":"Funda\u00e7\u00e3o de Amparo \u00e0 Pesquisa do Estado de S\u00e3o Paulo","doi-asserted-by":"publisher","award":["2013\/20317-9"],"award-info":[{"award-number":["2013\/20317-9"]}],"id":[{"id":"10.13039\/501100001807","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003407","name":"Ministero dell'Istruzione, dell'Universit\u00e0 e della Ricerca","doi-asserted-by":"publisher","award":["2015KWREMX"],"award-info":[{"award-number":["2015KWREMX"]}],"id":[{"id":"10.13039\/501100003407","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100007601","name":"Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["731535"],"award-info":[{"award-number":["731535"]}],"id":[{"id":"10.13039\/501100007601","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2018,5,29]]},"DOI":"10.1145\/3194754.3194758","type":"proceedings-article","created":{"date-parts":[[2018,7,17]],"date-time":"2018-07-17T16:16:43Z","timestamp":1531844203000},"page":"29-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Do we need new strategies for testing systems-of-systems?"],"prefix":"10.1145","author":[{"given":"V\u00e2nia","family":"de Oliveira Neves","sequence":"first","affiliation":[{"name":"Universidade Federal de Juiz de Fora, Juiz de Fora, Brazil"}]},{"given":"Antonia","family":"Bertolino","sequence":"additional","affiliation":[{"name":"Consiglio Nazionale delle Ricerche, Pisa, Italy"}]},{"given":"Gugliemo","family":"De Angelis","sequence":"additional","affiliation":[{"name":"Consiglio Nazionale delle Ricerche, Rome, Italy"}]},{"given":"Lina","family":"Garc\u00e9s","sequence":"additional","affiliation":[{"name":"Universidade de S\u00e3o Paulo, S\u00e3o Carlos\/SP, Brazil"}]}],"member":"320","published-online":{"date-parts":[[2018,5,29]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2013.407"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2372251.2372290"},{"key":"e_1_3_2_1_3_1","volume-title":"Proceedings of the 9th EAI International Conference on Simulation Tools and Techniques (SIMUTOOLS'16)","author":"Arnold A.","unstructured":"A. Arnold , M. Baleani , A. Ferrari , M. Marazza , V. Senni , A. Legay , J. Quilbeuf , and C. Etzien . 2016. An Application of SMC to Continuous Validation of Heterogeneous Systems . In Proceedings of the 9th EAI International Conference on Simulation Tools and Techniques (SIMUTOOLS'16) . ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), ICST, Brussels, Belgium, Belgium, 76--85. A. Arnold, M. Baleani, A. Ferrari, M. Marazza, V. Senni, A. Legay, J. Quilbeuf, and C. Etzien. 2016. An Application of SMC to Continuous Validation of Heterogeneous Systems. In Proceedings of the 9th EAI International Conference on Simulation Tools and Techniques (SIMUTOOLS'16). ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), ICST, Brussels, Belgium, Belgium, 76--85."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2010.10.024"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2009.28"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2011.227"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183440.3183497"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-68524-1_19"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSTW.2009.39"},{"key":"e_1_3_2_1_10_1","article-title":"Interoperability test and evaluation: A systems of systems field study","author":"Colombi J.","year":"2008","unstructured":"J. Colombi , B. C. Cohee , and Chuck W. Turner . 2008 . Interoperability test and evaluation: A systems of systems field study . The Journal of Defense Software Engineering (Nov 2008), 10--14. J. Colombi, B. C. Cohee, and Chuck W. Turner. 2008. Interoperability test and evaluation: A systems of systems field study. The Journal of Defense Software Engineering (Nov 2008), 10--14.","journal-title":"The Journal of Defense Software Engineering"},{"key":"e_1_3_2_1_11_1","volume-title":"2010 5th International Conference on System of Systems Engineering. 1--6.","author":"Dahmann J.","unstructured":"J. Dahmann , J. A. Lane , G. Rebovich , and R. Lowry . 2010. Systems of systems test and evaluation challenges . In 2010 5th International Conference on System of Systems Engineering. 1--6. J. Dahmann, J. A. Lane, G. Rebovich, and R. Lowry. 2010. Systems of systems test and evaluation challenges. In 2010 5th International Conference on System of Systems Engineering. 1--6."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-02161-9_1"},{"key":"e_1_3_2_1_13_1","first-page":"2","article-title":"Applying Structural Testing to Services Using Testing Interfaces and Metadata","volume":"7","author":"Eler M. M.","year":"2013","unstructured":"M. M. Eler , A. Bertolino , and P. C. Masiero . 2013 . Applying Structural Testing to Services Using Testing Interfaces and Metadata . International Journal of Software and Informatics (IJSI) 7 , 2 (April 2013), 239--271. M. M. Eler, A. Bertolino, and P. C. Masiero. 2013. Applying Structural Testing to Services Using Testing Interfaces and Metadata. International Journal of Software and Informatics (IJSI) 7, 2 (April 2013), 239--271.","journal-title":"International Journal of Software and Informatics (IJSI)"},{"key":"e_1_3_2_1_14_1","volume-title":"Unmanned and Autonomous Systems of Systems Test and Evaluation: Challenges and Opportunities. In IEEE Systems Conference. 15 pp.-.","author":"Ferreira S.","unstructured":"S. Ferreira , R. Valerdi , N. Medvidovi\u0107 , J. Hess , I. Deonandan , T. Mikaelian , and G. Shull . 2010 . Unmanned and Autonomous Systems of Systems Test and Evaluation: Challenges and Opportunities. In IEEE Systems Conference. 15 pp.-. S. Ferreira, R. Valerdi, N. Medvidovi\u0107, J. Hess, I. Deonandan, T. Mikaelian, and G. Shull. 2010. Unmanned and Autonomous Systems of Systems Test and Evaluation: Challenges and Opportunities. In IEEE Systems Conference. 15 pp.-."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"crossref","unstructured":"M. Gagliardi B. Wood and T. Morrow. 2013. Introduction to the Mission Thread Workshop. Technical Report. Software Engineering Institute Pittsburgh PA.  M. Gagliardi B. Wood and T. Morrow. 2013. Introduction to the Mission Thread Workshop. Technical Report. Software Engineering Institute Pittsburgh PA.","DOI":"10.21236\/ADA610474"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAIC-PART.2008.14"},{"key":"e_1_3_2_1_17_1","volume-title":"2010 5th International Conference on System of Systems Engineering. 1--6.","author":"Hess J. T.","unstructured":"J. T. Hess and R. Valerdi . 2010. Test and evaluation of a SoS using a prescriptive and adaptive testing framework . In 2010 5th International Conference on System of Systems Engineering. 1--6. J. T. Hess and R. Valerdi. 2010. Test and evaluation of a SoS using a prescriptive and adaptive testing framework. In 2010 5th International Conference on System of Systems Engineering. 1--6."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TR.2011.2104490"},{"key":"e_1_3_2_1_19_1","volume-title":"System of systems engineering: innovations for the 21st century","author":"Jamshidi M.","unstructured":"M. Jamshidi . 2009. System of systems engineering: innovations for the 21st century . John Wiley & Sons . M. Jamshidi. 2009. System of systems engineering: innovations for the 21st century. John Wiley & Sons."},{"key":"e_1_3_2_1_20_1","volume-title":"Randomization in Searching for Composites of Software Components. In 2007 IEEE International Conference on Information Reuse and Integration. 42--48","author":"Liang Q.","unstructured":"Q. Liang and S. H. Rubin . 2007 . Randomization in Searching for Composites of Software Components. In 2007 IEEE International Conference on Information Reuse and Integration. 42--48 . Q. Liang and S. H. Rubin. 2007. Randomization in Searching for Composites of Software Components. In 2007 IEEE International Conference on Information Reuse and Integration. 42--48."},{"key":"e_1_3_2_1_21_1","volume-title":"2009 IEEE International Conference on Information Reuse Integration. 110--114","author":"Liang Q.","unstructured":"Q. Liang and S. H. Rubin . 2009. Randomization for testing systems of systems . In 2009 IEEE International Conference on Information Reuse Integration. 110--114 . Q. Liang and S. H. Rubin. 2009. Randomization for testing systems of systems. In 2009 IEEE International Conference on Information Reuse Integration. 110--114."},{"key":"e_1_3_2_1_22_1","volume-title":"Cihan H. Dagli (Ed.)","volume":"20","author":"Luna S.","unstructured":"S. Luna , A. J. Lopes , H. Y. S. Tao , F. Zapata , and R. Pineda . 2013. Integration, Verification, Validation, Test, and Evaluation (IVVT&E) Framework for System of Systems (SoS).. In Complex Adaptive Systems (Procedia Computer Science) , Cihan H. Dagli (Ed.) , Vol. 20 . Elsevier, 298--305. S. Luna, A. J. Lopes, H. Y. S. Tao, F. Zapata, and R. Pineda. 2013. Integration, Verification, Validation, Test, and Evaluation (IVVT&E) Framework for System of Systems (SoS).. In Complex Adaptive Systems (Procedia Computer Science), Cihan H. Dagli (Ed.), Vol. 20. Elsevier, 298--305."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1520-6858(1998)1:4<267::AID-SYS3>3.0.CO;2-D"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2794381"},{"key":"e_1_3_2_1_26_1","volume-title":"2015 10th System of Systems Engineering Conference (SoSE). 346--351","author":"Silva E.","unstructured":"E. Silva , T. Batista , and F. Oquendo . 2015. A mission-oriented approach for designing system-of-systems . In 2015 10th System of Systems Engineering Conference (SoSE). 346--351 . E. Silva, T. Batista, and F. Oquendo. 2015. A mission-oriented approach for designing system-of-systems. In 2015 10th System of Systems Engineering Conference (SoSE). 346--351."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"crossref","unstructured":"W. Yun D. Shin and D. H. Bae. 2017. Mutation Analysis for System of Systems Policy Testing. In 2017 IEEE\/ACM Joint 5th International Workshop on Software Engineering for Systems-of-Systems and 11th Workshop on Distributed Software Development Software Ecosystems and Systems-of-Systems (JSOS). 16--22.   W. Yun D. Shin and D. H. Bae. 2017. Mutation Analysis for System of Systems Policy Testing. In 2017 IEEE\/ACM Joint 5th International Workshop on Software Engineering for Systems-of-Systems and 11th Workshop on Distributed Software Development Software Ecosystems and Systems-of-Systems (JSOS). 16--22.","DOI":"10.1109\/JSOS.2017.9"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2013.09.270"}],"event":{"name":"ICSE '18: 40th International Conference on Software Engineering","location":"Gothenburg Sweden","acronym":"ICSE '18","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","IEEE-CS Computer Society"]},"container-title":["Proceedings of the 6th International Workshop on Software Engineering for Systems-of-Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3194754.3194758","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3194754.3194758","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T19:07:23Z","timestamp":1750273643000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3194754.3194758"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,5,29]]},"references-count":27,"alternative-id":["10.1145\/3194754.3194758","10.1145\/3194754"],"URL":"https:\/\/doi.org\/10.1145\/3194754.3194758","relation":{},"subject":[],"published":{"date-parts":[[2018,5,29]]},"assertion":[{"value":"2018-05-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}