{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T15:09:28Z","timestamp":1784300968667,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":25,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,5,9]],"date-time":"2022-05-09T00:00:00Z","timestamp":1652054400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,5,9]]},"DOI":"10.1145\/3524846.3527339","type":"proceedings-article","created":{"date-parts":[[2023,1,27]],"date-time":"2023-01-27T23:08:56Z","timestamp":1674860936000},"page":"15-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["SR-MT"],"prefix":"10.1145","author":[{"given":"Feifei","family":"Wang","sequence":"first","affiliation":[{"name":"Naval University of Engineering, Wuhan, Hubei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kerong","family":"Ben","sequence":"additional","affiliation":[{"name":"Naval University of Engineering, Wuhan, Hubei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xian","family":"Zhang","sequence":"additional","affiliation":[{"name":"Naval University of Engineering, Wuhan, Hubei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,1,27]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME46990.2020.00066"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2014.2372785"},{"key":"e_1_3_2_1_3_1","volume-title":"Metamorphic Testing of Navigation Software: A Pilot Study with Google Maps. In 51st Hawaii International Conference on System Sciences, HICSS 2018","author":"Brown Joshua","year":"2018","unstructured":"Joshua Brown , Zhi Quan Zhou , and Yang-Wai Chow . 2018 . Metamorphic Testing of Navigation Software: A Pilot Study with Google Maps. In 51st Hawaii International Conference on System Sciences, HICSS 2018 , Hilton Waikoloa Village, Hawaii, USA, January 3--6 , 2018, Tung Bui (Ed.). ScholarSpace \/ AIS Electronic Library (AISeL), 1--10. Joshua Brown, Zhi Quan Zhou, and Yang-Wai Chow. 2018. Metamorphic Testing of Navigation Software: A Pilot Study with Google Maps. In 51st Hawaii International Conference on System Sciences, HICSS 2018, Hilton Waikoloa Village, Hawaii, USA, January 3--6, 2018, Tung Bui (Ed.). ScholarSpace \/ AIS Electronic Library (AISeL), 1--10."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3440755"},{"key":"e_1_3_2_1_5_1","volume-title":"Metamorphic Testing: A Review of Challenges and Opportunities. ACM Comput. Surv. 51, 1","author":"Chen Tsong Yueh","year":"2018","unstructured":"Tsong Yueh Chen , Fei-Ching Kuo , Huai Liu , Pak-Lok Poon , Dave Towey , T. H. Tse , and Zhi Quan Zhou . 2018 . Metamorphic Testing: A Review of Challenges and Opportunities. ACM Comput. Surv. 51, 1 (2018), 4:1--4:27. Tsong Yueh Chen, Fei-Ching Kuo, Huai Liu, Pak-Lok Poon, Dave Towey, T. H. Tse, and Zhi Quan Zhou. 2018. Metamorphic Testing: A Review of Challenges and Opportunities. ACM Comput. Surv. 51, 1 (2018), 4:1--4:27."},{"key":"e_1_3_2_1_6_1","volume-title":"Deep-cruiser: Automated guided testing for stateful deep learning systems. arXiv preprint arXiv:1812.05339","author":"Du Xiaoning","year":"2018","unstructured":"Xiaoning Du , Xiaofei Xie , Yi Li , Lei Ma , Jianjun Zhao , and Yang Liu . 2018 . Deep-cruiser: Automated guided testing for stateful deep learning systems. arXiv preprint arXiv:1812.05339 (2018). Xiaoning Du, Xiaofei Xie, Yi Li, Lei Ma, Jianjun Zhao, and Yang Liu. 2018. Deep-cruiser: Automated guided testing for stateful deep learning systems. arXiv preprint arXiv:1812.05339 (2018)."},{"key":"e_1_3_2_1_7_1","volume-title":"Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2018","author":"Dwarakanath Anurag","year":"2018","unstructured":"Anurag Dwarakanath , Manish Ahuja , Samarth Sikand , Raghotham M. Rao , and R. P. Jagadeesh Chandra Bose and. 2018. Identifying implementation bugs in machine learning based image classifiers using metamorphic testing . In Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2018 , Amsterdam, The Netherlands, July 16--21 , 2018 , Frank Tip and Eric Bodden (Eds.). ACM, 118--128. Anurag Dwarakanath, Manish Ahuja, Samarth Sikand, Raghotham M. Rao, and R. P. Jagadeesh Chandra Bose and. 2018. Identifying implementation bugs in machine learning based image classifiers using metamorphic testing. In Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2018, Amsterdam, The Netherlands, July 16--21, 2018, Frank Tip and Eric Bodden (Eds.). ACM, 118--128."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.6028\/NIST.IR.4930"},{"key":"e_1_3_2_1_9_1","volume-title":"Time-scale modification of audio signals using enhanced WSOLA with management of transients","author":"Grofit Shahaf","year":"2007","unstructured":"Shahaf Grofit and Yizhar Lavner . 2007. Time-scale modification of audio signals using enhanced WSOLA with management of transients . IEEE transactions on audio, speech, and language processing 16, 1 ( 2007 ), 106--115. Shahaf Grofit and Yizhar Lavner. 2007. Time-scale modification of audio signals using enhanced WSOLA with management of transients. IEEE transactions on audio, speech, and language processing 16, 1 (2007), 106--115."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2016.7472763"},{"key":"e_1_3_2_1_11_1","volume-title":"Metamorphic Robustness Testing of Google Translate. In ICSE '20: 42nd International Conference on Software Engineering","author":"Lee Dickson T. S.","year":"2020","unstructured":"Dickson T. S. Lee , Zhi Quan Zhou , and T. H. Tse . 2020 . Metamorphic Robustness Testing of Google Translate. In ICSE '20: 42nd International Conference on Software Engineering , Workshops, Seoul, Republic of Korea, 27 June - 19 July , 2020 . ACM, 388--395. Dickson T. S. Lee, Zhi Quan Zhou, and T. H. Tse. 2020. Metamorphic Robustness Testing of Google Translate. In ICSE '20: 42nd International Conference on Software Engineering, Workshops, Seoul, Republic of Korea, 27 June - 19 July, 2020. ACM, 388--395."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2015.348"},{"key":"e_1_3_2_1_13_1","volume-title":"Proceedings of the Second International Conference on Language Resources and Evaluation, LREC 2000","author":"Nie\u00dfen Sonja","year":"2000","unstructured":"Sonja Nie\u00dfen , Franz Josef Och , Gregor Leusch , and Hermann Ney . 2000 . An Evaluation Tool for Machine Translation: Fast Evaluation for MT Research . In Proceedings of the Second International Conference on Language Resources and Evaluation, LREC 2000 , 31 May - June 2, 2000, Athens, Greece. European Language Resources Association. Sonja Nie\u00dfen, Franz Josef Och, Gregor Leusch, and Hermann Ney. 2000. An Evaluation Tool for Machine Translation: Fast Evaluation for MT Research. In Proceedings of the Second International Conference on Language Resources and Evaluation, LREC 2000, 31 May - June 2, 2000, Athens, Greece. European Language Resources Association."},{"key":"e_1_3_2_1_14_1","volume-title":"Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, July 6--12","author":"Papineni Kishore","year":"2002","unstructured":"Kishore Papineni , Salim Roukos , Todd Ward , and Wei-Jing Zhu . 2002 . Bleu: a Method for Automatic Evaluation of Machine Translation . In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, July 6--12 , 2002, Philadelphia, PA, USA. ACL, 311--318. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: a Method for Automatic Evaluation of Machine Translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, July 6--12, 2002, Philadelphia, PA, USA. ACL, 311--318."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/BioMedCom.2012.17"},{"key":"e_1_3_2_1_16_1","volume-title":"International conference on machine learning. PMLR, 5231--5240","author":"Qin Yao","year":"2019","unstructured":"Yao Qin , Nicholas Carlini , Garrison Cottrell , Ian Goodfellow , and Colin Raffel . 2019 . Imperceptible, robust, and targeted adversarial examples for automatic speech recognition . In International conference on machine learning. PMLR, 5231--5240 . Yao Qin, Nicholas Carlini, Garrison Cottrell, Ian Goodfellow, and Colin Raffel. 2019. Imperceptible, robust, and targeted adversarial examples for automatic speech recognition. In International conference on machine learning. PMLR, 5231--5240."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2017.2764464"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00530-014-0446-1"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICWS.2011.65"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180220"},{"key":"e_1_3_2_1_21_1","volume-title":"The Voice Conversion Challenge","author":"Toda Tomoki","year":"2016","unstructured":"Tomoki Toda , Ling-Hui Chen , Daisuke Saito , Fernando Villavicencio , Mirjam Wester , Zhizheng Wu , and Junichi Yamagishi . 2016. The Voice Conversion Challenge 2016 .. In Interspeech . 1632--1636. Tomoki Toda, Ling-Hui Chen, Daisuke Saito, Fernando Villavicencio, Mirjam Wester, Zhizheng Wu, and Junichi Yamagishi. 2016. The Voice Conversion Challenge 2016.. In Interspeech. 1632--1636."},{"key":"e_1_3_2_1_22_1","volume-title":"Adversarial attacks and defenses for speech recognition systems. arXiv preprint arXiv:2103.17122","author":"Zelasko Piotr","year":"2021","unstructured":"Piotr Zelasko , Sonal Joshi , Yiwen Shao , Jesus Villalba , Jan Trmal , Najim Dehak , and Sanjeev Khudanpur . 2021. Adversarial attacks and defenses for speech recognition systems. arXiv preprint arXiv:2103.17122 ( 2021 ). Piotr Zelasko, Sonal Joshi, Yiwen Shao, Jesus Villalba, Jan Trmal, Najim Dehak, and Sanjeev Khudanpur. 2021. Adversarial attacks and defenses for speech recognition systems. arXiv preprint arXiv:2103.17122 (2021)."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2019.2915065"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2015.2478001"},{"key":"e_1_3_2_1_25_1","volume-title":"Datamorphic Testing: A Method for Testing Intelligent Applications. In IEEE International Conference On Artificial Intelligence Testing, AITest 2019","author":"Zhu Hong","year":"2019","unstructured":"Hong Zhu , Dongmei Liu , Ian Bayley , Rachel Harrison , and Fabio Cuzzolin . 2019 . Datamorphic Testing: A Method for Testing Intelligent Applications. In IEEE International Conference On Artificial Intelligence Testing, AITest 2019 , Newark, CA, USA, April 4--9 , 2019. IEEE, 149--156. Hong Zhu, Dongmei Liu, Ian Bayley, Rachel Harrison, and Fabio Cuzzolin. 2019. Datamorphic Testing: A Method for Testing Intelligent Applications. In IEEE International Conference On Artificial Intelligence Testing, AITest 2019, Newark, CA, USA, April 4--9, 2019. IEEE, 149--156."}],"event":{"name":"ICSE '22: 44th International Conference on Software Engineering","location":"Pittsburgh Pennsylvania","acronym":"ICSE '22","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","IEEE CS"]},"container-title":["Proceedings of the 7th International Workshop on Metamorphic Testing"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3524846.3527339","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3524846.3527339","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:09:36Z","timestamp":1750183776000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3524846.3527339"}},"subtitle":["a metamorphic method to test the robustness of speech recognition software"],"short-title":[],"issued":{"date-parts":[[2022,5,9]]},"references-count":25,"alternative-id":["10.1145\/3524846.3527339","10.1145\/3524846"],"URL":"https:\/\/doi.org\/10.1145\/3524846.3527339","relation":{},"subject":[],"published":{"date-parts":[[2022,5,9]]},"assertion":[{"value":"2023-01-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}