{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2022,12,27]],"date-time":"2022-12-27T06:09:07Z","timestamp":1672121347607},"reference-count":52,"publisher":"MIT Press","license":[{"start":{"date-parts":[[2021,5,4]],"date-time":"2021-05-04T00:00:00Z","timestamp":1620086400000},"content-version":"vor","delay-in-days":123,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,5,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We introduce a novel paraphrastic augmentation strategy based on sentence-level lexically constrained paraphrasing and discriminative span alignment. Our approach allows for the large-scale expansion of existing datasets or the rapid creation of new datasets using a small, manually produced seed corpus. We demonstrate our approach with experiments on the Berkeley FrameNet Project, a large-scale language understanding effort spanning more than two decades of human labor. With four days of training data collection for a span alignment model and one day of parallel compute, we automatically generate and release to the community 495,300 unique (Frame,Trigger) pairs in diverse sentential contexts, a roughly 50-fold expansion atop FrameNet v1.7. The resulting dataset is intrinsically and extrinsically evaluated in detail, showing positive results on a downstream task.<\/jats:p>","DOI":"10.1162\/tacl_a_00380","type":"journal-article","created":{"date-parts":[[2021,5,5]],"date-time":"2021-05-05T00:21:35Z","timestamp":1620174095000},"page":"494-509","update-policy":"http:\/\/dx.doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":0,"title":["Iterative Paraphrastic Augmentation with Discriminative Span Alignment"],"prefix":"10.1162","volume":"9","author":[{"given":"Ryan","family":"Culkin","sequence":"first","affiliation":[{"name":"Johns Hopkins University, United States. rculkin@jhu.edu"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"J. Edward","family":"Hu","sequence":"additional","affiliation":[{"name":"Johns Hopkins University, United States. edward.hu@jhu.edu"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Elias","family":"Stengel-Eskin","sequence":"additional","affiliation":[{"name":"Johns Hopkins University, United States. elias@jhu.edu"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guanghui","family":"Qin","sequence":"additional","affiliation":[{"name":"Johns Hopkins University, United States. gqin@jhu.edu"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Benjamin Van","family":"Durme","sequence":"additional","affiliation":[{"name":"Johns Hopkins University, United States. vandurme@jhu.edu"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","published-online":{"date-parts":[[2021,5,4]]},"reference":[{"key":"2021060823404496600_bib1","article-title":"A BERT Baseline for the Natural Questions","author":"Alberti","year":"2019"},{"key":"2021060823404496600_bib2","doi-asserted-by":"crossref","first-page":"556","DOI":"10.1162\/tacl_a_00333","article-title":"Task-oriented dialogue as dataflow synthesis","volume":"8","author":"Andreas","year":"2020","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2021060823404496600_bib3","doi-asserted-by":"crossref","DOI":"10.3115\/1621474.1621492","article-title":"Frame semantic structure extraction","volume-title":"SemEval","author":"Baker","year":"2007"},{"key":"2021060823404496600_bib4","doi-asserted-by":"crossref","DOI":"10.3115\/v1\/P14-1133","article-title":"Semantic parsing via paraphrasing","volume-title":"ACL","author":"Berant","year":"2014"},{"issue":"2","key":"2021060823404496600_bib5","first-page":"263","article-title":"The mathematics of statistical machine translation: Parameter estimation","volume":"19","author":"Brown","year":"1993","journal-title":"Computational Linguistics"},{"key":"2021060823404496600_bib6","article-title":"Approaching textual entailment with lfg and framenet frames","author":"Burchardt","year":"2006"},{"key":"2021060823404496600_bib7","first-page":"1223","article-title":"Parsing paraphrases with joint inference","volume-title":"Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)","author":"Do","year":"2015"},{"issue":"4","key":"2021060823404496600_bib8","doi-asserted-by":"crossref","first-page":"597","DOI":"10.1162\/coli.08-003-R1-07-044","article-title":"Constructing corpora for the development and evaluation of paraphrase systems","volume":"34","author":"Cohn","year":"2008","journal-title":"Computational Linguistics"},{"issue":"1","key":"2021060823404496600_bib9","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1162\/COLI_a_00163","article-title":"Frame-Semantic Parsing","volume":"40","author":"Das","year":"2014","journal-title":"Computational Linguistics"},{"key":"2021060823404496600_bib10","article-title":"Semi-supervised frame-semantic parsing for unknown predicates","volume-title":"Association for Computational Linguistics and Human Language Technology (ACL-HLT)","author":"Das","year":"2011"},{"key":"2021060823404496600_bib11","first-page":"948","article-title":"Probabilistic frame-semantic parsing","volume-title":"NAACL","author":"Das","year":"2010"},{"key":"2021060823404496600_bib12","article-title":"BERT: Pre-training of deep bidirectional transformers for language understanding","author":"Devlin","year":"2018","journal-title":"CoRR"},{"key":"2021060823404496600_bib13","article-title":"Automatically constructing a corpus of sentential paraphrases","volume-title":"IWP","author":"Dolan","year":"2005"},{"key":"2021060823404496600_bib14","first-page":"644","article-title":"A simple, fast, and effective reparameterization of IBM Model 2","volume-title":"NAACL:HLT","author":"Dyer","year":"2013"},{"key":"2021060823404496600_bib15","volume-title":"Linguistics in the Morning Calm: Selected Papers from SICOL-1981","author":"Fillmore","year":"1982"},{"key":"2021060823404496600_bib16","first-page":"758","article-title":"PPDB: The paraphrase database","volume-title":"NAACL-HLT","author":"Ganitkevitch","year":"2013"},{"issue":"3","key":"2021060823404496600_bib17","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1162\/089120102760275983","article-title":"Automatic labeling of semantic roles","volume":"28","author":"Gildea","year":"2002","journal-title":"Computational Linguistics"},{"key":"2021060823404496600_bib18","doi-asserted-by":"crossref","DOI":"10.3115\/v1\/P14-1136","article-title":"Semantic frame identification with distributed word representations","volume-title":"ACL","author":"Hermann","year":"2014"},{"issue":"8","key":"2021060823404496600_bib19","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long Short-Term Memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Computation"},{"key":"2021060823404496600_bib20","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/N19-1090","article-title":"Improved lexically constrained decoding for translation and monolingual rewriting","volume-title":"NAACL","author":"Hu","year":"2019"},{"key":"2021060823404496600_bib21","doi-asserted-by":"crossref","DOI":"10.1609\/aaai.v33i01.33016521","article-title":"ParaBank: Monolingual bitext generation and sentential paraphrasing via lexically-constrained neural machine translation","author":"Hu","year":"2019","journal-title":"AAAI"},{"key":"2021060823404496600_bib22","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/K19-1005","article-title":"Large-scale, diverse, paraphrastic bitexts via sampling and clustering","volume-title":"CoNLL","author":"Hu","year":"2019"},{"key":"2021060823404496600_bib23","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1162\/tacl_a_00300","article-title":"Spanbert: Improving pre-training by representing and predicting spans","volume":"8","author":"Joshi","year":"2020","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2021060823404496600_bib24","doi-asserted-by":"crossref","DOI":"10.21437\/Interspeech.2015-711","article-title":"Audio augmentation for speech recognition","volume-title":"Sixteenth Annual Conference of ISCA","author":"Ko","year":"2015"},{"key":"2021060823404496600_bib25","doi-asserted-by":"crossref","DOI":"10.3115\/v1\/P15-2036","article-title":"Frame-semantic role labeling with heterogeneous annotations","volume-title":"Association for Computational Linguistics and International Joint Conference on Natural Language Processing (ACL-IJCNLP)","author":"Kshirsagar","year":"2015"},{"key":"2021060823404496600_bib26","first-page":"66","article-title":"Sentencepiece: A simple and language independent subword tokenizer and detokenizer for neural text processing.","volume-title":"EMNLP 2018: System Demonstrations","author":"Kudo","year":"2018"},{"key":"2021060823404496600_bib27","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/N19-1363","article-title":"Submodular optimization-based diverse paraphrasing and its effectiveness in data augmentation","volume-title":"NAACL: HLT","author":"Kumar","year":"2019"},{"key":"2021060823404496600_bib28","doi-asserted-by":"crossref","first-page":"2833","DOI":"10.18653\/v1\/D19-1283","article-title":"Learning with limited data for multilingual reading comprehension","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Lee","year":"2019"},{"key":"2021060823404496600_bib29","first-page":"881","article-title":"Paraphrasing revisited with neural machine translation","volume-title":"EACL","author":"Mallinson","year":"2017"},{"key":"2021060823404496600_bib30","first-page":"4724","article-title":"Neural network alignment for sentential paraphrases","volume-title":"ACL","author":"Ouyang","year":"2019"},{"key":"2021060823404496600_bib31","doi-asserted-by":"crossref","DOI":"10.3115\/v1\/P15-2067","article-title":"FrameNet+: Fast Paraphrastic Tripling of FrameNet","volume-title":"ACL 2015","author":"Pavlick","year":"2015"},{"key":"2021060823404496600_bib32","first-page":"1492","article-title":"Learning Joint Semantic Parsers from Disjoint Data","volume-title":"North American Association for Computational Linguistics (NAACL)","author":"Peng","year":"2018"},{"key":"2021060823404496600_bib33","doi-asserted-by":"crossref","DOI":"10.3115\/v1\/D14-1162","article-title":"GloVe: Global Vector for Word Representation","volume-title":"Empirical Methods in Natural Language Processing (EMNLP)","author":"Pennington","year":"2014"},{"key":"2021060823404496600_bib34","first-page":"1314","article-title":"Fast lexically constrained decoding with dynamic beam allocation for neural machine translation","volume-title":"NAACL","author":"Post","year":"2018"},{"key":"2021060823404496600_bib35","doi-asserted-by":"crossref","DOI":"10.21437\/Interspeech.2014-207","article-title":"Data augmentation for low resource languages","volume-title":"Fifteenth Annual Conference ISCA","author":"Ragni","year":"2014"},{"key":"2021060823404496600_bib36","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/P18-1079","article-title":"Semantically equivalent adversarial rules for debugging NLP models","volume-title":"ACL","author":"Ribeiro","year":"2018"},{"key":"2021060823404496600_bib37","doi-asserted-by":"crossref","DOI":"10.1162\/tacl_a_00150","article-title":"Context-aware Frame-Semantic Role Labeling","author":"Roth","year":"2015","journal-title":"Transactions of the Association for Computational Linguistics (TACL)"},{"key":"2021060823404496600_bib38","doi-asserted-by":"crossref","first-page":"6033","DOI":"10.18653\/v1\/P19-1605","article-title":"Unsupervised paraphrasing without translation","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Roy","year":"2019"},{"key":"2021060823404496600_bib39","first-page":"104","article-title":"Semantic frames as an anchor representation for sentiment analysis","volume-title":"The Workshop in Computational Approaches to Subjectivity and Sentiment Analysis","author":"Ruppenhofer","year":"2012"},{"key":"2021060823404496600_bib40","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/D17-2001","article-title":"The NLTK FrameNet API: Designing for discoverability with a rich linguistic resource","volume-title":"Empirical Methods in Natural Language Processing (EMNLP)","author":"Schneider","year":"2017"},{"key":"2021060823404496600_bib41","first-page":"12","article-title":"Using semantic roles to improve question answering","volume-title":"EMNLP-CoNLL","author":"Shen","year":"2007"},{"issue":"1","key":"2021060823404496600_bib42","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1186\/s40537-019-0197-0","article-title":"A survey on image data augmentation for deep learning","volume":"6","author":"Shorten","year":"2019","journal-title":"Journal of Big Data"},{"issue":"Jun","key":"2021060823404496600_bib43","first-page":"2063","article-title":"Pattern for Python","volume":"13","author":"Smedt","year":"2012","journal-title":"Journal of Machine Learning Research"},{"key":"2021060823404496600_bib44","doi-asserted-by":"crossref","DOI":"10.3115\/1220175.1220276","article-title":"Semantic taxonomy induction from heterogenous evidence","volume-title":"ICCL\/ACL","author":"Snow","year":"2006"},{"key":"2021060823404496600_bib45","first-page":"909","article-title":"A discriminative neural model for cross-lingual word alignment","volume-title":"EMNLP-IJCNLP","author":"Stengel-Eskin","year":"2019"},{"key":"2021060823404496600_bib46","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/D18-1412","article-title":"Syntactic Scaffolds for Semantic Structures","volume-title":"Empirical Methods in Natural Language Processing (EMNLP)","author":"Swayamdipta","year":"2018"},{"key":"2021060823404496600_bib47","doi-asserted-by":"crossref","DOI":"10.1109\/CVPR.2016.308","article-title":"Rethinking the Inception Architecture for Computer Vision","volume-title":"Computer Vision and Pattern Recognition (CVPR)","author":"Szegedy","year":"2016"},{"key":"2021060823404496600_bib48","article-title":"A task in a suit and a tie: paraphrase generation with semantic augmentation","author":"Wang","year":"2018"},{"key":"2021060823404496600_bib49","doi-asserted-by":"crossref","DOI":"10.3115\/v1\/P15-1129","article-title":"Building a semantic parser overnight","volume-title":"ACL-IJCNLP","author":"Wang","year":"2015"},{"key":"2021060823404496600_bib50","first-page":"451","article-title":"ParaNMT-50M: Pushing the limits of paraphrastic sentence embeddings with millions of machine translations","volume-title":"ACL","author":"Wieting","year":"2018"},{"key":"2021060823404496600_bib51","first-page":"702","article-title":"A lightweight and high performance monolingual word aligner","volume-title":"ACL","author":"Yao","year":"2013"},{"key":"2021060823404496600_bib52","first-page":"590","article-title":"Semi- Markov phrase-based monolingual alignment","volume-title":"EMNLP","author":"Yao","year":"2013"}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/tacl\/article-pdf\/doi\/10.1162\/tacl_a_00380\/1924197\/tacl_a_00380.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/tacl\/article-pdf\/doi\/10.1162\/tacl_a_00380\/1924197\/tacl_a_00380.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,26]],"date-time":"2022-12-26T10:24:58Z","timestamp":1672050298000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/doi\/10.1162\/tacl_a_00380\/100783\/Iterative-Paraphrastic-Augmentation-with"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021]]},"references-count":52,"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00380","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021]]},"published":{"date-parts":[[2021]]}}}