{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,23]],"date-time":"2025-08-23T05:23:31Z","timestamp":1755926611664},"reference-count":29,"publisher":"Cambridge University Press (CUP)","issue":"5","license":[{"start":{"date-parts":[[2021,9,1]],"date-time":"2021-09-01T00:00:00Z","timestamp":1630454400000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["cambridge.org"],"crossmark-restriction":true},"short-container-title":["Nat. Lang. Eng."],"published-print":{"date-parts":[[2021,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Deep nets have done well with early adopters, but the future will soon depend on crossing the chasm. The goal of this paper is to make deep nets more accessible to a broader audience including people with little or no programming skills, and people with little interest in training new models. A github is provided with simple implementations of image classification, optical character recognition, sentiment analysis, named entity recognition, question answering (QA\/SQuAD), machine translation, speech to text (SST), and speech recognition (STT). The emphasis is on instant gratification. Non-programmers should be able to install these programs and use them in 15 minutes or less (per program). Programs are short (10\u2013100 lines each) and readable by users with modest programming skills. Much of the complexity is hidden behind abstractions such as pipelines and auto classes, and pretrained models and datasets provided by hubs: PaddleHub, PaddleNLP, HuggingFaceHub, and Fairseq. Hubs have different priorities than research. Research is training models from corpora and fine-tuning them for tasks. Users are already overwhelmed with an embarrassment of riches (13k models and 1k datasets). Do they want more? We believe the broader market is more interested in inference (how to run pretrained models on novel inputs) and less interested in training (how to create even more models).<\/jats:p>","DOI":"10.1017\/s1351324921000231","type":"journal-article","created":{"date-parts":[[2021,9,1]],"date-time":"2021-09-01T03:16:14Z","timestamp":1630466174000},"page":"631-645","update-policy":"http:\/\/dx.doi.org\/10.1017\/policypage","source":"Crossref","is-referenced-by-count":6,"title":["Emerging trends: Deep nets for poets"],"prefix":"10.1017","volume":"27","author":[{"given":"Kenneth Ward","family":"Church","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaopeng","family":"Yuan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sheng","family":"Guo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zewu","family":"Wu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yehua","family":"Yang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zeyu","family":"Chen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"56","published-online":{"date-parts":[[2021,9,1]]},"reference":[{"key":"S1351324921000231_ref7","unstructured":"Goodfellow, I. , Bengio, Y. and Courville, A. (2016). MIT Press."},{"key":"S1351324921000231_ref17","first-page":"263","article-title":"Building a large annotated corpus of English: The Penn Treebank","volume":"19","author":"Marcus","year":"1993","journal-title":"Computational Linguistics"},{"key":"S1351324921000231_ref12","unstructured":"Kernighan, B.W. and Pike, R. (1999). Addison-Wesley, USA."},{"key":"S1351324921000231_ref3","unstructured":"Bronstein, M.M. , Bruna, J. , Cohen, T. and Veli\u010dkovi\u0107, P. (2021). Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges, 2104.13478, arXiv."},{"key":"S1351324921000231_ref13","volume-title":"Elements of programming style.","author":"Kernighan","year":"1974"},{"key":"S1351324921000231_ref28","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-3007"},{"key":"S1351324921000231_ref19","volume-title":"Crossing the Chasm","author":"Moore","year":"1999"},{"key":"S1351324921000231_ref30","volume-title":"The C Programming Language","author":"Kernighan","year":"1988"},{"key":"S1351324921000231_ref16","doi-asserted-by":"publisher","DOI":"10.1145\/318723.318728"},{"key":"S1351324921000231_ref27","unstructured":"Tiedemann, J. and Thottingal, S. (2020). OPUS-MT\u2013building open translation services for the world. In Proceedings of the 22nd Annual Conference of the European Association for Machine Translation, pp. 479\u2013480."},{"key":"S1351324921000231_ref29","doi-asserted-by":"crossref","unstructured":"Wolf, T. , Debut, L. , Sanh, V. , Chaumond, J. , Delangue, C. , Moi, A. , Cistac, P. , Rault, T. , Louf, R. , Funtowicz, M. , Davison, J. , Shleifer, S. , von Platen, P. , Ma, C. , Jernite, Y. , Plu, J. , Xu, C. , Le Scao, T. , Gugger, S. , Drame, M. , Lhoest, Q. and Rush, A.M. (2019). HuggingFace\u2019s Transformers: State-of-the-art Natural Language Processing, arXiv:1910.03771","DOI":"10.18653\/v1\/2020.emnlp-demos.6"},{"key":"S1351324921000231_ref9","volume-title":"Frequency Analysis of English Usage: Lexicon and Grammar.","author":"Francis","year":"1982"},{"key":"S1351324921000231_ref2","volume-title":"Pattern Recognition and Machine Learning.","author":"Bishop","year":"2006"},{"key":"S1351324921000231_ref6","unstructured":"G\u00e9ron, A. (2019). Hands-on Machine Learning with Scikit-Learn, Keras, and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems. O\u2019Reilly Media."},{"key":"S1351324921000231_ref18","doi-asserted-by":"publisher","DOI":"10.1002\/j.1538-7305.1978.tb02135.x"},{"key":"S1351324921000231_ref20","first-page":"2825","article-title":"Coders at work: Reflections on the craft of programming, Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"Journal of Machine Learning Research"},{"key":"S1351324921000231_ref24","doi-asserted-by":"publisher","DOI":"10.1145\/321439.321441"},{"key":"S1351324921000231_ref4","volume-title":"Deep Learning with Python","author":"Chollet","year":"2017"},{"key":"S1351324921000231_ref26","volume-title":"Ernie 2.0: A Continual Pre-Training Framework for Language Understanding","author":"Sun","year":"2019"},{"key":"S1351324921000231_ref23","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00349"},{"key":"S1351324921000231_ref14","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630200106"},{"key":"S1351324921000231_ref5","unstructured":"Devlin, J. , Chang, M.-W. , Lee, K. and Toutanova, K. (2019) BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. ACL, pp. 4171\u20134186."},{"key":"S1351324921000231_ref1","unstructured":"Aho, A.V. and Kernighan, B.W. and Weinberger, P.J. (1979). Wiley Online Library, USA."},{"key":"S1351324921000231_ref11","doi-asserted-by":"publisher","DOI":"10.1002\/j.1538-7305.1978.tb02145.x"},{"key":"S1351324921000231_ref15","volume-title":"Lex: A Lexical Analyzer Generator","author":"Lesk","year":"1976"},{"key":"S1351324921000231_ref21","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D16-1264"},{"key":"S1351324921000231_ref8","first-page":"258","volume-title":"Route Finding in Street Maps by Computers and People","author":"Elliott","year":"1982"},{"key":"S1351324921000231_ref10","volume-title":"UNIX: A History and a Memoir","author":"Kernighan","year":"2019"},{"key":"S1351324921000231_ref25","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4302-1949-1"}],"container-title":["Natural Language Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S1351324921000231","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,1]],"date-time":"2021-09-01T03:18:41Z","timestamp":1630466321000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S1351324921000231\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9]]},"references-count":29,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2021,9]]}},"alternative-id":["S1351324921000231"],"URL":"https:\/\/doi.org\/10.1017\/s1351324921000231","relation":{},"ISSN":["1351-3249","1469-8110"],"issn-type":[{"value":"1351-3249","type":"print"},{"value":"1469-8110","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9]]},"assertion":[{"value":"\u00a9 The Author(s), 2021. Published by Cambridge University Press","name":"copyright","label":"Copyright","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}},{"value":"This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http:\/\/creativecommons.org\/licenses\/by\/4.0\/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.","name":"license","label":"License","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}},{"value":"This content has been made available to all.","name":"free","label":"Free to read"}]}}