{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,7,15]],"date-time":"2024-07-15T05:55:59Z","timestamp":1721022959621},"reference-count":51,"publisher":"MIT Press","issue":"3","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,2,17]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>The past 10 years have witnessed an explosion in deep learning neural network model development. The most common perceptual models with vision, speech, and text inputs are not general-purpose AI systems but tools. They automatically extract clues from inputs and compute probabilities of class labels. Successful applications require representative training data, an understanding of the limitations and capabilities of deep learning, and careful attention to a complex development process. The goal of this view is to foster an intuitive understanding of convolutional network deep learning models and how to use them with the goal of engaging a wider creative community. A focus is to make it possible for experts in areas such as health, education, poverty, and agriculture to understand the process of deep learning model development so they can help transition effective solutions to practice.<\/jats:p>","DOI":"10.1162\/neco_a_01518","type":"journal-article","created":{"date-parts":[[2022,8,26]],"date-time":"2022-08-26T22:05:18Z","timestamp":1661551518000},"page":"287-308","update-policy":"http:\/\/dx.doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":2,"title":["Understanding and Applying Deep Learning"],"prefix":"10.1162","volume":"35","author":[{"given":"Richard","family":"Lippmann","sequence":"first","affiliation":[{"name":"IEEE Life Fellow; Wayland, MA 01778, U.S.A. richardp.lippmann@gmail.com"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","published-online":{"date-parts":[[2023,2,17]]},"reference":[{"key":"2023021720443022100_","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1016\/j.inffus.2021.05.008","article-title":"A review of uncertainty quantification in deep learning: Techniques, applications and challenges","volume":"76","author":"Abdar","year":"2021","journal-title":"Information Fusion"},{"key":"2023021720443022100_","volume-title":"Advances in neural information processing systems","author":"Barbu","year":"2019"},{"key":"2023021720443022100_","author":"Bommasani","year":"2021","journal-title":"On the opportunities and risks of foundation models"},{"issue":"12","key":"2023021720443022100_","doi-asserted-by":"publisher","DOI":"10.3390\/antibiotics10121480","article-title":"Assessment of the antibacterial efficacy of halicin against pathogenic bacteria","volume":"10","author":"Booq","year":"2021","journal-title":"Antibiotics"},{"key":"2023021720443022100_","author":"Brown","year":"2020","journal-title":"Language models are few-shot learners"},{"issue":"8","key":"2023021720443022100_","doi-asserted-by":"publisher","first-page":"1655","DOI":"10.1109\/JPROC.2019.2921977","article-title":"Deep learning with edge computing: A review","volume":"107","author":"Chen","year":"2019","journal-title":"Proceedings of the IEEE"},{"key":"2023021720443022100_","author":"Chen","year":"2021","journal-title":"WavLM: Large-scale self-supervised pre-training for full stack speech processing"},{"key":"2023021720443022100_","author":"Chen","year":"2021","journal-title":"An empirical study of training self-supervised vision transformers"},{"key":"2023021720443022100_","author":"Creswell","year":"2017","journal-title":"Generative adversarial networks: An overview"},{"key":"2023021720443022100_","author":"Dai","year":"2021","journal-title":"CoAtNet: Marrying convolution and attention for all data sizes"},{"key":"2023021720443022100_","volume-title":"America needs AI literacy now","author":"Decario","year":"2021"},{"key":"2023021720443022100_","author":"Devlin","year":"2019","journal-title":"BERT: Pre-training of deep bidirectional transformers for language understanding"},{"key":"2023021720443022100_","author":"Fridman","year":"2020","journal-title":"Deep learning state of the art 2020"},{"issue":"11","key":"2023021720443022100_","doi-asserted-by":"publisher","first-page":"e745","DOI":"10.1016\/S2589-7500(21)00208-9","article-title":"The false hope of current approaches to explainable artificial intelligence in health care","volume":"3","author":"Ghassemi","year":"2021","journal-title":"Lancet Digital Health"},{"key":"2023021720443022100_","volume-title":"Advances in neural information processing systems","author":"Goodfellow","year":"2014"},{"key":"2023021720443022100_","author":"Google","year":"2022","journal-title":"Teachable machine: Train a computer to recognize your own images, sounds, and poses"},{"issue":"5","key":"2023021720443022100_","doi-asserted-by":"publisher","first-page":"1153","DOI":"10.1109\/TMI.2016.2553401","article-title":"Overview and future promise of an exciting new technique","volume":"35","author":"Greenspan","year":"2016","journal-title":"IEEE Transactions on Medical Imaging"},{"issue":"22","key":"2023021720443022100_","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2016.17216","article-title":"Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs","volume":"316","author":"Gulshan","year":"2016","journal-title":"JAMA"},{"key":"2023021720443022100_","first-page":"770","article-title":"Deep residual learning for image recognition","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"He","year":"2016"},{"key":"2023021720443022100_","author":"Hendrycks","year":"2019","journal-title":"Deep anomaly detection with outlier exposure"},{"key":"2023021720443022100_","first-page":"15262","article-title":"Natural adversarial examples","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Hendrycks","year":"2021"},{"issue":"8","key":"2023021720443022100_","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Computation"},{"issue":"1","key":"2023021720443022100_","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1023\/A:1022631118932","article-title":"Very simple classification rules perform well on most commonly used datasets","volume":"11","author":"Holte","year":"1993","journal-title":"Machine Learning"},{"key":"2023021720443022100_","first-page":"1314","article-title":"Searching for MobileNetV3","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Howard","year":"2019"},{"key":"2023021720443022100_","article-title":"AI benchmark: Running deep neural networks on android smartphones","volume-title":"Proceedings of the European Conference on Computer Vision Workshops","author":"Ignatov","year":"2018"},{"key":"2023021720443022100_","author":"Karpathy","year":"2020","journal-title":"AI for full-self driving at Tesla"},{"key":"2023021720443022100_","first-page":"8110","article-title":"Analyzing and improving the image quality of StyleGAN","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Karras","year":"2020"},{"key":"2023021720443022100_","volume-title":"The age of AI and our human future","author":"Kissinger","year":"2021"},{"issue":"14","key":"2023021720443022100_","doi-asserted-by":"publisher","first-page":"7684","DOI":"10.1073\/pnas.1915768117","article-title":"Racial disparities in automated speech recognition","volume":"117","author":"Koenecke","year":"2020","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"7553","key":"2023021720443022100_","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"issue":"1","key":"2023021720443022100_","doi-asserted-by":"publisher","DOI":"10.3390\/e23010018","article-title":"Explainable AI: A review of machine learning interpretability methods","volume":"23","author":"Linardatos","year":"2020","journal-title":"Entropy"},{"issue":"2","key":"2023021720443022100_","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1109\/MASSP.1987.1165576","article-title":"An introduction to computing with neural nets","volume":"4","author":"Lippmann","year":"1987","journal-title":"IEEE ASSP Magazine"},{"key":"2023021720443022100_","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3476415.3476428","article-title":"Rethinking search: Making domain experts out of dilettantes","volume":"55","author":"Metzler","year":"2021","journal-title":"ACR SIGIR Forum"},{"key":"2023021720443022100_","author":"Microsoft","year":"2022","journal-title":"Lob: Machine learning made easy"},{"key":"2023021720443022100_","article-title":"An overview of early vision in InceptionV1","author":"Olah","year":"2020","journal-title":"Distill"},{"key":"2023021720443022100_","author":"OpenAI","year":"2022","journal-title":"OpenAI Microscope"},{"key":"2023021720443022100_","author":"OpenAI","year":"2022","journal-title":"OpenAI Playground: Text completion task"},{"key":"2023021720443022100_","author":"Radford","year":"2021","journal-title":"Learning transferable visual models from natural language supervision"},{"key":"2023021720443022100_","author":"Rajpurkar","year":"2017","journal-title":"CheXNet: Radiologist-level pneumonia detection on chest x-rays with deep learning"},{"key":"2023021720443022100_","article-title":"Do ImageNet classifiers generalize to ImageNet?","volume-title":"Proceedings of the 36th International Conference on Machine Learning","author":"Recht","year":"2019"},{"issue":"5","key":"2023021720443022100_","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1038\/s42256-019-0048-x","article-title":"Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead","author":"Rudin","year":"2019","journal-title":"Nature Machine Intelligence"},{"issue":"3","key":"2023021720443022100_","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","article-title":"ImageNet large scale visual recognition challenge","volume":"115","author":"Russakovsky","year":"2015","journal-title":"International Journal of Computer Vision"},{"key":"2023021720443022100_","doi-asserted-by":"publisher","DOI":"10.1016\/j.jtcvs.2020.08.058","article-title":"Commentary: Machine learning and cardiac surgery risk prediction","author":"Shahian","year":"2020","journal-title":"Journal of Thoracic and Cardiovascular Surgery"},{"key":"2023021720443022100_","first-page":"8634","article-title":"Evaluating machine accuracy on ImageNet","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Shankar","year":"2020"},{"issue":"4","key":"2023021720443022100_","doi-asserted-by":"publisher","first-page":"688","DOI":"10.1016\/j.cell.2020.01.021","article-title":"A deep learning approach to antibiotic discovery","volume":"180","author":"Stokes","year":"2020","journal-title":"Cell"},{"key":"2023021720443022100_","author":"Tan","year":"2019","journal-title":"EfficientNet: Rethinking model scaling for convolutional neural networks"},{"key":"2023021720443022100_","author":"Vanschoren","year":"2021","journal-title":"NeurIPS Datasets and Benchmarks Track"},{"key":"2023021720443022100_","first-page":"5998","volume-title":"Advances in neural information processing systems","author":"Vaswani","year":"2017"},{"issue":"1","key":"2023021720443022100_","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-019-14108-y","article-title":"The role of artificial intelligence in achieving the sustainable development goals","volume":"11","author":"Vinuesa","year":"2020","journal-title":"Nature Communications"},{"issue":"2","key":"2023021720443022100_","doi-asserted-by":"publisher","first-page":"869","DOI":"10.1109\/COMST.2020.2970550","article-title":"Convergence of edge computing and deep learning: A comprehensive survey","volume":"22","author":"Wang","year":"2020","journal-title":"IEEE Communications Surveys Tutorials"},{"issue":"8","key":"2023021720443022100_","doi-asserted-by":"publisher","first-page":"3370","DOI":"10.1021\/acs.jcim.9b00237","article-title":"Analyzing learned molecular representations for property prediction","volume":"59","author":"Yang","year":"2019","journal-title":"Journal of Chemical Information and Modeling"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/neco\/article-pdf\/35\/3\/287\/2071846\/neco_a_01518.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/neco\/article-pdf\/35\/3\/287\/2071846\/neco_a_01518.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,17]],"date-time":"2023-02-17T20:45:40Z","timestamp":1676666740000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/35\/3\/287\/111335\/Understanding-and-Applying-Deep-Learning"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,17]]},"references-count":51,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,2,17]]},"published-print":{"date-parts":[[2023,2,17]]}},"URL":"https:\/\/doi.org\/10.1162\/neco_a_01518","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,3]]},"published":{"date-parts":[[2023,2,17]]}}}