{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T06:58:37Z","timestamp":1780556317941,"version":"3.54.1"},"reference-count":26,"publisher":"MIT Press","issue":"3","license":[{"start":{"date-parts":[[2022,8,19]],"date-time":"2022-08-19T00:00:00Z","timestamp":1660867200000},"content-version":"vor","delay-in-days":230,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Center for Security and Emerging Technologies (CSET) at Georgetown University"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,11,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The accurate forecasting of exceptional growth in research areas has been an extremely difficult problem to solve. In a previous study we introduced an approach to forecasting which research clusters in a global model of the scientific literature would have an annual growth rate of 8% annually over a 3-year period. In this study we (a) introduce a much more robust method of creating and updating global models of research, (b) introduce new indicators based on author publication patterns, (c) test a much larger set (81) of indicators to forecast exceptional growth, and (d) expand the forecast horizon from 3 to 4 years. Forecast accuracy increased dramatically (threat score increased from 20 to 32) from our previous study. Most of this gain is surprisingly due to the advances in model robustness rather than the indicators used for forecasting. We also provide evidence that most indicators (including popular network indicators) do not improve the ability to forecast growth in research above the baseline provided by indicators associated with the vitality of a research cluster.<\/jats:p>","DOI":"10.1162\/qss_a_00202","type":"journal-article","created":{"date-parts":[[2022,8,19]],"date-time":"2022-08-19T14:14:25Z","timestamp":1660918465000},"page":"672-693","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":6,"title":["An improved practical approach to forecasting exceptional growth in research"],"prefix":"10.1162","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7814-8951","authenticated-orcid":true,"given":"Kevin W.","family":"Boyack","sequence":"first","affiliation":[{"name":"SciTech Strategies, Inc., Albuquerque, NM"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9118-8955","authenticated-orcid":true,"given":"Richard","family":"Klavans","sequence":"additional","affiliation":[{"name":"SciTech Strategies Inc., Wayne, PA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","published-online":{"date-parts":[[2022,11,1]]},"reference":[{"key":"2022111422091266600_bib1","volume-title":"U.S. Patent 20160292573 A1","author":"Babko-Malaya","year":"2016"},{"key":"2022111422091266600_bib2","volume-title":"Forecasting technology emergence from metadata and language of scientific publications and patents","author":"Babko-Malaya","year":"2015"},{"key":"2022111422091266600_bib3","doi-asserted-by":"publisher","first-page":"108514","DOI":"10.1109\/ACCESS.2020.3000948","article-title":"TermBall: Tracking and predicting evolution types of research topics by using knowledge structures in scholarly big data","volume":"8","author":"Balili","year":"2020","journal-title":"IEEE Access"},{"issue":"4","key":"2022111422091266600_bib4","doi-asserted-by":"publisher","first-page":"1570","DOI":"10.1162\/qss_a_00085","article-title":"A comparison of large-scale science models based on textual, direct citation and hybrid relatedness","volume":"1","author":"Boyack","year":"2020","journal-title":"Quantitative Science Studies"},{"key":"2022111422091266600_bib5","volume-title":"Data for \u201cAn improved practical approach to forecasting exceptional growth in research.\u201d","author":"Boyack","year":"2022"},{"key":"2022111422091266600_bib6","doi-asserted-by":"publisher","first-page":"408","DOI":"10.1038\/s41597-020-00749-y","article-title":"A detailed open access model of the PubMed literature","volume":"7","author":"Boyack","year":"2020","journal-title":"Scientific Data"},{"issue":"4","key":"2022111422091266600_bib7","doi-asserted-by":"publisher","first-page":"1158","DOI":"10.1016\/j.joi.2017.10.002","article-title":"Research portfolio analysis and topic prominence","volume":"11","author":"Klavans","year":"2017","journal-title":"Journal of Informetrics"},{"issue":"4","key":"2022111422091266600_bib8","doi-asserted-by":"publisher","first-page":"984","DOI":"10.1002\/asi.23734","article-title":"Which type of citation analysis generates the most accurate taxonomy of scientific and technical knowledge?","volume":"68","author":"Klavans","year":"2017","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"2022111422091266600_bib9","volume-title":"A unique approach to characterizing types of prolific authors","author":"Klavans","year":"2021"},{"issue":"9","key":"2022111422091266600_bib10","doi-asserted-by":"publisher","first-page":"e0239177","DOI":"10.1371\/journal.pone.0239177","article-title":"A novel approach to predicting exceptional growth in research","volume":"15","author":"Klavans","year":"2020","journal-title":"PLOS ONE"},{"issue":"4","key":"2022111422091266600_bib11","doi-asserted-by":"publisher","first-page":"1910","DOI":"10.1073\/pnas.1914370116","article-title":"Predicting research trends with semantic and neural networks with an application in quantum physics","volume":"117","author":"Krenn","year":"2020","journal-title":"Proceedings of the National Academy of Sciences of the USA"},{"key":"2022111422091266600_bib12","volume-title":"The structure of scientific revolutions","author":"Kuhn","year":"1970","edition":"2nd ed."},{"key":"2022111422091266600_bib13","doi-asserted-by":"publisher","first-page":"e0252753","DOI":"10.1371\/journal.pone.0252753","article-title":"Deep learning-based prediction of future growth potential of technologies","volume":"16","author":"Lee","year":"2021","journal-title":"PLOS ONE"},{"key":"2022111422091266600_bib14","doi-asserted-by":"publisher","first-page":"1152","DOI":"10.3390\/e21121152","article-title":"Predicting the evolution of physics research from a complex network perspective","volume":"21","author":"Liu","year":"2019","journal-title":"Entropy"},{"issue":"11","key":"2022111422091266600_bib15","doi-asserted-by":"publisher","first-page":"2684","DOI":"10.1002\/asi.23612","article-title":"Predicting the impact of scientific concepts using full text features","volume":"67","author":"McKeown","year":"2016","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"2022111422091266600_bib16","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1111","volume-title":"Predicting the rise and fall of scientific topics from trends in their rhetorical framing","author":"Prabhakaran","year":"2016"},{"key":"2022111422091266600_bib17","doi-asserted-by":"publisher","first-page":"630124","DOI":"10.3389\/frma.2021.630124","article-title":"AI research funding portfolios and extreme growth","volume":"6","author":"Rahkovsky","year":"2021","journal-title":"Frontiers in Research Metrics and Analytics"},{"key":"2022111422091266600_bib18","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2110.07917","article-title":"Improving overlay maps of science: Combining overview and detail","author":"Sj\u00f6g\u00e5rde","year":"2021","journal-title":"arXiv:2110.07917"},{"issue":"3","key":"2022111422091266600_bib19","doi-asserted-by":"publisher","first-page":"595","DOI":"10.1007\/s11192-006-0132-y","article-title":"Tracking and predicting growth areas in science","volume":"68","author":"Small","year":"2006","journal-title":"Scientometrics"},{"key":"2022111422091266600_bib20","doi-asserted-by":"publisher","first-page":"1450","DOI":"10.1016\/j.respol.2014.02.005","article-title":"Identifying emerging topics in science and technology","volume":"43","author":"Small","year":"2014","journal-title":"Research Policy"},{"key":"2022111422091266600_bib21","volume-title":"Expert political judgment: How good is it? How can we know?","author":"Tetlock","year":"2005"},{"key":"2022111422091266600_bib22","doi-asserted-by":"publisher","first-page":"5233","DOI":"10.1038\/s41598-019-41695-z","article-title":"From Louvain to Leiden: Guaranteeing well-connected communities","volume":"9","author":"Traag","year":"2019","journal-title":"Scientific Reports"},{"issue":"2","key":"2022111422091266600_bib23","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1162\/qss_a_00035","article-title":"A principled methodology for comparing relatedness measures for clustering publications","volume":"1","author":"Waltman","year":"2020","journal-title":"Quantitative Science Studies"},{"issue":"12","key":"2022111422091266600_bib24","doi-asserted-by":"publisher","first-page":"2378","DOI":"10.1002\/asi.22748","article-title":"A new methodology for constructing a publication-level classification system of science","volume":"63","author":"Waltman","year":"2012","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"2022111422091266600_bib25","doi-asserted-by":"publisher","first-page":"785","DOI":"10.1016\/j.techfore.2018.04.026","article-title":"Tracing the system transformations and innovation pathways of an emerging technology: Solid lipid nanoparticles","volume":"146","author":"Zhou","year":"2019","journal-title":"Technological Forecasting & Social Change"},{"key":"2022111422091266600_bib26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11192-020-03351-6","article-title":"Forecasting emerging technologies using data augmentation and deep learning","volume":"123","author":"Zhou","year":"2020","journal-title":"Scientometrics"}],"container-title":["Quantitative Science Studies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/qss\/article-pdf\/3\/3\/672\/2057756\/qss_a_00202.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/qss\/article-pdf\/3\/3\/672\/2057756\/qss_a_00202.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,14]],"date-time":"2022-11-14T17:09:58Z","timestamp":1668445798000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/qss\/article\/3\/3\/672\/112695\/An-improved-practical-approach-to-forecasting"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022]]},"references-count":26,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,11,1]]}},"URL":"https:\/\/doi.org\/10.1162\/qss_a_00202","relation":{"has-review":[{"id-type":"doi","id":"10.1162\/QSS_A_00202\/v2\/response1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00202\/v2\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00202\/v2\/review2","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00202\/v1\/review2","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00202\/v1\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00202\/v3\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00202\/v2\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00202\/v1\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00202\/v3\/response1","asserted-by":"object"}]},"ISSN":["2641-3337"],"issn-type":[{"value":"2641-3337","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022]]},"published":{"date-parts":[[2022]]}}}