{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,4]],"date-time":"2026-02-04T18:24:40Z","timestamp":1770229480334,"version":"3.49.0"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"10","license":[{"start":{"date-parts":[[2024,5,18]],"date-time":"2024-05-18T00:00:00Z","timestamp":1715990400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2024,5,18]],"date-time":"2024-05-18T00:00:00Z","timestamp":1715990400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"funder":[{"DOI":"10.13039\/501100001665","name":"Agence Nationale de la Recherche","doi-asserted-by":"publisher","award":["ANR-21-CE38-0003-01"],"award-info":[{"award-number":["ANR-21-CE38-0003-01"]}],"id":[{"id":"10.13039\/501100001665","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2024,10]]},"DOI":"10.1007\/s11192-024-05009-z","type":"journal-article","created":{"date-parts":[[2024,5,18]],"date-time":"2024-05-18T12:01:57Z","timestamp":1716033717000},"page":"6261-6285","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Annotation of scientific uncertainty using linguistic patterns"],"prefix":"10.1007","volume":"129","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8630-6603","authenticated-orcid":false,"given":"Panggih Kusuma","family":"Ningrum","sequence":"first","affiliation":[]},{"given":"Iana","family":"Atanassova","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,5,18]]},"reference":[{"key":"5009_CR1","doi-asserted-by":"publisher","first-page":"383","DOI":"10.1016\/j.ecolmodel.2008.07.015","volume":"219","author":"J Ascough II","year":"2008","unstructured":"Ascough II, J., Maier, H., Ravalico, J., & Strudley, M. (2008). Future research challenges for incorporation of uncertainty in environmental and ecological decision-making. Ecological Modelling, 219, 383\u2013399. https:\/\/doi.org\/10.1016\/j.ecolmodel.2008.07.015","journal-title":"Ecological Modelling"},{"key":"5009_CR2","unstructured":"Atanassova, I., Rey, F., & Bertin, M. (2018). Studying Uncertainty in Science: A distributional analysis through the IMRaD structure. In 7th International workshop on mining scientific publications (WOSP 2018) at 11th edition of the language resources and evaluation conference (LREC 2018), 2018, Miyazaki, Japan. http:\/\/lrec-conf.org\/workshops\/lrec2018\/W24\/pdf\/10_W24.pdf"},{"key":"5009_CR3","unstructured":"Blanchemanche, S., Rona-Tas, A., Cornu\u00e9jols, A., Duroy, A., & Martin, C. (2013, January). An ontology of scientific uncertainty: Methodological lessons from analyzing expressions of uncertainty in food risk assessment. In SAESA Amsterdam conference, 2013."},{"issue":"9","key":"5009_CR4","doi-asserted-by":"publisher","first-page":"e0221933","DOI":"10.1371\/journal.pone.0221933","volume":"14","author":"R Bongelli","year":"2019","unstructured":"Bongelli, R., Riccioni, I., Burro, R., & Zuczkowski, A. (2019). Writers\u2019 uncertainty in scientific and popular biomedical articles. A comparative analysis of the British Medical Journal and Discover Magazine. PLoS ONE, 14(9), e0221933.","journal-title":"PLoS ONE"},{"key":"5009_CR5","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1016\/S0079-7421(08)60313-8","volume":"32","author":"DV Budescu","year":"1995","unstructured":"Budescu, D. V., & Wallsten, T. S. (1995). Processing linguistic probabilities: General principles and empirical evidence. Psychology of Learning and Motivation, 32, 275\u2013318.","journal-title":"Psychology of Learning and Motivation"},{"key":"5009_CR6","doi-asserted-by":"crossref","unstructured":"Candlin, C. N., & Hyland, K. (Eds.) (2014). Writing: Texts, processes and practices. Routledge.","DOI":"10.4324\/9781315840390"},{"issue":"1","key":"5009_CR7","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1111\/1468-5949.00206","volume":"19","author":"F Candlin","year":"2000","unstructured":"Candlin, F. (2000). Practice-based doctorates and questions of academic legitimacy. Journal of Art and Design Education, 19(1), 96\u2013101.","journal-title":"Journal of Art and Design Education"},{"issue":"1","key":"5009_CR8","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1016\/j.joi.2017.12.004","volume":"12","author":"C Chen","year":"2018","unstructured":"Chen, C., Song, M., & Heo, G. E. (2018). A scalable and adaptive method for finding semantically equivalent cue words of uncertainty. Journal of Informetrics, 12(1), 158\u2013180.","journal-title":"Journal of Informetrics"},{"issue":"3","key":"5009_CR9","doi-asserted-by":"publisher","first-page":"469","DOI":"10.1111\/socf.12034","volume":"28","author":"A Cordner","year":"2013","unstructured":"Cordner, A., & Brown, P. (2013). Moments of uncertainty: Ethical considerations and emerging contaminants. Sociological Forum, 28(3), 469\u2013494. https:\/\/doi.org\/10.1111\/socf.12034","journal-title":"Sociological Forum"},{"key":"5009_CR10","unstructured":"Courtney, H. (2001). 20\/20 Foresight: Crafting strategy in an uncertain world. Harvard Business Press."},{"key":"5009_CR11","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1007\/BF01224917","volume":"1","author":"G Dosi","year":"1991","unstructured":"Dosi, G., & Egidi, M. (1991). Substantive and procedural uncertainty: An exploration of economic behaviours in changing environments. Journal of Evolutionary Economics, 1, 145\u2013168.","journal-title":"Journal of Evolutionary Economics"},{"key":"5009_CR13","unstructured":"Fijnvandraat, M. L. (2009). Shedding light on the black hole: The roll-out of broadband access networks by private operators. Doctoral Dissertation, Delft University of Technology. Next Generation Infrastructure Foundation. ISBN 978-90-79878-03-1."},{"key":"5009_CR14","doi-asserted-by":"publisher","unstructured":"Fox, C. R., & \u00dclk\u00fcmen, G. (2011), Distinguishing two dimensions of uncertainty. In W. Brun, G. Kirkeb\u00f8en & H. Montgomery (Eds.), Essays in judgment and decision making. Universitetsforlaget. https:\/\/doi.org\/10.2139\/ssrn.3695311","DOI":"10.2139\/ssrn.3695311"},{"key":"5009_CR15","doi-asserted-by":"crossref","unstructured":"Friedman, M., & Kandel, A. (1999). Introduction to pattern recognition: Statistical, structural, neural, and fuzzy logic approaches (Vol. 32). World Scientific.","DOI":"10.1142\/3641"},{"key":"5009_CR16","doi-asserted-by":"crossref","unstructured":"Funtowicz, S. O., & Ravetz, J. R. (1990). Uncertainty and quality in science for policy (Vol. 15). Springer.","DOI":"10.1007\/978-94-009-0621-1"},{"issue":"8","key":"5009_CR17","doi-asserted-by":"publisher","first-page":"6744","DOI":"10.1002\/2017WR020609","volume":"53","author":"JH Guillaume","year":"2017","unstructured":"Guillaume, J. H., Helgeson, C., Elsawah, S., Jakeman, A. J., & Kummu, M. (2017). Toward best practice framing of uncertainty in scientific publications: A review of Water Resources Research abstracts. Water Resources Research, 53(8), 6744\u20136762. https:\/\/doi.org\/10.1002\/2017WR020609","journal-title":"Water Resources Research"},{"issue":"4","key":"5009_CR18","doi-asserted-by":"publisher","first-page":"483","DOI":"10.1111\/j.1539-6924.1994.tb00266.x","volume":"14","author":"JC Helton","year":"1994","unstructured":"Helton, J. C. (1994). Treatment of uncertainty in performance assessments for complex systems. Risk Analysis, 14(4), 483\u2013511.","journal-title":"Risk Analysis"},{"issue":"2","key":"5009_CR21","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1177\/0741088396013002004","volume":"13","author":"K Hyland","year":"1996","unstructured":"Hyland, K. (1996). Talking to the academy: Forms of hedging in science research articles. Written Communication, 13(2), 251\u2013281.","journal-title":"Written Communication"},{"key":"5009_CR19","doi-asserted-by":"publisher","unstructured":"Hyland, K. (1998). Hedging in scientific research articles. In Hedging in scientific research articles (pp. 1\u2013317). John Benjamins. https:\/\/doi.org\/10.1075\/pbns.54","DOI":"10.1075\/pbns.54"},{"issue":"3","key":"5009_CR20","doi-asserted-by":"publisher","first-page":"297","DOI":"10.1016\/S0889-4906(99)00026-5","volume":"19","author":"K Hyland","year":"2000","unstructured":"Hyland, K. (2000). Developments in English for Specific Purposes: A multi-disciplinary approach. English for Specific Purposes, 19(3), 297\u2013300.","journal-title":"English for Specific Purposes"},{"issue":"4","key":"5009_CR22","doi-asserted-by":"publisher","first-page":"777","DOI":"10.2307\/258396","volume":"11","author":"LR Jauch","year":"1986","unstructured":"Jauch, L. R., & Kraft, K. L. (1986). Strategic management of uncertainty. Academy of Management Review, 11(4), 777\u2013790.","journal-title":"Academy of Management Review"},{"issue":"2","key":"5009_CR23","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1016\/0010-0277(82)90023-3","volume":"11","author":"D Kahneman","year":"1982","unstructured":"Kahneman, D., & Tversky, A. (1982). Variants of uncertainty. Cognition, 11(2), 143\u2013157.","journal-title":"Cognition"},{"key":"5009_CR24","unstructured":"Light, M., Qiu, X. Y., & Srinivasan, P. (2004). The language of bioscience: Facts, speculations, and statements in between. In HLT-NAACL 2004 workshop: Linking biological literature, ontologies and databases, 2004 (pp. 17\u201324). https:\/\/aclanthology.org\/W04-3103"},{"key":"5009_CR25","unstructured":"Medlock, B., & Briscoe, T. (2007, June). Weakly supervised learning for hedge classification in scientific literature. In ACL, 2007 (Vol. 2007, pp. 992\u2013999)."},{"issue":"2","key":"5009_CR26","doi-asserted-by":"publisher","first-page":"214","DOI":"10.1504\/IJFIP.2006.009316","volume":"2","author":"IS Meijer","year":"2006","unstructured":"Meijer, I. S., Hekkert, M. P., Faber, J., & Smits, R. E. (2006). Perceived uncertainties regarding socio-technological transformations: Towards a framework. International Journal of Foresight and Innovation Policy, 2(2), 214\u2013240.","journal-title":"International Journal of Foresight and Innovation Policy"},{"key":"5009_CR27","unstructured":"Morgan, M. G., Henrion, M., & Small, M. (1992). Uncertainty: A guide to dealing with uncertainty in quantitative risk and policy analysis. Cambridge University Press."},{"key":"5009_CR28","doi-asserted-by":"publisher","unstructured":"Ningrum, P. K., & Atanassova, I. (2023). Dataset for multidisciplinary uncertainty mining\u2014Ver1. https:\/\/doi.org\/10.5281\/zenodo.8024787","DOI":"10.5281\/zenodo.8024787"},{"key":"5009_CR29","unstructured":"Ningrum, P. K., Mayr, P., & Atanassova, I. (2023). UnScientify: Detecting scientific uncertainty in scholarly full text. arXiv [Cs.CL]. http:\/\/arxiv.org\/abs\/2307.14236"},{"key":"5009_CR30","doi-asserted-by":"crossref","unstructured":"Pinto, M. D. G., Osorio, P., & Martins, F. (2014). A theoretical contribution to tackling certainty and uncertainty in scientific writing: Four research articles from the journal Brain in focus. In Communicating certainty and uncertainty in medical, supportive and scientific contexts (pp. 291\u2013308). John Benjamins Publishing Company.","DOI":"10.1075\/ds.25.14pin"},{"issue":"2\u20133","key":"5009_CR32","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1016\/S0921-8009(03)00193-9","volume":"47","author":"C Rammel","year":"2003","unstructured":"Rammel, C., & van den Bergh, J. C. (2003). Evolutionary policies for sustainable development: Adaptive flexibility and risk minimising. Ecological Economics, 47(2\u20133), 121\u2013133.","journal-title":"Ecological Economics"},{"issue":"11","key":"5009_CR33","doi-asserted-by":"publisher","first-page":"1543","DOI":"10.1016\/j.envsoft.2007.02.004","volume":"22","author":"JC Refsgaard","year":"2007","unstructured":"Refsgaard, J. C., van der Sluijs, J. P., H\u00f8jberg, A. L., & Vanrolleghem, P. A. (2007). Uncertainty in the environmental modelling process\u2014A framework and guidance. Environmental Modelling and Software, 22(11), 1543\u20131556. https:\/\/doi.org\/10.1016\/j.envsoft.2007.02.004","journal-title":"Environmental Modelling and Software"},{"key":"5009_CR34","unstructured":"Rey, F. C., Bertin, M., & Atanassova, I. (2018, June). Une \u00e9tude de l'incertitude dans les textes scientifiques: vers la construction d'une ontologie. In TOTh 2018 Terminology and Ontology: Theories and applications (pp. 229\u2013242). Presses universitaires Savoie Mont Blanc."},{"key":"5009_CR35","doi-asserted-by":"crossref","unstructured":"Rubin, V. L., Liddy, E. D., & Kando, N. (2006). Certainty identification in texts: Categorization model and manual tagging results. In Computing attitude and affect in text: Theory and applications (pp. 61\u201376). Springer.","DOI":"10.1007\/1-4020-4102-0_7"},{"key":"5009_CR12","unstructured":"Salager-Meyer, F. (1997). I think that perhaps you should: A study of hedges in written scientific discourse. In T. Miller (Ed.), Functional approaches to written text: Classroom applications (pp. 105\u2013118). English Language Programs: United States Information Agency."},{"issue":"2","key":"5009_CR36","doi-asserted-by":"publisher","first-page":"186","DOI":"10.1177\/107554709301500205","volume":"15","author":"SH Stocking","year":"1993","unstructured":"Stocking, S. H., & Holstein, L. W. (1993). Constructing and reconstructing scientific ignorance: Ignorance claims in science and journalism. Knowledge, 15(2), 186\u2013210.","journal-title":"Knowledge"},{"key":"5009_CR37","doi-asserted-by":"crossref","unstructured":"Swales, J. M. (2014). 1990. Genre analysis: English in academic and research settings. Cambridge: Cambridge University Press, selected 45\u201347, 52\u201360. In The discourse studies reader (pp. 306\u2013316). John Benjamins Publishing Company.","DOI":"10.1075\/z.184.513swa"},{"key":"5009_CR31","doi-asserted-by":"publisher","unstructured":"Thomson, J., Hetzler, E., MacEachren, A., Gahegan, M., & Pavel, M. (2005). A typology for visualizing uncertainty. Proceedings of SPIE: The International Society for Optical Engineering, 5669, 146\u2013157, Article 16. https:\/\/doi.org\/10.1117\/12.587254","DOI":"10.1117\/12.587254"},{"key":"5009_CR38","doi-asserted-by":"crossref","unstructured":"Van Asselt, M. (2000). Perspectives on uncertainty and risk: The PRIMA approach to decision support. Springer.","DOI":"10.1007\/978-94-017-2583-5"},{"key":"5009_CR39","unstructured":"Van Asselt, M., & Rotmans, J. (2000). Uncertainty in integrated assessment, a bridge over troubled water (p. 60). ICIS (International Centre for Integrative Studies), Maastricht University."},{"issue":"Suppl 1","key":"5009_CR40","first-page":"A9","volume":"23","author":"AM van der Bles","year":"2018","unstructured":"van der Bles, A. M., van der Linden, S., Freeman, A., & Spiegelhalter, D. (2018). 18 The effects of communicating uncertainty about facts and numbers. Evidence-Based Medicine, 23(Suppl 1), A9\u2013A10.","journal-title":"Evidence-Based Medicine"},{"key":"5009_CR41","unstructured":"van der Sluijs, J. P. (1997). Anchoring amid uncertainty. In On the management of uncertainties in risk assessment of anthropogenic climate change. CIF-Gegevens Koninklijke Bibliotheek."},{"key":"5009_CR42","unstructured":"van Witteloostuijn, A. (1986). Choice-theory versus vs. behaviourism: A paradox (pp. 1\u201316). University of Groningen."},{"issue":"11","key":"5009_CR43","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1471-2105-9-S11-S9","volume":"9","author":"V Vincze","year":"2008","unstructured":"Vincze, V., Szarvas, G., Farkas, R., M\u00f3ra, G., & Csirik, J. (2008). The BioScope corpus: Biomedical texts annotated for uncertainty, negation, and their scopes. BMC Bioinformatics, 9(11), 1\u20139. https:\/\/doi.org\/10.1186\/1471-2105-9-S11-S9","journal-title":"BMC Bioinformatics"},{"issue":"1","key":"5009_CR44","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1076\/iaij.4.1.5.16466","volume":"4","author":"WE Walker","year":"2003","unstructured":"Walker, W. E., Harremo\u00ebs, P., Rotmans, J., Van Der Sluijs, J. P., Van Asselt, M. B., Janssen, P., & Krayer von Krauss, M. P. (2003). Defining uncertainty: A conceptual basis for uncertainty management in model-based decision support. Integrated Assessment, 4(1), 5\u201317. https:\/\/doi.org\/10.1076\/iaij.4.1.5.16466","journal-title":"Integrated Assessment"},{"issue":"8","key":"5009_CR45","doi-asserted-by":"publisher","first-page":"4541","DOI":"10.1007\/s11192-023-04759-6","volume":"128","author":"M Yao","year":"2023","unstructured":"Yao, M., Wei, Y., & Wang, H. (2023). Promoting research by reducing uncertainty in academic writing: A large-scale diachronic case study on hedging in Science research articles across 25 years. Scientometrics, 128(8), 4541\u20134558. https:\/\/doi.org\/10.1007\/s11192-023-04759-6","journal-title":"Scientometrics"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-024-05009-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-024-05009-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-024-05009-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,22]],"date-time":"2024-11-22T12:01:04Z","timestamp":1732276864000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-024-05009-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,18]]},"references-count":45,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2024,10]]}},"alternative-id":["5009"],"URL":"https:\/\/doi.org\/10.1007\/s11192-024-05009-z","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,18]]},"assertion":[{"value":"16 November 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 March 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 May 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors affirm that there are no conflicts of interest or competing interests associated with the completion of this research work and the development of the manuscript. They declare that no financial, personal, or professional circumstances exist that could be perceived as having influenced the conduct or reporting of the research. The authors are committed to upholding the highest standards of integrity and transparency in the communication of their findings. This statement serves as an unequivocal declaration that, to the best of their knowledge, there are no affiliations, financial involvements, or other relationships that could be perceived as constituting a conflict of interest or influencing the impartiality of the research presented in this manuscript.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}