{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,28]],"date-time":"2026-07-28T10:22:31Z","timestamp":1785234151606,"version":"3.55.0"},"reference-count":88,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2022,8,25]],"date-time":"2022-08-25T00:00:00Z","timestamp":1661385600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,8,25]],"date-time":"2022-08-25T00:00:00Z","timestamp":1661385600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100005247","name":"University of British Columbia","doi-asserted-by":"crossref","award":["RGPIN-2019-05175"],"award-info":[{"award-number":["RGPIN-2019-05175"]}],"id":[{"id":"10.13039\/501100005247","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100008920","name":"University of Saskatchewan","doi-asserted-by":"crossref","award":["RGPIN-2021-04232"],"award-info":[{"award-number":["RGPIN-2021-04232"]}],"id":[{"id":"10.13039\/100008920","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100008920","name":"University of Saskatchewan","doi-asserted-by":"crossref","award":["DGECR-2021-00283"],"award-info":[{"award-number":["DGECR-2021-00283"]}],"id":[{"id":"10.13039\/100008920","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100000995","name":"Australian National University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100000995","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Autom Softw Eng"],"published-print":{"date-parts":[[2022,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Self-Admitted Technical Debt (SATD) is primarily studied in Object-Oriented (OO) languages and traditionally commercial software. However, scientific software coded in dynamically-typed languages such as R differs in paradigm, and the source code comments\u2019 semantics are different (i.e., more aligned with algorithms and statistics when compared to traditional software). Additionally, many Software Engineering topics are understudied in scientific software development, with SATD detection remaining a challenge for this domain. This gap adds complexity since prior works determined SATD in scientific software does not adjust to many of the keywords identified for OO SATD, possibly hindering its automated detection. Therefore, we investigated how classification models (traditional machine learning, deep neural networks, and deep neural Pre-Trained Language Models (PTMs)) automatically detect SATD in R packages. This study aims to study the capabilities of these models to classify different TD types in this domain and manually analyze the causes of each in a representative sample. Our results show that PTMs (i.e., RoBERTa) outperform other models and work well when the number of comments labelled as a particular SATD type has low occurrences. We also found that some SATD types are more challenging to detect. We manually identified sixteen causes, including eight new causes detected by our study. The most common cause was <jats:italic>failure to remember<\/jats:italic>, in agreement with previous studies. These findings will help the R package authors automatically identify SATD in their source code and improve their code quality. In the future, checklists for R developers can also be developed by scientific communities such as rOpenSci to guarantee a higher quality of packages before submission.<\/jats:p>","DOI":"10.1007\/s10515-022-00358-6","type":"journal-article","created":{"date-parts":[[2022,8,25]],"date-time":"2022-08-25T20:02:31Z","timestamp":1661457751000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":28,"title":["Self-admitted technical debt in R: detection and causes"],"prefix":"10.1007","volume":"29","author":[{"given":"Rishab","family":"Sharma","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ramin","family":"Shahbazi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fatemeh H.","family":"Fard","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zadia","family":"Codabux","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4099-1430","authenticated-orcid":false,"given":"Melina","family":"Vidoni","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,8,25]]},"reference":[{"issue":"3","key":"358_CR1","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1109\/MCSE.2014.5","volume":"16","author":"S Ahalt","year":"2014","unstructured":"Ahalt, S., Band, L., Christopherson, L., et al.: Water science software institute: agile and open source scientific software development. Comput. Sci. Eng. 16(3), 18\u201326 (2014). https:\/\/doi.org\/10.1109\/MCSE.2014.5","journal-title":"Comput. Sci. Eng."},{"key":"358_CR2","doi-asserted-by":"crossref","unstructured":"Ahmad, W., Chakraborty, S., Ray, B., et al.: A transformer-based approach for source code summarization. In: 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Online, pp. 4998\u20135007,https:\/\/doi.org\/10.18653\/v1\/2020.acl-main.449 (2020)","DOI":"10.18653\/v1\/2020.acl-main.449"},{"key":"358_CR3","doi-asserted-by":"publisher","unstructured":"Alfadel, M., Costa, DE., Shihab, E.: Empirical analysis of security vulnerabilities in python packages. In: IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER), 446\u2013457, (2021) https:\/\/doi.org\/10.1109\/SANER50967.2021.00048","DOI":"10.1109\/SANER50967.2021.00048"},{"issue":"102","key":"358_CR4","doi-asserted-by":"publisher","first-page":"693","DOI":"10.1016\/j.scico.2021.102693","volume":"213","author":"EA AlOmar","year":"2022","unstructured":"AlOmar, E.A., Christians, B., Busho, M., et al.: Satdbailiff-mining and tracking self-admitted technical debt. Sci. Comput. Program. 213(102), 693 (2022). https:\/\/doi.org\/10.1016\/j.scico.2021.102693","journal-title":"Sci. Comput. Program."},{"issue":"110","key":"358_CR5","doi-asserted-by":"publisher","first-page":"848","DOI":"10.1016\/j.jss.2020.110848","volume":"172","author":"EM Arvanitou","year":"2021","unstructured":"Arvanitou, E.M., Ampatzoglou, A., Chatzigeorgiou, A., et al.: Software engineering practices for scientific software development: a systematic mapping study. J. Syst. Softw. 172(110), 848 (2021). https:\/\/doi.org\/10.1016\/j.jss.2020.110848","journal-title":"J. Syst. Softw."},{"key":"358_CR6","first-page":"454","volume-title":"41st International Conference on Software Engineering","author":"D Arya","year":"2019","unstructured":"Arya, D., Wang, W., Guo, J.L., et al.: Analysis and detection of information types of open source software issue discussions. In: 41st International Conference on Software Engineering, pp. 454\u2013464. IEEE\/ACM, Canada (2019)"},{"key":"358_CR7","doi-asserted-by":"publisher","unstructured":"Bavota, G., Russo, B.: A Large-Scale Empirical Study on Self-Admitted Technical Debt. In: 13th International Conference on Mining Software Repositories. ACM, USA, MSR \u201916, pp. 315\u2013326, (2016) https:\/\/doi.org\/10.1145\/2901739.2901742","DOI":"10.1145\/2901739.2901742"},{"key":"358_CR8","doi-asserted-by":"publisher","unstructured":"Bogart, C., K\u00e4stner, C., Herbsleb, J., et\u00a0al.: How to break an api: Cost negotiation and community values in three software ecosystems. In: 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering. Association for Computing Machinery, New York, NY, USA, FSE 2016, p. 109\u2013120, (2016) https:\/\/doi.org\/10.1145\/2950290.2950325","DOI":"10.1145\/2950290.2950325"},{"key":"358_CR9","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1613\/jair.953","volume":"16","author":"NV Chawla","year":"2002","unstructured":"Chawla, N.V., Bowyer, K.W., Hall, L.O., et al.: Smote: synthetic minority over-sampling technique. J. artif. intell. res. 16, 321\u2013357 (2002)","journal-title":"J. artif. intell. res."},{"issue":"10","key":"358_CR10","doi-asserted-by":"publisher","DOI":"10.1002\/smr.1894","volume":"29","author":"Z Codabux","year":"2017","unstructured":"Codabux, Z., Williams, B.J., Bradshaw, G.L., et al.: An empirical assessment of technical debt practices in industry. J. Softw. Evol. Process. 29(10), e1894 (2017). https:\/\/doi.org\/10.1002\/smr.1894","journal-title":"J. Softw. Evol. Process."},{"key":"358_CR11","doi-asserted-by":"publisher","unstructured":"Codabux, Z., Vidoni, M., Fard, FH.: Technical Debt in the Peer-Review Documentation of R Packages: A rOpenSci Case Study. In: IEEE\/ACM 18th International Conference on Mining Software Repositories. IEEE, USA, pp. 195\u2013206, (2021)https:\/\/doi.org\/10.1109\/MSR52588.2021.00032","DOI":"10.1109\/MSR52588.2021.00032"},{"key":"358_CR12","doi-asserted-by":"publisher","unstructured":"Cruz, D., Santana, A., Figueiredo, E.: Detecting bad smells with machine learning algorithms: An empirical study. In: 3rd International Conference on Technical Debt. ACM, USA, TechDebt \u201920, p. 31\u201340, (2020) https:\/\/doi.org\/10.1145\/3387906.3388618","DOI":"10.1145\/3387906.3388618"},{"key":"358_CR13","doi-asserted-by":"publisher","unstructured":"Cui, Y., Jia, M., Lin, T., et\u00a0al.: Class-balanced loss based on effective number of samples. In: IEEE\/CVF Conference on Computer Vision and Pattern Recognition. IEEE, Long Beach, CA, USA, pp. 9260\u20139269, (2019)https:\/\/doi.org\/10.1109\/CVPR.2019.00949","DOI":"10.1109\/CVPR.2019.00949"},{"key":"358_CR14","doi-asserted-by":"publisher","unstructured":"Cunha, WS., Armijo, GA., de\u00a0Camargo, VV.: Investigating non-usually employed features in the identification of architectural smells: A machine learning-based approach. In: 14th Brazilian Symposium on Software Components, Architectures, and Reuse. ACM, USA, SBCARS \u201920, p. 21\u201330, (2020)https:\/\/doi.org\/10.1145\/3425269.3425281","DOI":"10.1145\/3425269.3425281"},{"issue":"11","key":"358_CR15","doi-asserted-by":"publisher","first-page":"1044","DOI":"10.1109\/TSE.2017.2654244","volume":"43","author":"ME da Silva","year":"2017","unstructured":"da Silva, M.E., Shihab, E., Tsantalis, N.: Using Natural Language Processing to Automatically Detect Self-Admitted Technical Debt. IEEE Trans. Software Eng. 43(11), 1044\u20131062 (2017). https:\/\/doi.org\/10.1109\/TSE.2017.2654244","journal-title":"IEEE Trans. Software Eng."},{"key":"358_CR16","doi-asserted-by":"publisher","unstructured":"Decan, A., Mens, T., Claes, M.: On the topology of package dependency networks: A comparison of three programming language ecosystems. In: Proccedings of the 10th European Conference on Software Architecture Workshops. Association for Computing Machinery, New York, NY, USA, ECSAW \u201916, (2016) https:\/\/doi.org\/10.1145\/2993412.3003382","DOI":"10.1145\/2993412.3003382"},{"key":"358_CR17","first-page":"493","volume-title":"23rd International Conference on Software Analysis, Evolution, and Reengineering","author":"A Decan","year":"2016","unstructured":"Decan, A., Mens, T., Claes, M., et al.: When github meets cran: an analysis of inter-repository package dependency problems. In: 23rd International Conference on Software Analysis, Evolution, and Reengineering, vol. 1, pp. 493\u2013504. IEEE, Suita, Japan (2016)"},{"key":"358_CR18","unstructured":"Devlin, J., Chang, MW., Lee, K., et\u00a0al.: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In: Proceedings of NAACL-HLT 2019. ACL, Minneapolis, Minnesota, p. 4171\u20134186(2019)"},{"key":"358_CR19","doi-asserted-by":"publisher","unstructured":"Fan, A., Lewis, M., Dauphin, Y.: Hierarchical neural story generation. In: 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, Melbourne, Australia, pp. 889\u2013898, https:\/\/doi.org\/10.18653\/v1\/P18-1082(2018)","DOI":"10.18653\/v1\/P18-1082"},{"key":"358_CR20","doi-asserted-by":"publisher","unstructured":"Flisar, J., Podgorelec, V.: Enhanced Feature Selection Using Word Embeddings for Self-Admitted Technical Debt Identification. In: 44th Euromicro Conference on Software Engineering and Advanced Applications. IEEE, Prague, Czech Republic, pp. 230\u2013233, (2018)https:\/\/doi.org\/10.1109\/SEAA.2018.00045","DOI":"10.1109\/SEAA.2018.00045"},{"key":"358_CR21","doi-asserted-by":"publisher","unstructured":"Flisar, J., Podgorelec, V.: Identification of Self-Admitted Technical Debt Using Enhanced Feature Selection Based on Word Embedding. IEEE Access 7:106,475\u2013106,494. https:\/\/doi.org\/10.1109\/ACCESS.2019.2933318(2019)","DOI":"10.1109\/ACCESS.2019.2933318"},{"issue":"1","key":"358_CR22","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1145\/1882471.1882479","volume":"12","author":"G Forman","year":"2010","unstructured":"Forman, G., Scholz, M.: Apples-to-apples in cross-validation studies: pitfalls in classifier performance measurement. SIGKDD. Explor. Newsl. 12(1), 49\u201357 (2010). https:\/\/doi.org\/10.1145\/1882471.1882479","journal-title":"SIGKDD. Explor. Newsl."},{"key":"358_CR23","unstructured":"Fowler, M.: Technical debt quadrant. https:\/\/martinfowler.com\/bliki\/TechnicalDebtQuadrant.html (2009)"},{"key":"358_CR24","doi-asserted-by":"publisher","unstructured":"Freire, S., Rios, N., Gutierrez, B., et\u00a0al.: Surveying Software Practitioners on Technical Debt Payment Practices and Reasons for Not Paying off Debt Items. In: Proceedings of the Evaluation and Assessment in Software Engineering. ACM, USA, EASE \u201920, p. 210\u2013219, https:\/\/doi.org\/10.1145\/3383219.3383241 (2020)","DOI":"10.1145\/3383219.3383241"},{"key":"358_CR25","doi-asserted-by":"publisher","unstructured":"Fucci, G., Cassee, N., Zampetti, F., et\u00a0al.: Waiting around or job half-done? sentiment in self-admitted technical debt. In: 18th International Conference on Mining Software Repositories. IEEE, Madrid, Spain, pp. 403\u2013414, https:\/\/doi.org\/10.1109\/MSR52588.2021.00052 (2021)","DOI":"10.1109\/MSR52588.2021.00052"},{"key":"358_CR26","doi-asserted-by":"publisher","unstructured":"Gao, Z., Xia, X., Lo, D., et\u00a0al.: Automating the Removal of Obsolete TODO Comments. In: 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering. ACM, USA, ESEC\/FSE 2021, p. 218\u2013229, (2021)https:\/\/doi.org\/10.1145\/3468264.3468553","DOI":"10.1145\/3468264.3468553"},{"key":"358_CR27","doi-asserted-by":"publisher","unstructured":"German, DM., Adams, B., Hassan, AE.: The Evolution of the R Software Ecosystem. In: 17th European Conference on Software Maintenance and Reengineering. IEEE, Genova, Italy, pp. 243\u2013252, (2013) https:\/\/doi.org\/10.1109\/CSMR.2013.33, iSSN: 1534-5351","DOI":"10.1109\/CSMR.2013.33"},{"key":"358_CR28","volume-title":"Imbalanced Learning: Foundations, Algorithms, and Applications","author":"YM Haibo He","year":"2013","unstructured":"Haibo He, Y.M.: Imbalanced Learning: Foundations, Algorithms, and Applications. Wiley-IEEE Press, USA (2013)"},{"key":"358_CR29","doi-asserted-by":"publisher","unstructured":"Hannay, JE., MacLeod, C., Singer, J., et\u00a0al.: How Do Scientists Develop and Use Scientific Software? In: ICSE Workshop on Software Engineering for Computational Science and Engineering. IEEE, Vancouver, Canada, pp. 1\u20138, (2009) https:\/\/doi.org\/10.1109\/SECSE.2009.5069155","DOI":"10.1109\/SECSE.2009.5069155"},{"issue":"4","key":"358_CR30","doi-asserted-by":"publisher","first-page":"454","DOI":"10.1093\/reseval\/rvv014","volume":"24","author":"J Howison","year":"2015","unstructured":"Howison, J., Deelman, E., McLennan, M.J., et al.: Understanding the scientific software ecosystem and its impact: current and future measures. Res. Eval. 24(4), 454\u2013470 (2015). https:\/\/doi.org\/10.1093\/reseval\/rvv014","journal-title":"Res. Eval."},{"issue":"1","key":"358_CR31","doi-asserted-by":"publisher","first-page":"418","DOI":"10.1007\/s10664-017-9522-4","volume":"23","author":"Q Huang","year":"2018","unstructured":"Huang, Q., Shihab, E., Xia, X., et al.: Identifying Self-Admitted Technical Debt in Open-Source Projects Using Text Mining. Empir. Softw. Eng. 23(1), 418\u2013451 (2018)","journal-title":"Empir. Softw. Eng."},{"key":"358_CR32","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-7138-7","volume-title":"An Introduction to Statistical Learning","author":"G James","year":"2013","unstructured":"James, G., Witten, D., Hastie, T., et al.: An Introduction to Statistical Learning, vol. 112. Springer, USA (2013)"},{"issue":"179","key":"358_CR33","first-page":"942","volume":"7","author":"M Jiang","year":"2019","unstructured":"Jiang, M., Wu, J., Shi, X., et al.: Transformer based memory network for sentiment analysis of web comments. IEEE Access. 7(179), 942\u2013179953 (2019)","journal-title":"IEEE Access."},{"key":"358_CR34","first-page":"5110","volume-title":"International Conference on Machine Learning","author":"A Kanade","year":"2020","unstructured":"Kanade, A., Maniatis, P., Balakrishnan, G., et al.: Learning and evaluating contextual embedding of source code. In: International Conference on Machine Learning, pp. 5110\u20135121. PMLR, USA (2020)"},{"key":"358_CR35","doi-asserted-by":"publisher","first-page":"909","DOI":"10.1007\/978-981-13-0761-4_86","volume-title":"Harmony Search and Nature Inspired Optimization Algorithms","author":"A Kaur","year":"2019","unstructured":"Kaur, A., Dhiman, G.: A review on search-based tools and techniques to identify bad code smells in object-oriented systems. In: Yadav, N., Yadav, A., Bansal, J.C., et al. (eds.) Harmony Search and Nature Inspired Optimization Algorithms, pp. 909\u2013921. Springer, Singapore (2019)"},{"key":"358_CR36","first-page":"9","volume-title":"International Conference on Machine Learning and Data Science","author":"A Kaur","year":"2017","unstructured":"Kaur, A., Jain, S., Goel, S.: A support vector machine based approach for code smell detection. In: International Conference on Machine Learning and Data Science, pp. 9\u201314. IEEE, Noida, India (2017)"},{"key":"358_CR37","doi-asserted-by":"publisher","first-page":"723","DOI":"10.1007\/978-981-15-0199-9_62","volume-title":"Artificial Intelligence and Evolutionary Computations in Engineering Systems","author":"S Krishnaveni","year":"2020","unstructured":"Krishnaveni, S., Vigneshwar, P., Kishore, S., et al.: Anomaly-based intrusion detection system using support vector machine. In: Artificial Intelligence and Evolutionary Computations in Engineering Systems, pp. 723\u2013731. Springer, Singapore (2020)"},{"key":"358_CR38","first-page":"1","volume-title":"International Conference on Learning Representations","author":"Z Lan","year":"2020","unstructured":"Lan, Z., Chen, M., Goodman, S., et al.: ALBERT: a lite BERT for self-supervised learning of language representations. In: International Conference on Learning Representations, pp. 1\u201313. ICLR, Addis Ababa, Ethiopia (2020)"},{"key":"358_CR39","doi-asserted-by":"publisher","unstructured":"Li, Y., Soliman, M., Avgeriou, P.: Identification and remediation of self-admitted technical debt in issue trackers. In: 46th Euromicro Conference on Software Engineering and Advanced Applications (SEAA). IEEE, Portoroz, Slovenia, pp. 495\u2013503,(2020) https:\/\/doi.org\/10.1109\/SEAA51224.2020.00083","DOI":"10.1109\/SEAA51224.2020.00083"},{"issue":"2","key":"358_CR40","doi-asserted-by":"publisher","first-page":"318","DOI":"10.1109\/TPAMI.2018.2858826","volume":"42","author":"T Lin","year":"2020","unstructured":"Lin, T., Goyal, P., Girshick, R., et al.: Focal loss for dense object detection. IEEE Trans. Pattern Anal. Mach. Intell. 42(2), 318\u2013327 (2020). https:\/\/doi.org\/10.1109\/TPAMI.2018.2858826","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"358_CR41","doi-asserted-by":"publisher","unstructured":"Liu J, Huang, Q., Xia, X., et\u00a0al.: Is Using Deep Learning Frameworks Free? Characterizing Technical Debt in Deep Learning Frameworks. In: 42nd International Conference on Software Engineering: Software Engineering in Society. ACM, USA, ICSE-SEIS \u201920, p. 1\u201310, (2020)https:\/\/doi.org\/10.1145\/3377815.3381377","DOI":"10.1145\/3377815.3381377"},{"key":"358_CR42","unstructured":"Liu, Y., Ott, M., Goyal, N., et\u00a0al.: Roberta: A Robustly Optimized BERT Pretraining Approach. arXiv preprint arXiv:1907.11692 1(1):1\u201313 (2019)"},{"key":"358_CR43","doi-asserted-by":"publisher","unstructured":"Liu, Z., Huang, Q., Xia, X., et\u00a0al.: SATD Detector: A Text-Mining-Based Self-Admitted Technical Debt Detection Tool. In: 40th International Conference on Software Engineering: Companion Proceeedings. ACM, USA, ICSE \u201918, p. 9\u201312, https:\/\/doi.org\/10.1145\/3183440.3183478 (2018)","DOI":"10.1145\/3183440.3183478"},{"key":"358_CR44","doi-asserted-by":"publisher","unstructured":"Maalej, W., Nabil, H.: Bug report, feature request, or simply praise? on automatically classifying app reviews. In: IEEE 23rd International RE. IEEE, Canada, pp. 116\u2013125, https:\/\/doi.org\/10.1109\/RE.2015.7320414 (2015)","DOI":"10.1109\/RE.2015.7320414"},{"key":"358_CR45","first-page":"54","volume-title":"20th International Working Conference on Source Code Analysis and Manipulation","author":"R Maipradit","year":"2020","unstructured":"Maipradit, R., Lin, B., Nagy, C., et al.: Automated identification of on-hold self-admitted technical debt. In: 20th International Working Conference on Source Code Analysis and Manipulation, pp. 54\u201364. IEEE, Adelaide, SA, Australia (2020)"},{"issue":"5","key":"358_CR46","doi-asserted-by":"publisher","first-page":"3770","DOI":"10.1007\/s10664-020-09854-3","volume":"25","author":"R Maipradit","year":"2020","unstructured":"Maipradit, R., Treude, C., Hata, H., et al.: Wait for it: identifying \u201con-hold\u2019\u2019 self-admitted technical debt. Empir. Softw. Eng. 25(5), 3770\u20133798 (2020)","journal-title":"Empir. Softw. Eng."},{"key":"358_CR47","doi-asserted-by":"publisher","unstructured":"Maldonado, E., Shihab, E.: Detecting and quantifying different types of self-admitted technical debt. In: 7th International Workshop on Managing Technical Debt. IEEE, Bremen, Germany, pp. 9\u201315, https:\/\/doi.org\/10.1109\/MTD.2015.7332619 (2015)","DOI":"10.1109\/MTD.2015.7332619"},{"key":"358_CR48","doi-asserted-by":"publisher","unstructured":"Manning, C., Klein, D.: Optimization, maxent models, and conditional estimation without magic. In: Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology. Association for Computational Linguistics, USA, NAACL-Tutorials \u201903, p\u00a08, (2003) https:\/\/doi.org\/10.3115\/1075168.1075176","DOI":"10.3115\/1075168.1075176"},{"issue":"3","key":"358_CR49","doi-asserted-by":"publisher","first-page":"276","DOI":"10.11613\/BM.2012.031","volume":"22","author":"ML McHugh","year":"2012","unstructured":"McHugh, M.L.: Interrater reliability: the kappa statistic. Biochemia. medica. Biochemia. medica. 22(3), 276\u2013282 (2012)","journal-title":"Biochemia. medica. Biochemia. medica."},{"key":"358_CR50","unstructured":"Mensah, S., Keung, J., Bosu, MF., et\u00a0al.: Rework effort estimation of self-admitted technical debt. In: First International Workshop on Technical Debt Analytics. CEUR-WS, Hamilton, New Zealand, p\u00a06 (2016)"},{"key":"358_CR51","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1016\/j.jss.2017.09.026","volume":"135","author":"S Mensah","year":"2018","unstructured":"Mensah, S., Keung, J., Svajlenko, J., et al.: On the Value of a Prioritization Scheme for Resolving Self-Admitted Technical Debt. J. Syst. Softw. 135, 37\u201354 (2018). https:\/\/doi.org\/10.1016\/j.jss.2017.09.026","journal-title":"J. Syst. Softw."},{"key":"358_CR52","doi-asserted-by":"publisher","unstructured":"Milewicz, R., Pinto, G., Rodeghero, P.: Characterizing the roles of contributors in open-source scientific software projects. In: IEEE\/ACM 16th International Conference on Mining Software Repositories, pp. 421\u2013432, https:\/\/doi.org\/10.1109\/MSR.2019.00069 (2019)","DOI":"10.1109\/MSR.2019.00069"},{"key":"358_CR53","unstructured":"Minaee, S., Kalchbrenner, N., Cambria, E., et\u00a0al.: Deep learning based text classification: A comprehensive review. arXiv preprint arXiv:2004.03705 0(0):1\u201313 (2020)"},{"key":"358_CR54","doi-asserted-by":"crossref","unstructured":"Mora-Cantallops, M., Sicilia, M.A., Garcia-Barriocanal, E., et al.: Evolution and prospects of the comprehensive r archive network (cran) package ecosystem. Journal of Software: Evolution and Process 32(11), e2270 (2020). https:\/\/doi.org\/10.1002\/smr.2270, e2270 smr.2270","DOI":"10.1002\/smr.2270"},{"issue":"110","key":"358_CR55","doi-asserted-by":"publisher","first-page":"744","DOI":"10.1016\/j.jss.2020.110744","volume":"170","author":"M Mora-Cantallops","year":"2020","unstructured":"Mora-Cantallops, M., S\u00e1nchez-Alonso, S., Garc\u00eda-Barriocanal, E.: A complex network analysis of the comprehensive r archive network (cran) package ecosystem. J. Syst. Softw. 170(110), 744 (2020). https:\/\/doi.org\/10.1016\/j.jss.2020.110744","journal-title":"J. Syst. Softw."},{"key":"358_CR56","doi-asserted-by":"publisher","first-page":"104","DOI":"10.1007\/978-3-642-31057-7_6","volume-title":"ECOOP 2012 - Object-Oriented Programming","author":"F Morandat","year":"2012","unstructured":"Morandat, F., Hill, B., Osvald, L., et al.: Evaluating the design of the R language. In: Noble, J. (ed.) ECOOP 2012 - Object-Oriented Programming, pp. 104\u2013131. Springer, Berlin (2012)"},{"key":"358_CR57","first-page":"439","volume-title":"Fixing Dependency Errors for Python Build Reproducibility","author":"S Mukherjee","year":"2021","unstructured":"Mukherjee, S., Almanza, A., Rubio-Gonz\u00e1lez, C.: Fixing Dependency Errors for Python Build Reproducibility, pp. 439\u2013451. Association for Computing Machinery, New York, NY, USA (2021)"},{"key":"358_CR58","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1016\/j.future.2020.06.050","volume":"113","author":"U Naseem","year":"2020","unstructured":"Naseem, U., Razzak, I., Musial, K., et al.: Transformer based deep intelligent contextual embedding for twitter sentiment analysis. Futur. Gener. Comput. Syst. 113, 58\u201369 (2020)","journal-title":"Futur. Gener. Comput. Syst."},{"key":"358_CR59","doi-asserted-by":"publisher","unstructured":"Novielli, N., Girardi, D., Lanubile, F.: A Benchmark Study on Sentiment Analysis for Software Engineering Research. In: 15th International Conference on MSR. ACM, USA, MSR \u201918, p. 364\u2013375, https:\/\/doi.org\/10.1145\/3196398.3196403 (2018)","DOI":"10.1145\/3196398.3196403"},{"key":"358_CR60","unstructured":"Phan, TH., Yamamoto, K.: Resolving class imbalance in object detection with weighted cross entropy losses. arXiv e-prints 1(1):1\u201313 (2020)"},{"key":"358_CR61","doi-asserted-by":"publisher","unstructured":"Pinto, G., Wiese, I., Dias, LF.: How do scientists develop scientific software? an external replication. In: 25th International Conference on Software Analysis, Evolution and Reengineering. IEEE, Campobasso, Italy, pp. 582\u2013591, https:\/\/doi.org\/10.1109\/SANER.2018.8330263 (2018)","DOI":"10.1109\/SANER.2018.8330263"},{"key":"358_CR62","doi-asserted-by":"publisher","unstructured":"Potdar, A., Shihab, E.: An exploratory study on self-admitted technical debt. In: International Conference on Software Maintenance and Evolution. IEEE, Victoria, Canada, pp. 91\u2013100, https:\/\/doi.org\/10.1109\/ICSME.2014.31 (2014)","DOI":"10.1109\/ICSME.2014.31"},{"issue":"4","key":"358_CR63","doi-asserted-by":"publisher","first-page":"1551","DOI":"10.1007\/s11219-020-09520-3","volume":"28","author":"L Rantala","year":"2020","unstructured":"Rantala, L., M\u00e4ntyl\u00e4, M.: Predicting technical debt from commit contents: reproduction and extension with automated feature selection. Softw. Qual. J. 28(4), 1551\u20131579 (2020). https:\/\/doi.org\/10.1007\/s11219-020-09520-3","journal-title":"Softw. Qual. J."},{"issue":"3","key":"358_CR64","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3324916","volume":"28","author":"X Ren","year":"2019","unstructured":"Ren, X., Xing, Z., Xia, X., et al.: Neural network-based detection of self-admitted technical debt: from performance to explainability. ACM Trans. Softw. Eng. Methodol. 28(3), 1\u201345 (2019)","journal-title":"ACM Trans. Softw. Eng. Methodol."},{"key":"358_CR65","doi-asserted-by":"publisher","unstructured":"Robbes, R., Janes, A.: Leveraging small software engineering data sets with pre-trained neural networks. In: 41st International Conference on Software Engineering: New Ideas and Emerging Results. IEEE\/ACM, Montreal,Canada, pp. 29\u201332, https:\/\/doi.org\/10.1109\/ICSE-NIER.2019.00016 (2019)","DOI":"10.1109\/ICSE-NIER.2019.00016"},{"key":"358_CR66","doi-asserted-by":"crossref","unstructured":"Santos, RM., Santos, IM., J\u00fanior, MCR., et\u00a0al.: Long term-short memory neural networks and word2vec for self-admitted technical debt detection. In: ICEIS (2). IEEE, Virtual Conference, pp. 157\u2013165 (2020)","DOI":"10.5220\/0009796001570165"},{"key":"358_CR67","first-page":"1","volume-title":"International Conference on Applied Engineering","author":"MYH Setyawan","year":"2018","unstructured":"Setyawan, M.Y.H., Awangga, R.M., Efendi, S.R.: Comparison of multinomial naive bayes algorithm and logistic regression for intent classification in chatbot. In: International Conference on Applied Engineering, pp. 1\u20135. IEEE, Batam, Indonesia (2018)"},{"key":"358_CR68","doi-asserted-by":"publisher","unstructured":"Siavvas, M., Tsoukalas, D., Jankovic, M., et al.: Technical debt as an indicator of software security risk: a machine learning approach for software development enterprises. Enterprise Information Systems , 1\u201343 (2020). https:\/\/doi.org\/10.1080\/17517575.2020.1824017","DOI":"10.1080\/17517575.2020.1824017"},{"key":"358_CR69","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1016\/j.jss.2019.02.056","volume":"152","author":"G Sierra","year":"2019","unstructured":"Sierra, G., Shihab, E., Kamei, Y.: A survey of Self-Admitted Technical Debt. J. Syst. Softw. 152, 70\u201382 (2019). https:\/\/doi.org\/10.1016\/j.jss.2019.02.056","journal-title":"J. Syst. Softw."},{"key":"358_CR70","doi-asserted-by":"publisher","unstructured":"Sridharan, M., Mantyla, M., Rantala, L., et\u00a0al.: Data balancing improves self-admitted technical debt detection. In: 18th International Conference on Mining Software Repositories. IEEE Computer Society, USA, pp. 358\u2013368, https:\/\/doi.org\/10.1109\/MSR52588.2021.00048 (2021)","DOI":"10.1109\/MSR52588.2021.00048"},{"key":"358_CR71","doi-asserted-by":"publisher","unstructured":"Stanik, C., Haering, M., Maalej, W.: Classifying multilingual user feedback using traditional machine learning and deep learning. In: IEEE 27th REW. IEEE, Jeju, South Korea, pp 220\u2013226, https:\/\/doi.org\/10.1109\/REW.2019.00046 (2019)","DOI":"10.1109\/REW.2019.00046"},{"key":"358_CR72","doi-asserted-by":"publisher","DOI":"10.1145\/3084225","author":"T Storer","year":"2017","unstructured":"Storer, T.: Bridging the chasm: a survey of software engineering practice in scientific programming. ACM. Comput. Surv. (2017). https:\/\/doi.org\/10.1145\/3084225","journal-title":"ACM. Comput. Surv."},{"key":"358_CR73","unstructured":"TIOBE (2020) TIOBE Index - The Software Quality Company. Online, https:\/\/www.tiobe.com\/tiobe-index\/"},{"key":"358_CR74","doi-asserted-by":"publisher","unstructured":"Vidoni, M.: Evaluating Unit Testing Practices in R Packages. In: IEEE\/ACM 43rd International Conference on Software Engineering, pp 1523\u20131534, https:\/\/doi.org\/10.1109\/ICSE43902.2021.00136 (2021a)","DOI":"10.1109\/ICSE43902.2021.00136"},{"key":"358_CR75","doi-asserted-by":"publisher","unstructured":"Vidoni, M.: Self-Admitted Technical Debt in R packages: an exploratory study. In: IEEE\/ACM 18th International Conference on Mining Software Repositories. IEEE Computer Society, USA, pp 179\u2013189, https:\/\/doi.org\/10.1109\/MSR52588.2021.00030 (2021b)","DOI":"10.1109\/MSR52588.2021.00030"},{"key":"358_CR76","doi-asserted-by":"crossref","unstructured":"Wang, Q., Li, B., Xiao, T., et al.: Learning deep transformer models for machine translation. In: 57th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Florence, Italy, pp. 1810\u20131822, https:\/\/doi.org\/10.18653\/v1\/P19-1176 (2019)","DOI":"10.18653\/v1\/P19-1176"},{"key":"358_CR77","first-page":"871","volume-title":"35th International Conference on Automated Software Engineering","author":"X Wang","year":"2020","unstructured":"Wang, X., Liu, J., Li, L., et al.: Detecting and explaining self-admitted technical debts with attention-based neural networks. In: 35th International Conference on Automated Software Engineering, pp. 871\u2013882. IEEE, Melbourne, Australia (2020)"},{"key":"358_CR78","first-page":"7","volume-title":"9th International Workshop on Empirical Software Engineering in Practice (IWESEP)","author":"S Wattanakriengkrai","year":"2018","unstructured":"Wattanakriengkrai, S., Maipradit, R., Hata, H., et al.: Identifying design and requirement self-admitted technical debt using N-gram IDF. In: 9th International Workshop on Empirical Software Engineering in Practice (IWESEP), pp. 7\u201312. IEEE, Nara, Japan (2018)"},{"key":"358_CR79","first-page":"179","volume-title":"23rd International Conference on Software Analysis, Evolution, and Reengineering","author":"S Wehaibi","year":"2016","unstructured":"Wehaibi, S., Shihab, E., Guerrouj, L.: Examining the impact of self-admitted technical debt on software quality. In: 23rd International Conference on Software Analysis, Evolution, and Reengineering, vol. 1, pp. 179\u2013188. IEEE, Osaka, Japan (2016)"},{"key":"358_CR80","volume-title":"Encyclopedia of Human Computer Interaction","author":"B Whitworth","year":"2006","unstructured":"Whitworth, B., Ahmad, A., Soegaard, M., et al.: Encyclopedia of Human Computer Interaction. Interaction Design Foundation, USA (2006)"},{"key":"358_CR81","first-page":"137","volume-title":"Beyond the Code: Mining Self-Admitted Technical Debt in Issue Tracker Systems","author":"L Xavier","year":"2020","unstructured":"Xavier, L., Ferreira, F., Brito, R., et al.: Beyond the Code: Mining Self-Admitted Technical Debt in Issue Tracker Systems, pp. 137\u2013146. Association for Computing Machinery, New York, NY, USA (2020)"},{"issue":"12","key":"358_CR82","doi-asserted-by":"publisher","first-page":"1211","DOI":"10.1109\/TSE.2018.2831232","volume":"45","author":"M Yan","year":"2018","unstructured":"Yan, M., Xia, X., Shihab, E., et al.: Automating change-level self-admitted technical debt determination. IEEE Trans. Softw. Eng. 45(12), 1211\u20131229 (2018). https:\/\/doi.org\/10.1109\/TSE.2018.2831232","journal-title":"IEEE Trans. Softw. Eng."},{"key":"358_CR83","doi-asserted-by":"publisher","first-page":"2132","DOI":"10.18653\/v1\/P19-1205","volume-title":"57th Annual Meeting of the Association for Computational Linguistics","author":"Y You","year":"2019","unstructured":"You, Y., Jia, W., Liu, T., et al.: Improving abstractive document summarization with salient information modeling. In: 57th Annual Meeting of the Association for Computational Linguistics, pp. 2132\u20132141. ACL, Florence, Italy (2019)"},{"key":"358_CR84","doi-asserted-by":"publisher","first-page":"526","DOI":"10.1145\/3196398.3196423","volume-title":"15th International Conference on Mining Software Repositories","author":"F Zampetti","year":"2018","unstructured":"Zampetti, F., Serebrenik, A., Di Penta, M.: Was self-admitted technical debt removal a real removal? an in-depth perspective. In: 15th International Conference on Mining Software Repositories, pp. 526\u2013536. IEEE, Gothenburg, Sweden (2018)"},{"key":"358_CR85","first-page":"355","volume-title":"27th International Conference on Software Analysis","author":"F Zampetti","year":"2020","unstructured":"Zampetti, F., Serebrenik, A., Di Penta, M.: Automatically learning patterns for self-admitted technical debt removal. In: 27th International Conference on Software Analysis, pp. 355\u2013366. Evolution and Reengineering. IEEE, London, ON, Canada (2020)"},{"key":"358_CR86","doi-asserted-by":"publisher","unstructured":"Zanella, G., Liu, CZ.: A Social Network Perspective on the Success of Open Source Software: The Case of R Packages. In: Hawaii International Conference on System Sciences. Scholar Space, Hawaii, pp. 471\u2013480, https:\/\/doi.org\/10.24251\/HICSS.2020.058 (2020)","DOI":"10.24251\/HICSS.2020.058"},{"key":"358_CR87","doi-asserted-by":"publisher","unstructured":"Zhang, T., Xu, B., Thung, F., et\u00a0al.: Sentiment analysis for software engineering: how far can pre-trained transformer models go? In: International Conference on Software Maintenance and Evolution. IEEE, Adelaide, Australia, pp 70\u201380, https:\/\/doi.org\/10.1109\/ICSME46990.2020.00017 (2020)","DOI":"10.1109\/ICSME46990.2020.00017"},{"key":"358_CR88","unstructured":"Zhang, Z., Sabuncu, MR.: Generalized cross entropy loss for training deep neural networks with noisy labels. In: 32nd International Conference on Neural Information Processing Systems. Curran Associates Inc., USA, NIPS\u201918, p 8792\u20138802 (2018)"}],"container-title":["Automated Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10515-022-00358-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10515-022-00358-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10515-022-00358-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,28]],"date-time":"2022-10-28T11:23:15Z","timestamp":1666956195000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10515-022-00358-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,25]]},"references-count":88,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,11]]}},"alternative-id":["358"],"URL":"https:\/\/doi.org\/10.1007\/s10515-022-00358-6","relation":{},"ISSN":["0928-8910","1573-7535"],"issn-type":[{"value":"0928-8910","type":"print"},{"value":"1573-7535","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,25]]},"assertion":[{"value":"16 December 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 August 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 August 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"53"}}