{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T21:11:02Z","timestamp":1777497062158,"version":"3.51.4"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2023,7,21]],"date-time":"2023-07-21T00:00:00Z","timestamp":1689897600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Universit\u00e0 degli Studi dell\u2019Insubria"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2023,9,30]]},"abstract":"<jats:p>Measuring software functional size via standard Function Points Analysis (FPA) requires the availability of fully specified requirements and specific competencies. Most of the time, the need to measure software functional size occurs well in advance with respect to these ideal conditions, under the lack of complete information or skilled experts. To work around the constraints of the official measurement process, several estimation methods\u00a0for FPA have been proposed and are commonly used. Among these, the International Function Points User Group (IFPUG) has adopted the \u201cHigh-level FPA\u201d method (also known as the NESMA method). This method avoids weighting each data and transaction function by using fixed weights instead. Applying High-level FPA, or similar estimation methods, is faster and easier than carrying out the official measurement process but inevitably yields an approximation in the measures. In this article, we contribute to the problem of estimating software functional size measures by using machine learning. To the best of our knowledge, machine learning methods were never applied to the early estimation of software functional size. Our goal is to understand whether machine learning techniques yield estimates of FPA measures that are more accurate than those obtained with High-level FPA or similar methods. An empirical study on a large dataset of functional size predictors was carried out to train and test three of the most popular and robust machine learning methods, namely Random Forests, Support Vector Regression\u00a0, and Neural Networks. A systematic experimental phase, with cycles of dataset filtering and splitting, parameter tuning, and model training and validation, is presented. The estimation accuracy of the obtained models was then evaluated and compared to that of fixed-weight models (e.g., High-level FPA) and linear regression models, also using a second dataset as the test set. We found that Support Vector Regression yields quite accurate estimation models. However, the obtained level of accuracy does not appear significantly better with respect to High-level FPA or to models built via ordinary least squares regression. Noticeably, fairly good accuracy levels were obtained by models that do not even require discerning among different types of transactions and data.<\/jats:p>","DOI":"10.1145\/3582575","type":"journal-article","created":{"date-parts":[[2023,1,31]],"date-time":"2023-01-31T12:10:35Z","timestamp":1675167035000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":16,"title":["Estimating Software Functional Size via Machine Learning"],"prefix":"10.1145","volume":"32","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5226-4337","authenticated-orcid":false,"given":"Luigi","family":"Lavazza","sequence":"first","affiliation":[{"name":"Universit\u00e0 degli Studi dell\u2019Insubria, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6740-8620","authenticated-orcid":false,"given":"Angela","family":"Locoro","sequence":"additional","affiliation":[{"name":"Universit\u00e0 degli Studi dell\u2019Insubria, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4686-0834","authenticated-orcid":false,"given":"Geng","family":"Liu","sequence":"additional","affiliation":[{"name":"Hangzhou Dianzi University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1069-8548","authenticated-orcid":false,"given":"Roberto","family":"Meli","sequence":"additional","affiliation":[{"name":"DPO, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,7,21]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2017.02.005"},{"key":"e_1_3_3_3_2","first-page":"83","volume-title":"Proceedings of the Joint SHARE\/GUIDE\/ IBM Application Development Symposium","volume":"10","author":"Albrecht Allan J.","year":"1979","unstructured":"Allan J. Albrecht. 1979. Measuring application development productivity. In Proceedings of the Joint SHARE\/GUIDE\/ IBM Application Development Symposium, Vol. 10. 83\u201392."},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/2480362.2480571"},{"key":"e_1_3_3_5_2","article-title":"Software effort estimation using radial basis function neural networks","volume":"319","author":"Bautista Ana Maria","year":"1993","unstructured":"Ana Maria Bautista, Angel Castellanos, and Tomas San Feliu. 1993. Software effort estimation using radial basis function neural networks. Information Theories & Applications 319 (1993), 319--327.","journal-title":"Information Theories & Applications"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.5555\/1095639"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/0164-1212(92)90101-O"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/32.177363"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.7717\/peerj-cs.623"},{"key":"e_1_3_3_10_2","first-page":"20","article-title":"Statistical Power Analysis for the Behavioral Sciences. Lawrence Earlbaum Associates","author":"Cohen Jacob","year":"1988","unstructured":"Jacob Cohen. 1988. Statistical Power Analysis for the Behavioral Sciences. Lawrence Earlbaum Associates. Hillsdale, NJ, 20\u201326.","journal-title":"Hillsdale, NJ"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/TEM.2015.2453354"},{"issue":"106308","key":"e_1_3_3_12_2","article-title":"Assessing the effectiveness of approximate functional sizing approaches for effort estimation","volume":"123","author":"Martino Sergio Di","year":"2020","unstructured":"Sergio Di Martino, Filomena Ferrucci, Carmine Gravino, and Federica Sarro. 2020. Assessing the effectiveness of approximate functional sizing approaches for effort estimation. Information and Software Technology 123, 106308 (2020).","journal-title":"Information and Software Technology"},{"key":"e_1_3_3_13_2","volume-title":"Early & Quick Function Points Reference Manual - IFPUG version","year":"2012","unstructured":"DPO. 2012. Early & Quick Function Points Reference Manual - IFPUG version. Technical Report EQ&FP-IFPUG-31-RM-11-EN-P. DPO, Roma, Italy."},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/2851613.2851779"},{"issue":"4","key":"e_1_3_3_15_2","article-title":"Inside SEER-SEM","volume":"18","author":"Fischman Lee","year":"2005","unstructured":"Lee Fischman, Karen McRitchie, and Donald D. Galorath. 2005. Inside SEER-SEM. CrossTalk 18, 4 (2005), 26--28.","journal-title":"CrossTalk"},{"key":"e_1_3_3_16_2","unstructured":"R. Georgi and T. Vogt. 2008. Illustrative Example of a Function Point Analysis for the NASA Crew Exploration Vehicle Guidance Navigation and Control Flight Software. (2008)."},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1021\/ci0342472"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0950-5849(98)00074-3"},{"key":"e_1_3_3_19_2","unstructured":"International Function Point Users Group (IFPUG). 2021. Simple Function Point (SFP) Counting Practices Manual Release 2.1. (2021)."},{"key":"e_1_3_3_20_2","unstructured":"International Function Point Users Group (IFPUG). 2010. Function Point Counting Practices Manual Release 4.3.1. (2010)."},{"key":"e_1_3_3_21_2","unstructured":"International Software Benchmarking Standards Group. 2009. Worldwide Software Development: The Benchmark Release 11. (2009)."},{"key":"e_1_3_3_22_2","unstructured":"International Standardization Organization (ISO). 2003. ISO\/IEC 20926: 2003 Software engineering \u2013 IFPUG 4.1 Unadjusted functional size measurement method \u2013 Counting Practices Manual. (2003)."},{"key":"e_1_3_3_23_2","unstructured":"International Standards Organisation. 2005. ISO\/IEC 24570:2005 \u2013 Software engineering \u2013 NESMA functional size measurement method version 2.1 \u2013 definitions and counting guidelines for the application of Function Point Analysis. (2005)."},{"key":"e_1_3_3_24_2","first-page":"179","volume-title":"Proceedings Software Measurement European Forum (SMEF\u201907)","author":"Iorio Tommaso","year":"2007","unstructured":"Tommaso Iorio, Roberto Meli, and Franco Perna. 2007. Early & quick function points\u00ae v3.0: Enhancements for a publicly available method. In Proceedings Software Measurement European Forum (SMEF\u201907). 179\u2013198."},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1201\/9781315314426"},{"key":"e_1_3_3_26_2","first-page":"81","volume-title":"IEEE Proceedings on Software-","volume":"148","author":"Kitchenham B. A.","year":"2001","unstructured":"B. A. Kitchenham, L. M. Pickard, S. G. MacDonell, and M. J. Shepperd. 2001. What accuracy statistics really measure [software estimation]. In IEEE Proceedings on Software-, Vol. 148. IET, IEEE, 81\u201385."},{"issue":"3","key":"e_1_3_3_27_2","first-page":"249","article-title":"Supervised machine learning: A review of classification techniques","volume":"31","author":"Kotsiantis S. B.","year":"2007","unstructured":"S. B. Kotsiantis. 2007. Supervised machine learning: A review of classification techniques. Informatica 31, 3 (2007), 249\u2013268. http:\/\/www.informatica.si\/PDF\/31-3\/11_Kotsiantis%20-%20Supervised%20Machine%20Learning%20-%20A%20Review%20of...pdf.","journal-title":"Informatica"},{"key":"e_1_3_3_28_2","article-title":"On the effort required by function point measurement phases","author":"Lavazza Luigi","year":"2017","unstructured":"Luigi Lavazza. 2017. On the effort required by function point measurement phases. International Journal on Advances in Software 10, 1\u20132 (2017), 108--120.","journal-title":"International Journal on Advances in Software"},{"issue":"1","key":"e_1_3_3_29_2","article-title":"An empirical evaluation of simplified function point measurement processes","volume":"6","author":"Lavazza Luigi","year":"2013","unstructured":"Luigi Lavazza and Geng Liu. 2013. An empirical evaluation of simplified function point measurement processes. Journal on Advances in Software 6, 1\u20132 (2013), 1--13.","journal-title":"Journal on Advances in Software"},{"key":"e_1_3_3_30_2","first-page":"24","volume-title":"The 14th International Conference on Software Engineering Advances (ICSEA\u201919)","author":"Lavazza Luigi","year":"2019","unstructured":"Luigi Lavazza and Geng Liu. 2019. An empirical evaluation of the accuracy of NESMA function points estimates. In The 14th International Conference on Software Engineering Advances (ICSEA\u201919). 24\u201329."},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/3382494.3410691"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/IWSM.Mensura.2014.28"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2013.04.003"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2020.110888"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.3390\/app11115183"},{"key":"e_1_3_3_36_2","volume-title":"Software Measurement European Forum","author":"Meli Roberto","year":"2011","unstructured":"Roberto Meli. 2011. Simple function point: A new functional size measurement method fully compliant with IFPUG 4x. In Software Measurement European Forum."},{"key":"e_1_3_3_37_2","volume-title":"Int. Conf. on Advances and Trends in Software Engineering","author":"Meli R.","year":"2015","unstructured":"R. Meli. 2015. Early & quick function point method-an empirical validation experiment. In Int. Conf. on Advances and Trends in Software Engineering."},{"key":"e_1_3_3_38_2","volume-title":"Software Measurement European Forum (FESMA\u201999)","year":"1999","unstructured":"Roberto Meli and Luca Santillo. 1999. Function point estimation methods: A comparative overview. In Software Measurement European Forum (FESMA\u201999). Amsterdam, Nederlands, October 1999."},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11219-013-9215-1"},{"key":"e_1_3_3_40_2","unstructured":"NESMA. 2015. Early Function Point Analysis. https:\/\/nesma.org\/wp-content\/uploads\/2015\/11\/Early-Function-Point-Analysis-vs-2015-07-15-EN.pdf."},{"key":"e_1_3_3_41_2","unstructured":"NESMA\u2013the Netherlands Software Metrics Association. 2004. Definitions and counting guidelines for the application of function point analysis. NESMA Functional Size Measurement method compliant to ISO\/IEC 24570 version 2.1. (2004)."},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.2298\/CSIS110316068P"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2017.11.066"},{"key":"e_1_3_3_44_2","unstructured":"R Core Team. 2015. R: A language and environment for statistical computing. (2015)."},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3057807"},{"key":"e_1_3_3_46_2","volume-title":"Joint Conf. of the 22nd Int. Workshop on Software Measurement and the 7th Int. Conf. on Software Process and Product Measurement","author":"Santillo Luca","year":"2012","unstructured":"Luca Santillo. 2012. Easy function points \u2013 \u201cSmart\u201d approximation technique for the IFPUG and COSMIC methods. In Joint Conf. of the 22nd Int. Workshop on Software Measurement and the 7th Int. Conf. on Software Process and Product Measurement."},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/METRICS.2005.18"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICACCI.2016.7732171"},{"key":"e_1_3_3_49_2","unstructured":"Simple Function Point Association. 2014. Simple function point functional size measurement method\u2013Reference manual SiFP-01.00-RM-EN-01.01. (2014). http:\/\/www.sifpa.org\/wp-content\/uploads\/2018\/01\/SiFP-01.00-RM-EN-01.01.pdf."},{"key":"e_1_3_3_50_2","volume-title":"IFPUG Fall Conference","author":"Tichenor C.","year":"1997","unstructured":"C. Tichenor. 1997. The IRS development and application of the internal logical file model to estimate function point counts. In IFPUG Fall Conference."},{"key":"e_1_3_3_51_2","unstructured":"Adri Timp. 2015. uTip \u2013 Early Function Point Analysis and Consistent Cost Estimating. (2015). https:\/\/www.ifpug.org\/content\/tips\/uTip003EarlyFPAandConsistentCostEstimating.pdf. uTip # 03 \u2013 (version # 1.0 2015\/07\/01)."},{"key":"e_1_3_3_52_2","article-title":"effsize: Efficient effect size computation","volume":"1","author":"Torchiano Marco","year":"2017","unstructured":"Marco Torchiano et\u00a0al. 2017. effsize: Efficient effect size computation. R Package Version 0.7 1 (2017).","journal-title":"R Package Version 0.7"},{"key":"e_1_3_3_53_2","volume-title":"Software Measurement European Forum (SMEF\u201909)","author":"Heeringen H. S. van","year":"2009","unstructured":"H. S. van Heeringen, E. W. M. van Gorp, and T. G. Prins. 2009. Functional size measurement-accuracy versus costs\u2013Is it really worth it? In Software Measurement European Forum (SMEF\u201909)."},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2011.05.008"},{"issue":"1","key":"e_1_3_3_55_2","first-page":"233","article-title":"Software cost estimation using soft computing techniques","volume":"2","author":"Ziauddin Sh K. Tipu","year":"2012","unstructured":"Sh K. Tipu Ziauddin, Khairuz Zaman, and Shahrukh Zia. 2012. Software cost estimation using soft computing techniques. Advances in Information Technology and Management (AITM) 2, 1 (2012), 233\u2013238.","journal-title":"Advances in Information Technology and Management (AITM)"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3582575","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3582575","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:09:13Z","timestamp":1750183753000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3582575"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,21]]},"references-count":54,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2023,9,30]]}},"alternative-id":["10.1145\/3582575"],"URL":"https:\/\/doi.org\/10.1145\/3582575","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,21]]},"assertion":[{"value":"2022-07-30","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-12-23","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-07-21","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}