{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T14:20:52Z","timestamp":1767968452355,"version":"3.49.0"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"21","license":[{"start":{"date-parts":[[2020,9,25]],"date-time":"2020-09-25T00:00:00Z","timestamp":1600992000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,9,25]],"date-time":"2020-09-25T00:00:00Z","timestamp":1600992000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100012740","name":"Gruppo Nazionale per l\u2019Analisi Matematica, la Probabilit\u00e0 e le loro Applicazioni","doi-asserted-by":"publisher","award":["2020 Italian project \u201cTrade-off between Number of Examples and Precision in Variations of the Fixed-Effects Panel Data Model\u201d, funded by INdAM-GNAMPA"],"award-info":[{"award-number":["2020 Italian project \u201cTrade-off between Number of Examples and Precision in Variations of the Fixed-Effects Panel Data Model\u201d, funded by INdAM-GNAMPA"]}],"id":[{"id":"10.13039\/100012740","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Soft Comput"],"published-print":{"date-parts":[[2020,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper is focused on the unbalanced fixed effects panel data model. This is a linear regression model able to represent unobserved heterogeneity in the data, by allowing each two distinct observational units to have possibly different numbers of associated observations. We specifically address the case in which the model includes the additional possibility of controlling the conditional variance of the output given the input and the selection probabilities of the different units per unit time. This is achieved by varying the cost associated with the supervision of each training example. Assuming an upper bound on the expected total supervision cost and fixing the expected number of observed units for each instant, we analyze and optimize the trade-off between sample size, precision of supervision (the reciprocal of the conditional variance of the output) and selection probabilities. This is obtained by formulating and solving a suitable optimization problem. The formulation of such a problem is based on a large-sample upper bound on the generalization error associated with the estimates of the parameters of the unbalanced fixed effects panel data model, conditioned on the training input dataset. We prove that, under appropriate assumptions, in some cases \u201cmany but bad\u201d examples provide a smaller large-sample upper bound on the conditional generalization error than \u201cfew but good\u201d ones, whereas in other cases the opposite occurs. We conclude discussing possible applications of the presented results, and extensions of the proposed optimization framework to other panel data models.<\/jats:p>","DOI":"10.1007\/s00500-020-05317-5","type":"journal-article","created":{"date-parts":[[2020,9,25]],"date-time":"2020-09-25T13:04:16Z","timestamp":1601039056000},"page":"15937-15949","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Optimal trade-off between sample size, precision of supervision, and selection probabilities for the unbalanced fixed effects panel data model"],"prefix":"10.1007","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5427-4328","authenticated-orcid":false,"given":"Giorgio","family":"Gnecco","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Federico","family":"Nutarelli","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniela","family":"Selvi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,9,25]]},"reference":[{"key":"5317_CR1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-32914-2","volume-title":"Applied panel data analysis for economic and social surveys","author":"H-J Andre\u00df","year":"2013","unstructured":"Andre\u00df H-J, Golsch K, Schmidt AW (2013) Applied panel data analysis for economic and social surveys. Springer, Berlin"},{"key":"5317_CR2","volume-title":"Panel data econometrics","author":"M Arellano","year":"2004","unstructured":"Arellano M (2004) Panel data econometrics. Oxford University Press, Oxford"},{"key":"5317_CR3","doi-asserted-by":"publisher","first-page":"7353","DOI":"10.1073\/pnas.1510489113","volume":"113","author":"S Athey","year":"2016","unstructured":"Athey S, Imbens G (2016) Recursive partitioning for heterogeneous causal effects. Proc Nat Acad Sci 113:7353\u20137360","journal-title":"Proc Nat Acad Sci"},{"key":"5317_CR4","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4612-0653-8","volume-title":"Matrix analysis","author":"R Bhatia","year":"1997","unstructured":"Bhatia R (1997) Matrix analysis. Springer, Berlin"},{"key":"5317_CR5","doi-asserted-by":"publisher","DOI":"10.1007\/s41060-019-00187-z","author":"FJ Bargagli Stoffi","year":"2019","unstructured":"Bargagli Stoffi FJ, Gnecco G (2019) Causal tree with instrumental variable: an extension of the causal tree framework to irregular assignment mechanisms. Int J Data Sci Anal. https:\/\/doi.org\/10.1007\/s41060-019-00187-z","journal-title":"Int J Data Sci Anal"},{"key":"5317_CR6","doi-asserted-by":"crossref","unstructured":"Bargagli Stoffi FJ, Gnecco G (2018) Estimating heterogeneous causal effects in the presence of irregular assignment mechanisms. In Proceedings of the 5th IEEE international conference on data science and advanced analytics (IEEE DSAA 2018), Turin, Italy, pp 1\u201310","DOI":"10.1109\/DSAA.2018.00010"},{"key":"5317_CR7","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1017\/psrm.2014.7","volume":"3","author":"A Bell","year":"2014","unstructured":"Bell A, Jones K (2014) Explaining fixed effects: random effects modeling of time-series cross-sectional and panel data. Polit Sci Res Methods 3:133\u2013153","journal-title":"Polit Sci Res Methods"},{"key":"5317_CR8","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511804441","volume-title":"Convex optimization","author":"S Boyd","year":"2004","unstructured":"Boyd S, Vandenberghe L (2004) Convex optimization. Cambridge University Press, Cambridge"},{"key":"5317_CR9","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511811241","volume-title":"Microeconometrics: methods and applications","author":"AC Cameron","year":"2005","unstructured":"Cameron AC, Trivedi PK (2005) Microeconometrics: methods and applications. Cambridge University Press, Cambridge"},{"key":"5317_CR10","doi-asserted-by":"publisher","DOI":"10.1142\/7437","volume-title":"Stochastic simulation optimization: an optimal computing budget allocation","author":"C-H Chen","year":"2010","unstructured":"Chen C-H, Lee LH (2010) Stochastic simulation optimization: an optimal computing budget allocation. World Scientific, Singapore"},{"key":"5317_CR11","unstructured":"Crane-Droesch A (2017) Semiparametric panel data using neural networks. In: Proceedings of the 2017 annual meeting of the agricultural and applied economics association, Chicago, USA"},{"key":"5317_CR12","volume-title":"Probability and stochastic processes","author":"I Florescu","year":"2015","unstructured":"Florescu I (2015) Probability and stochastic processes. Wiley, Hoboken"},{"key":"5317_CR13","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511790928","volume-title":"Longitudinal and panel data: analysis and applications in the social sciences","author":"EW Frees","year":"2004","unstructured":"Frees EW (2004) Longitudinal and panel data: analysis and applications in the social sciences. Cambridge University Press, Cambridge"},{"key":"5317_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1006\/nimg.1999.0439","volume":"10","author":"KJ Friston","year":"1999","unstructured":"Friston KJ, Holmes AP, Worsley KJ (1999) How many subjects constitute a study? Neuroimage 10:1\u20135","journal-title":"Neuroimage"},{"key":"5317_CR15","doi-asserted-by":"crossref","unstructured":"Gnecco G, Nutarelli F (2019) On the trade-off between number of examples and precision of supervision in regression problems. In: Proceedings of the 4th international conference of the international neural network society on big data and deep learning (INNS BDDL 2019), Sestri Levante, Italy, pp 1\u20136","DOI":"10.1007\/978-3-030-16841-4_1"},{"key":"5317_CR16","doi-asserted-by":"publisher","DOI":"10.1007\/s11590-019-01486-x","author":"G Gnecco","year":"2019","unstructured":"Gnecco G, Nutarelli F (2019) On the trade-off between number of examples and precision of supervision in machine learning problems. Optim Lett. https:\/\/doi.org\/10.1007\/s11590-019-01486-x","journal-title":"Optim Lett"},{"key":"5317_CR17","doi-asserted-by":"crossref","unstructured":"Gnecco G, Nutarelli F (2019) On the optimal trade-off between sample size and precision of supervision. In: Program of the international conference on optimization and decision science (ODS 2019), Genoa, Italy, p 27","DOI":"10.1007\/978-3-030-37599-7_44"},{"key":"5317_CR18","doi-asserted-by":"crossref","unstructured":"Gnecco G, Nutarelli F (2020) Optimal trade-off between sample size and precision of supervision for the fixed effects panel data model. In: Proceedings of the 5th international conference on machine learning, optimization & data science (LOD 2019), Certosa di Pontignano (Siena), Italy, vol 11943 of Lecture notes in computer science, pp 531\u2013542","DOI":"10.1007\/978-3-030-37599-7_44"},{"key":"5317_CR19","volume-title":"Econometric analysis","author":"WH Greene","year":"2003","unstructured":"Greene WH (2003) Econometric analysis. Pearson Education, London"},{"key":"5317_CR20","volume-title":"Survey methodology","author":"RM Groves","year":"2004","unstructured":"Groves RM, Fowler FJ Jr, Couper MP, Lepkowski JM, Singer E, Tourangeau R (2004) Survey methodology. Wiley, Hoboken"},{"key":"5317_CR21","volume-title":"Statistical methods for biostatistics and related fields","author":"W H\u00e4rdle","year":"2007","unstructured":"H\u00e4rdle W, Mori Y, Vieu P (2007) Statistical methods for biostatistics and related fields. Springer, Berlin"},{"key":"5317_CR22","doi-asserted-by":"publisher","DOI":"10.1007\/b60971","volume-title":"Micro-econometrics: methods of moments and limited dependent variables","author":"M-J Lee","year":"2010","unstructured":"Lee M-J (2010) Micro-econometrics: methods of moments and limited dependent variables. Springer, Berlin"},{"key":"5317_CR23","volume-title":"Continuous knapsack problems: algorithms and computer implementations","author":"S Martello","year":"1990","unstructured":"Martello S, Toth P (1990) Continuous knapsack problems: algorithms and computer implementations. Wiley, Hoboken"},{"key":"5317_CR24","doi-asserted-by":"publisher","first-page":"1164","DOI":"10.1016\/j.ijar.2009.06.013","volume":"50","author":"HT Nguyen","year":"2009","unstructured":"Nguyen HT, Kosheleva O, Kreinovich V, Ferson S (2009) Trade-off between sample size and accuracy: case of measurements under interval uncertainty. Int J Approx Reason 50:1164\u20131176","journal-title":"Int J Approx Reason"},{"key":"5317_CR25","doi-asserted-by":"crossref","unstructured":"Reeve CP (1988) A new statistical model for the calibration of force sensors, NBS Technical Note 1246. National Bureau of Standards, pp 1\u201341","DOI":"10.6028\/NBS.TN.1246"},{"key":"5317_CR26","volume-title":"The laws of large numbers","author":"P R\u00e9v\u00e9sz","year":"1968","unstructured":"R\u00e9v\u00e9sz P (1968) The laws of large numbers. Academic Press, Cambridge"},{"key":"5317_CR27","volume-title":"An introduction to classical econometric theory","author":"PA Ruud","year":"2000","unstructured":"Ruud PA (2000) An introduction to classical econometric theory. Oxford University Press, Oxford"},{"key":"5317_CR28","unstructured":"Sherron T, Allen J, Shumacker, RE (2000) A fixed effects panel data model: mathematics achievement in the U.S. In: Proceedings of the annual meeting of the American educational research association, New Orleans, USA"},{"key":"5317_CR29","volume-title":"Statistical learning theory","author":"VN Vapnik","year":"1998","unstructured":"Vapnik VN (1998) Statistical learning theory. Wiley, Hoboken"},{"key":"5317_CR30","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1257\/jep.28.2.3","volume":"28","author":"HR Varian","year":"2014","unstructured":"Varian HR (2014) Big data: new tricks for econometrics. J Econ Perspect 28:3\u201338","journal-title":"J Econ Perspect"},{"key":"5317_CR31","volume-title":"Econometric analysis of cross section and panel data","author":"JM Wooldridge","year":"2002","unstructured":"Wooldridge JM (2002) Econometric analysis of cross section and panel data. MIT Press, Cambridge"},{"key":"5317_CR32","doi-asserted-by":"publisher","first-page":"3039","DOI":"10.1109\/TITS.2018.2792493","volume":"9","author":"Q Yu","year":"2018","unstructured":"Yu Q, Qin Y, Liu P, Ren G (2018) A panel data model-based multi-factor predictive model of highway electromechanical equipment faults. IEEE Trans Intell Transp Syst 9:3039\u20133045","journal-title":"IEEE Trans Intell Transp Syst"},{"key":"5317_CR33","doi-asserted-by":"crossref","unstructured":"Zeifman M (2015) Measurement and verification of energy saving in smart building technologies. In: Proceedings of the IEEE symposium on signal processing applications in smart buildings (GlobalSIP 2015), Orlando, USA, pp 343\u2013347","DOI":"10.1109\/GlobalSIP.2015.7418214"}],"container-title":["Soft Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00500-020-05317-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00500-020-05317-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00500-020-05317-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,25]],"date-time":"2021-09-25T00:27:22Z","timestamp":1632529642000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00500-020-05317-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,25]]},"references-count":33,"journal-issue":{"issue":"21","published-print":{"date-parts":[[2020,11]]}},"alternative-id":["5317"],"URL":"https:\/\/doi.org\/10.1007\/s00500-020-05317-5","relation":{},"ISSN":["1432-7643","1433-7479"],"issn-type":[{"value":"1432-7643","type":"print"},{"value":"1433-7479","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,25]]},"assertion":[{"value":"25 September 2020","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"This article does not contain any studies with human participants or animals performed by any of the authors.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval\/informed consent"}}]}}