{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T07:31:18Z","timestamp":1740123078263,"version":"3.37.3"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2021,6,8]],"date-time":"2021-06-08T00:00:00Z","timestamp":1623110400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,6,8]],"date-time":"2021-06-08T00:00:00Z","timestamp":1623110400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"2020 Italian project \u201cTrade-off between Number of Examples and Precision in Variations of the Fixed-Effects Panel Data Model\u201d, funded by INdAM-GNAMPA"},{"DOI":"10.13039\/100015963","name":"Scuola IMT Alti Studi Lucca","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100015963","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mach Learn"],"published-print":{"date-parts":[[2021,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This work belongs to the strand of literature that combines machine learning, optimization, and econometrics. The aim is to optimize the data collection process in a specific statistical model, commonly used in econometrics, employing an optimization criterion inspired by machine learning, namely, the generalization error conditioned on the training input data. More specifically, the paper is focused on the analysis of the conditional generalization error of the Fixed Effects Generalized Least Squares (FEGLS) panel data model, i.e., a linear regression model with applications in several fields, able to represent unobserved heterogeneity in the data associated with different units, for which distinct observations related to the same unit are corrupted by correlated measurement errors. The framework considered in this work differs from the classical FEGLS model for the additional possibility of controlling the conditional variance of the output variable given the associated unit and input variables, by changing the cost per supervision of each training example. Assuming an upper bound on the total supervision cost, i.e., the cost associated with the whole training set, the trade-off between the training set size and the precision of supervision (i.e., the reciprocal of the conditional variance of the output variable) is analyzed and optimized. This is achieved by formulating and solving in closed form suitable optimization problems, based on large-sample approximations of the generalization error associated with the FEGLS estimates of the model parameters, conditioned on the training input data. The results of the analysis extend to the FEGLS case and to various large-sample approximations of its conditional generalization error the ones obtained by the authors in recent works for simpler linear regression models. They highlight the importance of how the precision of supervision scales with respect to the cost per training example in determining the optimal trade-off between training set size and precision. Numerical results confirm the validity of the theoretical findings.<\/jats:p>","DOI":"10.1007\/s10994-021-05976-x","type":"journal-article","created":{"date-parts":[[2021,6,8]],"date-time":"2021-06-08T21:03:52Z","timestamp":1623186232000},"page":"1549-1584","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Optimal data collection design in machine learning: the case of the fixed effects generalized least squares panel data model"],"prefix":"10.1007","volume":"110","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5427-4328","authenticated-orcid":false,"given":"Giorgio","family":"Gnecco","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Federico","family":"Nutarelli","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniela","family":"Selvi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,6,8]]},"reference":[{"key":"5976_CR1","doi-asserted-by":"crossref","unstructured":"Aitken A. C. (1936). On least-squares and linear combinations of observations, Proceedings of the Royal Society of Edinburgh, 55, pp. 42-48.","DOI":"10.1017\/S0370164600014346"},{"key":"5976_CR2","volume-title":"Panel data econometrics","author":"M Arellano","year":"2004","unstructured":"Arellano, M. (2004). Panel data econometrics. Oxford: Oxford University Press."},{"key":"5976_CR3","doi-asserted-by":"publisher","first-page":"7353","DOI":"10.1073\/pnas.1510489113","volume":"113","author":"S Athey","year":"2016","unstructured":"Athey, S., & Imbens, G. (2016). Recursive partitioning for heterogeneous causal effects. Proceedings of the National Academy of Sciences, 113, 7353\u20137360.","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"5976_CR4","first-page":"923","volume":"7","author":"Z Bai","year":"1997","unstructured":"Bai, Z., Cheng, P. E., & Zhang, C.-H. (1997). An extension of the Hardy-Littlewood strong law. Statistica Sinica, 7, 923\u2013928.","journal-title":"Statistica Sinica"},{"key":"5976_CR5","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1007\/s13538-011-0052-z","volume":"42","author":"JCA Barata","year":"2012","unstructured":"Barata, J. C. A., & Hussein, M. S. (2012). The Moore-Penrose pseudoinverse: A tutorial review of the theory. Brazilian Journal of Physics, 42, 146\u2013165.","journal-title":"Brazilian Journal of Physics"},{"key":"5976_CR6","doi-asserted-by":"crossref","unstructured":"Bargagli Stoffi, F. J., & Gnecco, G. (2018). Estimating heterogeneous causal effects in the presence of irregular assignment mechanisms, in Proceedings of the $$5^{\\rm th}$$ IEEE International Conference on Data Science and Advanced Analytics (IEEE DSAA 2018), Turin, Italy, pp. 1-10.","DOI":"10.1109\/DSAA.2018.00010"},{"key":"5976_CR7","doi-asserted-by":"publisher","first-page":"315","DOI":"10.1007\/s41060-019-00187-z","volume":"9","author":"FJ Bargagli Stoffi","year":"2020","unstructured":"Bargagli Stoffi, F. J., & Gnecco, G. (2020). Causal tree with instrumental variable: An extension of the causal tree framework to irregular assignment mechanisms. International Journal of Data Science and Analytics, 9, 315\u2013337.","journal-title":"International Journal of Data Science and Analytics"},{"key":"5976_CR8","volume-title":"Statistics: A guide to the use of statistical methods in the physical sciences","author":"RJ Barlow","year":"1989","unstructured":"Barlow, R. J. (1989). Statistics: A guide to the use of statistical methods in the physical sciences. Hoboken: Wiley."},{"key":"5976_CR9","first-page":"1265","volume":"7","author":"KP Bennett","year":"2006","unstructured":"Bennett, K. P., & Parrado-Hern\u00e1ndez, E. (2006). The interplay of optimization and machine learning research. Journal of Machine Learning Research, 7, 1265\u20131281.","journal-title":"Journal of Machine Learning Research"},{"key":"5976_CR10","doi-asserted-by":"publisher","first-page":"533","DOI":"10.2307\/2297285","volume":"49","author":"A Bhargava","year":"1982","unstructured":"Bhargava, A., Franzini, L., & Narendranathan, W. (1982). Serial correlation and the fixed effects model. Review of Economic Studies, 49, 533\u2013549.","journal-title":"Review of Economic Studies"},{"key":"5976_CR11","doi-asserted-by":"crossref","unstructured":"Bianchini, M., Frasconi, P., Gori, M., & Maggini, M. (1998). Optimal learning in artificial neural networks: A theoretical view. In: Leondes, C. T. (ed.), Neural networks systems, techniques and applications, (pp. 1-51).","DOI":"10.1016\/S1874-5946(98)80037-0"},{"key":"5976_CR12","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511811241","volume-title":"Microeconometrics: Methods and applications","author":"AC Cameron","year":"2005","unstructured":"Cameron, A. C., & Trivedi, P. K. (2005). Microeconometrics: Methods and applications. Cambridge: Cambridge University Press."},{"key":"5976_CR13","unstructured":"Dattorro, J. (2019). Convex analysis $$\\dagger$$ Euclidean distance geometry, $${\\cal{M}}\\varepsilon \\beta oo$$ Publishing, https:\/\/web.stanford.edu\/group\/SOL\/Books\/0976401304.pdf."},{"key":"5976_CR14","volume-title":"Probability and stochastic processes","author":"I Florescu","year":"2015","unstructured":"Florescu, I. (2015). Probability and stochastic processes. Hoboken: Wiley."},{"key":"5976_CR15","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511790928","volume-title":"Longitudinal and panel data: Analysis and applications in the social sciences","author":"EW Frees","year":"2004","unstructured":"Frees, E. W. (2004). Longitudinal and panel data: Analysis and applications in the social sciences. Cambridge: Cambridge University Press."},{"key":"5976_CR16","first-page":"749","volume":"7","author":"S Gerschgorin","year":"1931","unstructured":"Gerschgorin, S. (1931). \u00dcber die abgrenzung der eigenwerte einer matrix. Izvestija Akademii Nauk SSSR, Serija Matematika, 7, 749\u2013754.","journal-title":"Izvestija Akademii Nauk SSSR, Serija Matematika"},{"key":"5976_CR17","volume-title":"Univariate time series in geosciences: Theory and examples","author":"H Gilgen","year":"2006","unstructured":"Gilgen, H. (2006). Univariate time series in geosciences: Theory and examples. Berlin: Springer."},{"key":"5976_CR18","doi-asserted-by":"publisher","first-page":"1029","DOI":"10.1162\/NECO_a_00417","volume":"25","author":"G Gnecco","year":"2013","unstructured":"Gnecco, G., Gori, M., & Sanguineti, M. (2013). Learning with boundary conditions. Neural Computation, 25, 1029\u20131106.","journal-title":"Neural Computation"},{"key":"5976_CR19","doi-asserted-by":"crossref","unstructured":"Gnecco G., & Nutarelli, F. (2019). On the trade-off between number of examples and precision of supervision in regression problems, in Proceedings of the $$4^{\\rm th}$$ International Conference of the International Neural Network Society on Big Data and Deep Learning (INNS BDDL 2019), Sestri Levante, Italy, pp. 1-6.","DOI":"10.1007\/978-3-030-16841-4_1"},{"key":"5976_CR20","doi-asserted-by":"publisher","DOI":"10.1007\/s11590-019-01486-x","author":"G Gnecco","year":"2019","unstructured":"Gnecco, G., & Nutarelli, F. (2019). On the trade-off between number of examples and precision of supervision in machine learning problems. Optimization Letters. https:\/\/doi.org\/10.1007\/s11590-019-01486-x.","journal-title":"Optimization Letters"},{"key":"5976_CR21","unstructured":"Gnecco, G., & Nutarelli, F. (2020). Optimal trade-off between sample size and precision of supervision for the fixed effects panel data model. In Proceedings of the $$5^{\\rm th}$$ International Conference on machine Learning, Optimization & Data science (LOD 2019), Certosa di Pontignano (Siena), Italy. Lecture Notes in Computer Science, vol. 11943, pp. 1-12."},{"key":"5976_CR22","doi-asserted-by":"publisher","first-page":"15937","DOI":"10.1007\/s00500-020-05317-5","volume":"24","author":"G Gnecco","year":"2020","unstructured":"Gnecco, G., Nutarelli, F., & Selvi, D. (2020). Optimal trade-off between sample size, precision of supervision, and selection probabilities for the unbalanced fixed effects panel data model. Soft Computing, 24, 15937\u201315949.","journal-title":"Soft Computing"},{"key":"5976_CR23","volume-title":"Machine learning: A constraint-based approach","author":"M Gori","year":"2017","unstructured":"Gori, M. (2017). Machine learning: A constraint-based approach. Burlington: Morgan Kaufmann."},{"key":"5976_CR24","volume-title":"Toeplitz and circulant matrices: A review","author":"RM Gray","year":"2006","unstructured":"Gray, R. M. (2006). Toeplitz and circulant matrices: A review. Delft: Now Publishers."},{"key":"5976_CR25","volume-title":"Econometric analysis","author":"WH Greene","year":"2003","unstructured":"Greene, W. H. (2003). Econometric analysis. Delhi: Pearson Education."},{"key":"5976_CR26","volume-title":"Survey methodology","author":"RM Groves","year":"2004","unstructured":"Groves, R. M., Fowler, F. J., Jr., Couper, M. P., Lepkowski, J. M., Singer, E., & Tourangeau, R. (2004). Survey methodology. Hoboken: Wiley-Interscience."},{"key":"5976_CR27","volume-title":"Statistical methods for biostatistics and related fields","author":"W H\u00e4rdle","year":"2007","unstructured":"H\u00e4rdle, W., Mori, Y., & Vieu, P. (2007). Statistical methods for biostatistics and related fields. Berlin: Springer."},{"key":"5976_CR28","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-84858-7","volume-title":"The elements of statistical learning: Data mining, inference, and prediction","author":"T Hastie","year":"2009","unstructured":"Hastie, T., Tibshirani, R., & Friedman, J. (2009). The elements of statistical learning: Data mining, inference, and prediction. Berlin: Springer."},{"key":"5976_CR29","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1016\/S0304-4076(99)00008-1","volume":"93","author":"KS Im","year":"1999","unstructured":"Im, K. S., Ahn, S. C., Schmidt, P., & Wooldridge, J. M. (1999). Efficient estimation of panel data models with strictly exogenous explanatory variables. Journal of Econometrics, 93, 177\u2013201.","journal-title":"Journal of Econometrics"},{"key":"5976_CR30","doi-asserted-by":"publisher","DOI":"10.1007\/b60971","volume-title":"Micro-econometrics: Methods of moments and limited dependent variables","author":"M-J Lee","year":"2010","unstructured":"Lee, M.-J. (2010). Micro-econometrics: Methods of moments and limited dependent variables. Berlin: Springer."},{"key":"5976_CR31","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1016\/0304-4076(80)90090-1","volume":"14","author":"NM Kiefer","year":"1980","unstructured":"Kiefer, N. M. (1980). Estimation of fixed effect models for time series of cross-sections with arbitrary intertemporal covariance. Journal of Econometrics, 14, 195\u2013202.","journal-title":"Journal of Econometrics"},{"key":"5976_CR32","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1177\/027836498500400308","volume":"4","author":"AA Maciejewski","year":"1985","unstructured":"Maciejewski, A. A., & Klein, C. A. (1985). Obstacle avoidance for kinematically redundant manipulators in dynamically varying environments. International Journal of Robotics Research, 4, 109\u2013116.","journal-title":"International Journal of Robotics Research"},{"key":"5976_CR33","doi-asserted-by":"publisher","first-page":"1164","DOI":"10.1016\/j.ijar.2009.06.013","volume":"50","author":"HT Nguyen","year":"2009","unstructured":"Nguyen, H. T., Kosheleva, O., Kreinovich, V., & Ferson, S. (2009). Trade-off between sample size and accuracy: Case of measurements under interval uncertainty. International Journal of Approximate Reasoning, 50, 1164\u20131176.","journal-title":"International Journal of Approximate Reasoning"},{"key":"5976_CR34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10994-011-5261-8","volume":"85","author":"S \u00d6z\u00f6\u011f\u00fcr-Aky\u00fcz","year":"2011","unstructured":"\u00d6z\u00f6\u011f\u00fcr-Aky\u00fcz, S., \u00dcnay, D., & Smola, A. (2011). Guest editorial: Model selection and optimization in machine learning. Machine Learning, 85, 1\u201312.","journal-title":"Machine Learning"},{"key":"5976_CR35","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611971163","volume-title":"The symmetric eigenvalue problem","author":"BN Parlett","year":"1998","unstructured":"Parlett, B. N. (1998). The symmetric eigenvalue problem. Philadelphia: SIAM."},{"key":"5976_CR36","doi-asserted-by":"publisher","DOI":"10.1002\/9780470316436","volume-title":"Linear statistical inference and its applications","author":"CP Rao","year":"1973","unstructured":"Rao, C. P. (1973). Linear statistical inference and its applications. Hoboken: Wiley."},{"key":"5976_CR37","doi-asserted-by":"crossref","unstructured":"Reeve, C. P. (1988). A new statistical model for the calibration of force sensors, NBS Technical Note 1246, National Bureau of Standards, pp. 1-41.","DOI":"10.6028\/NBS.TN.1246"},{"key":"5976_CR38","volume-title":"An introduction to classical econometric theory","author":"PA Ruud","year":"2000","unstructured":"Ruud, P. A. (2000). An introduction to classical econometric theory. Oxford: Oxford University Press."},{"volume-title":"Optimization for machine learning","year":"2011","key":"5976_CR39","unstructured":"Sra, S., Nowozin, S., & Wright, S. J. (Eds.). (2011). Optimization for machine learning. Cambridge: MIT Press."},{"key":"5976_CR40","doi-asserted-by":"publisher","first-page":"848","DOI":"10.1080\/00029890.1993.11990500","volume":"100","author":"G Strang","year":"1993","unstructured":"Strang, G. (1993). The fundamental theorem of linear algebra. The American Mathematical Monthly, 100, 848\u2013855.","journal-title":"The American Mathematical Monthly"},{"key":"5976_CR41","first-page":"180","volume":"40","author":"F-W Sun","year":"2003","unstructured":"Sun, F.-W. (2003). On the convergence of the inverses of Toeplitz matrices and its applications. IEEE Transactions in Information Theory, 40, 180\u2013190.","journal-title":"IEEE Transactions in Information Theory"},{"key":"5976_CR42","volume-title":"Statistical learning theory","author":"VN Vapnik","year":"1998","unstructured":"Vapnik, V. N. (1998). Statistical learning theory. Hoboken: Wiley-Interscience."},{"key":"5976_CR43","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1257\/jep.28.2.3","volume":"28","author":"HR Varian","year":"2014","unstructured":"Varian, H. R. (2014). Big data: New tricks for econometrics. Journal of Economic Perspectives, 28, 3\u201338.","journal-title":"Journal of Economic Perspectives"},{"key":"5976_CR44","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1007\/BF01933494","volume":"13","author":"PA Wedin","year":"1973","unstructured":"Wedin, P. A. (1973). Perturbation theory for pseudo-inverses. BIT, 13, 217\u2013232.","journal-title":"BIT"},{"key":"5976_CR45","volume-title":"Econometric analysis of cross section and panel data","author":"JM Wooldridge","year":"2002","unstructured":"Wooldridge, J. M. (2002). Econometric analysis of cross section and panel data. Cambridge: MIT Press."}],"container-title":["Machine Learning"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-021-05976-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10994-021-05976-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-021-05976-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,1]],"date-time":"2021-07-01T18:14:57Z","timestamp":1625163297000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10994-021-05976-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,8]]},"references-count":45,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2021,7]]}},"alternative-id":["5976"],"URL":"https:\/\/doi.org\/10.1007\/s10994-021-05976-x","relation":{},"ISSN":["0885-6125","1573-0565"],"issn-type":[{"type":"print","value":"0885-6125"},{"type":"electronic","value":"1573-0565"}],"subject":[],"published":{"date-parts":[[2021,6,8]]},"assertion":[{"value":"9 June 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 January 2021","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 April 2021","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 June 2021","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflicts of interest\/competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}