{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,1]],"date-time":"2025-11-01T05:47:31Z","timestamp":1761976051333,"version":"build-2065373602"},"reference-count":49,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2023,5,18]],"date-time":"2023-05-18T00:00:00Z","timestamp":1684368000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["BDCC"],"abstract":"<jats:p>Global models have been developed to tackle the challenge of forecasting sets of series that are related or share similarities, but they have not been developed for heterogeneous datasets. Various methods of partitioning by relatedness have been introduced to enhance the similarities of sets, resulting in improved forecasting accuracy but often at the cost of a reduced sample size, which could be harmful. To shed light on how the relatedness between series impacts the effectiveness of global models in real-world demand-forecasting problems, we perform an extensive empirical study using the M5 competition dataset. We examine cross-learning scenarios driven by the product hierarchy commonly employed in retail planning to allow global models to capture interdependencies across products and regions more effectively. Our findings show that global models outperform state-of-the-art local benchmarks by a considerable margin, indicating that they are not inherently more limited than local models and can handle unrelated time-series data effectively. The accuracy of data-partitioning approaches increases as the sizes of the data pools and the models\u2019 complexity decrease. However, there is a trade-off between data availability and data relatedness. Smaller data pools lead to increased similarity among time series, making it easier to capture cross-product and cross-region dependencies, but this comes at the cost of a reduced sample, which may not be beneficial. Finally, it is worth noting that the successful implementation of global models for heterogeneous datasets can significantly impact forecasting practice.<\/jats:p>","DOI":"10.3390\/bdcc7020100","type":"journal-article","created":{"date-parts":[[2023,5,18]],"date-time":"2023-05-18T10:17:26Z","timestamp":1684405046000},"page":"100","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Investigating the Accuracy of Autoregressive Recurrent Networks Using Hierarchical Aggregation Structure-Based Data Partitioning"],"prefix":"10.3390","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8516-6418","authenticated-orcid":false,"given":"Jos\u00e9 Manuel","family":"Oliveira","sequence":"first","affiliation":[{"name":"Faculty of Economics, University of Porto, rua Dr. Roberto Frias, 4200-464 Porto, Portugal"},{"name":"Institute for Systems and Computer Engineering, Technology and Science, rua Dr. Roberto Frias, 4200-465 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0959-8446","authenticated-orcid":false,"given":"Patr\u00edcia","family":"Ramos","sequence":"additional","affiliation":[{"name":"Institute for Systems and Computer Engineering, Technology and Science, rua Dr. Roberto Frias, 4200-465 Porto, Portugal"},{"name":"CEOS.PP, ISCAP, Polytechnic of Porto, rua Jaime Lopes Amorim s\/n, 4465-004 S\u00e3o Mamede de Infesta, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1283","DOI":"10.1016\/j.ijforecast.2019.06.004","article-title":"Retail forecasting: Research and practice","volume":"38","author":"Fildes","year":"2022","journal-title":"Int. J. Forecast."},{"doi-asserted-by":"crossref","unstructured":"Oliveira, J.M., and Ramos, P. (2019). Assessing the Performance of Hierarchical Forecasting Methods on the Retail Sector. Entropy, 21.","key":"ref_2","DOI":"10.3390\/e21040436"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"822","DOI":"10.1016\/j.ijforecast.2018.03.001","article-title":"Considerations of a retail forecasting practitioner","volume":"34","author":"Seaman","year":"2018","journal-title":"Int. J. Forecast."},{"doi-asserted-by":"crossref","unstructured":"Ramos, P., Oliveira, J.M., Kourentzes, N., and Fildes, R. (2023). Forecasting Seasonal Sales with Many Drivers: Shrinkage or Dimensionality Reduction?. Appl. Syst. Innov., 6.","key":"ref_4","DOI":"10.3390\/asi6010003"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1016\/j.rcim.2014.12.015","article-title":"Performance of state space and ARIMA models for consumer retail sales forecasting","volume":"34","author":"Ramos","year":"2015","journal-title":"Robot. Comput. Integr. Manuf."},{"doi-asserted-by":"crossref","unstructured":"Ramos, P., and Oliveira, J.M. (2016). A procedure for identification of appropriate state space and ARIMA models based on time-series cross-validation. Algorithms, 9.","key":"ref_6","DOI":"10.3390\/a9040076"},{"doi-asserted-by":"crossref","unstructured":"Hyndman, R.J., Koehler, A.B., Ord, J.K., and Snyder, R.D. (2008). Forecasting with Exponential Smoothing: The State Space Approach, Springer.","key":"ref_7","DOI":"10.1007\/978-3-540-71918-2"},{"doi-asserted-by":"crossref","unstructured":"Box, G.E.P., Jenkins, G.M., and Reinsel, G.C. (2008). Time Series Analysis, Wiley. [4th ed.].","key":"ref_8","DOI":"10.1002\/9781118619193"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1632","DOI":"10.1016\/j.ijforecast.2021.03.004","article-title":"Principles and algorithms for forecasting groups of time series: Locality and globality","volume":"37","author":"Hyndman","year":"2021","journal-title":"Int. J. Forecast."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1016\/j.ijforecast.2019.05.008","article-title":"Criteria for classifying forecasting methods","volume":"36","author":"Januschowski","year":"2020","journal-title":"Int. J. Forecast."},{"unstructured":"Rabanser, S., Januschowski, T., Flunkert, V., Salinas, D., and Gasthaus, J. (2020). The Effectiveness of Discretization in Forecasting: An Empirical Study on Neural Time Series Models. arXiv.","key":"ref_11"},{"unstructured":"Laptev, N., Yosinski, J., Li, L.E., and Smyl, S. (2017, January 6\u201311). Time-series extreme event forecasting with neural networks at Uber. Proceedings of the International Conference on Machine Learning, Workshop, Sydney, Australia.","key":"ref_12"},{"unstructured":"Chaudhuri, K., and Sugiyama, M. (2019, January 16\u201318). Probabilistic Forecasting with Spline Quantile Function RNNs. Proceedings of the Twenty-Second International Conference on Artificial Intelligence and Statistics, Naha, Japan.","key":"ref_13"},{"unstructured":"Oreshkin, B.N., Carpov, D., Chapados, N., and Bengio, Y. (2020). N-BEATS: Neural basis expansion analysis for interpretable time series forecasting. arXiv.","key":"ref_14"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"108148","DOI":"10.1016\/j.patcog.2021.108148","article-title":"Improving the accuracy of global forecasting models using time series data augmentation","volume":"120","author":"Bandara","year":"2021","journal-title":"Pattern Recognit."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1016\/j.ijforecast.2019.04.014","article-title":"The M4 Competition: 100,000 time series and 61 forecasting methods","volume":"36","author":"Makridakis","year":"2020","journal-title":"Int. J. Forecast."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.ijforecast.2019.03.017","article-title":"A hybrid method of exponential smoothing and recurrent neural networks for time series forecasting","volume":"36","author":"Smyl","year":"2020","journal-title":"Int. J. Forecast."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1325","DOI":"10.1016\/j.ijforecast.2021.07.007","article-title":"The M5 competition: Background, organization, and implementation","volume":"38","author":"Makridakis","year":"2022","journal-title":"Int. J. Forecast."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1346","DOI":"10.1016\/j.ijforecast.2021.11.013","article-title":"M5 accuracy competition: Results, findings, and conclusions","volume":"38","author":"Makridakis","year":"2022","journal-title":"Int. J. Forecast."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1365","DOI":"10.1016\/j.ijforecast.2021.10.009","article-title":"The M5 uncertainty competition: Results, findings and conclusions","volume":"38","author":"Makridakis","year":"2022","journal-title":"Int. J. Forecast."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1016\/j.ijforecast.2020.07.007","article-title":"Kaggle forecasting competitions: An overlooked learning opportunity","volume":"37","author":"Bojer","year":"2021","journal-title":"Int. J. Forecast."},{"doi-asserted-by":"crossref","unstructured":"Armstrong, J.S. (2001). Principles of Forecasting: A Handbook for Researchers and Practitioners, Springer.","key":"ref_22","DOI":"10.1007\/978-0-306-47630-3"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1181","DOI":"10.1016\/j.ijforecast.2019.07.001","article-title":"DeepAR: Probabilistic forecasting with autoregressive recurrent networks","volume":"36","author":"Salinas","year":"2020","journal-title":"Int. J. Forecast."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"112896","DOI":"10.1016\/j.eswa.2019.112896","article-title":"Forecasting across time series databases using recurrent neural networks on groups of similar series: A clustering approach","volume":"140","author":"Bandara","year":"2020","journal-title":"Expert Syst. Appl."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"108441","DOI":"10.1016\/j.patcog.2021.108441","article-title":"Global models for time series forecasting: A Simulation study","volume":"124","author":"Hewamalage","year":"2022","journal-title":"Pattern Recognit."},{"doi-asserted-by":"crossref","unstructured":"Rajapaksha, D., Bergmeir, C., and Hyndman, R.J. (2022). LoMEF: A framework to produce local explanations for global model time series forecasts. Int. J. Forecast.","key":"ref_26","DOI":"10.1016\/j.ijforecast.2022.06.006"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1080\/00207166808803030","article-title":"Three approaches to the quantitative definition of information","volume":"2","author":"Kolmogorov","year":"1968","journal-title":"Int. J. Comput. Math."},{"unstructured":"Li, M., and Vit\u00e1nyi, P. (2013). An Introduction to Kolmogorov Complexity and Its Applications, Springer.","key":"ref_28"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1523","DOI":"10.1109\/TIT.2005.844059","article-title":"Clustering by compression","volume":"51","author":"Cilibrasi","year":"2005","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1072","DOI":"10.1016\/j.ijforecast.2020.11.009","article-title":"Investigating the accuracy of cross-learning time series forecasting methods","volume":"37","author":"Semenoglou","year":"2021","journal-title":"Int. J. Forecast."},{"unstructured":"Novak, R., Bahri, Y., Abolafia, D.A., Pennington, J., and Sohl-Dickstein, J. (2018). Sensitivity and Generalization in Neural Networks: An Empirical Study. arXiv.","key":"ref_31"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1016\/j.ijpe.2013.01.009","article-title":"Intermittent demand forecasts with neural networks","volume":"143","author":"Kourentzes","year":"2013","journal-title":"Int. J. Prod. Econ."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1057\/jors.1972.50","article-title":"Forecasting and Stock Control for Intermittent Demands","volume":"23","author":"Croston","year":"1972","journal-title":"J. Oper. Res. Soc."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long Short-Term Memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"unstructured":"Wallach, H., Larochelle, H., Beygelzimer, A., d\u2019Alch\u00e9-Buc, F., Fox, E., and Garnett, R. (2019). Proceedings of the Advances in Neural Information Processing Systems, Curran Associates, Inc.","key":"ref_35"},{"key":"ref_36","first-page":"4629","article-title":"GluonTS: Probabilistic and Neural Time Series Modeling in Python","volume":"21","author":"Alexandrov","year":"2020","journal-title":"J. Mach. Learn. Res."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"705","DOI":"10.1016\/j.ijforecast.2021.11.001","article-title":"Forecasting: Theory and practice","volume":"38","author":"Petropoulos","year":"2022","journal-title":"Int. J. Forecast."},{"unstructured":"Garza, F., Canseco, M.M., Chall\u00fa, C., and Olivares, K.G. (2022). StatsForecast: Lightning Fast Forecasting with Statistical and Econometric Models, PyCon.","key":"ref_38"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v027.i03","article-title":"Automatic time series forecasting: The forecast package for R","volume":"27","author":"Hyndman","year":"2008","journal-title":"J. Stat. Softw."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1016\/S0169-2070(01)00110-8","article-title":"A state space framework for automatic forecasting using exponential smoothing methods","volume":"18","author":"Hyndman","year":"2002","journal-title":"Int. J. Forecast."},{"unstructured":"Ord, J.K., Fildes, R., and Kourentzes, N. (2017). Principles of Business Forecasting, Wessex Press Publishing Co.. [2nd ed.].","key":"ref_41"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1016\/j.ijforecast.2016.09.004","article-title":"Visualising forecasting algorithm performance using time series instance spaces","volume":"33","author":"Kang","year":"2017","journal-title":"Int. J. Forecast."},{"unstructured":"Jolliffe, I. (2002). Principal Component Analysis, Springer. [2nd ed.].","key":"ref_43"},{"unstructured":"O\u2019Hara-Wild, M., Hyndman, R., and Wang, E. (2022, December 12). feasts: Feature Extraction and Statistics for Time Series. Available online: https:\/\/github.com\/tidyverts\/feasts\/.","key":"ref_44"},{"key":"ref_45","first-page":"1","article-title":"FactoMineR: A Package for Multivariate Analysis","volume":"25","author":"Josse","year":"2008","journal-title":"J. Stat. Softw."},{"doi-asserted-by":"crossref","unstructured":"Akiba, T., Sano, S., Yanase, T., Ohta, T., and Koyama, M. (2019, January 4\u20138). Optuna: A Next-generation Hyperparameter Optimization Framework. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Anchorage, AK, USA.","key":"ref_46","DOI":"10.1145\/3292500.3330701"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1016\/j.ijforecast.2006.03.001","article-title":"Another look at measures of forecast accuracy","volume":"22","author":"Hyndman","year":"2006","journal-title":"Int. J. Forecast."},{"doi-asserted-by":"crossref","unstructured":"Hollander, M., Wolfe, D.A., and Chicken, E. (2015). Nonparametric Statistical Methods, John Wiley & Sons, Inc.","key":"ref_48","DOI":"10.1002\/9781119196037"},{"unstructured":"Kourentzes, N. (2022, December 12). tsutils: Time Series Exploration, Modelling and Forecasting, R Package Version 0.9.3; 2022. Available online: https:\/\/github.com\/trnnick\/tsutils\/.","key":"ref_49"}],"container-title":["Big Data and Cognitive Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-2289\/7\/2\/100\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:37:56Z","timestamp":1760125076000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-2289\/7\/2\/100"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,18]]},"references-count":49,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["bdcc7020100"],"URL":"https:\/\/doi.org\/10.3390\/bdcc7020100","relation":{},"ISSN":["2504-2289"],"issn-type":[{"type":"electronic","value":"2504-2289"}],"subject":[],"published":{"date-parts":[[2023,5,18]]}}}