{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T16:37:40Z","timestamp":1781714260596,"version":"3.54.5"},"reference-count":52,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2022,6,25]],"date-time":"2022-06-25T00:00:00Z","timestamp":1656115200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["41975018"],"award-info":[{"award-number":["41975018"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Densely connected convolutional networks (DenseNet) behave well in image processing. However, for regression tasks, convolutional DenseNet may lose essential information from independent input features. To tackle this issue, we propose a novel DenseNet regression model where convolution and pooling layers are replaced by fully connected layers and the original concatenation shortcuts are maintained to reuse the feature. To investigate the effects of depth and input dimensions of the proposed model, careful validations are performed by extensive numerical simulation. The results give an optimal depth (19) and recommend a limited input dimension (under 200). Furthermore, compared with the baseline models, including support vector regression, decision tree regression, and residual regression, our proposed model with the optimal depth performs best. Ultimately, DenseNet regression is applied to predict relative humidity, and the outcome shows a high correlation with observations, which indicates that our model could advance environmental data science.<\/jats:p>","DOI":"10.3390\/e24070876","type":"journal-article","created":{"date-parts":[[2022,6,25]],"date-time":"2022-06-25T10:39:13Z","timestamp":1656153553000},"page":"876","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Densely Connected Neural Networks for Nonlinear Regression"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4997-2559","authenticated-orcid":false,"given":"Chao","family":"Jiang","sequence":"first","affiliation":[{"name":"Department of Civil Engineering, Monash University, Clayton, VIC 3800, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5868-0243","authenticated-orcid":false,"given":"Canchen","family":"Jiang","sequence":"additional","affiliation":[{"name":"Department of Data Science and Artificial Intelligence, Monash University, Clayton, VIC 3800, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1956-7683","authenticated-orcid":false,"given":"Dongwei","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Mathematical and Statistical Sciences, Clemson University, Clemson, SC 29641, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fei","family":"Hu","sequence":"additional","affiliation":[{"name":"Institute of Atmospheric Physics, Chinese Academy of Sciences, Beijing 100029, China"},{"name":"College of Earth and Planetary Sciences, University of Chinese Academy of Sciences, Beijing 100029, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,6,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1016\/j.envsoft.2018.04.005","article-title":"Environmental data science","volume":"106","author":"Gibert","year":"2018","journal-title":"Environ. Model. Softw."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1038\/sj.jes.7500571","article-title":"Comparison of regression models with land-use and emissions data to predict the spatial distribution of traffic-related air pollution in Rome","volume":"18","author":"Rosenlund","year":"2008","journal-title":"J. Expo. Sci. Environ. Epidemiol."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Rehana, S. (2019). River water temperature modelling under climate change using support vector regression. Hydrology in a Changing World, Springer.","DOI":"10.1007\/978-3-030-02197-9_8"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"6220","DOI":"10.1109\/JSTARS.2020.3026363","article-title":"A Multiparametric Nonlinear Regression Approach for the Estimation of Global Surface Ocean pCO 2 Using Satellite Oceanographic Data","volume":"13","author":"Krishna","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens."},{"key":"ref_5","first-page":"96","article-title":"Multiple linear regression and genetic algorithm approaches to predict temporal scour depth near circular pier in non-cohesive sediment","volume":"26","author":"Pandey","year":"2020","journal-title":"ISH J. Hydraul. Eng."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1051","DOI":"10.1109\/TPWRS.2011.2172004","article-title":"A stepwise regression method for estimating dominant electromechanical modes","volume":"27","author":"Zhou","year":"2011","journal-title":"IEEE Trans. Power Syst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"8369","DOI":"10.1016\/j.eswa.2012.01.183","article-title":"Using ridge regression with genetic algorithm to enhance real estate appraisal forecasting","volume":"39","author":"Ahn","year":"2012","journal-title":"Expert Syst. Appl."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","article-title":"Regression shrinkage and selection via the lasso","volume":"58","author":"Tibshirani","year":"1996","journal-title":"J. R. Stat. Soc. Ser. B (Methodol.)"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1111\/j.1467-9868.2005.00503.x","article-title":"Regularization and variable selection via the elastic net","volume":"67","author":"Zou","year":"2005","journal-title":"J. R. Stat. Soc. Ser. B (Stat. Methodol.)"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2265","DOI":"10.1016\/j.eswa.2009.07.046","article-title":"Application of fuzzy inference system and nonlinear regression models for predicting rock brittleness","volume":"37","author":"Yagiz","year":"2010","journal-title":"Expert Syst. Appl."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1088\/0951-7715\/26\/1\/201","article-title":"Physics constrained nonlinear regression models for time series","volume":"26","author":"Majda","year":"2012","journal-title":"Nonlinearity"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Rhinehart, R.R. (2016). Nonlinear Regression Modeling for Engineering Applications: Modeling, Model Validation, and Enabling Design of Experiments, John Wiley & Sons.","DOI":"10.1002\/9781118597972"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"500","DOI":"10.1016\/j.proeng.2012.09.545","article-title":"Modelling using polynomial regression","volume":"48","year":"2012","journal-title":"Procedia Eng."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1023\/B:STCO.0000035301.49549.88","article-title":"A tutorial on support vector regression","volume":"14","author":"Smola","year":"2004","journal-title":"Stat. Comput."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1002\/widm.8","article-title":"Classification and regression trees","volume":"1","author":"Loh","year":"2011","journal-title":"Wiley Interdiscip. Rev. Data Min. Knowl. Discov."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Chen, D., Hu, F., Nian, G., and Yang, T. (2020). Deep residual learning for nonlinear regression. Entropy, 22.","DOI":"10.3390\/e22020193"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1016\/0893-6080(89)90020-8","article-title":"Multilayer feedforward networks are universal approximators","volume":"2","author":"Hornik","year":"1989","journal-title":"Neural Netw."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1016\/0893-6080(89)90003-8","article-title":"On the approximate realization of continuous mappings by neural networks","volume":"2","author":"Funahashi","year":"1989","journal-title":"Neural Netw."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1016\/0893-6080(92)90012-8","article-title":"Kolmogorov\u2019s theorem and multilayer neural networks","volume":"5","year":"1992","journal-title":"Neural Netw."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1007\/BF02124745","article-title":"Limitations of the approximation capabilities of neural networks with one hidden layer","volume":"5","author":"Chui","year":"1996","journal-title":"Adv. Comput. Math."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1109\/TASLP.2014.2364452","article-title":"A regression approach to speech enhancement based on deep neural networks","volume":"23","author":"Xu","year":"2014","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"621","DOI":"10.3389\/fpls.2019.00621","article-title":"Crop yield prediction using deep neural networks","volume":"10","author":"Khaki","year":"2019","journal-title":"Front. Plant Sci."},{"key":"ref_23","first-page":"2065","article-title":"A comprehensive analysis of deep regression","volume":"42","author":"Mesejo","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1109\/JIOT.2018.2853663","article-title":"ResInNet: A novel deep neural network with feature reuse for Internet of Things","volume":"6","author":"Sun","year":"2018","journal-title":"IEEE Internet Things J."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1407","DOI":"10.1109\/TMI.2018.2823338","article-title":"A sparse-view CT reconstruction method based on combination of DenseNet and deconvolution","volume":"37","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Med Imaging"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Saleh, K., Hossny, M., and Nahavandi, S. (2019, January 20\u201324). Real-time intent prediction of pedestrians for autonomous ground vehicles via spatio-temporal densenet. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8793991"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"8573","DOI":"10.1021\/acs.jpclett.0c01598","article-title":"High-speed chemical imaging by dense-net learning of femtosecond stimulated Raman scattering","volume":"11","author":"Zhang","year":"2020","journal-title":"J. Phys. Chem. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1367","DOI":"10.1007\/s42452-020-3157-6","article-title":"Identifying redundant features using unsupervised learning for high-dimensional data","volume":"2","author":"Danasingh","year":"2020","journal-title":"SN Appl. Sci."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Rojek, K., Wyrzykowski, R., and Gepner, P. (2021, January 16\u201318). AI-Accelerated CFD Simulation Based on OpenFOAM and CPU\/GPU Computing. Proceedings of the International Conference on Computational Science, Krakow, Poland.","DOI":"10.1007\/978-3-030-77964-1_29"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"111486","DOI":"10.1016\/j.combustflame.2021.111486","article-title":"A data-driven subgrid scale model in Large Eddy Simulation of turbulent premixed combustion","volume":"231","author":"Shin","year":"2021","journal-title":"Combust. Flame"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"101977","DOI":"10.1016\/j.cagd.2021.101977","article-title":"Parameterization for polynomial curve approximation via residual deep neural networks","volume":"85","author":"Scholz","year":"2021","journal-title":"Comput. Aided Geom. Des."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Shi, L., Copot, C., and Vanlanduit, S. (2020, January 9\u201311). A Deep Regression Model for Safety Control in Visual Servoing Applications. Proceedings of the 2020 Fourth IEEE International Conference on Robotic Computing (IRC), Taichung, Taiwan.","DOI":"10.1109\/IRC.2020.00063"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"165","DOI":"10.3389\/frobt.2021.687031","article-title":"A Bayesian Deep Neural Network for Safe Visual Servoing in Human\u2013Robot Interaction","volume":"8","author":"Shi","year":"2021","journal-title":"Front. Robot. AI"},{"key":"ref_35","unstructured":"Ioffe, S., and Szegedy, C. (2015, January 7\u20139). Batch normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of the International Conference on Machine Learning (PMLR), Lille, France."},{"key":"ref_36","unstructured":"Hanin, B., and Sellke, M. (2017). Approximating continuous functions by relu nets of minimal width. arXiv."},{"key":"ref_37","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_38","first-page":"2121","article-title":"Adaptive subgradient methods for online learning and stochastic optimization","volume":"12","author":"Duchi","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_39","unstructured":"Reddi, S.J., Kale, S., and Kumar, S. (May, January 30). On the Convergence of Adam and Beyond. Proceedings of the International Conference on Learning Representations, Vancouver, BC, Canada."},{"key":"ref_40","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"20200083","DOI":"10.1098\/rsta.2020.0083","article-title":"Opportunities and challenges for machine learning in weather and climate modelling: Hard, medium and soft AI","volume":"379","author":"Chantry","year":"2021","journal-title":"Philos. Trans. R. Soc. A"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1038\/s41586-019-0912-1","article-title":"Deep learning and process understanding for data-driven Earth system science","volume":"566","author":"Reichstein","year":"2019","journal-title":"Nature"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"e1978","DOI":"10.1002\/met.1978","article-title":"Estimation of precipitation induced by tropical cyclones based on machine-learning-enhanced analogue identification of numerical prediction","volume":"28","author":"Liu","year":"2021","journal-title":"Meteorol. Appl."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"104861","DOI":"10.1016\/j.atmosres.2020.104861","article-title":"Dynamic spatial-temporal precipitation distribution models for short-duration rainstorms in Shenzhen, China based on machine learning","volume":"237","author":"Liu","year":"2020","journal-title":"Atmos. Res."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1016\/j.atmosres.2019.05.006","article-title":"Rapid identification of rainstorm disaster risks based on an artificial intelligence technology using the 2DPCA method","volume":"227","author":"Liu","year":"2019","journal-title":"Atmos. Res."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41612-019-0098-0","article-title":"Nowcasting lightning occurrence from commonly available meteorological parameters using machine learning techniques","volume":"2","author":"Mostajabi","year":"2019","journal-title":"Npj Clim. Atmos. Sci."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"e2020GL087776","DOI":"10.1029\/2020GL087776","article-title":"A machine learning-based global atmospheric forecast model","volume":"47","author":"Arcomano","year":"2020","journal-title":"Geophys. Res. Lett."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"4403","DOI":"10.5194\/amt-14-4403-2021","article-title":"On the estimation of boundary layer heights: A machine learning approach","volume":"14","author":"Krishnamurthy","year":"2021","journal-title":"Atmos. Meas. Tech."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Rodriguez, A., Cuellar, C.R., Rodriguez, L.F., Garcia, A., Gudimetla, V.R., Kotteda, V.K., Munoz, J.A., and Kumar, V. (2020, January 13\u201315). Stochastic Analysis of LES Atmospheric Turbulence Solutions with Generative Machine Learning Models. Proceedings of the Fluids Engineering Division Summer Meeting, Online.","DOI":"10.1115\/1.0001637V"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1029\/2006JD008136","article-title":"Effects of aerosols and relative humidity on cumulus clouds","volume":"112","author":"Fan","year":"2007","journal-title":"J. Geophys. Res. Atmos."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1029\/2018JD028315","article-title":"Method to estimate water vapor supersaturation in the ambient activation process using aerosol and droplet measurement data","volume":"123","author":"Shen","year":"2018","journal-title":"J. Geophys. Res. Atmos."},{"key":"ref_52","unstructured":"Hersbach, H., Bell, B., Berrisford, P., Biavati, G., Hor\u00e1nyi, A., Mu\u00f1oz Sabater, J., Nicolas, J., Peubey, C., Radu, R., and Rozum, I. (2022, May 21). ERA5 Hourly Data on Pressure Levels from 1979 to Present\u2014Copernicus Climate Change Service (C3S) and Climate Data Store (CDS). Available online: https:\/\/cds.climate.copernicus.eu\/cdsapp#!\/dataset\/reanalysis-era5-pressure-levels?tab=overview."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/7\/876\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:40:07Z","timestamp":1760139607000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/7\/876"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,25]]},"references-count":52,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["e24070876"],"URL":"https:\/\/doi.org\/10.3390\/e24070876","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,25]]}}}