{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T14:11:23Z","timestamp":1777126283387,"version":"3.51.4"},"reference-count":87,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2021,5,22]],"date-time":"2021-05-22T00:00:00Z","timestamp":1621641600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"NCN","award":["2016\/23\/G\/ST1\/04083"],"award-info":[{"award-number":["2016\/23\/G\/ST1\/04083"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Identification of the diffusion type of molecules in living cells is crucial to deduct their driving forces and hence to get insight into the characteristics of the cells. In this paper, deep residual networks have been used to classify the trajectories of molecules. We started from the well known ResNet architecture, developed for image classification, and carried out a series of numerical experiments to adapt it to detection of diffusion modes. We managed to find a model that has a better accuracy than the initial network, but contains only a small fraction of its parameters. The reduced size significantly shortened the training time of the model. Moreover, the resulting network has less tendency to overfitting and generalizes better to unseen data.<\/jats:p>","DOI":"10.3390\/e23060649","type":"journal-article","created":{"date-parts":[[2021,5,23]],"date-time":"2021-05-23T23:59:03Z","timestamp":1621814343000},"page":"649","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Detection of Anomalous Diffusion with Deep Residual Networks"],"prefix":"10.3390","volume":"23","author":[{"given":"Mi\u0142osz","family":"Gajowczyk","sequence":"first","affiliation":[{"name":"Faculty of Pure and Applied Mathematics, Hugo Steinhaus Center, Wroc\u0142aw University of Science and Technology, 50-370 Wroc\u0142aw, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6992-3634","authenticated-orcid":false,"given":"Janusz","family":"Szwabi\u0144ski","sequence":"additional","affiliation":[{"name":"Faculty of Pure and Applied Mathematics, Hugo Steinhaus Center, Wroc\u0142aw University of Science and Technology, 50-370 Wroc\u0142aw, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1016\/S0006-3495(87)83271-X","article-title":"Nanovid tracking: A new automatic method for the study of mobility in living cells based on colloidal gold and video microscopy","volume":"52","author":"Geerts","year":"1987","journal-title":"Biophys. J."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"846","DOI":"10.1083\/jcb.95.3.846","article-title":"Diffusion of low density lipoprotein-receptor complex on human fibroblasts","volume":"95","author":"Barak","year":"1982","journal-title":"J. Cell Biol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2021","DOI":"10.1016\/S0006-3495(93)81253-0","article-title":"Confined Lateral Diffusion of Membrane Receptors as Studied by Single Particle Tracking (Nanovid Microscopy). Effects of Calcium-induced Differentiation in Cultured Epithelial Cells","volume":"65","author":"Kusumi","year":"1993","journal-title":"Biophys. J."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1146\/annurev.biophys.37.092607.174640","article-title":"Single-Molecule Approach to Molecular Biology in Living Bacterial Cells","volume":"37","author":"Xie","year":"2008","journal-title":"Annu. Rev. Biophys."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1016\/j.physa.2015.12.049","article-title":"Characterization of diffusion processes: Normal and anomalous regimes","volume":"447","author":"Alves","year":"2016","journal-title":"Physica A"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1002\/andp.18551700105","article-title":"Ueber Diffusion (On Diffusion)","volume":"170","author":"Fick","year":"1855","journal-title":"Ann. Phys."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1146\/annurev.biophys.26.1.373","article-title":"Single-Particle Tracking: Applications to Membrane Dynamics","volume":"26","author":"Saxton","year":"1997","journal-title":"Annu. Rev. Biophys. Biomol. Struct."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1063\/PT.3.1677","article-title":"Strange kinetics of single molecules in living cells","volume":"65","author":"Barkai","year":"2012","journal-title":"Phys. Today"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"24128","DOI":"10.1039\/C4CP03465A","article-title":"Anomalous diffusion models and their properties: Non-stationarity, non-ergodicity, and ageing at the centenary of single particle tracking","volume":"16","author":"Metzler","year":"2014","journal-title":"Phys. Chem. Chem. Phys."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2451","DOI":"10.1016\/j.bbamem.2016.01.022","article-title":"Non-Brownian diffusion in lipid membranes: Experiments and simulations","volume":"1858","author":"Metzler","year":"2016","journal-title":"Biochim. Biophys. Acta BBA Biomembr."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1098\/rspa.1926.0043","article-title":"Atmospheric Diffusion Shown on a Distance-Neighbour Graph","volume":"110","author":"Richardson","year":"1926","journal-title":"Proc. R. Soc. Lond. Ser. A"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1613\/jair.4992","article-title":"Primer on Neural Network Models for Natural Language Processing","volume":"57","author":"Goldberg","year":"2016","journal-title":"J. Artif. Intell. Res."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"018102","DOI":"10.1103\/PhysRevLett.103.018102","article-title":"Transient Anomalous Diffusion of Telomeres in the Nucleus of Mammalian Cells","volume":"103","author":"Bronstein","year":"2009","journal-title":"Phys. Rev. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"048103","DOI":"10.1103\/PhysRevLett.106.048103","article-title":"In Vivo Anomalous Diffusion and Weak Ergodicity Breaking of Lipid Granules","volume":"106","author":"Jeon","year":"2011","journal-title":"Phys. Rev. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1667","DOI":"10.1103\/PhysRevE.56.1667","article-title":"Structural and dynamical properties of the percolation backbone in two and three dimensions","volume":"56","author":"Porto","year":"1997","journal-title":"Phys. Rev. E"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"4558","DOI":"10.1103\/PhysRevA.41.4558","article-title":"Current flow under anomalous-diffusion conditions: L\u00e9vy walks","volume":"41","author":"Zumofen","year":"1990","journal-title":"Phys. Rev. A"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3162","DOI":"10.1103\/PhysRevLett.83.3162","article-title":"Keyhole Look at L\u00e9vy Flights in Subrecoil Laser Cooling","volume":"83","author":"Schaufler","year":"1999","journal-title":"Phys. Rev. Lett."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Alt, W., and Hoffmann, G. (1990). Microzooplankton Feeding Behavior and the Levy Walk. Biological Motion. Lecture Notes in Biomathematics, Springer.","DOI":"10.1007\/978-3-642-51664-1"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Viswanathan, G.M., da Luz, M.G.E., Raposo, E.P., and Stanley, H.E. (2011). The Physics of Foraging: An Introduction to Random Searches and Biological Encounters, Cambridge University Press.","DOI":"10.1017\/CBO9780511902680"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"779","DOI":"10.1038\/nature06958","article-title":"Understanding individual human mobility patterns","volume":"453","author":"Hidalgo","year":"2008","journal-title":"Nature"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"525","DOI":"10.1016\/S0378-4371(02)01558-3","article-title":"Financial market dynamics","volume":"320","author":"Michael","year":"2003","journal-title":"Phys. A Stat. Mech. Its Appl."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"041914","DOI":"10.1103\/PhysRevE.82.041914","article-title":"Mean square displacement analysis of single-particle trajectories with localization error: Brownian motion in an isotropic medium","volume":"82","author":"Michalet","year":"2010","journal-title":"Phys. Rev. E"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"041105","DOI":"10.1063\/1.4891357","article-title":"Communication: A scaling approach to anomalous diffusion","volume":"141","author":"Kneller","year":"2014","journal-title":"J. Chem. Phys."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"910","DOI":"10.1016\/S0006-3495(91)82125-7","article-title":"Single particle tracking. Analysis of diffusion and flow in two-dimensional systems","volume":"60","author":"Qian","year":"1991","journal-title":"Biophys. J."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1007\/s00397-013-0694-6","article-title":"Particle tracking in living cells: A review of the mean square displacement method and beyond","volume":"52","author":"Gal","year":"2013","journal-title":"Rheol. Acta"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kepten, E., Weron, A., Sikora, G., Burnecki, K., and Garini, Y. (2015). Guidelines for the Fitting of Anomalous Diffusion Mean Square Displacement Graphs from Single Particle Tracking Experiments. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0117722"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"062121","DOI":"10.1103\/PhysRevE.97.062121","article-title":"Statistical analysis of particle trajectories in living cells","volume":"97","author":"Briane","year":"2018","journal-title":"Phys. Rev. E"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1766","DOI":"10.1016\/S0006-3495(93)81548-0","article-title":"Lateral diffusion in an archipelago. Single-particle diffusion","volume":"64","author":"Saxton","year":"1993","journal-title":"Biophys. J."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"061506","DOI":"10.1103\/PhysRevE.64.061506","article-title":"Investigating the microenvironments of inhomogeneous soft materials with multiple particle tracking","volume":"64","author":"Valentine","year":"2001","journal-title":"Phys. Rev. E"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"020903","DOI":"10.1103\/PhysRevE.81.020903","article-title":"Experimental evidence of strong anomalous diffusion in living cells","volume":"81","author":"Gal","year":"2010","journal-title":"Phys. Rev. E"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"011918","DOI":"10.1103\/PhysRevE.76.011918","article-title":"Stress fluctuations and motion of cytoskeletal-bound markers","volume":"76","author":"Raupach","year":"2007","journal-title":"Phys. Rev. E"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"19689","DOI":"10.1073\/pnas.1319473110","article-title":"Distribution of directional change as a signature of complex dynamics","volume":"110","author":"Burov","year":"2013","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1364","DOI":"10.1016\/j.bpj.2009.12.4282","article-title":"Quantitative Analysis of Single Particle Trajectories: Mean Maximal Excursion Method","volume":"98","author":"Tejedor","year":"2010","journal-title":"Biophys. J."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"11306","DOI":"10.1038\/srep11306","article-title":"Estimating the anomalous diffusion exponent for single particle tracking data with measurement errors\u2014An alternative approach","volume":"5","author":"Burnecki","year":"2015","journal-title":"Sci. Rep."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Das, R., Cairo, C.W., and Coombs, D. (2009). A Hidden Markov Model for Single Particle Tracks Quantifies Dynamic Interactions between LFA-1 and the Actin Cytoskeleton. PLoS Comput. Biol., 5.","DOI":"10.1371\/journal.pcbi.1000556"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Slator, P.J., Cairo, C.W., and Burroughs, N.J. (2015). Detection of Diffusion Heterogeneity in Single Particle Tracking Trajectories Using a Hidden Markov Model with Measurement Noise Propagation. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0140759"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1741","DOI":"10.1016\/j.bpj.2018.09.005","article-title":"A Hidden Markov Model for Detecting Confinement in Single-Particle Tracking Trajectories","volume":"115","author":"Slator","year":"2018","journal-title":"Biophys. J."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"042149","DOI":"10.1103\/PhysRevE.99.042149","article-title":"Statistical testing approach for fractional anomalous diffusion classification","volume":"99","author":"Weron","year":"2019","journal-title":"Phys. Rev. E"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"032140","DOI":"10.1103\/PhysRevE.88.032140","article-title":"Optimal and suboptimal quadratic forms for noncentered Gaussian processes","volume":"88","author":"Grebenkov","year":"2013","journal-title":"Phys. Rev. E"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"616","DOI":"10.1016\/j.bpj.2012.06.029","article-title":"Bayesian Approach to MSD-Based Analysis of Particle Motion in Live Cells","volume":"103","author":"Monnier","year":"2012","journal-title":"Biophys. J."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"29018","DOI":"10.1039\/C8CP04043E","article-title":"Bayesian analysis of single-particle tracking data using the nested-sampling algorithm: Maximum-likelihood model selection applied to stochastic-diffusivity data","volume":"20","author":"Thapa","year":"2018","journal-title":"Phys. Chem. Chem. Phys."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"2526","DOI":"10.1039\/C8SM02096E","article-title":"Non-Gaussian, non-ergodic, and non-Fickian diffusion of tracers in mucin hydrogels","volume":"15","author":"Cherstvy","year":"2019","journal-title":"Soft Matter"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Wagner, T., Kroll, A., Haramagatti, C.R., Lipinski, H.G., and Wiemann, M. (2017). Classification and Segmentation of Nanoparticle Diffusion Trajectories in Cellular Micro Environments. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0170165"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"032410","DOI":"10.1103\/PhysRevE.100.032410","article-title":"Classification of diffusion modes in single-particle tracking data: Feature-based versus deep-learning approach","volume":"100","author":"Kowalek","year":"2019","journal-title":"Phys. Rev. E"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"013010","DOI":"10.1088\/1367-2630\/ab6065","article-title":"Single trajectory characterization via machine learning","volume":"22","author":"Manzo","year":"2020","journal-title":"New J. Phys."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"032402","DOI":"10.1103\/PhysRevE.102.032402","article-title":"Classification of particle trajectories in living cells: Machine learning versus statistical testing hypothesis for fractional anomalous diffusion","volume":"102","author":"Janczura","year":"2020","journal-title":"Phys. Rev. E"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Loch-Olszewska, H., and Szwabi\u0144ski, J. (2020). Impact of feature choice on machine learning classification of fractional anomalous diffusion. Entropy, 22.","DOI":"10.3390\/e22121436"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Dosset, P., Rassam, P., Fernandez, L., Espenel, C., Rubinstein, E., Margeat, E., and Milhiet, P.E. (2016). Automatic detection of diffusion modes within biological membranes using backpropagation neural network. BMC Bioinform., 17.","DOI":"10.1186\/s12859-016-1064-z"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/j.bpj.2019.06.015","article-title":"Single-Particle Diffusion Characterization by Deep Learning","volume":"117","author":"Granik","year":"2019","journal-title":"Biophys. J."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"010102","DOI":"10.1103\/PhysRevE.100.010102","article-title":"Measurement of anomalous diffusion using recurrent neural networks","volume":"100","author":"Bo","year":"2019","journal-title":"Phys. Rev. E"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Gentili, A., and Volpe, G. (2021). Characterization of anomalous diffusion statistics powered by deep learning. arXiv.","DOI":"10.1088\/1751-8121\/ac0c5d"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Mu\u00f1oz-Gil, G., Volpe, G., Garc\u00eda-March, M.A., Metzler, R., Lewenstein, M., and Manzo, C. (2020, January 5\u20137). The anomalous diffusion challenge: Single trajectory characterisation as a competition. Proceedings of the Emerging Topics in Artificial Intelligence 2020, Halkidiki, Greece.","DOI":"10.1117\/12.2567914"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_54","unstructured":"Verikas, A., Radeva, P., Nikolaev, D., and Zhou, J. (2018). Classification of Time-Series Images Using Deep Convolu- tional Neural Networks. Proceedings of SPIE, Tenth International Conference on Machine Vision (ICMV 2017), SPIE Publications."},{"key":"ref_55","unstructured":"Ishikawa, H., Liu, C.L., Pajdla, T., and Shi, J. (2021). SpotPatch: Parameter-Efficient Transfer Learning for Mobile Object Detection. Computer Vision\u2014ACCV 2020, Springer International Publishing."},{"key":"ref_56","unstructured":"Guo, Y., Li, Y., Wang, L., and Rosing, T. (February, January 27). Depthwise Convolution Is All You Need for Learning Multiple Visual Domains. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Guo, Y., Shi, H., Kumar, A., Grauman, K., Rosing, T., and Feris, R. (2019, January 15\u201320). SpotTune: Transfer Learning Through Adaptive Fine-Tuning. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00494"},{"key":"ref_58","unstructured":"Mudrakarta, P.K., Sandler, M., Zhmoginov, A., and Howard, A.G. (2018). K For The Price Of 1: Parameter Efficient Multi-task In addition, Transfer Learning. arXiv."},{"key":"ref_59","unstructured":"Literaturverz, S. (2014). Stochastic Processes in Cell Biology, Springer."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"3518","DOI":"10.1529\/biophysj.104.044263","article-title":"Anomalous Subdiffusion Is a Measure for Cytoplasmic Crowding in Living Cells","volume":"87","author":"Weiss","year":"2004","journal-title":"Biophys. J."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"2110","DOI":"10.1016\/S0006-3495(94)80694-0","article-title":"Single-particle tracking: Models of directed transport","volume":"67","author":"Saxton","year":"1994","journal-title":"Biophys. J."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"022708","DOI":"10.1103\/PhysRevE.89.022708","article-title":"Anomalous diffusion due to hindering by mobile obstacles undergoing Brownian motion or Orstein-Ulhenbeck processes","volume":"89","author":"Berry","year":"2014","journal-title":"Phys. Rev. E"},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/S0370-1573(00)00070-3","article-title":"The random walk\u2019s guide to anomalous diffusion: A fractional dynamics approach","volume":"339","author":"Metzler","year":"2000","journal-title":"Phys. Rep."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"17052","DOI":"10.1073\/pnas.1204589109","article-title":"Heterogeneity of AMPA receptor trafficking and molecular interactions revealed by superresolution analysis of live cell imaging","volume":"109","author":"Hoze","year":"2012","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"248103","DOI":"10.1103\/PhysRevLett.101.248103","article-title":"Temporal Analysis of Active and Passive Transport in Living Cells","volume":"101","author":"Arcizet","year":"2008","journal-title":"Phys. Rev. Lett."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"14759","DOI":"10.1021\/ja074936k","article-title":"Imaging and Tracking of Tat Peptide-Conjugated Quantum Dots in Living Cells: New Insights into Nanoparticle Uptake, Intracellular Transport, and Vesicle Shedding","volume":"129","author":"Ruan","year":"2007","journal-title":"J. Am. Chem. Soc."},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"4363","DOI":"10.1021\/mp500439c","article-title":"Mechanisms of Nanoparticle Internalization and Transport Across an Intestinal Epithelial Cell Model: Effect of Size and Surface Charge","volume":"11","author":"Bannunah","year":"2014","journal-title":"Mol. Pharm."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"422","DOI":"10.1137\/1010093","article-title":"Fractional Brownian Motions, Fractional Noises and Applications","volume":"10","author":"Mandelbrot","year":"1968","journal-title":"SIAM Rev."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/2000000039","article-title":"Deep Learning: Methods and Applications","volume":"7","author":"Deng","year":"2014","journal-title":"Found. Trends Signal Process."},{"key":"ref_70","unstructured":"Yang, J.B., Nguyen, M.N., San, P.P., Li, X.L., and Krishnaswamy, S. (2015, January 25\u201331). Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition. Proceedings of the 24th International Conference on Artificial Intelligence, IJCAI\u201915, Buenos Aires, Argentina."},{"key":"ref_71","doi-asserted-by":"crossref","unstructured":"van Kuppevelt, D., Meijer, C., Huber, F., van der Ploeg, A., Georgievska, S., and van Hees, V.T. (2020). Mcfly: Automated deep learning on time series. SoftwareX, 12.","DOI":"10.1016\/j.softx.2020.100548"},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"He, T., Zhang, Z., Zhang, H., Zhang, Z., Xie, J., and Li, M. (2018, January 18\u201323). Bag of Tricks for Image Classification with Convolutional Neural Networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2019.00065"},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"062112","DOI":"10.1103\/PhysRevE.98.062112","article-title":"Statistical analysis of random trajectories of vibrated disks: Towards a macroscopic realization of Brownian motion","volume":"98","author":"Briand","year":"2018","journal-title":"Phys. Rev. E"},{"key":"ref_74","first-page":"242","article-title":"Effect of separate sampling on classification accuracy","volume":"30","author":"Dougherty","year":"2013","journal-title":"Bioinformatics"},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1038\/nrm908","article-title":"Seven-transmembrane receptors","volume":"3","author":"Pierce","year":"2002","journal-title":"Nat. Rev. Mol. Cell Biol."},{"key":"ref_76","unstructured":"Wallach, H., Larochelle, H., Beygelzimer, A., d\u2019Alch\u00e9-Buc, F., Fox, E., and Garnett, R. (2019). PyTorch: An Imperative Style, High-Performance Deep Learning Library. Advances in Neural Information Processing Systems 32, Curran Associates, Inc."},{"key":"ref_77","doi-asserted-by":"crossref","unstructured":"Szarek, D., Sikora, G., Balcerek, M., Jab\u0142o\u0144ski, I., and Wy\u0142oma\u0144ska, A. (2020). Fractional Dynamics Identification via Intelligent Unpacking of the Sample Autocovariance Function by Neural Networks. Entropy, 22.","DOI":"10.3390\/e22111322"},{"key":"ref_78","unstructured":"Jiang, A.H., Wong, D.L., Zhou, G., Andersen, D.G., Dean, J., Ganger, G.R., Joshi, G., Kaminsky, M., Kozuch, M., and Lipton, Z.C. (2019). Accelerating Deep Learning by Focusing on the Biggest Losers. arXiv."},{"key":"ref_79","unstructured":"G\u00e9ron, A. (2017). Hands-On Machine Learning with Scikit-Learn and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems, O\u2019Reilly Media."},{"key":"ref_80","doi-asserted-by":"crossref","unstructured":"Mira, J., and Sandoval, F. (1995). The influence of the sigmoid function parameters on the speed of backpropagation learning. From Natural to Artificial Neural Computation, Springer.","DOI":"10.1007\/3-540-59497-3"},{"key":"ref_81","unstructured":"Nair, V., and Hinton, G.E. (2010, January 21\u201324). Rectified Linear Units Improve Restricted Boltzmann Machines. Proceedings of the 27th International Conference on International Conference on Machine Learning, ICML\u201910, Haifa, Israel."},{"key":"ref_82","unstructured":"Maas, A.L., Hannun, A.Y., and Ng, A.Y. (2013, January 16). Rectifier nonlinearities improve neural network acoustic models. Proceedings of the ICML Workshop on Deep Learning for Audio, Speech and Language Processing, JMLR.org, Atlanta, GA, USA."},{"key":"ref_83","unstructured":"Clevert, D.A., Unterthiner, T., and Hochreiter, S. (2016). Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs). arXiv."},{"key":"ref_84","unstructured":"Keskar, N.S., Mudigere, D., Nocedal, J., Smelyanskiy, M., and Tang, P.T.P. (2017). On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima. arXiv."},{"key":"ref_85","unstructured":"Smith, L.N. (2017). No More Pesky Learning Rate Guessing Games. arXiv."},{"key":"ref_86","unstructured":"Falcon, W. (2020, October 20). PyTorch Lightning. GitHub. Note. Available online: https:\/\/github.com\/PyTorchLightning\/pytorch-lightning."},{"key":"ref_87","unstructured":"Raschka, S. (2015). Python Machine Learning, Packt Publishing."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/6\/649\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:06:01Z","timestamp":1760162761000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/6\/649"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,22]]},"references-count":87,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["e23060649"],"URL":"https:\/\/doi.org\/10.3390\/e23060649","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,22]]}}}