{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T10:21:03Z","timestamp":1777371663193,"version":"3.51.4"},"reference-count":45,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,2,25]],"date-time":"2022-02-25T00:00:00Z","timestamp":1645747200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100013348","name":"Innosuisse - Swiss Innovation Agency","doi-asserted-by":"publisher","award":["40598.1"],"award-info":[{"award-number":["40598.1"]}],"id":[{"id":"10.13039\/501100013348","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Information is the resolution of uncertainty and manifests itself as patterns. Although complex, most observable phenomena are not random and instead are associated with deterministic, chaotic systems. The underlying patterns and symmetries expressed from these phenomena determine their information content and compressibility. While some patterns, such as the existence of Fourier modes, are easy to extract, advances in machine learning have enabled more comprehensive methods in feature extraction, most notably in their ability to elicit non-linear relationships. Herein we review methods concerned with the encoding and reconstruction of natural signals and how they might inform the discovery of useful transform bases. Additionally, we illustrate the efficacy of data-driven bases over generic ones in encoding information whilst discussing these developments in the context of \u201cfourth paradigm\u201d metrology. Toward this end, we propose that existing metrological standards and norms may need to be redefined within the context of a data-rich world.<\/jats:p>","DOI":"10.3390\/info13030111","type":"journal-article","created":{"date-parts":[[2022,2,25]],"date-time":"2022-02-25T10:00:40Z","timestamp":1645783240000},"page":"111","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Measurement in the Age of Information"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7631-0222","authenticated-orcid":false,"given":"Forrest","family":"Webler","sequence":"first","affiliation":[{"name":"Laboratory of Integrated Performance In Design (LIPID), School of Architecture, Civil and Environmental Engineering (ENAC), \u00c9cole Polytechnique F\u00e9d\u00e9rale de Lausanne (EPFL), 1015 Lausanne, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marilyne","family":"Andersen","sequence":"additional","affiliation":[{"name":"Laboratory of Integrated Performance In Design (LIPID), School of Architecture, Civil and Environmental Engineering (ENAC), \u00c9cole Polytechnique F\u00e9d\u00e9rale de Lausanne (EPFL), 1015 Lausanne, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,25]]},"reference":[{"key":"ref_1","unstructured":"Kubin, G. (1995). What Is a Chaotic Signal?. IEEE Workshop on Nonlinear Signal and Image Processing."},{"key":"ref_2","first-page":"9","article-title":"International vocabulary of basic and general terms in metrology (VIM)","volume":"2004","author":"Vim","year":"2004","journal-title":"Int. Organ."},{"key":"ref_3","first-page":"20","article-title":"Gravity quantized?","volume":"267","author":"Wheeler","year":"1992","journal-title":"Sci. Am."},{"key":"ref_4","unstructured":"Asimov, I. (1951). Foundation, Gnome Press."},{"key":"ref_5","unstructured":"Miller, R.A. (1980). Origins of the Japanese Language: Lectures in Japan during the Academic Year 1977\u20131978, University of Washington Press."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Brunton, S.L., and Kutz, J.N. (2019). Data-Driven Science and Engineering: Machine Learning, Dynamical Systems, and Control, Cambridge University Press.","DOI":"10.1017\/9781108380690"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1109\/MCS.2018.2810460","article-title":"Data-driven sparse sensor placement for reconstruction: Demonstrating the benefits of exploiting known patterns","volume":"38","author":"Manohar","year":"2018","journal-title":"IEEE Control Syst. Mag."},{"key":"ref_8","unstructured":"Borges, J.L. (1998). The library of Babel. Collected Fictions, Andrew Hurley Penguin."},{"key":"ref_9","unstructured":"Von Luxburg, U., Williamson, R.C., and Guyon, I. (July, January 28). Clustering: Science or art?. Proceedings of the ICML Workshop on Unsupervised and Transfer Learning, JMLR Workshop and Conference Proceedings, Bellevue, WA, USA."},{"key":"ref_10","first-page":"20170009","article-title":"Model selection for dynamical systems via sparse regression and information criteria","volume":"473","author":"Mangan","year":"2017","journal-title":"Proc. R. Soc. A Math. Phys. Eng. Sci."},{"key":"ref_11","unstructured":"Udrescu, S.M., Tan, A., Feng, J., Neto, O., Wu, T., and Tegmark, M. (2020). AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularity. arXiv."},{"key":"ref_12","unstructured":"Pelleg, D., and Moore, A.W. (July, January 29). X-means: Extending k-means with efficient estimation of the number of clusters. Proceedings of the Icml, Stanford, CA, USA."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1523","DOI":"10.1109\/TIT.2005.844059","article-title":"Clustering by compression","volume":"51","author":"Cilibrasi","year":"2005","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1407","DOI":"10.1109\/18.681318","article-title":"Information distance","volume":"44","author":"Bennett","year":"1998","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_15","unstructured":"Murphy, K.P. (2012). Machine Learning: A Probabilistic Perspective, MIT Press."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1364\/JOSAA.17.000218","article-title":"Color signals in natural scenes: Characteristics of reflectance spectra and effects of natural illuminants","volume":"17","author":"Chiao","year":"2000","journal-title":"JOSA A"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.cobeha.2019.06.006","article-title":"What is the \u2018spectral diet\u2019of humans?","volume":"30","author":"Webler","year":"2019","journal-title":"Curr. Opin. Behav. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3308","DOI":"10.1016\/j.sigpro.2010.05.025","article-title":"A short note on compressed sensing with partially known signal support","volume":"90","author":"Jacques","year":"2010","journal-title":"Signal Process."},{"key":"ref_19","unstructured":"Gribbin, J., and Gribbin, M. (2018). Richard Feynman: A Life in Science, Icon Books."},{"key":"ref_20","unstructured":"BIPM (1993). Guide to the Expression of Uncertainty in Measurement, DIANE Publishing."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1109\/JRPROC.1949.232969","article-title":"Communication in the presence of noise","volume":"37","author":"Shannon","year":"1949","journal-title":"Proc. IRE"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1016\/j.ins.2015.08.029","article-title":"Intrinsic dimension estimation: Advances and open problems","volume":"328","author":"Camastra","year":"2016","journal-title":"Inf. Sci."},{"key":"ref_23","unstructured":"Candes, E., and Romberg, J. (2021, December 26). l1-magic: Recovery of Sparse Signals via Convex Programming. Available online: www.acm.caltech.edu\/l1magic\/downloads\/l1magic.pdf."},{"key":"ref_24","unstructured":"Cand\u00e8s, E.J. (2006, January 22\u201330). Compressive sampling. Proceedings of the International Congress of Mathematicians, Madrid, Spain."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"4053","DOI":"10.1109\/TSP.2011.2161982","article-title":"Structured compressed sensing: From theory to applications","volume":"59","author":"Duarte","year":"2011","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Eldar, Y.C., and Kutyniok, G. (2012). Compressed Sensing: Theory and Applications, Cambridge University Press.","DOI":"10.1017\/CBO9780511794308"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Kohrt, M. (1986). The term \u2018grapheme\u2019 in the history and theory of linguisticsv. New Trends in Graphemics and Orthography, De Gruyter.","DOI":"10.1515\/9783110867329.80"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1109\/TSP.2008.2007095","article-title":"Sensor selection via convex optimization","volume":"57","author":"Joshi","year":"2008","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Kuang, D., Ding, C., and Park, H. (2012, January 26\u201328). Symmetric nonnegative matrix factorization for graph clustering. Proceedings of the 2012 SIAM International Conference on Data Mining, SIAM, Anaheim, CA, USA.","DOI":"10.1137\/1.9781611972825.10"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1289","DOI":"10.1109\/TIT.2006.871582","article-title":"Compressed sensing","volume":"52","author":"Donoho","year":"2006","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1109\/TIT.2005.862083","article-title":"Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information","volume":"52","author":"Romberg","year":"2006","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Davenport, M.A., Duarte, M.F., Eldar, Y.C., and Kutyniok, G. (2012). Introduction to Compressed Sensing, Cambridge University Press. Available online: https:\/\/assets.cambridge.org\/97811070\/05587\/excerpt\/9781107005587_excerpt.pdf.","DOI":"10.1017\/CBO9780511794308.002"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1214\/aoms\/1177730031","article-title":"The multiplicative process","volume":"20","author":"Otter","year":"1949","journal-title":"Ann. Math. Stat."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1016\/S0378-4371(00)00633-6","article-title":"Explaining the uneven distribution of numbers in nature: The laws of Benford and Zipf","volume":"293","author":"Pietronero","year":"2001","journal-title":"Phys. A Stat. Mech. Its Appl."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"A536","DOI":"10.1137\/140952363","article-title":"Minimization of 1\u20132 for compressed sensing","volume":"37","author":"Yin","year":"2015","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1162\/089976603762552951","article-title":"Dictionary learning algorithms for sparse representation","volume":"15","author":"Murray","year":"2003","journal-title":"Neural Comput."},{"key":"ref_37","unstructured":"Purohit, M., Svitkina, Z., and Kumar, R. (2018, January 3\u20138). Improving online algorithms via ML predictions. Proceedings of the 32nd International Conference on Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Mairal, J., Bach, F., Ponce, J., and Sapiro, G. (2009, January 14\u201318). Online dictionary learning for sparse coding. Proceedings of the 26th Annual International Conference on Machine Learning, Montreal, QC, Canada.","DOI":"10.1145\/1553374.1553463"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Che, D., Safran, M., and Peng, Z. (2013, January 22\u201325). From big data to big data mining: Challenges, issues, and opportunities. Proceedings of the International Conference on Database Systems for Advanced Applications, Wuhan, China.","DOI":"10.1007\/978-3-642-40270-8_1"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1016\/S0007-8506(07)63238-7","article-title":"Measurement as inference: Fundamental ideas","volume":"48","author":"Estler","year":"1999","journal-title":"Cirp Ann."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1209\/epl\/i2004-10483-y","article-title":"Hierarchical clustering using mutual information","volume":"70","author":"Kraskov","year":"2005","journal-title":"EPL Europhys. Lett."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"4472","DOI":"10.1109\/TIT.2017.2695614","article-title":"Compressed sensing with prior information: Strategies, geometry, and bounds","volume":"63","author":"Mota","year":"2017","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1016\/j.neucom.2011.08.018","article-title":"Kernel sparse representation based classification","volume":"77","author":"Yin","year":"2012","journal-title":"Neurocomputing"},{"key":"ref_44","first-page":"600","article-title":"Multi-fidelity sensor selection: Greedy algorithms to place cheap and expensive sensors with cost constraints","volume":"21","author":"Clark","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_45","first-page":"369","article-title":"On tables of random numbers","volume":"25","author":"Kolmogorov","year":"1963","journal-title":"Sankhy\u0101 Indian J. Stat. Ser. A"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/13\/3\/111\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:27:21Z","timestamp":1760135241000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/13\/3\/111"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,25]]},"references-count":45,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["info13030111"],"URL":"https:\/\/doi.org\/10.3390\/info13030111","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,25]]}}}