{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T20:58:58Z","timestamp":1783717138516,"version":"3.55.0"},"reference-count":46,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,7,3]],"date-time":"2021-07-03T00:00:00Z","timestamp":1625270400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,7,3]],"date-time":"2021-07-03T00:00:00Z","timestamp":1625270400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Ann Math Artif Intell"],"published-print":{"date-parts":[[2022,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The inner representation of deep neural networks (DNNs) is indecipherable, which makes it difficult to tune DNN models, control their training process, and interpret their outputs. In this paper, we propose a novel approach to investigate the inner representation of DNNs through topological data analysis (TDA). Persistent homology (PH), one of the outstanding methods in TDA, was employed for investigating the complexities of trained DNNs. We constructed clique complexes on trained DNNs and calculated the one-dimensional PH of DNNs. The PH reveals the combinational effects of multiple neurons in DNNs at different resolutions, which is difficult to be captured without using PH. Evaluations were conducted using fully connected networks (FCNs) and networks combining FCNs and convolutional neural networks (CNNs) trained on the MNIST and CIFAR-10 data sets. Evaluation results demonstrate that the PH of DNNs reflects both the excess of neurons and problem difficulty, making PH one of the prominent methods for investigating the inner representation of DNNs.<\/jats:p>","DOI":"10.1007\/s10472-021-09761-3","type":"journal-article","created":{"date-parts":[[2021,7,3]],"date-time":"2021-07-03T10:02:47Z","timestamp":1625306567000},"page":"75-92","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Topological measurement of deep neural networks using persistent homology"],"prefix":"10.1007","volume":"90","author":[{"given":"Satoru","family":"Watanabe","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hayato","family":"Yamana","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,7,3]]},"reference":[{"key":"9761_CR1","unstructured":"Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al.: Tensorflow: A system for large-scale machine learning. In: 12th {USENIX} Symposium on Operating Systems Design and Implementation ({OSDI 16}), pp. 265\u2013283 (2016)"},{"issue":"7","key":"9761_CR2","doi-asserted-by":"publisher","first-page":"e0130140","DOI":"10.1371\/journal.pone.0130140","volume":"10","author":"S Bach","year":"2015","unstructured":"Bach, S., Binder, A., Montavon, G., Klauschen, F., M\u00fcller, K.-R., Samek, W.: On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PloS one 10(7), e0130140 (2015)","journal-title":"PloS one"},{"key":"9761_CR3","unstructured":"Barannikov, S.: The framed morse complex and its invariants (1994)"},{"key":"9761_CR4","unstructured":"Bergstra, J.S., Bardenet, R., Bengio, Y., K\u00e9gl, B.: Algorithms for hyper-parameter optimization. In: Shawe-Taylor, J., Zemel, R.S., Bartlett, P.L., Pereira, F., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems, vol. 24, pp 2546\u20132554. Curran Associates, Inc. (2011)"},{"issue":"8","key":"9761_CR5","doi-asserted-by":"publisher","first-page":"1553","DOI":"10.1109\/TNNLS.2013.2293637","volume":"25","author":"M Bianchini","year":"2014","unstructured":"Bianchini, M., Scarselli, F.: On the complexity of neural network classifiers: A comparison between shallow and deep architectures. IEEE Trans. Neural Netw. Learn. Sys. 25(8), 1553\u20131565 (2014)","journal-title":"IEEE Trans. Neural Netw. Learn. Sys."},{"issue":"3","key":"9761_CR6","doi-asserted-by":"publisher","first-page":"406","DOI":"10.1007\/s00453-014-9887-3","volume":"70","author":"J-D Boissonnat","year":"2014","unstructured":"Boissonnat, J.-D., Maria, C.: The simplex tree: An efficient data structure for general simplicial complexes. Algorithmica 70(3), 406\u2013427 (2014)","journal-title":"Algorithmica"},{"issue":"2","key":"9761_CR7","doi-asserted-by":"publisher","first-page":"e2914","DOI":"10.1002\/cnm.2914","volume":"34","author":"Z Cang","year":"2018","unstructured":"Cang, Z., Wei, G.-W.: Integration of element specific persistent homology and machine learning for protein-ligand binding affinity prediction. Int. J. Numer. Methods Biomed. Eng. 34(2), e2914 (2018)","journal-title":"Int. J. Numer. Methods Biomed. Eng."},{"issue":"2","key":"9761_CR8","doi-asserted-by":"publisher","first-page":"649","DOI":"10.1109\/TMI.2017.2774364","volume":"37","author":"B Cassidy","year":"2018","unstructured":"Cassidy, B., Bowman, F. D., Rae, C., Solo, V.: On the reliability of individual brain activity networks. IEEE Trans. Med. Imaging 37(2), 649\u2013662 (2018)","journal-title":"IEEE Trans. Med. Imaging"},{"key":"9761_CR9","volume-title":"Deep Learning with Python","author":"F Chollet","year":"2017","unstructured":"Chollet, F.: Deep Learning with Python, 1st edn. Manning Publications Co., Greenwich (2017)","edition":"1st edn."},{"issue":"1","key":"9761_CR10","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1090\/bull\/1554","volume":"54","author":"C Curto","year":"2017","unstructured":"Curto, C.: What can topology tell us about the neural code? Bull. Am. Math. Soc. 54(1), 63\u201378 (2017)","journal-title":"Bull. Am. Math. Soc."},{"key":"9761_CR11","doi-asserted-by":"crossref","unstructured":"Edelsbrunner, H., Harer, J.: Computational topology: an introduction. American Mathematical Soc. (2010)","DOI":"10.1090\/mbk\/069"},{"key":"9761_CR12","unstructured":"Edelsbrunner, H., Letscher, D., Zomorodian, A.: Topological persistence and simplification. In: Proceedings 41st Annual Symposium on Foundations of Computer Science, pp 454\u2013463. IEEE (2000)"},{"key":"9761_CR13","unstructured":"Edelsbrunner, H., Morozov, D.: Persistent homology: theory and practice. Technical report, Lawrence Berkeley National Lab.(LBNL). Berkeley, CA (United States) (2012)"},{"issue":"1","key":"9761_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s13160-014-0153-5","volume":"32","author":"M Gameiro","year":"2015","unstructured":"Gameiro, M., Hiraoka, Y., Izumi, S., Kramar, M., Mischaikow, K., Nanda, V.: A topological measurement of protein compressibility. Jpn. J. Ind. Appl. Math. 32(1), 1\u201317 (2015)","journal-title":"Jpn. J. Ind. Appl. Math."},{"key":"9761_CR15","unstructured":"Guss, W.H., Salakhutdinov, R.: On characterizing the capacity of neural networks using algebraic topology. arXiv:1802.04443 (2018)"},{"key":"9761_CR16","doi-asserted-by":"publisher","first-page":"24411","DOI":"10.1109\/ACCESS.2018.2830661","volume":"6","author":"WG Hatcher","year":"2018","unstructured":"Hatcher, W.G., Yu, W.: A survey of deep learning: platforms, applications and emerging research trends. IEEE Access 6, 24411\u201324432 (2018)","journal-title":"IEEE Access"},{"key":"9761_CR17","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770\u2013778 (2016)","DOI":"10.1109\/CVPR.2016.90"},{"issue":"26","key":"9761_CR18","doi-asserted-by":"publisher","first-page":"7035","DOI":"10.1073\/pnas.1520877113","volume":"113","author":"Y Hiraoka","year":"2016","unstructured":"Hiraoka, Y., Nakamura, T., Hirata, A., Escolar, E. G, Matsue, K., Nishiura, Y.: Hierarchical structures of amorphous solids characterized by persistent homology. Proc. Natl. Acad. Sci. 113(26), 7035\u20137040 (2016)","journal-title":"Proc. Natl. Acad. Sci."},{"issue":"03","key":"9761_CR19","doi-asserted-by":"publisher","first-page":"P03034","DOI":"10.1088\/1742-5468\/2009\/03\/P03034","volume":"2009","author":"D Horak","year":"2009","unstructured":"Horak, D., Maleti\u0107, S., Rajkovi\u0107, M.: Persistent homology of complex networks. Journal of Statistical Mechanics: Theory and Experiment 2009 (03), P03034 (2009)","journal-title":"Journal of Statistical Mechanics: Theory and Experiment"},{"key":"9761_CR20","unstructured":"Kornblith, S., Norouzi, M., Lee, H., Hinton, G.: Similarity of neural network representations revisited. arXiv:1905.00414 (2019)"},{"issue":"4","key":"9761_CR21","doi-asserted-by":"publisher","first-page":"042207","DOI":"10.1103\/PhysRevE.87.042207","volume":"87","author":"M Kramar","year":"2013","unstructured":"Kramar, M, Goullet, A, Kondic, L, Mischaikow, K.: Persistence of force networks in compressed granular media. Phys. Rev. E 87(4), 042207 (2013)","journal-title":"Phys. Rev. E"},{"key":"9761_CR22","unstructured":"Krizhevsky, A., Hinton, G., et al.: Learning multiple layers of features from tiny images (2009)"},{"issue":"7553","key":"9761_CR23","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436 (2015)","journal-title":"Nature"},{"issue":"11","key":"9761_CR24","doi-asserted-by":"publisher","first-page":"2278","DOI":"10.1109\/5.726791","volume":"86","author":"Y LeCun","year":"1998","unstructured":"LeCun, Y., Bottou, L., Bengio, Y., Haffner, P., et al.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278\u20132324 (1998)","journal-title":"Proc. IEEE"},{"issue":"1","key":"9761_CR25","doi-asserted-by":"publisher","first-page":"388","DOI":"10.1186\/s40064-016-2022-y","volume":"5","author":"P Masulli","year":"2016","unstructured":"Masulli, P., Villa, AEP: The topology of the directed clique complex as a network invariant. SpringerPlus 5(1), 388 (2016)","journal-title":"SpringerPlus"},{"key":"9761_CR26","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1016\/j.patcog.2016.11.008","volume":"65","author":"G Montavon","year":"2017","unstructured":"Montavon, G., Lapuschkin, S., Binder, A., Samek, W., M\u00fcller, K.-R.: Explaining nonlinear classification decisions with deep taylor decomposition. Pattern Recogn. 65, 211\u2013222 (2017)","journal-title":"Pattern Recogn."},{"key":"9761_CR27","unstructured":"Morcos, A., Raghu, M., Bengio, S.: Insights on representational similarity in neural networks with canonical correlation. In: Advances in Neural Information Processing Systems, pp. 5727\u20135736 (2018)"},{"issue":"1","key":"9761_CR28","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1140\/epjds\/s13688-017-0109-5","volume":"6","author":"N Otter","year":"2017","unstructured":"Otter, N., Porter, M. A, Tillmann, U., Grindrod, P., Harrington, H.A: A roadmap for the computation of persistent homology. EPJ Data Science 6(1), 17 (2017)","journal-title":"EPJ Data Science"},{"issue":"101","key":"9761_CR29","doi-asserted-by":"publisher","first-page":"20140873","DOI":"10.1098\/rsif.2014.0873","volume":"11","author":"G Petri","year":"2014","unstructured":"Petri, G., Expert, P., Turkheimer, F., Carhart-Harris, R., Nutt, D., Hellyer, P.J., Vaccarino, F.: Homological scaffolds of brain functional networks. Journal of The Royal Society Interface 11(101), 20140873 (2014)","journal-title":"Journal of The Royal Society Interface"},{"key":"9761_CR30","unstructured":"Raghu, M., Gilmer, J., Yosinski, J., Sohl-Dickstein, J.: Svcca: Singular vector canonical correlation analysis for deep learning dynamics and interpretability. In: Advances in Neural Information Processing Systems, pp 6076\u20136085 (2017)"},{"key":"9761_CR31","doi-asserted-by":"publisher","first-page":"48","DOI":"10.3389\/fncom.2017.00048","volume":"11","author":"MW Reimann","year":"2017","unstructured":"Reimann, M. W, Nolte, M., Scolamiero, M., Turner, K., Perin, R., Chindemi, G., D\u0142otko, P, Levi, R., Hess, K., Markram, H.: Cliques of neurons bound into cavities provide a missing link between structure and function. Frontiers in computational neuroscience 11, 48 (2017)","journal-title":"Frontiers in computational neuroscience"},{"key":"9761_CR32","unstructured":"Rieck, B., Togninalli, M., Bock, C., Moor, M., Horn, M., Gumbsch, T., Borgwardt, K.: Neural persistence: A complexity measure for deep neural networks using algebraic topology. arXiv:1812.09764 (2018)"},{"key":"9761_CR33","unstructured":"Rouvreau, V.: Cython interface. In: GUDHI User and Reference Manual. GUDHI Editorial Board (2016)"},{"issue":"11","key":"9761_CR34","doi-asserted-by":"publisher","first-page":"2660","DOI":"10.1109\/TNNLS.2016.2599820","volume":"28","author":"W Samek","year":"2016","unstructured":"Samek, W., Binder, A., Montavon, G., Lapuschkin, S., M\u00fcller, K.-R.: Evaluating the visualization of what a deep neural network has learned. IEEE Trans. Neural Netw. Learn. Sys. 28(11), 2660\u20132673 (2016)","journal-title":"IEEE Trans. Neural Netw. Learn. Sys."},{"key":"9761_CR35","unstructured":"Saxena, S., Verbeek, J.: Convolutional neural fabrics. In: Advances in Neural Information Processing Systems, pp. 4053\u20134061 (2016)"},{"issue":"1","key":"9761_CR36","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1007\/s10827-017-0672-6","volume":"44","author":"AE Sizemore","year":"2018","unstructured":"Sizemore, A.E., Giusti, C., Kahn, A., Vettel, J.M., Betzel, R.F., Bassett, D.S.: Cliques and cavities in the human connectome. J. Comput. Neurosci. 44(1), 115\u2013145 (2018)","journal-title":"J. Comput. Neurosci."},{"issue":"1","key":"9761_CR37","first-page":"1929","volume":"15","author":"N Srivastava","year":"2014","unstructured":"Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929\u20131958 (2014)","journal-title":"J. Mach. Learn. Res."},{"key":"9761_CR38","doi-asserted-by":"crossref","unstructured":"Tausz, A., Vejdemo-Johansson, M., Adams, H.: JavaPlex: A research software package for persistent (co)homology. In: Hong, H., Yap, C. (eds.) Proceedings of ICMS 2014, Lecture Notes in Computer Science 8592, pp. 129\u2013136. Software available at http:\/\/appliedtopology.github.io\/javaplex\/ (2014)","DOI":"10.1007\/978-3-662-44199-2_23"},{"key":"9761_CR39","unstructured":"The GUDHI Project: GUDHI User and Reference Manual. GUDHI Editorial Board (2015)"},{"key":"9761_CR40","doi-asserted-by":"publisher","first-page":"501","DOI":"10.1146\/annurev-statistics-031017-100045","volume":"5","author":"L Wasserman","year":"2018","unstructured":"Wasserman, L.: Topological data analysis. Annual Rev. Stat. Appl. 5, 501\u2013532 (2018)","journal-title":"Annual Rev. Stat. Appl."},{"key":"9761_CR41","doi-asserted-by":"crossref","unstructured":"Watanabe, S., Yamana, H.: Topological measurement of deep neural networks using persistent homology. International Symposium on Artificial Intelligence and Mathematics (2020)","DOI":"10.1007\/s10472-021-09761-3"},{"issue":"8","key":"9761_CR42","doi-asserted-by":"publisher","first-page":"814","DOI":"10.1002\/cnm.2655","volume":"30","author":"K Xia","year":"2014","unstructured":"Xia, K., Wei, G.-W.: Persistent homology analysis of protein structure, flexibility, and folding. Int. J. Numer. Methods Biomed. Eng. 30(8), 814\u2013844 (2014)","journal-title":"Int. J. Numer. Methods Biomed. Eng."},{"key":"9761_CR43","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.jneumeth.2016.04.001","volume":"267","author":"J Yoo","year":"2016","unstructured":"Yoo, J., Kim, E. Y., Ahn, Y. M., Ye, J. C.: Topological persistence vineyard for dynamic functional brain connectivity during resting and gaming stages. J. Neurosci. Methods 267, 1\u201313 (2016)","journal-title":"J. Neurosci. Methods"},{"key":"9761_CR44","doi-asserted-by":"crossref","unstructured":"Zeiler, M. D, Fergus, R.: Visualizing and understanding convolutional networks. In: European conference on computer vision, pp 818\u2013833. Springer (2014)","DOI":"10.1007\/978-3-319-10590-1_53"},{"key":"9761_CR45","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1016\/j.inffus.2017.10.006","volume":"42","author":"Q Zhang","year":"2018","unstructured":"Zhang, Q., Yang, L. T, Chen, Z., Li, P.: A survey on deep learning for big data. Information Fusion 42, 146\u2013157 (2018)","journal-title":"Information Fusion"},{"key":"9761_CR46","unstructured":"Zoph, B., Le, Q.V.: Neural architecture search with reinforcement learning. arXiv:1611.01578 (2016)"}],"container-title":["Annals of Mathematics and Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10472-021-09761-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10472-021-09761-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10472-021-09761-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,1,19]],"date-time":"2022-01-19T00:16:24Z","timestamp":1642551384000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10472-021-09761-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,3]]},"references-count":46,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,1]]}},"alternative-id":["9761"],"URL":"https:\/\/doi.org\/10.1007\/s10472-021-09761-3","relation":{},"ISSN":["1012-2443","1573-7470"],"issn-type":[{"value":"1012-2443","type":"print"},{"value":"1573-7470","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,3]]},"assertion":[{"value":"10 June 2021","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 July 2021","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}