{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T05:44:15Z","timestamp":1777527855851,"version":"3.51.4"},"reference-count":34,"publisher":"Walter de Gruyter GmbH","issue":"1","license":[{"start":{"date-parts":[[2020,12,8]],"date-time":"2020-12-08T00:00:00Z","timestamp":1607385600000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,2,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Purpose<\/jats:title>\n                    <jats:p>The goal of this study is to explore whether deep learning based embedded models can provide a better visualization solution for large citation networks.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Design\/methodology\/approach<\/jats:title>\n                    <jats:p>Our team compared the visualization approach borrowed from the deep learning community with the well-known bibliometric network visualization for large scale data. 47,294 highly cited papers were visualized by using three network embedding models plus the t-SNE dimensionality reduction technique. Besides, three base maps were created with the same dataset for evaluation purposes. All base maps used the classic OpenOrd method with different edge cutting strategies and parameters.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Findings<\/jats:title>\n                    <jats:p>The network embedded maps with t-SNE preserve a very similar global structure to the full edges classic force-directed map, while the maps vary in local structure. Among them, the Node2Vec model has the best overall visualization performance, the local structure has been significantly improved and the maps\u2019 layout has very high stability.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Research limitations<\/jats:title>\n                    <jats:p>The computational and time costs of training are very high for network embedded models to obtain high dimensional latent vector. Only one dimensionality reduction technique was tested.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Practical implications<\/jats:title>\n                    <jats:p>This paper demonstrates that the network embedding models are able to accurately reconstruct the large bibliometric network in the vector space. In the future, apart from network visualization, many classical vector-based machine learning algorithms can be applied to network representations for solving bibliometric analysis tasks.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Originality\/value<\/jats:title>\n                    <jats:p>This paper provides the first systematic comparison of classical science mapping visualization with network embedding based visualization on a large scale dataset. We showed deep learning based network embedding model with t-SNE can provide a richer, more stable science map. We also designed a practical evaluation method to investigate and compare maps.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2478\/jdis-2021-0006","type":"journal-article","created":{"date-parts":[[2020,12,22]],"date-time":"2020-12-22T08:10:01Z","timestamp":1608624601000},"page":"154-177","source":"Crossref","is-referenced-by-count":6,"title":["Using Network Embedding to Obtain a Richer and More Stable Network Layout for a Large Scale Bibliometric Network"],"prefix":"10.2478","volume":"6","author":[{"given":"Ting","family":"Chen","sequence":"first","affiliation":[{"name":"National Science Library, Chinese Academy of Sciences , Beijing , China"},{"name":"Department of Library, Information and Archives Management , University of Chinese Academy of Sciences , Beijing , China"},{"name":"Institutes of Science and Development, Chinese Academy of Sciences , Beijing , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guopeng","family":"Li","sequence":"additional","affiliation":[{"name":"Institutes of Science and Development, Chinese Academy of Sciences , Beijing , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qiping","family":"Deng","sequence":"additional","affiliation":[{"name":"Library, University of Electronic Science and Technology of China , Chengdu , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaomei","family":"Wang","sequence":"additional","affiliation":[{"name":"Institutes of Science and Development, Chinese Academy of Sciences , Beijing , China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"374","published-online":{"date-parts":[[2020,12,8]]},"reference":[{"key":"2026020215094040379_j_jdis-2021-0006_ref_001_w2aab3b7c34b1b6b1ab2b2b1Aa","doi-asserted-by":"crossref","unstructured":"Bartol, T., Budimir, G., Juznic, P., & Stopar, K. (2016). Mapping and classification of agriculture in Web of Science: Other subject categories and research fields may benefit. Scientometrics, 109(2), 979\u2013996.","DOI":"10.1007\/s11192-016-2071-6"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_002_w2aab3b7c34b1b6b1ab2b2b2Aa","doi-asserted-by":"crossref","unstructured":"Bastian, M., Heymann, S., & Jacomy, M. (2009). Gephi: An open source software for exploring and manipulating networks. Third international AAAI conference on weblogs and social media.","DOI":"10.1609\/icwsm.v3i1.13937"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_003_w2aab3b7c34b1b6b1ab2b2b3Aa","doi-asserted-by":"crossref","unstructured":"Bornmann, L., Leydesdorff, L., Walch-Solimena, C., & Ettl, C. (2011). Mapping excellence in the geography of science: An approach based on Scopus data. Journal of Informetrics, 5(4), 537\u2013546.","DOI":"10.1016\/j.joi.2011.05.005"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_004_w2aab3b7c34b1b6b1ab2b2b4Aa","doi-asserted-by":"crossref","unstructured":"Boyack, K.W., & Klavans, R. (2014). Creation of a highly detailed, dynamic, global model and map of science. Journal of the Association for Information Science and Technology, 65(4), 670\u2013685. doi: 10.1002\/asi.22990, URL https:\/\/dx.doi.org\/10.1002\/asi.22990","DOI":"10.1002\/asi.22990"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_005_w2aab3b7c34b1b6b1ab2b2b5Aa","doi-asserted-by":"crossref","unstructured":"Boyack, K.W., Klavans, R., & B\u00f6rner, K. (2005). Mapping the backbone of science. Scientometrics, 64(3), 351\u2013374.","DOI":"10.1007\/s11192-005-0255-6"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_006_w2aab3b7c34b1b6b1ab2b2b6Aa","doi-asserted-by":"crossref","unstructured":"Boyack, K.W., Newman, D., Duhon, R.J., Klavans, R., Patek, M., Biberstine, J.R., Schijvenaars, B., Skupin, A., Ma, N., & B\u00f6rner, K. (2011). Clustering More than Two Million Biomedical Publications: Comparing the Accuracies of Nine Text-Based Similarity Approaches. PLoS ONE, 6(3), e18029\u2013e18029. doi: 10.1371\/journal.pone.0018029","DOI":"10.1371\/journal.pone.0018029"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_007_w2aab3b7c34b1b6b1ab2b2b7Aa","doi-asserted-by":"crossref","unstructured":"Boyack, K.W., Small, H., & Klavans, R. (2013). Improving the accuracy of co-citation clustering using full text. Journal of the American Society for Information Science and Technology, 64(9), 1759\u20131767. doi: 10.1002\/asi.22896","DOI":"10.1002\/asi.22896"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_008_w2aab3b7c34b1b6b1ab2b2b8Aa","doi-asserted-by":"crossref","unstructured":"Chen, C.M. (1999). Visualising semantic spaces and author co-citation networks in digital libraries. Information Processing & Management, 35(3), 401\u2013420.","DOI":"10.1016\/S0306-4573(98)00068-5"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_009_w2aab3b7c34b1b6b1ab2b2b9Aa","unstructured":"Chen, T. (2020). Essential Science Indicators highly cited paper co-citation relationships 2018.3. V1. DOI http:\/\/www.dx.doi.org\/10.11922\/sciencedb.00256, URL http:\/\/www.dx.doi.org\/10.11922\/sciencedb.00256"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_010_w2aab3b7c34b1b6b1ab2b2c10Aa","unstructured":"Chen, T., Wang, H., & Wang, X. (2020). Detecting Funding Topics Evolutions with Visualization (in Chinese). Data Analysis and Knowledge Discovery, 4(2\/3)."},{"key":"2026020215094040379_j_jdis-2021-0006_ref_011_w2aab3b7c34b1b6b1ab2b2c11Aa","doi-asserted-by":"crossref","unstructured":"van Eck, N.J., & Waltman, L. (2010). Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics, 84(2), 523\u2013538.","DOI":"10.1007\/s11192-009-0146-3"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_012_w2aab3b7c34b1b6b1ab2b2c12Aa","doi-asserted-by":"crossref","unstructured":"van Eck, N.J., Waltman, L., Noyons, E.C.M., & Buter, R.K. (2010). Automatic term identification for bibliometric mapping. Scientometrics, 82(3), 581\u2013596.","DOI":"10.1007\/s11192-010-0173-0"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_013_w2aab3b7c34b1b6b1ab2b2c13Aa","doi-asserted-by":"crossref","unstructured":"Gibson, H., Faith, J., & Vickers, P. (2013). A survey of two-dimensional graph layout techniques for information visualisation. Information Visualization, 12(3\u20134), 324\u2013357.","DOI":"10.1177\/1473871612455749"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_014_w2aab3b7c34b1b6b1ab2b2c14Aa","doi-asserted-by":"crossref","unstructured":"Grover, A., & Leskovec, J. (2016). Node2Vec: Scalable feature learning for networks. In Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining, ACM, pp 855\u2013864.","DOI":"10.1145\/2939672.2939754"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_015_w2aab3b7c34b1b6b1ab2b2c15Aa","doi-asserted-by":"crossref","unstructured":"Katsurai, M., & Ono, S. (2019). TrendNets: Mapping emerging research trends from dynamic co-word networks via sparse representation. Scientometrics, 121(3), 1583\u20131598.","DOI":"10.1007\/s11192-019-03241-6"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_016_w2aab3b7c34b1b6b1ab2b2c16Aa","unstructured":"Kruskal, J.B. (1977). Multidimensional scaling and other methods for discovery structure. In: Enslein, K., Ralston, A., & Wilf, H. (eds) Statistical methods for digital computers, Wiley."},{"key":"2026020215094040379_j_jdis-2021-0006_ref_017_w2aab3b7c34b1b6b1ab2b2c17Aa","doi-asserted-by":"crossref","unstructured":"Kullback, S., & Leibler, R.A. (1951). On Information and Sufficiency. The Annals of Mathematical Statistics, 22(1), 79\u201386. doi: 10.1214\/aoms\/1177729694","DOI":"10.1214\/aoms\/1177729694"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_018_w2aab3b7c34b1b6b1ab2b2c18Aa","unstructured":"Le, Q., & Mikolov, T. (2014). Distributed representations of sentences and documents. In Proceedings of the 31st International Conference on Machine Learning, pp 1188\u20131196."},{"key":"2026020215094040379_j_jdis-2021-0006_ref_019_w2aab3b7c34b1b6b1ab2b2c19Aa","doi-asserted-by":"crossref","unstructured":"Li, P., Yang, G.L., & Wang, C.Q. (2019). Visual topical analysis of library and information science. Scientometrics, 121, 1753\u20131791.","DOI":"10.1007\/s11192-019-03239-0"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_020_w2aab3b7c34b1b6b1ab2b2c20Aa","doi-asserted-by":"crossref","unstructured":"Li, W.T., Cerise, J.E., Yang, Y.N., & Han, H. (2017). Application of t-SNE to human genetic data. Journal of Bioinformatics and Computational Biology, 15(4), 1750017\u20131750017.","DOI":"10.1142\/S0219720017500172"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_021_w2aab3b7c34b1b6b1ab2b2c21Aa","doi-asserted-by":"crossref","unstructured":"Liu, S., Bremer, P.T., Thiagarajan, J.J., Srikumar, V., Wang, B., Livnat, Y., & Pascucci, V. (2018). Visual Exploration of Semantic Relationships in Neural Word Embeddings. IEEE Transactions on Visualization and Computer Graphics, 24(1), 553\u2013562.","DOI":"10.1109\/TVCG.2017.2745141"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_022_w2aab3b7c34b1b6b1ab2b2c22Aa","doi-asserted-by":"crossref","unstructured":"Liu, Z. (1992). Visualizing the intellectual structure in urban studies: A journal co-citation analysis. Scientometrics, 62(3), 385\u2013402.","DOI":"10.1007\/s11192-005-0029-1"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_023_w2aab3b7c34b1b6b1ab2b2c23Aa","unstructured":"Maaten, L.V.D., & Hinton, G. (2008). Visualizing data using t-SNE. Journal of Machine Learning Research, 9, 2579\u20132605."},{"key":"2026020215094040379_j_jdis-2021-0006_ref_024_w2aab3b7c34b1b6b1ab2b2c24Aa","doi-asserted-by":"crossref","unstructured":"Martin, S., Brown, W.M., Klavans, R., & Boyack, K.W. (2011). OpenOrd: An open-source toolbox for large graph layout. International Society for Optics and Photonics, 7868, 786806\u2013786806.","DOI":"10.1117\/12.871402"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_025_w2aab3b7c34b1b6b1ab2b2c25Aa","doi-asserted-by":"crossref","unstructured":"Perozzi, B., Al-Rfou, R., & Skiena, S. (2014). Deepwalk: Online learning of social representations. In: Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, ACM, pp 701\u2013710.","DOI":"10.1145\/2623330.2623732"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_026_w2aab3b7c34b1b6b1ab2b2c26Aa","doi-asserted-by":"crossref","unstructured":"Pezzotti, N., Lelieveldt, B.P.F., van der Maaten, L., Hollt, T., Eisemann, E., & Vilanova, A. (2017). Approximated and User Steerable tSNE for Progressive Visual Analytics. IEEE Transactions on Visualization and Computer Graphics, 23(7), 1739\u20131752.","DOI":"10.1109\/TVCG.2016.2570755"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_027_w2aab3b7c34b1b6b1ab2b2c27Aa","doi-asserted-by":"crossref","unstructured":"Shen, Z.S., Chen, F.Y., Yang, L.Y., & Wu, J.S. (2019). Node2vec representation for clustering journals and as a possible measure of diversity. Journal of Data and Information Science, 4(2), 79\u201392.","DOI":"10.2478\/jdis-2019-0010"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_028_w2aab3b7c34b1b6b1ab2b2c28Aa","doi-asserted-by":"crossref","unstructured":"Small, H. (1999). Visualizing science by citation mapping. Journal of the American Society for Information Science, 50(9), 799\u2013813.","DOI":"10.1002\/(SICI)1097-4571(1999)50:9<799::AID-ASI9>3.0.CO;2-G"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_029_w2aab3b7c34b1b6b1ab2b2c29Aa","doi-asserted-by":"crossref","unstructured":"Small, H., & Griffith, B.C. (1974). The Structure of Scientific Literatures I: Identifying and Graphing Specialties. Science Studies, 4(1), 17\u201340.","DOI":"10.1177\/030631277400400102"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_030_w2aab3b7c34b1b6b1ab2b2c30Aa","doi-asserted-by":"crossref","unstructured":"Tang, J., Qu, M., Wang, M., Zhang, M., Yan, J., & Mei, Q. (2015). Line: Large-scale information network embedding. In: Proceedings of the 24th international conference on world wide web, WWW, pp 1067\u20131077.","DOI":"10.1145\/2736277.2741093"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_031_w2aab3b7c34b1b6b1ab2b2c31Aa","unstructured":"Wang, X., Han, T., Li, G., Chen, T., & Zhang, X. (2017). Mapping science structure 2017 (in Chinese). Science Press China."},{"key":"2026020215094040379_j_jdis-2021-0006_ref_032_w2aab3b7c34b1b6b1ab2b2c32Aa","doi-asserted-by":"crossref","unstructured":"White, H.D. (2003). Pathfinder networks and author co-citation analysis: A remapping of paradigmatic information scientists. Journal of the American Society for Information Science, 54(5), 423\u2013434.","DOI":"10.1002\/asi.10228"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_033_w2aab3b7c34b1b6b1ab2b2c33Aa","doi-asserted-by":"crossref","unstructured":"Zhai, T., & Di, L.Z. (2019). Information mining and visualization of highly cited papers on type-2 diabetes mellitus from ESI. CURRENT SCIENCE, 116(12), 1965.","DOI":"10.18520\/cs\/v116\/i12\/1965-1974"},{"key":"2026020215094040379_j_jdis-2021-0006_ref_034_w2aab3b7c34b1b6b1ab2b2c34Aa","doi-asserted-by":"crossref","unstructured":"Zhou, Q., & Leydesdorff, L. (2016). The normalization of occurrence and Co-occurrence matrices in bibliometrics using Cosinesimilarities and Ochiaicoefficients. Journal of the Association for Information Science and Technology, 67(11), 2805\u20132814. doi: 10.1002\/asi.23603","DOI":"10.1002\/asi.23603"}],"container-title":["Journal of Data and Information Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/content.sciendo.com\/view\/journals\/jdis\/ahead-of-print\/article-10.2478-jdis-2021-0006\/article-10.2478-jdis-2021-0006.xml","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyterbrill.com\/document\/doi\/10.2478\/jdis-2021-0006\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyterbrill.com\/document\/doi\/10.2478\/jdis-2021-0006\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,2]],"date-time":"2026-02-02T15:09:51Z","timestamp":1770044991000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.degruyterbrill.com\/document\/doi\/10.2478\/jdis-2021-0006\/html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,8]]},"references-count":34,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,12,8]]},"published-print":{"date-parts":[[2021,2,1]]}},"alternative-id":["10.2478\/jdis-2021-0006"],"URL":"https:\/\/doi.org\/10.2478\/jdis-2021-0006","relation":{},"ISSN":["2543-683X"],"issn-type":[{"value":"2543-683X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,8]]}}}