{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T15:28:08Z","timestamp":1776094088063,"version":"3.50.1"},"reference-count":45,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2018,3,9]],"date-time":"2018-03-09T00:00:00Z","timestamp":1520553600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Baidu gift"},{"name":"NIH","award":["R01LM011986"],"award-info":[{"award-number":["R01LM011986"]}]},{"name":"ARO","award":["W911NF-16-1-0168"],"award-info":[{"award-number":["W911NF-16-1-0168"]}]},{"DOI":"10.13039\/100000774","name":"DTRA","doi-asserted-by":"crossref","award":["HDTRA1-16-0017"],"award-info":[{"award-number":["HDTRA1-16-0017"]}],"id":[{"id":"10.13039\/100000774","id-type":"DOI","asserted-by":"crossref"}]},{"name":"National 973 Program of China","award":["2014CB340304"],"award-info":[{"award-number":["2014CB340304"]}]},{"name":"RGC GRF","award":["618313"],"award-info":[{"award-number":["618313"]}]},{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["IIS-1651203"],"award-info":[{"award-number":["IIS-1651203"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2018,3,31]]},"abstract":"<jats:p>\n            Research impact plays a critical role in evaluating the research quality and influence of a scholar, a journal, or a conference. Many researchers have attempted to quantify research impact by introducing different types of metrics based on citation data, such as\n            <jats:italic>h<\/jats:italic>\n            -index, citation count, and impact factor. These metrics are widely used in the academic community. However, quantitative metrics are highly aggregated in most cases and sometimes biased, which probably results in the loss of impact details that are important for comprehensively understanding research impact. For example, which research area does a researcher have great research impact on? How does the research impact change over time? How do the collaborators take effect on the research impact of an individual? Simple quantitative metrics can hardly help answer such kind of questions, since more detailed exploration of the citation data is needed. Previous work on visualizing citation data usually only shows limited aspects of research impact and may suffer from other problems including visual clutter and scalability issues. To fill this gap, we propose an interactive visualization tool,\n            <jats:italic>ImpactVis<\/jats:italic>\n            , for better exploration of research impact through citation data. Case studies and in-depth expert interviews are conducted to demonstrate the effectiveness of\n            <jats:italic>ImpactVis<\/jats:italic>\n            .\n          <\/jats:p>","DOI":"10.1145\/3132744","type":"journal-article","created":{"date-parts":[[2018,3,9]],"date-time":"2018-03-09T13:27:48Z","timestamp":1520602068000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":15,"title":["Visualizing Research Impact through Citation Data"],"prefix":"10.1145","volume":"8","author":[{"given":"Yong","family":"Wang","sequence":"first","affiliation":[{"name":"the Hong Kong University of Science and Technology, Hong Kong, China"}]},{"given":"Conglei","family":"Shi","sequence":"additional","affiliation":[{"name":"Airbnb Inc., San Francisco, USA"}]},{"given":"Liangyue","family":"Li","sequence":"additional","affiliation":[{"name":"Arizona State University, Tempe, USA"}]},{"given":"Hanghang","family":"Tong","sequence":"additional","affiliation":[{"name":"Arizona State University, Tempe, USA"}]},{"given":"Huamin","family":"Qu","sequence":"additional","affiliation":[{"name":"the Hong Kong University of Science and Technology, Hong Kong, China"}]}],"member":"320","published-online":{"date-parts":[[2018,3,9]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.4018\/ijswis.2013100102"},{"key":"e_1_2_1_2_1","volume-title":"How to track the impact of research data with metrics. DCC How-to Guides","author":"Ball Alex","year":"2015","unstructured":"Alex Ball and Monica Duke . 2015. How to track the impact of research data with metrics. DCC How-to Guides ( 2015 ). http:\/\/www.dcc.ac.uk\/resources\/how-guides\/track-data-impact-metrics. Alex Ball and Monica Duke. 2015. How to track the impact of research data with metrics. DCC How-to Guides (2015). http:\/\/www.dcc.ac.uk\/resources\/how-guides\/track-data-impact-metrics."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-006-0090-4"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2010.159"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/PACIFICVIS.2015.7156353"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2011.185"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2015.73"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.252"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2016.7883512"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-006-0144-7"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/PACIFICVIS.2008.4475479"},{"key":"e_1_2_1_12_1","volume-title":"Retrieved","author":"China Computer Federation","year":"2005","unstructured":"China Computer Federation . 2005 . A list of computer science conferences and journals recommended by CCF. (2005) . Retrieved Oct. 27, 2016 from http:\/\/history.ccf.org.cn\/sites\/ccf\/paiming.jsp. China Computer Federation. 2005. A list of computer science conferences and journals recommended by CCF. (2005). Retrieved Oct. 27, 2016 from http:\/\/history.ccf.org.cn\/sites\/ccf\/paiming.jsp."},{"key":"e_1_2_1_14_1","volume-title":"Measuring research impact: Not everything that can be counted counts, and not everything that counts can be counted. Bibliometrics. Use and Abuse in the Review of Research Performance","author":"Grimson Jane","year":"2014","unstructured":"Jane Grimson . 2014. Measuring research impact: Not everything that can be counted counts, and not everything that counts can be counted. Bibliometrics. Use and Abuse in the Review of Research Performance ( 2014 ), 29--41. Jane Grimson. 2014. Measuring research impact: Not everything that can be counted counts, and not everything that counts can be counted. Bibliometrics. Use and Abuse in the Review of Research Performance (2014), 29--41."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1054972.1055031"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2467621"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2007.70582"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0507655102"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.joi.2013.09.002"},{"key":"e_1_2_1_20_1","volume-title":"Retrieved","author":"Kyeongan Kwon","year":"2016","unstructured":"Kwon Kyeongan , Majeti Dinesh , Uzzi Brian , and Ioannis Pavlidis . 2016 . Scholar plot. (May 2016) . Retrieved Sept. 12, 2016 from http:\/\/scholarplot.com\/index.html. Kwon Kyeongan, Majeti Dinesh, Uzzi Brian, and Ioannis Pavlidis. 2016. Scholar plot. (May 2016). Retrieved Sept. 12, 2016 from http:\/\/scholarplot.com\/index.html."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1056808.1057069"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.21609"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-45523-4_57"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1038\/msb.2008.55"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1520340.1520360"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.5555\/3058878.3058900"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2212776.2212796"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1093\/reseval\/rvt021"},{"key":"e_1_2_1_29_1","volume-title":"AMIA Annual Symposium Proceedings","volume":"2012","author":"Perer Adam","year":"2012","unstructured":"Adam Perer and Jimeng Sun . 2012 . MatrixFlow: Temporal network visual analytics to track symptom evolution during disease progression . In AMIA Annual Symposium Proceedings , Vol. 2012 . American Medical Informatics Association, 716--725. Adam Perer and Jimeng Sun. 2012. MatrixFlow: Temporal network visual analytics to track symptom evolution during disease progression. In AMIA Annual Symposium Proceedings, Vol. 2012. American Medical Informatics Association, 716--725."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0806977105"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2015.2453957"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.5555\/832277.834354"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2740908.2742839"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1220184110"},{"key":"e_1_2_1_35_1","volume-title":"Citevis: Exploring conference paper citation data visually. Posters of IEEE Information Visualization","author":"Stasko John","year":"2013","unstructured":"John Stasko , Jaegul Choo , Yi Han , Mengdie Hu , Hannah Pileggi , Ramik Sadana , and Charles D. Stolper . 2013 . Citevis: Exploring conference paper citation data visually. Posters of IEEE Information Visualization ( 2013 ). John Stasko, Jaegul Choo, Yi Han, Mengdie Hu, Hannah Pileggi, Ramik Sadana, and Charles D. Stolper. 2013. Citevis: Exploring conference paper citation data visually. Posters of IEEE Information Visualization (2013)."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1402008"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.3152\/147154403781776690"},{"key":"e_1_2_1_38_1","volume-title":"Fellner","author":"Landesberger Tatiana Von","year":"2011","unstructured":"Tatiana Von Landesberger , Arjan Kuijper , Tobias Schreck , J\u00f6rn Kohlhammer , Jarke J. van Wijk , J.-D. Fekete , and Dieter W . Fellner . 2011 . Visual analysis of large graphs: State-of-the-art and future research challenges. In Computer Graphics Forum, Vol. 30 . Wiley Online Library , 1719--1749. Tatiana Von Landesberger, Arjan Kuijper, Tobias Schreck, J\u00f6rn Kohlhammer, Jarke J. van Wijk, J.-D. Fekete, and Dieter W. Fellner. 2011. Visual analysis of large graphs: State-of-the-art and future research challenges. In Computer Graphics Forum, Vol. 30. Wiley Online Library, 1719--1749."},{"key":"e_1_2_1_39_1","volume-title":"Information Visualization: Perception for Design","author":"Ware Colin","year":"2012","unstructured":"Colin Ware . 2012 . Information Visualization: Perception for Design ( 3 rd ed.). Morgan Kaufmann , San Francisco, CA . Colin Ware. 2012. Information Visualization: Perception for Design (3rd ed.). Morgan Kaufmann, San Francisco, CA.","edition":"3"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2492517.2492638"},{"key":"e_1_2_1_41_1","volume-title":"Retrieved","author":"Xie Lexing","year":"2016","unstructured":"Lexing Xie . 2016 . Visualizing citation patterns of computer science conferences. (Aug. 2016) . Retrieved Sept. 16, 2016 from http:\/\/cm.cecs.anu.edu.au\/post\/citation_vis. Lexing Xie. 2016. Visualizing citation patterns of computer science conferences. (Aug. 2016). Retrieved Sept. 16, 2016 from http:\/\/cm.cecs.anu.edu.au\/post\/citation_vis."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/PACIFICVIS.2016.7465248"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/860435.860485"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2013.167"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858488"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702419"}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3132744","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3132744","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3132744","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:10:57Z","timestamp":1750212657000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3132744"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,3,9]]},"references-count":45,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2018,3,31]]}},"alternative-id":["10.1145\/3132744"],"URL":"https:\/\/doi.org\/10.1145\/3132744","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"value":"2160-6455","type":"print"},{"value":"2160-6463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,3,9]]},"assertion":[{"value":"2017-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-03-09","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}