{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T20:22:41Z","timestamp":1772137361428,"version":"3.50.1"},"reference-count":25,"publisher":"Proceedings of the National Academy of Sciences","issue":"51","content-domain":{"domain":["www.pnas.org"],"crossmark-restriction":true},"short-container-title":["Proc. Natl. Acad. Sci. U.S.A."],"published-print":{"date-parts":[[2004,12,21]]},"abstract":"<jats:p>Acknowledgments in research publications, like citations, indicate influential contributions to scientific work. However, acknowledgments are different from citations; whereas citations are formal expressions of debt, acknowledgments are arguably more personal, singular, or private expressions of appreciation and contribution. Furthermore, many sources of research funding expect researchers to acknowledge any support that contributed to the published work. Just as citation indexing proved to be an important tool for evaluating research contributions, we argue that acknowledgments can be considered as a metric parallel to citations in the academic audit process. We have developed automated methods for acknowledgment extraction and analysis and show that combining acknowledgment analysis with citation indexing yields a measurable impact of the efficacy of various individuals as well as government, corporate, and university sponsors of scientific work.<\/jats:p>","DOI":"10.1073\/pnas.0407743101","type":"journal-article","created":{"date-parts":[[2004,12,15]],"date-time":"2004-12-15T20:25:44Z","timestamp":1103142344000},"page":"17599-17604","update-policy":"https:\/\/doi.org\/10.1073\/pnas.cm10313","source":"Crossref","is-referenced-by-count":104,"title":["Who gets acknowledged: Measuring scientific contributions through automatic acknowledgment indexing"],"prefix":"10.1073","volume":"101","author":[{"given":"C. Lee","family":"Giles","sequence":"first","affiliation":[{"name":"School of Information Sciences and Technology, Pennsylvania State University, 311 IST Building, University Park, PA 16802"}]},{"given":"Isaac G.","family":"Councill","sequence":"additional","affiliation":[{"name":"School of Information Sciences and Technology, Pennsylvania State University, 311 IST Building, University Park, PA 16802"}]}],"member":"341","published-online":{"date-parts":[[2004,12,15]]},"reference":[{"key":"e_1_3_2_1_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.144.3619.649"},{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0307852100"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199308)44:7<406::AID-ASI6>3.0.CO;2-8"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.10278"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1177\/016224399101600404"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1177\/007327537901700202"},{"key":"e_1_3_2_7_2","first-page":"404","volume":"55","year":"1999","unstructured":"Cronin, B. & Shaw, D. (1999) J. Doc. 55, 404\u2013408.","journal-title":"J. Doc."},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1192\/bjp.183.4.273"},{"key":"e_1_3_2_9_2","unstructured":"Jeschin D. Lewison G. & Anderson J. (1995) in Proceedings of the 5th Biennial Conference of the International Society for Scientometrics and Informetrics eds. Koenig M. & Bookstein A. (Learned Information Medford NJ) pp. 235\u2013244."},{"key":"e_1_3_2_10_2","unstructured":"Cameron R. D. (1997) First Monday 2 www.firstmonday.org."},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.1123"},{"key":"e_1_3_2_12_2","unstructured":"Giles C. L. Bollacker K. & Lawrence S. (1998) in ACM Conference on Digital Libraries eds. Witten I. Akseyn R. & Shipman F. M. (ACM Press New York) pp. 89\u201398."},{"key":"e_1_3_2_13_2","first-page":"67","volume":"32","year":"1999","unstructured":"Lawrence, S., Giles, C. L. & Bollacker, K. (1999) IEEE Computer 32, 67\u201371.","journal-title":"IEEE Computer"},{"key":"e_1_3_2_14_2","unstructured":"Joachims T. (1998) in Advances in Kernel Methods: Support Vector Machines eds. Sch\u00f6lkopf B. Burges C. & Smola A. (MIT Press Cambridge MA) pp. 169\u2013184."},{"key":"e_1_3_2_15_2","doi-asserted-by":"crossref","unstructured":"Dumais S. Platt J. Heckerman D. & Sahami M. (1998) in Proceedings of the 7th International Conference on Information and Knowledge Management eds. Makki K. & Bourganim L. (ACM Press New York) pp 148\u2013155.","DOI":"10.1145\/288627.288651"},{"key":"e_1_3_2_16_2","unstructured":"Chieu H. L. & Ng H. T. (2002) in Proceedings of the 18th National Conference on Artificial Intelligence eds. Dechter R. Kearns M. & Sutton R. (AAAI Press Menlo Park CA) pp 786\u2013791."},{"key":"e_1_3_2_17_2","unstructured":"Han H. Giles C. L. Manavoglu E. & Zha H. (2003) in Proceedings of the ACM\/IEEE Joint Conference on Digital Libraries eds. Delcambre L. Henry G. & Marshall C. C. (IEEE Computer Soc. Washington DC) pp. 37\u201348."},{"key":"e_1_3_2_18_2","unstructured":"McNamee P. & Mayfield J. (2002) in Proceedings of the 6th Conference on Natural Language Learning eds. Roth D. & van den Bosch A. (Association for Computational Linguistics New Brunswick NJ) pp. 183\u2013186."},{"key":"e_1_3_2_19_2","unstructured":"Kudoh T. & Matsumoto Y. (2000) in Proceedings of the 4th Conference on Natural Language Learning eds. Cardie C. Daelemans W. Nedellec C. & Sang T. K. (Association for Computational Linguistics New Brunswick NJ) pp. 142\u2013144."},{"key":"e_1_3_2_20_2","unstructured":"Takeuchi K. & Collier N. (2002) in Proceedings of the 6th Conference on Natural Language Learning eds. Roth D. & van den Bosch A. (Association for Computational Linguistics New Brunswick NJ) pp. 119\u2013125."},{"key":"e_1_3_2_21_2","unstructured":"Seymore K. McCallum A. & Rosenfeld R. (1999) in Proceedings of the AAAI 99 Workshop on Machine Learning for Information Extraction ed. Califf M. E. (AAAI Press Menlo Park CA) pp 37\u201342."},{"key":"e_1_3_2_22_2","unstructured":"Han H. Giles C. L. Zha H. Li C. & Tsioutsiouliklis K. (2004) in Proceedings of the ACM\/IEEE Joint Conference on Digital Libraries eds. Chen H. Wactlar H. & Chen C.-C. (ACM Press New York) pp. 296\u2013305."},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1108\/EUM0000000007089"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199312)44:10<590::AID-ASI5>3.0.CO;2-U"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1007\/s100510050359"}],"container-title":["Proceedings of the National Academy of Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pnas.org\/doi\/pdf\/10.1073\/pnas.0407743101","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,21]],"date-time":"2024-12-21T06:15:39Z","timestamp":1734761739000},"score":1,"resource":{"primary":{"URL":"https:\/\/pnas.org\/doi\/full\/10.1073\/pnas.0407743101"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2004,12,15]]},"references-count":25,"journal-issue":{"issue":"51","published-print":{"date-parts":[[2004,12,21]]}},"alternative-id":["10.1073\/pnas.0407743101"],"URL":"https:\/\/doi.org\/10.1073\/pnas.0407743101","relation":{"has-review":[{"id-type":"doi","id":"10.3410\/f.1023021.265681","asserted-by":"object"}]},"ISSN":["0027-8424","1091-6490"],"issn-type":[{"value":"0027-8424","type":"print"},{"value":"1091-6490","type":"electronic"}],"subject":[],"published":{"date-parts":[[2004,12,15]]},"assertion":[{"value":"2004-07-07","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2004-12-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}