{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T18:21:17Z","timestamp":1780424477603,"version":"3.54.1"},"reference-count":33,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2018,4,26]],"date-time":"2018-04-26T00:00:00Z","timestamp":1524700800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/publicdomain\/zero\/1.0\/"}],"funder":[{"name":"Mozilla Science Lab"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Publications"],"abstract":"<jats:p>Scholarly research faces threats to its sustainability on multiple domains (access, incentives, reproducibility, inclusivity). We argue that \u201cafter-the-fact\u201d research papers do not help and actually cause some of these threats because the chronology of the research cycle is lost in a research paper. We propose to give up the academic paper and propose a digitally native \u201cas-you-go\u201d alternative. In this design, modules of research outputs are communicated along the way and are directly linked to each other to form a network of outputs that can facilitate research evaluation. This embeds chronology in the design of scholarly communication and facilitates the recognition of more diverse outputs that go beyond the paper (e.g., code, materials). Moreover, using network analysis to investigate the relations between linked outputs could help align evaluation tools with evaluation questions. We illustrate how such a modular \u201cas-you-go\u201d design of scholarly communication could be structured and how network indicators could be computed to assist in the evaluation process, with specific use cases for funders, universities, and individual researchers.<\/jats:p>","DOI":"10.3390\/publications6020021","type":"journal-article","created":{"date-parts":[[2018,4,26]],"date-time":"2018-04-26T04:17:52Z","timestamp":1524716272000},"page":"21","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["\u201cAs-You-Go\u201d Instead of \u201cAfter-the-Fact\u201d: A Network Approach to Scholarly Communication and Evaluation"],"prefix":"10.3390","volume":"6","author":[{"given":"Chris H. J.","family":"Hartgerink","sequence":"first","affiliation":[{"name":"Mozilla Science Lab, Mountain View, CA, USA"},{"name":"Department of Methodology and Statistics, Tilburg University, 5037 AB Tilburg, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4690-848X","authenticated-orcid":false,"given":"Marino","family":"Van Zelst","sequence":"additional","affiliation":[{"name":"Department of Organization Studies, Tilburg University, 5037 AB Tilburg, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2018,4,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"452","DOI":"10.1038\/533452a","article-title":"1500 scientists lift the lid on reproducibility","volume":"533","author":"Baker","year":"2016","journal-title":"Nature"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Larivi\u00e8re, V., Haustein, S., and Mongeon, P. (2015). The Oligopoly of Academic Publishers in the Digital Era. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0127502"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1002\/aris.1440370105","article-title":"Electronic journals, the Internet, and scholarly communication","volume":"37","author":"Kling","year":"2005","journal-title":"Annu. Rev. Inf. Sci. Technol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1001\/jama.295.1.90","article-title":"The History and Meaning of the Journal Impact Factor","volume":"295","author":"Garfield","year":"2006","journal-title":"JAMA"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1043","DOI":"10.1007\/s11192-016-2034-y","article-title":"Does high impact factor successfully predict future citations? An analysis using Peirce\u2019s measure","volume":"108","author":"Prathap","year":"2016","journal-title":"Scientometrics"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"628","DOI":"10.1002\/(SICI)1097-4571(199210)43:9<628::AID-ASI5>3.0.CO;2-0","article-title":"The skewness of science","volume":"43","author":"Seglen","year":"1992","journal-title":"J. Am. Soc. Inf. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/(SICI)1097-4571(199401)45:1<1::AID-ASI1>3.0.CO;2-Y","article-title":"Causal relationship between article citedness and journal impact","volume":"45","author":"Seglen","year":"1994","journal-title":"J. Am. Soc. Inf. Sci."},{"key":"ref_8","unstructured":"Roosendaal, H.E., and Geurts, P.A.T.M. (1997). Forces and Functions in Scientific Communication: An Analysis of Their Interplay, University of Twente."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Van de Sompel, H., Payette, S., Erickson, J., Lagoze, C., and Warner, S. (2004). Rethinking Scholarly Communication. D-Lib Mag., 10.","DOI":"10.1045\/september2004-vandesompel"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1502","DOI":"10.1126\/science.1255484","article-title":"Publication bias in the social sciences: Unlocking the file drawer","volume":"345","author":"Franco","year":"2014","journal-title":"Science"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1007\/BF01173636","article-title":"Publication prejudices: An experimental study of confirmatory bias in the peer review system","volume":"1","author":"Mahoney","year":"1977","journal-title":"Cognit. Ther. Res."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1108\/EUM0000000007185","article-title":"Modularity: The next form of scientific information presentation?","volume":"54","author":"Kircz","year":"1998","journal-title":"J. Doc."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kuhn, T., Chichester, C., Krauthammer, M., Queralt-Rosinach, N., Verborgh, R., Giannakopoulos, G., Ngonga Ngomo, A.-C., Viglianti, R., and Dumontier, M. (2016). Decentralized provenance-aware publishing with nanopublications. PeerJ Comput. Sci., 2.","DOI":"10.7717\/peerj-cs.78"},{"key":"ref_14","first-page":"51","article-title":"The anatomy of a nanopublication","volume":"30","author":"Groth","year":"2010","journal-title":"Inf. Serv. Use"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1163\/095796511X560006","article-title":"Nanopublications the Future of Coping with Information Overload","volume":"21","author":"Velterop","year":"2010","journal-title":"Logos"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Nielsen, M. (2012). Reinventing Discovery: The New Era of Networked Science, Princeton University Press.","DOI":"10.1515\/9781400839452"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1207\/s15327957pspr0203_4","article-title":"HARKing: Hypothesizing after the Results are Known","volume":"2","author":"Kerr","year":"1998","journal-title":"Personal. Soc. Psychol. Rev."},{"key":"ref_18","unstructured":"Seeber, M., Cattaneo, M., Meoli, M., and Malighetti, P. (2017). Self-citations as strategic response to the use of metrics for career decisions. Res. Policy."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"PLoS Medicine Editors (2006). The Impact Factor Game. PLoS Med., 3.","DOI":"10.1371\/journal.pmed.0030291"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2600","DOI":"10.1073\/pnas.1708274114","article-title":"The preregistration revolution","volume":"115","author":"Nosek","year":"2018","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Ogden, M. (2017). Dat\u2014Distributed Dataset Synchronization and Versioning. OSF Preprints.","DOI":"10.31219\/osf.io\/nsv2c"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1151","DOI":"10.12688\/f1000research.12037.3","article-title":"A multi-disciplinary perspective on emergent and future innovations in peer review","volume":"6","author":"Tennant","year":"2017","journal-title":"F1000Research"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Reich, V., and Rosenthal, D.S.H. (2001). LOCKSS. D-Lib Mag., 7.","DOI":"10.1045\/june2001-reich"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wasserman, S., and Faust, K. (1994). Social Network Analysis: Methods and Applications, Cambridge University Press.","DOI":"10.1017\/CBO9780511815478"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"eaao0185","DOI":"10.1126\/science.aao0185","article-title":"Science of science","volume":"359","author":"Fortunato","year":"2018","journal-title":"Science"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Morel, C.M., Serruya, S.J., Penna, G.O., and Guimar\u00e3es, R. (2009). Co-authorship Network Analysis: A Powerful Tool for Strategic Planning of Research, Development and Capacity Building Programs on Neglected Diseases. PLoS Negl. Trop. Dis., 3.","DOI":"10.1371\/journal.pntd.0000501"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1038\/520429a","article-title":"Bibliometrics: The Leiden Manifesto for research metrics","volume":"520","author":"Hicks","year":"2015","journal-title":"Nature"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wilsdon, J., Allen, L., Belfiore, E., Campbell, P., Curry, S., Hill, S., Jones, R., Kain, R., Kerridge, S., and Thelwall, M. (2015). The Metric Tide: Report of the Independent Review of the Role of Metrics in Research Assessment and Management, HEFCE.","DOI":"10.4135\/9781473978782"},{"key":"ref_29","unstructured":"Kaiser, J. (2017). Are preprints the future of biology? A survival guide for scientists. Science."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1331","DOI":"10.1126\/science.aaq0167","article-title":"Preprint ecosystems","volume":"357","author":"Berg","year":"2017","journal-title":"Science"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Bradley, J.-C. (2007). Open Notebook Science Using Blogs and Wikis. Nat. Preced.","DOI":"10.1038\/npre.2007.39.1"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Klein, M., Van de Sompel, H., Sanderson, R., Shankar, H., Balakireva, L., Zhou, K., and Tobin, R. (2014). Scholarly Context Not Found: One in Five Articles Suffers from Reference Rot. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0115253"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Cavdar, D., and Alagoz, F. (2012, January 3\u20137). A survey of research on greening data centers. Proceedings of the 2012 IEEE Global Communications Conference (Globecom), Anaheim, CA, USA.","DOI":"10.1109\/GLOCOM.2012.6503613"}],"container-title":["Publications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2304-6775\/6\/2\/21\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:02:13Z","timestamp":1760194933000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2304-6775\/6\/2\/21"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,4,26]]},"references-count":33,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2018,6]]}},"alternative-id":["publications6020021"],"URL":"https:\/\/doi.org\/10.3390\/publications6020021","relation":{},"ISSN":["2304-6775"],"issn-type":[{"value":"2304-6775","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,4,26]]}}}