{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,27]],"date-time":"2026-05-27T19:57:29Z","timestamp":1779911849288,"version":"3.53.1"},"reference-count":26,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2020,8,12]],"date-time":"2020-08-12T00:00:00Z","timestamp":1597190400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>Open-source software (OSS) is a key aspect of software creation. However, little is known about programmers\u2019 decisions to trust software from OSS websites. The current study emulated OSS websites and manipulated reputation and performance factors in the stimuli according to the heuristic-systematic processing model. We sampled professional programmers\u2014with a minimum experience of three years\u2014from Amazon Mechanical Turk (N = 38). We used a 3 \u00d7 3 within-subjects design to investigate the relationship between OSS reputation and performance on users\u2019 time spent on code, the number of interface clicks, trustworthiness perceptions, and willingness to use OSS code. We found that participants spent more time on and clicked the interface more often for code that was high in reputation. Meta-information included with OSS tools was found to affect the degree to which computer programmers interact with and perceive online code repositories. Furthermore, participants reported higher levels of perceived trustworthiness in and trust toward highly reputable OSS code. Notably, we observed fewer significant main effects for the performance manipulation, which may correspond to participants considering performance attributes mainly within the context of reputation-relevant information. That is, the degree to which programmers investigate and then trust OSS code may depend on the initial reputation ratings.<\/jats:p>","DOI":"10.3390\/systems8030028","type":"journal-article","created":{"date-parts":[[2020,8,13]],"date-time":"2020-08-13T02:58:02Z","timestamp":1597287482000},"page":"28","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Trust Perceptions of Metadata in Open-Source Software: The Role of Performance and Reputation"],"prefix":"10.3390","volume":"8","author":[{"given":"Gene M.","family":"Alarcon","sequence":"first","affiliation":[{"name":"Air Force Research Laboratory, Wright Patterson AFB, OH 45433, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anthony M.","family":"Gibson","sequence":"additional","affiliation":[{"name":"Consortium of Universities, Washington, DC 20036, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Charles","family":"Walter","sequence":"additional","affiliation":[{"name":"Computer &amp; Information Science, University of Mississippi, Oxford, MS 38677, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rose F.","family":"Gamble","sequence":"additional","affiliation":[{"name":"College of Engineering &amp; Natural Sciences, University of Tulsa, Tulsa, OK 74101, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tyler J.","family":"Ryan","sequence":"additional","affiliation":[{"name":"Department of Psychology, Wright State University, Dayton, OH 45433, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah A.","family":"Jessup","sequence":"additional","affiliation":[{"name":"Air Force Research Laboratory, Wright Patterson AFB, OH 45433, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian E.","family":"Boyd","sequence":"additional","affiliation":[{"name":"College of Engineering &amp; Natural Sciences, University of Tulsa, Tulsa, OK 74101, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"August","family":"Capiola","sequence":"additional","affiliation":[{"name":"Air Force Research Laboratory, Wright Patterson AFB, OH 45433, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,8,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1389640","DOI":"10.1080\/23311908.2017.1389640","article-title":"Application of the heuristic-systematic model to computer code trustworthiness: The influence of reputation and transparency","volume":"4","author":"Alarcon","year":"2017","journal-title":"Cogent Psychol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1177\/1555343416657236","article-title":"A descriptive model of computer code trustworthiness","volume":"11","author":"Alarcon","year":"2017","journal-title":"J. Cogn. Eng. Decis. Mak."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Li, J., Conradi, R., Slyngstad, O.P.N., Bunse, C., Torchiano, M., and Morisio, M. (2006, January 20\u201328). An empirical study on decision making in off-the-shelf component-based development. Proceedings of the 28th International Conference on Software Engineering, Shanghai, China.","DOI":"10.1145\/1134285.1134446"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Weber, S., and Luo, J. (2014, January 14). What makes an open source code popular on github?. Proceedings of the 2014 IEEE International Conference on Data Mining Workshop, Shenzhen, China.","DOI":"10.1109\/ICDMW.2014.55"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"709","DOI":"10.2307\/258792","article-title":"An integrative model of organizational trust","volume":"20","author":"Mayer","year":"1995","journal-title":"Acad. Manag. Rev."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1518\/hfes.46.1.50.30392","article-title":"Trust in automation: Designing for appropriate reliance","volume":"46","author":"Lee","year":"2004","journal-title":"Hum. Factors"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Oleson, K.E., Billings, D.R., Kocsis, V., Chen, J.Y.C., and Hancock, P.A. (2011, January 22\u201324). Antecedents of trust in human-robot collaborations. Proceedings of the 2011 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support, Miami, FL, USA.","DOI":"10.1109\/COGSIMA.2011.5753439"},{"key":"ref_8","first-page":"9","article-title":"Trust-based analysis of an Air Force collision avoidance system","volume":"24","author":"Lyons","year":"2016","journal-title":"Ergon. Des."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1177\/0018720814547570","article-title":"Trust in automation: Integrating empirical evidence on factors that influence trust","volume":"57","author":"Hoff","year":"2015","journal-title":"Hum. Factors"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1109\/TSE.2005.85","article-title":"Software reuse research: Status and future","volume":"31","author":"Frakes","year":"2005","journal-title":"IEEE Trans. Softw. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1109\/MC.2006.142","article-title":"Toward trustworthy software systems","volume":"39","author":"Hasselbring","year":"2006","journal-title":"Computer"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Alarcon, G., and Ryan, T. (2018, January 3\u20136). Trustworthiness perceptions of computer code: A heuristic-systematic processing model. Proceedings of the 51st Hawaii International Conference on System Sciences, Hilton Waikoloa Village, HI, USA.","DOI":"10.24251\/HICSS.2018.671"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"752","DOI":"10.1037\/0022-3514.39.5.752","article-title":"Heuristic versus systematic information processing and the use of source versus message cues in persuasion","volume":"39","author":"Chaiken","year":"1980","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1207\/s15327965pli1001_6","article-title":"Motivated heuristic and systematic processing","volume":"10","author":"Chen","year":"1999","journal-title":"Psychol. Inq."},{"key":"ref_15","unstructured":"Kahneman, D. (2011). Thinking, Fast and Slow, Macmillan."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1016\/j.apergo.2018.02.027","article-title":"The influence of commenting validity, placement, and style on perceptions of computer code trustworthiness: A heuristic-systematic processing approach","volume":"70","author":"Alarcon","year":"2018","journal-title":"Appl. Ergon."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1002\/spip.361","article-title":"An empirical study on software development with open source components in the Chinese software industry","volume":"13","author":"Chen","year":"2008","journal-title":"Softw. Process Improv. Pract."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Gallardo-Valencia, R.E., Tantikul, P., and Sim, S.E. (2010, January 13\u201316). Searching for reputable source code on the web. Proceedings of the 16th ACM International Conference on Supporting Group Work, Sanibel Island, FL, USA.","DOI":"10.1145\/1880071.1880102"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2063239.2063243","article-title":"How well do internet code search engines support open source reuse strategies","volume":"21","author":"Sim","year":"2009","journal-title":"ACM Trans. Softw. Eng. Methodol."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ryan, T.J., Walter, C., Alarcon, G.M., Gamble, R.F., Jessup, S.A., and Capiola, A.A. (2018, January 15\u201320). Individual differences in trust in code: The moderating effects of personality on the trustworthiness-trust relationship. Proceedings of the International Conference on Human-Computer Interaction, Las Vegas, NV, USA.","DOI":"10.1007\/978-3-319-92270-6_53"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Walter, C., Gamble, R., Alarcon, G., Jessup, S., and Calhoun, C. (2017, January 4\u20137). Developing a mechanism to study code trustworthiness. Proceedings of the 50th Hawaii International Conference on System Sciences, Hilton Waikoloa Village, HI, USA.","DOI":"10.24251\/HICSS.2017.701"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Lingzi, X., and Zhi, L. (2015, January 3\u20134). An Overview of Source Code Audit. Proceedings of the 2015 International Conference on Industrial Informatics-Computing Technology, Intelligent Technology, Industrial Information Integration, Wuhan, China.","DOI":"10.1109\/ICIICII.2015.94"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1037\/0021-9010.82.2.247","article-title":"Overall job satisfaction: How good are single-item measures?","volume":"82","author":"Wanous","year":"1997","journal-title":"J. Appl. Psychol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"175","DOI":"10.3758\/BF03193146","article-title":"G* Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences","volume":"39","author":"Faul","year":"2007","journal-title":"Behav. Res. Methods"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1037\/apl0000041","article-title":"Diagnosing the locus of trust: A temporal perspective for trustor, trustee, and dyadic influences on perceived trustworthiness","volume":"101","author":"Jones","year":"2016","journal-title":"J. Appl. Psychol."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Ryan, T.J., Walter, C., Alarcon, G.M., Gamble, R., and Jessup, S.A. (2019, January 7\u201311). The influence of personality on code reuse. Proceedings of the 52nd Hawaii International Conference on Systems Sciences, Maui, HI, USA.","DOI":"10.24251\/HICSS.2019.700"}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/8\/3\/28\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:59:50Z","timestamp":1760176790000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/8\/3\/28"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,12]]},"references-count":26,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["systems8030028"],"URL":"https:\/\/doi.org\/10.3390\/systems8030028","relation":{},"ISSN":["2079-8954"],"issn-type":[{"value":"2079-8954","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,12]]}}}