{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T10:36:05Z","timestamp":1779100565193,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":65,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,5,6]],"date-time":"2021-05-06T00:00:00Z","timestamp":1620259200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,5,6]]},"DOI":"10.1145\/3411764.3445650","type":"proceedings-article","created":{"date-parts":[[2021,5,8]],"date-time":"2021-05-08T02:33:36Z","timestamp":1620441216000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["Trust in Collaborative Automation in High Stakes Software Engineering Work: A Case Study at NASA"],"prefix":"10.1145","author":[{"given":"David Gray","family":"Widder","sequence":"first","affiliation":[{"name":"Carnegie Mellon University, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Laura","family":"Dabbish","sequence":"additional","affiliation":[{"name":"Human-Computer Interaction Institute Carnegie Mellon University, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James D.","family":"Herbsleb","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexandra","family":"Holloway","sequence":"additional","affiliation":[{"name":"Jet Propulsion Laboratory, California Institute of Technology, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Scott","family":"Davidoff","sequence":"additional","affiliation":[{"name":"Jet Propulsion Laboratory, California Institute of Technology, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,5,7]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2160881.2160897"},{"key":"e_1_3_2_1_2_1","volume-title":"Doing focus groups","author":"Barbour Rosaline","unstructured":"Rosaline Barbour . 2008. Doing focus groups . Sage . Rosaline Barbour. 2008. Doing focus groups. Sage."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173951"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2013.6698918"},{"key":"e_1_3_2_1_5_1","unstructured":"Virginia Braun and Victoria Clarke. 2012. Thematic analysis.(2012).  Virginia Braun and Victoria Clarke. 2012. Thematic analysis.(2012)."},{"key":"e_1_3_2_1_6_1","volume-title":"Automatic code generation from design patterns. IBM systems Journal 35, 2","author":"Budinsky J.","year":"1996","unstructured":"Frank\u00a0 J. Budinsky , Marilyn\u00a0 A. Finnie , John\u00a0 M. Vlissides , and Patsy\u00a0 S. Yu. 1996. Automatic code generation from design patterns. IBM systems Journal 35, 2 ( 1996 ), 151\u2013171. Frank\u00a0J. Budinsky, Marilyn\u00a0A. Finnie, John\u00a0M. Vlissides, and Patsy\u00a0S. Yu. 1996. Automatic code generation from design patterns. IBM systems Journal 35, 2 (1996), 151\u2013171."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11115-012-0216-5"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2970276.2970347"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1186\/cc10360"},{"key":"e_1_3_2_1_10_1","volume-title":"Influence: The psychology of persuasion.","author":"Cialdini B","year":"1993","unstructured":"Robert\u00a0 B Cialdini . 1993 . Influence: The psychology of persuasion. (1993). Robert\u00a0B Cialdini. 1993. Influence: The psychology of persuasion. (1993)."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/52.536462"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2019.00091"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2011.93"},{"key":"e_1_3_2_1_14_1","unstructured":"Munjal Desai Kristen Stubbs Aaron Steinfeld and Holly Yanco. 2009. Creating trustworthy robots: Lessons and inspirations from automated systems. (2009).  Munjal Desai Kristen Stubbs Aaron Steinfeld and Holly Yanco. 2009. Creating trustworthy robots: Lessons and inspirations from automated systems. (2009)."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884812"},{"key":"e_1_3_2_1_16_1","unstructured":"Paul\u00a0M Duvall Steve Matyas and Andrew Glover. 2007. Continuous integration: improving software quality and reducing risk. Pearson Education.  Paul\u00a0M Duvall Steve Matyas and Andrew Glover. 2007. Continuous integration: improving software quality and reducing risk. Pearson Education."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1071-5819(03)00038-7"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174006"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300724"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1518\/001872008X375018"},{"key":"e_1_3_2_1_21_1","volume-title":"A meta-analysis of factors affecting trust in human-robot interaction. Human factors 53, 5","author":"Hancock A","year":"2011","unstructured":"Peter\u00a0 A Hancock , Deborah\u00a0 R Billings , Kristin\u00a0 E Schaefer , Jessie\u00a0 YC Chen , Ewart\u00a0 J De\u00a0Visser , and Raja Parasuraman . 2011. A meta-analysis of factors affecting trust in human-robot interaction. Human factors 53, 5 ( 2011 ), 517\u2013527. Peter\u00a0A Hancock, Deborah\u00a0R Billings, Kristin\u00a0E Schaefer, Jessie\u00a0YC Chen, Ewart\u00a0J De\u00a0Visser, and Raja Parasuraman. 2011. A meta-analysis of factors affecting trust in human-robot interaction. Human factors 53, 5 (2011), 517\u2013527."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/4284.4286"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1177\/0018720814547570"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300830"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5555\/1318471.1318541"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2013.6606613"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858402"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985712"},{"key":"e_1_3_2_1_29_1","volume-title":"Survey methods: Questionnaires and interviews. Choosing Human-Computer Interaction (HCI) Appropriate Research Methods","author":"Kuter Ugur","year":"2001","unstructured":"Ugur Kuter and Cemal Yilmaz . 2001. Survey methods: Questionnaires and interviews. Choosing Human-Computer Interaction (HCI) Appropriate Research Methods ( 2001 ). Ugur Kuter and Cemal Yilmaz. 2001. Survey methods: Questionnaires and interviews. Choosing Human-Computer Interaction (HCI) Appropriate Research Methods (2001)."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v13i01.3232"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2011.104"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1518\/hfes.46.1.50.30392"},{"key":"e_1_3_2_1_33_1","volume-title":"The highways and country roads to continuous deployment. Ieee software 32, 2","author":"Lepp\u00e4nen Marko","year":"2015","unstructured":"Marko Lepp\u00e4nen , Simo M\u00e4kinen , Max Pagels , Veli-Pekka Eloranta , Juha Itkonen , Mika\u00a0 V M\u00e4ntyl\u00e4 , and Tomi M\u00e4nnist\u00f6 . 2015. The highways and country roads to continuous deployment. Ieee software 32, 2 ( 2015 ), 64\u201372. Marko Lepp\u00e4nen, Simo M\u00e4kinen, Max Pagels, Veli-Pekka Eloranta, Juha Itkonen, Mika\u00a0V M\u00e4ntyl\u00e4, and Tomi M\u00e4nnist\u00f6. 2015. The highways and country roads to continuous deployment. Ieee software 32, 2 (2015), 64\u201372."},{"key":"e_1_3_2_1_34_1","volume-title":"Paradigmatic controversies, contradictions, and emerging confluences, revisited","author":"Lincoln S","year":"2011","unstructured":"Yvonna\u00a0 S Lincoln , Susan\u00a0 A Lynham , and Egon\u00a0 G Guba . 2011. Paradigmatic controversies, contradictions, and emerging confluences, revisited . The Sage handbook of qualitative research 4 ( 2011 ), 97\u2013128. Yvonna\u00a0S Lincoln, Susan\u00a0A Lynham, and Egon\u00a0G Guba. 2011. Paradigmatic controversies, contradictions, and emerging confluences, revisited. The Sage handbook of qualitative research 4 (2011), 97\u2013128."},{"key":"e_1_3_2_1_35_1","unstructured":"Howard Lune and Bruce\u00a0L Berg. 2017. Qualitative research methods for the social sciences. Pearson.  Howard Lune and Bruce\u00a0L Berg. 2017. Qualitative research methods for the social sciences. Pearson."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1518\/001872007X230154"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1808920.1808934"},{"key":"e_1_3_2_1_38_1","volume-title":"How Do Users Discover New Tools in Software Development and Beyond?Computer Supported Cooperative Work (CSCW) 24, 5","author":"Murphy-Hill Emerson","year":"2015","unstructured":"Emerson Murphy-Hill , Gail\u00a0 C Murphy , Joanna McGrenere , 2015. How Do Users Discover New Tools in Software Development and Beyond?Computer Supported Cooperative Work (CSCW) 24, 5 ( 2015 ), 389\u2013422. Emerson Murphy-Hill, Gail\u00a0C Murphy, Joanna McGrenere, 2015. How Do Users Discover New Tools in Software Development and Beyond?Computer Supported Cooperative Work (CSCW) 24, 5 (2015), 389\u2013422."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2011.41"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2016.200"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-07227-2_45"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/ESEM.2009.5314231"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/975817.975844"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327108ijap0301_1"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173677"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2007.09.002"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"crossref","unstructured":"Karlene\u00a0H Roberts and Gina Gargano. 1989. Managing a high reliability organization: A case for interdependence. Managing complexity in high technology industries: Systems and people. New\u00a0\u2026.  Karlene\u00a0H Roberts and Gina Gargano. 1989. Managing a high reliability organization: A case for interdependence. Managing complexity in high technology industries: Systems and people. New\u00a0\u2026.","DOI":"10.1093\/oso\/9780195057201.003.0008"},{"key":"e_1_3_2_1_48_1","first-page":"76","article-title":"The self-designing high-reliability organization: Aircraft carrier flight operations at sea","volume":"40","author":"Rochlin I","year":"1987","unstructured":"Gene\u00a0 I Rochlin , Todd\u00a0 R La\u00a0Porte , and Karlene\u00a0 H Roberts . 1987 . The self-designing high-reliability organization: Aircraft carrier flight operations at sea . Naval War College Review 40 , 4 (1987), 76 \u2013 92 . Gene\u00a0I Rochlin, Todd\u00a0R La\u00a0Porte, and Karlene\u00a0H Roberts. 1987. The self-designing high-reliability organization: Aircraft carrier flight operations at sea. Naval War College Review 40, 4 (1987), 76\u201392.","journal-title":"Naval War College Review"},{"key":"e_1_3_2_1_49_1","volume-title":"Procedural Generation, and Creativity.","author":"Seidel Stefan","year":"2019","unstructured":"Stefan Seidel , Nicholas Berente , and John Gibbs . 2019. Designing with Autonomous Tools: Video Games , Procedural Generation, and Creativity. ( 2019 ). Stefan Seidel, Nicholas Berente, and John Gibbs. 2019. Designing with Autonomous Tools: Video Games, Procedural Generation, and Creativity. (2019)."},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3210753"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2018.3971341"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2519887"},{"key":"e_1_3_2_1_53_1","volume-title":"Participant observation","author":"Spradley P","unstructured":"James\u00a0 P Spradley . 2016. Participant observation . Waveland Press . James\u00a0P Spradley. 2016. Participant observation. Waveland Press."},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/CTS.2010.5478512"},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174014"},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1037\/e578902012-077"},{"key":"e_1_3_2_1_58_1","volume-title":"Basic content analysis. Number\u00a049","author":"Weber Robert\u00a0Philip","unstructured":"Robert\u00a0Philip Weber . 1990. Basic content analysis. Number\u00a049 . Sage . Robert\u00a0Philip Weber. 1990. Basic content analysis. Number\u00a049. Sage."},{"key":"e_1_3_2_1_59_1","volume-title":"Usability of Development Tools: A CASE-Study. In 2019 ACM\/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C). IEEE, 228\u2013235","author":"Weber Thomas","year":"2019","unstructured":"Thomas Weber , Alois Zoitl , and Heinrich Hu\u00dfmann . 2019 . Usability of Development Tools: A CASE-Study. In 2019 ACM\/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C). IEEE, 228\u2013235 . Thomas Weber, Alois Zoitl, and Heinrich Hu\u00dfmann. 2019. Usability of Development Tools: A CASE-Study. In 2019 ACM\/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C). IEEE, 228\u2013235."},{"key":"e_1_3_2_1_60_1","volume-title":"Organizational culture as a source of high reliability. California management review 29, 2","author":"Weick E","year":"1987","unstructured":"Karl\u00a0 E Weick . 1987. Organizational culture as a source of high reliability. California management review 29, 2 ( 1987 ), 112\u2013127. Karl\u00a0E Weick. 1987. Organizational culture as a source of high reliability. California management review 29, 2 (1987), 112\u2013127."},{"key":"e_1_3_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.3316\/QRJ0901018"},{"key":"e_1_3_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3338906.3338922"},{"key":"e_1_3_2_1_63_1","volume-title":"Foundations of qualitative research: Interpretive and critical approaches","author":"Willis W","unstructured":"Jerry\u00a0 W Willis , Muktha Jost , and Rema Nilakanta . 2007. Foundations of qualitative research: Interpretive and critical approaches . Sage . Jerry\u00a0W Willis, Muktha Jost, and Rema Nilakanta. 2007. Foundations of qualitative research: Interpretive and critical approaches. Sage."},{"key":"e_1_3_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531722"},{"key":"e_1_3_2_1_65_1","volume-title":"Case study research and applications: Design and methods","author":"Yin K","unstructured":"Robert\u00a0 K Yin . 2017. Case study research and applications: Design and methods . Sage publications. Robert\u00a0K Yin. 2017. Case study research and applications: Design and methods. Sage publications."},{"key":"e_1_3_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1177\/0018720811406725"}],"event":{"name":"CHI '21: CHI Conference on Human Factors in Computing Systems","location":"Yokohama Japan","acronym":"CHI '21","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411764.3445650","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3411764.3445650","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:28:38Z","timestamp":1750195718000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411764.3445650"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,6]]},"references-count":65,"alternative-id":["10.1145\/3411764.3445650","10.1145\/3411764"],"URL":"https:\/\/doi.org\/10.1145\/3411764.3445650","relation":{},"subject":[],"published":{"date-parts":[[2021,5,6]]},"assertion":[{"value":"2021-05-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}