{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,14]],"date-time":"2026-01-14T16:42:08Z","timestamp":1768408928184,"version":"3.49.0"},"reference-count":60,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","license":[{"start":{"date-parts":[[2021,4,13]],"date-time":"2021-04-13T00:00:00Z","timestamp":1618272000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["IIS-2001851, IIS-2000782, CNS-1952085"],"award-info":[{"award-number":["IIS-2001851, IIS-2000782, CNS-1952085"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2021,4,13]]},"abstract":"<jats:p>Bulk email is a primary communication channel within organizations, with all-company emails and regular newsletters serving as a mechanism for making employees aware of policies and events. Ineffective communication could result in wasted employee time and a lack of compliance or awareness. Previous studies on organizational emails focused mostly on recipients. However, organizational bulk email system is a multi-stakeholder problem including recipients, communicators, and the organization itself.<\/jats:p>\n          <jats:p>We studied the effectiveness, practice, and assessments of the organizational bulk email system of a large university from multi-stakeholders' perspectives. We conducted a qualitative study with the university's communicators, recipients, and managers. We delved into the organizational bulk email's distributing mechanisms of the communicators, the reading behaviors of recipients, and the perspectives on emails' values of communicators, managers, and recipients.<\/jats:p>\n          <jats:p>We found that the organizational bulk email system as a whole was strained, and communicators are caught in the middle of this multi-stakeholder problem. First, though the communicators had an interest in preserving the effectiveness of channels in reaching employees, they had high-level clients whose interests might outweigh judgment about whether a message deserves widespread circulation. Second, though communicators thought they were sending important information, recipients viewed most of the organizational bulk emails as not relevant to them. Third, this disagreement was amplified by the success metric used by communicators. They viewed their bulk emails as successful if they had a high open rate. But recipients often opened and then rapidly discarded emails without reading the details. Last, while the communicators in general understood the challenge, they had a limited set of targeting and feedback tools to support their task.<\/jats:p>","DOI":"10.1145\/3449154","type":"journal-article","created":{"date-parts":[[2021,4,22]],"date-time":"2021-04-22T17:51:09Z","timestamp":1619113869000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Learning to Ignore"],"prefix":"10.1145","volume":"5","author":[{"given":"Ruoyan","family":"Kong","sequence":"first","affiliation":[{"name":"University of Minnesota - Twin Cities, Minneapolis, MN, USA"}]},{"given":"Haiyi","family":"Zhu","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}]},{"given":"Joseph A.","family":"Konstan","sequence":"additional","affiliation":[{"name":"University of Minnesota - Twin Cities, Minneapolis, MN, USA"}]}],"member":"320","published-online":{"date-parts":[[2021,4,22]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"The sixth international conference on digital society (ICDS)","author":"Al-Jarrah Omar","unstructured":"Omar Al-Jarrah, Ismail Khater, and Basheer Al-Duwairi. 2012. Identifying potentially useful email header features for email spam filtering. In The sixth international conference on digital society (ICDS), Vol. 30. 140."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313624"},{"key":"e_1_2_1_3_1","volume-title":"Sandra Waddock","author":"Andriof Jorg","year":"2002","unstructured":"Jorg Andriof, Sandra Sutherland Rahman, Sandra Waddock, and Bryan Husted. 2002. Introduction: JCC theme issue: Stakeholder responsibility. The Journal of Corporate Citizenship (2002), 16--19."},{"key":"e_1_2_1_4_1","volume-title":"2014 IEEE International Conference on Big Data (Big Data). 579--584","author":"Balakrishnan R.","unstructured":"R. Balakrishnan and R. Parekh. 2014. Learning to predict subject-line opens for large-scale email marketing. In 2014 IEEE International Conference on Big Data (Big Data). 579--584."},{"key":"e_1_2_1_5_1","unstructured":"Ron Bekkerman. 2004. Automatic categorization of email into folders: Benchmark experiments on Enron and SRI corpora. (2004)."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327051hci2001&2_4"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2010.07.146"},{"key":"e_1_2_1_8_1","volume-title":"Contextual design. interactions 6, 1","author":"Beyer Hugh","year":"1999","unstructured":"Hugh Beyer and Karen Holtzblatt. 1999. Contextual design. interactions 6, 1 (1999), 32--42."},{"key":"e_1_2_1_9_1","volume-title":"Case studies in organizational research. Qualitative organizational research","author":"Buchanan David A","year":"2012","unstructured":"David A Buchanan. 2012. Case studies in organizational research. Qualitative organizational research (2012), 351--370."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1080\/10810730.2011.551998"},{"key":"e_1_2_1_11_1","first-page":"168","article-title":"The Importance of Corporate Email Service and Google Education Service for Education Institutions (A Case Study of Ronaki Duhok Education Company in Iraq)","volume":"5","author":"Celik B\u00fcnyamin","year":"2018","unstructured":"B\u00fcnyamin Celik and Zeynep \u00d6l\u00e7er. 2018. The Importance of Corporate Email Service and Google Education Service for Education Institutions (A Case Study of Ronaki Duhok Education Company in Iraq). International Journal of Social Sciences & Educational Studies 5, 1 (2018), 168.","journal-title":"International Journal of Social Sciences & Educational Studies"},{"key":"e_1_2_1_12_1","volume-title":"2014 2nd International Conference on Business and Information Management (ICBIM). 47--52","author":"Chakrabarty A.","unstructured":"A. Chakrabarty and S. Roy. 2014. An optimized k-NN classifier based on minimum spanning tree for email filtering. In 2014 2nd International Conference on Business and Information Management (ICBIM). 47--52."},{"key":"e_1_2_1_13_1","volume-title":"Constructing grounded theory","author":"Charmaz Kathy","unstructured":"Kathy Charmaz. 2014. Constructing grounded theory. Sage."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/765891.766073"},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the 2006 20th Anniversary Conference on Computer Supported Cooperative Work (Banff","author":"Laura","year":"1808","unstructured":"Laura A. Dabbish and Robert E. Kraut. 2006. Email Overload at Work: An Analysis of Factors Associated with Email Strain. In Proceedings of the 2006 20th Anniversary Conference on Computer Supported Cooperative Work (Banff, Alberta, Canada) (CSCW '06). Association for Computing Machinery, New York, NY, USA, 431--440. https:\/\/doi.org\/10.1145\/ 1180875.1180941"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1080\/02680513.2018.1556090arXiv:https:"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1086\/497999"},{"key":"e_1_2_1_18_1","unstructured":"David D Dill and Barbara Sporn. 1995. Emerging Patterns of Social Demand and University Reform: Through a Glass Darkly. Issues in Higher Education. ERIC."},{"key":"e_1_2_1_19_1","volume-title":"Assessing organizational communication: Strategic communication audits","author":"Downs Cal W","unstructured":"Cal W Downs and Allyson D Adrian. 2012. Assessing organizational communication: Strategic communication audits. Guilford Press."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1180875.1180922"},{"key":"e_1_2_1_22_1","unstructured":"Alan Gray and Mads Haahr. 2004. Personalised Collaborative Spam Filtering.. In CEAS."},{"key":"e_1_2_1_23_1","doi-asserted-by":"crossref","first-page":"739","DOI":"10.2307\/255650","article-title":"The audit of organizational communication","volume":"17","author":"Greenbaum Howard H","year":"1974","unstructured":"Howard H Greenbaum. 1974. The audit of organizational communication. Academy of Management Journal 17, 4 (1974), 739--754.","journal-title":"Academy of Management Journal"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557013"},{"key":"e_1_2_1_25_1","volume-title":"Understanding organizations","author":"Handy Charles","unstructured":"Charles Handy. 2007. Understanding organizations. Penguin Uk."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.elerap.2008.11.001"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1132469.1132493"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/859670.859673"},{"key":"e_1_2_1_29_1","volume-title":"Communication: the flow of information. Communication theory","author":"Katz Daniel","year":"2008","unstructured":"Daniel Katz and Robert L Kahn. 2008. Communication: the flow of information. Communication theory (2008), 382--389."},{"key":"e_1_2_1_30_1","volume-title":"Social media engagement: What motivates user participation and consumption on YouTube? Computers in human behavior 66","author":"Khan M Laeeq","year":"2017","unstructured":"M Laeeq Khan. 2017. Social media engagement: What motivates user participation and consumption on YouTube? Computers in human behavior 66 (2017), 236--247."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30115-8_22"},{"key":"e_1_2_1_32_1","volume-title":"Process performance measurement system: a tool to support process-based organizations. Total quality management 11, 1","author":"Kueng Peter","year":"2000","unstructured":"Peter Kueng. 2000. Process performance measurement system: a tool to support process-based organizations. Total quality management 11, 1 (2000), 67--85."},{"key":"e_1_2_1_33_1","unstructured":"GD Kuh and EJ Whitt. 2000. Culture in American colleges and universities. Organizational & Governance in Higher Education. MC Brown Ed."},{"key":"e_1_2_1_34_1","volume-title":"Jinjuan Heidi Feng, and Harry Hochheiser","author":"Lazar Jonathan","year":"2017","unstructured":"Jonathan Lazar, Jinjuan Heidi Feng, and Harry Hochheiser. 2017. Research methods in human-computer interaction. Morgan Kaufmann."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2166966.2167000"},{"key":"e_1_2_1_36_1","unstructured":"Eerikki M\u00e4ki Eila J\u00e4rvenp\u00e4\u00e4 Kirsi Ziegler and Kirsi Ziegler. 2004. Communication and knowledge sharing in a decentralized organization. (2004)."},{"key":"e_1_2_1_37_1","volume-title":"Proceedings, Computer Human Interaction, Human Factors in Computing Systems","author":"Malone T","year":"1987","unstructured":"T Malone. 1987. The information lens: An intelligent system for sharing information in organizations. Proceedings, Computer Human Interaction, Human Factors in Computing Systems (1987)."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858262"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1353\/rhe.1985.0026"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.sbspro.2010.04.055"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1177\/2329488414525399"},{"key":"e_1_2_1_42_1","volume-title":"Managing by communication: An organizational approach","author":"Myers Michele Tolela","unstructured":"Michele Tolela Myers and Gail E Myers. 1982. Managing by communication: An organizational approach. McGraw-Hill College."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13012-017-0625-5"},{"key":"e_1_2_1_44_1","article-title":"Communication problems in management","volume":"4","author":"Odine Maurice","year":"2015","unstructured":"Maurice Odine. 2015. Communication problems in management. Journal of Emerging Issues in Economics, Finance, and Banking (JEIEFB) 4, 2 (2015).","journal-title":"Journal of Emerging Issues in Economics, Finance, and Banking (JEIEFB)"},{"key":"e_1_2_1_45_1","article-title":"Checking email in the bathroom: monitoring email responsiveness behavior in the workplace","volume":"16","author":"Paczkowski William F","year":"2016","unstructured":"William F Paczkowski and Jason Kuruzovich. 2016. Checking email in the bathroom: monitoring email responsiveness behavior in the workplace. American Journal of Management 16, 2 (2016).","journal-title":"American Journal of Management"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.orgdyn.2015.05.008"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/227614.227615"},{"key":"e_1_2_1_48_1","volume-title":"A marketplace for attention: Responses to a synthetic currency used to signal information importance in e-mail. First Monday 13, 5","author":"Reeves Byron","year":"2008","unstructured":"Byron Reeves, Simon Roy, Brian Gorman, and Teresa Morley. 2008. A marketplace for attention: Responses to a synthetic currency used to signal information importance in e-mail. First Monday 13, 5 (2008)."},{"key":"e_1_2_1_49_1","volume-title":"Characterizing and Predicting Email Deferral Behavior. In WSDM '19","author":"Sarrafzadeh Bahareh","unstructured":"Bahareh Sarrafzadeh, Ahmed Hassan Awadallah, Christopher H. Lin, Chia-Jung Lee, Milad Shokouhi, and Susan T. Dumais. 2019. Characterizing and Predicting Email Deferral Behavior. In WSDM '19."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/0030-"},{"key":"e_1_2_1_51_1","unstructured":"Michael P Shriberg et al. 2002. Sustainability in US higher education: organizational factors influencing campus environmental performance and leadership. Ph.D. Dissertation. University of Michigan Ann Arbor MI."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1038\/scientificamerican0991-116"},{"key":"e_1_2_1_53_1","volume-title":"Organizational communication. Number 5","author":"Stohl Cynthia","unstructured":"Cynthia Stohl. 1995. Organizational communication. Number 5. Sage."},{"key":"e_1_2_1_54_1","unstructured":"Cynthia Stohl and W Charles Redding. 1987. Messages and message exchange processes. (1987)."},{"key":"e_1_2_1_55_1","doi-asserted-by":"crossref","unstructured":"Peter Swanborn. 2010. Case study research: What why and how? Sage.","DOI":"10.4135\/9781526485168"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11528-016-0058-z"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/MAHC.2012.6"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979456"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/238386.238530"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080782"},{"key":"e_1_2_1_61_1","unstructured":"Robert K Yin. 2003. Case study research: Design and methods (Vol. 5). (2003)."}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3449154","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3449154","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3449154","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:17Z","timestamp":1750191497000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3449154"}},"subtitle":["A Case Study of Organization-Wide Bulk Email Effectiveness"],"short-title":[],"issued":{"date-parts":[[2021,4,13]]},"references-count":60,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2021,4,13]]}},"alternative-id":["10.1145\/3449154"],"URL":"https:\/\/doi.org\/10.1145\/3449154","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,13]]},"assertion":[{"value":"2021-04-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}