{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T17:49:30Z","timestamp":1784915370236,"version":"3.55.0"},"reference-count":80,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2020,11,25]],"date-time":"2020-11-25T00:00:00Z","timestamp":1606262400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput.-Hum. Interact."],"published-print":{"date-parts":[[2020,12,31]]},"abstract":"<jats:p>\n            We study the impact and interplay of social design features on the engagement behaviors toward user-generated content on Facebook business pages. By examining the introduction of the \u201cReactions\u201d feature on Facebook, we aim to understand how the introduction of a new engagement feature affects the overall engagement activities and the use of existing engagement features. We found evidence of a positive effect of Reactions on overall engagement levels. Furthermore, the introduction of the Reactions feature had heterogeneous effects on the use of existing engagement features. Posts that received Reactions also ended up receiving more Likes and Comments than what they\n            <jats:italic>would have<\/jats:italic>\n            received before the feature change. However, the opposite is true for posts that received no Reactions, although the effect sizes were small. These effects were detected within the first four weeks after the feature introduction, and persisted after six months, indicating long-term structural changes in users\u2019 engagement behaviors.\n          <\/jats:p>","DOI":"10.1145\/3412844","type":"journal-article","created":{"date-parts":[[2020,11,26]],"date-time":"2020-11-26T19:37:30Z","timestamp":1606419450000},"page":"1-35","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Engagement by Design"],"prefix":"10.1145","volume":"27","author":[{"given":"Mochen","family":"Yang","sequence":"first","affiliation":[{"name":"University of Minnesota, Minneapolis, MN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuqing","family":"Ren","sequence":"additional","affiliation":[{"name":"University of Minnesota, Minneapolis, MN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gediminas","family":"Adomavicius","sequence":"additional","affiliation":[{"name":"University of Minnesota, Minneapolis, MN"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,11,25]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 971--980","author":"Ames M."},{"key":"e_1_2_2_2_1","volume-title":"Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 1485--1500","author":"Andalibi N."},{"key":"e_1_2_2_3_1","doi-asserted-by":"crossref","unstructured":"J. D. Angrist and J. S. Pischke. 2008. Mostly Harmless Econometrics: An Empiricist's Companion. Princeton University Press.  J. D. Angrist and J. S. Pischke. 2008. Mostly Harmless Econometrics: An Empiricist's Companion. Princeton University Press.","DOI":"10.2307\/j.ctvcm4j72"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1287\/isre.1120.0470"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1177\/1536867X0200200403"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.2307\/3250921"},{"key":"e_1_2_2_7_1","volume-title":"Retrieved","author":"Boxer J.","year":"2016"},{"key":"e_1_2_2_8_1","volume-title":"Retrieved","author":"Brink C.","year":"2016"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1177\/1094670511411703"},{"key":"e_1_2_2_10_1","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 4187--4196","author":"Burke M."},{"key":"e_1_2_2_11_1","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM","author":"Burke M."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1287\/isre.2016.0672"},{"key":"e_1_2_2_13_1","unstructured":"K. Chan. 2009. I Like This. Retrieved from https:\/\/www.facebook.com\/notes\/facebook\/i-like-this\/53024537130\/.  K. Chan. 2009. I Like This. Retrieved from https:\/\/www.facebook.com\/notes\/facebook\/i-like-this\/53024537130\/."},{"key":"e_1_2_2_14_1","doi-asserted-by":"crossref","volume-title":"Statistical Power Analysis for the Behavioral Sciences","author":"Cohen J.","DOI":"10.4324\/9780203771587"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.elerap.2013.04.001"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.intmar.2012.01.003"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jeconom.2004.04.012"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.2753\/MIS0742-1222270204"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1108\/JPBM-06-2014-0635"},{"key":"e_1_2_2_20_1","first-page":"26","article-title":"One caf\u00e9 chain's Facebook experiment","volume":"88","author":"Dholakia U. M.","year":"2010","journal-title":"Harvard Business Review"},{"key":"e_1_2_2_21_1","volume-title":"Proceedings of the 22nd Americas Conference on Information Systems (AMCIS \u201916)","author":"Dong X."},{"key":"e_1_2_2_22_1","doi-asserted-by":"crossref","unstructured":"T. Erickson and W. A. Kellogg. 2000. Social translucence: An approach to designing systems that support social processes. ACM transactions on Computer-Human Interaction 7 1 (2000) 59--83.  T. Erickson and W. A. Kellogg. 2000. Social translucence: An approach to designing systems that support social processes. ACM transactions on Computer-Human Interaction 7 1 (2000) 59--83.","DOI":"10.1145\/344949.345004"},{"key":"e_1_2_2_23_1","unstructured":"Facebook Newsroom. 2016. Reactions Now Available Globally. Retrieved from http:\/\/newsroom.fb.com\/news\/2016\/02\/reactions-now-available-globally\/.  Facebook Newsroom. 2016. Reactions Now Available Globally. Retrieved from http:\/\/newsroom.fb.com\/news\/2016\/02\/reactions-now-available-globally\/."},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.73.3.421"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.25300\/MISQ\/2015\/39.3.03"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.32614\/RJ-2016-037"},{"key":"e_1_2_2_27_1","volume-title":"Digital Methods Winter Conference Proceedings. 1--29","author":"Gerlitz C."},{"key":"e_1_2_2_28_1","doi-asserted-by":"crossref","unstructured":"C. Gerlitz and A. Helmond. 2013. The like economy: Social buttons and the data-intensive web. New Media 8 Society 15 8 (2013) 1348--1365.  C. Gerlitz and A. Helmond. 2013. The like economy: Social buttons and the data-intensive web. New Media 8 Society 15 8 (2013) 1348--1365.","DOI":"10.1177\/1461444812472322"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1287\/isre.1120.0469"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3166.3170"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1037\/1089-2680.2.3.271"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.85.2.348"},{"key":"e_1_2_2_33_1","first-page":"41","article-title":"Can you measure the ROI of your social media marketing","volume":"52","author":"Hoffman D. L.","year":"2010","journal-title":"MIT Sloan Management Review"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.elerap.2012.12.003"},{"key":"e_1_2_2_35_1","unstructured":"HubSpot. 2016. How Facebook's New \u201cReactions\u201d Feature Works 8 What It Means for Marketers. Retrieved from https:\/\/blog.hubspot.com\/marketing\/facebook-reaction-buttons.  HubSpot. 2016. How Facebook's New \u201cReactions\u201d Feature Works 8 What It Means for Marketers. Retrieved from https:\/\/blog.hubspot.com\/marketing\/facebook-reaction-buttons."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1093\/pan\/mpr013"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2015.2209"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357213"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.24251\/HICSS.2017.472"},{"key":"e_1_2_2_40_1","unstructured":"G. King and R. Nielsen. 2016. Why propensity scores should not be used for matching. Retrieved from http:\/\/j.mp\/1sexgVw.  G. King and R. Nielsen. 2016. Why propensity scores should not be used for matching. Retrieved from http:\/\/j.mp\/1sexgVw."},{"key":"e_1_2_2_41_1","volume-title":"M. Burke, Y. Chen, N. Kittur, J. Konstan, Y. Ren, and J. Riedl.","author":"Kraut R. E.","year":"2011"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.9.4.437"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1287\/isre.2017.0749"},{"key":"e_1_2_2_44_1","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 435--444","author":"Lampe C. A."},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1567-4223(03)00026-7"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0094093"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1970378.1970379"},{"key":"e_1_2_2_48_1","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 631--638","author":"Ludford P. J."},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1287\/isre.1120.0462"},{"key":"e_1_2_2_50_1","volume-title":"Quantitative Methods for Analyzing Travel Behavior of Individuals: Some Recent Developments","author":"McFadden D."},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1111\/jcc4.12030"},{"key":"e_1_2_2_52_1","first-page":"18","article-title":"How to create brand engagement on Facebook","volume":"54","author":"Malhotra A.","year":"2013","journal-title":"MIT Sloan Management Review"},{"key":"e_1_2_2_53_1","volume-title":"Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work 8 Social Computing. ACM, 900--910","author":"Matthews T."},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1287\/isre.1120.0466"},{"key":"e_1_2_2_55_1","volume-title":"Proceedings of the NAACL HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text. Association for Computational Linguistics, 26--34","author":"Mohammad S. M."},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.25300\/MISQ\/2014\/38.4.09"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.5555\/1358262.1358271"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1120.1536"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.25300\/MISQ\/2013\/37.2.12"},{"key":"e_1_2_2_60_1","doi-asserted-by":"crossref","unstructured":"J. W. Pennebaker and M. E. Francis. 1996. Cognitive emotional and language processes in disclosure. Cognition 8 Emotion 10 6 (1996) 601--626.  J. W. Pennebaker and M. E. Francis. 1996. Cognitive emotional and language processes in disclosure. Cognition 8 Emotion 10 6 (1996) 601--626.","DOI":"10.1080\/026999396380079"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1080\/01449290110084683"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.5555\/2481655.2481665"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1287\/isre.1120.0460"},{"key":"e_1_2_2_64_1","volume-title":"Design of Observational Studies","author":"Rosenbaum P. R."},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/70.1.41"},{"key":"e_1_2_2_66_1","volume-title":"Proceedings of the 33rd International Conference on Information Systems, Orlando.","author":"Sch\u00f6ndienst V."},{"key":"e_1_2_2_67_1","volume-title":"Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work 8 Social Computing. ACM, 1501--1510","author":"Scissors L."},{"key":"e_1_2_2_68_1","volume-title":"Retrieved","author":"Shah P.","year":"2018"},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.25300\/MISQ\/2015\/39.3.08"},{"key":"e_1_2_2_70_1","unstructured":"R. Shevlin. 2007. The value of customer engagement. Retrieved from http:\/\/marketingroi.wordpress.com\/ 2007\/11\/30\/the-value-of-customer-engagement\/.  R. Shevlin. 2007. The value of customer engagement. Retrieved from http:\/\/marketingroi.wordpress.com\/ 2007\/11\/30\/the-value-of-customer-engagement\/."},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.1108\/JRIM-05-2013-0026"},{"key":"e_1_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1509\/jmkr.2005.42.4.431"},{"key":"e_1_2_2_73_1","doi-asserted-by":"publisher","DOI":"10.1080\/10494820600924750"},{"key":"e_1_2_2_74_1","first-page":"54","article-title":"Pipelines, platforms, and the new rules of strategy","volume":"94","author":"Van Alstyne M. W.","year":"2016","journal-title":"Harvard Business Review"},{"key":"e_1_2_2_75_1","doi-asserted-by":"publisher","DOI":"10.2753\/MTP1069-6679200201"},{"key":"e_1_2_2_76_1","doi-asserted-by":"publisher","DOI":"10.5555\/2842479.2842485"},{"key":"e_1_2_2_77_1","doi-asserted-by":"publisher","DOI":"10.5555\/2017296.2017302"},{"key":"e_1_2_2_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/2486227.2486236"},{"key":"e_1_2_2_79_1","doi-asserted-by":"publisher","DOI":"10.1287\/isre.2019.0834"},{"key":"e_1_2_2_80_1","doi-asserted-by":"publisher","DOI":"10.1257\/aer.101.4.1601"}],"container-title":["ACM Transactions on Computer-Human Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3412844","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3412844","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:47:01Z","timestamp":1750193221000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3412844"}},"subtitle":["An Empirical Study of the \u201cReactions\u201d Feature on Facebook Business Pages"],"short-title":[],"issued":{"date-parts":[[2020,11,25]]},"references-count":80,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2020,12,31]]}},"alternative-id":["10.1145\/3412844"],"URL":"https:\/\/doi.org\/10.1145\/3412844","relation":{},"ISSN":["1073-0516","1557-7325"],"issn-type":[{"value":"1073-0516","type":"print"},{"value":"1557-7325","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,25]]},"assertion":[{"value":"2019-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-11-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}