{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,11]],"date-time":"2025-11-11T15:47:05Z","timestamp":1762876025783,"version":"3.41.0"},"reference-count":99,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW","license":[{"start":{"date-parts":[[2018,11,1]],"date-time":"2018-11-01T00:00:00Z","timestamp":1541030400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2018,11]]},"abstract":"<jats:p>We investigate how data-analyst productivity benefits from collaborative platforms that facilitate learning-by-doing (i.e. analysts learning by writing queries on their own) and learning-by-viewing (i.e. analysts learning by viewing queries written by peers). Learning is measured using a behavioral (productivity-improvement) approach. Productivity is measured using the time from creating an empty query to first executing it.<\/jats:p>\n          <jats:p>Using a sample of 2,001 data analysts at eBay Inc. who have written 79,797 queries from 2014 to 2018, we find that: 1) learning-by-doing is associated with significant productivity improvement when the analyst's prior experience focuses on the focally queried database; 2) only learning-by-viewing queries that are authored by analysts with high output rate (average number of queries written per month) is associated with significant improvement in the viewer's productivity; 3) learning-by-viewing also depends on the \"social influence\" of the author of the viewed query, which we measure 'locally' based on the number of the author's direct viewers per month or 'globally' based on the how the author's queries propagate to peers in the overall collaboration network. Combining results 2 and 3, when segmenting analysts based on output rate and 'local' social influence, the viewing of queries authored by analysts with high output but low local influence is associated with the largest improvement in the viewer's productivity; whereas when segmenting based on output rate and 'global' social influence, the viewing of queries authored analysts with high output and high global influence is associated with the largest improvement in the viewer's productivity.<\/jats:p>","DOI":"10.1145\/3274462","type":"journal-article","created":{"date-parts":[[2018,11,1]],"date-time":"2018-11-01T21:21:27Z","timestamp":1541107287000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Learning by Doing versus Learning by Viewing"],"prefix":"10.1145","volume":"2","author":[{"given":"Yue","family":"Yin","sequence":"first","affiliation":[{"name":"Northwestern University, Evanston, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Itai","family":"Gurvich","sequence":"additional","affiliation":[{"name":"Cornell Tech, New York, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stephanie","family":"McReynolds","sequence":"additional","affiliation":[{"name":"Alation Inc., Redwood City, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Debora","family":"Seys","sequence":"additional","affiliation":[{"name":"eBay, Inc., San Jose, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jan A.","family":"Van Mieghem","sequence":"additional","affiliation":[{"name":"Northwestern University, Evanston, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,11]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.2307\/2946672"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.2009.5306308"},{"key":"e_1_2_1_3_1","volume-title":"Reliability of progress curves in airframe production. Econometrica: Journal of the Econometric Society","author":"Alchian Armen","year":"1963","unstructured":"Armen Alchian. 1963. Reliability of progress curves in airframe production. Econometrica: Journal of the Econometric Society (1963), 679--693."},{"key":"e_1_2_1_4_1","volume-title":"Fixed-effects negative binomial regression models. Sociological methodology, 32, 1","author":"Allison Paul D","year":"2002","unstructured":"Paul D Allison and Richard P Waterman. 2002. Fixed-effects negative binomial regression models. Sociological methodology, 32, 1 (2002), 247--265."},{"key":"e_1_2_1_5_1","volume-title":"Situative versus cognitive perspectives: Form versus substance. Educational researcher, 26, 1","author":"Anderson John R","year":"1997","unstructured":"John R Anderson, Lynne M Reder, and Herbert A Simon. 1997. Situative versus cognitive perspectives: Form versus substance. Educational researcher, 26, 1 (1997), 18--21."},{"volume-title":"Organizational learning: Creating, retaining and transferring knowledge","author":"Argote Linda","key":"e_1_2_1_6_1","unstructured":"Linda Argote. 2012. Organizational learning: Creating, retaining and transferring knowledge .Springer Science & Business Media."},{"key":"e_1_2_1_7_1","volume-title":"Learning curves in manufacturing. Science , 247, 4945","author":"Argote Linda","year":"1990","unstructured":"Linda Argote and Dennis Epple. 1990. Learning curves in manufacturing. Science , 247, 4945 (1990), 920--924."},{"key":"e_1_2_1_8_1","volume-title":"Knowledge transfer in organizations: Learning from the experience of others. Organizational behavior and human decision processes , 82, 1","author":"Argote Linda","year":"2000","unstructured":"Linda Argote, Paul Ingram, John M Levine, and Richard L Moreland. 2000. Knowledge transfer in organizations: Learning from the experience of others. Organizational behavior and human decision processes , 82, 1 (2000), 1--8."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1162\/qjec.2010.125.2.549"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518944"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2669557.2669559"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-7552(98)00110-X"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.32614\/RJ-2017-066"},{"volume-title":"Knowledge and communities","author":"Brown JohnSeely","key":"e_1_2_1_15_1","unstructured":"JohnSeely Brown and Paul Duguid. 2000. Organizational learning and communities of practice: Toward a unified view of working, learning, and innovation. In Knowledge and communities . Elsevier, 99--121."},{"volume-title":"Structural holes: The social structure of competition","author":"Burt Ronald S","key":"e_1_2_1_16_1","unstructured":"Ronald S Burt. 2009. Structural holes: The social structure of competition .Harvard university press."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390630.1390647"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/2481674.2481683"},{"key":"e_1_2_1_19_1","volume-title":"Cognitive and situated learning perspectives in theory and practice. Educational researcher, 28, 2","author":"Cobb Paul","year":"1999","unstructured":"Paul Cobb and Janet Bowers. 1999. Cognitive and situated learning perspectives in theory and practice. Educational researcher, 28, 2 (1999), 4--15."},{"volume-title":"Applied multiple regression\/correlation analysis for the behavioral sciences","author":"Cohen Patricia","key":"e_1_2_1_20_1","unstructured":"Patricia Cohen, Stephen G West, and Leona S Aiken. 2014. Applied multiple regression\/correlation analysis for the behavioral sciences .Psychology Press."},{"key":"e_1_2_1_21_1","volume-title":"An organizational learning framework: From intuition to institution","author":"Crossan Mary M","year":"1999","unstructured":"Mary M Crossan, Henry W Lane, and Roderick E White. 1999. An organizational learning framework: From intuition to institution. Academy of management review, 24, 3 (1999), 522--537."},{"key":"e_1_2_1_22_1","volume-title":"Complex Systems","author":"Csardi Gabor","year":"2006","unstructured":"Gabor Csardi and Tamas Nepusz. 2006. The igraph software package for complex network research. InterJournal , Complex Systems (2006), 1695. http:\/\/igraph.org"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2145204.2145396"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.41.11.1750"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819984"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.5555\/1149126.1149144"},{"key":"e_1_2_1_27_1","volume-title":"Treating progress functions as a managerial opportunity","author":"Dutton John M","year":"1984","unstructured":"John M Dutton and Annie Thomas. 1984. Treating progress functions as a managerial opportunity. Academy of management review, 9, 2 (1984), 235--247."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2015.2352"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/344949.345004"},{"key":"e_1_2_1_30_1","volume-title":"Verbal reports as data. Psychological review , 87, 3","author":"Anders Ericsson K","year":"1980","unstructured":"K Anders Ericsson and Herbert A Simon. 1980. Verbal reports as data. Psychological review , 87, 3 (1980), 215."},{"key":"e_1_2_1_31_1","volume-title":"Organizational learning","author":"Marlene Fiol C","year":"1985","unstructured":"C Marlene Fiol and Marjorie A Lyles. 1985. Organizational learning. Academy of management review, 10, 4 (1985), 803--813."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1060.0687"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1287624.1287673"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2512207"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1806799.1806856"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.obhdp.2009.11.002"},{"key":"e_1_2_1_37_1","volume-title":"On claims that answer the wrong questions. Educational researcher, 26, 1","author":"Greeno James G","year":"1997","unstructured":"James G Greeno. 1997. On claims that answer the wrong questions. Educational researcher, 26, 1 (1997), 5--17."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1070.0809"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.2469\/cfm.v28.n4.4"},{"key":"e_1_2_1_40_1","volume-title":"et almbox","author":"Henke N","year":"2017","unstructured":"N Henke, J Bughin, M Chui, et almbox. 2017. The age of analytics: competing in a data-driven world. McKinsey Global Institute."},{"volume-title":"The competent organization: A psychological analysis of the strategic management process","author":"Hodgkinson Gerard P","key":"e_1_2_1_41_1","unstructured":"Gerard P Hodgkinson and Paul R Sparrow. 2002. The competent organization: A psychological analysis of the strategic management process .Open University Press."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.5555\/2842497.2842503"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.5555\/2007322.2007325"},{"volume-title":"Mapping strategic knowledge","author":"Huff Anne Sigismund","key":"e_1_2_1_44_1","unstructured":"Anne Sigismund Huff and Mark Jenkins. 2002. Mapping strategic knowledge .Sage."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.2015.1009"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.219"},{"key":"e_1_2_1_47_1","volume-title":"From data to insight: work practices of analysts in the enterprise","author":"Kandogan Eser","year":"2014","unstructured":"Eser Kandogan, Aruna Balakrishnan, Eben M Haber, and Jeffrey S Pierce. 2014. From data to insight: work practices of analysts in the enterprise. IEEE computer graphics and applications, 34, 5 (2014), 42--50."},{"key":"e_1_2_1_48_1","volume-title":"ICIS 2009 Proceedings","author":"Kang Keumseok","year":"2009","unstructured":"Keumseok Kang and Jungpil Hahn. 2009. Learning and forgetting curves in software development: Does type of knowledge matter? ICIS 2009 Proceedings (2009), 194."},{"key":"e_1_2_1_49_1","volume-title":"Content is King","author":"Karumur Raghav Pavan","year":"2018","unstructured":"Raghav Pavan Karumur, Bowen Yu, Haiyi Zhu, and Joseph A Konstan. 2018. Content is King, Leadership Lags: Effects of Prior Experience on Newcomer Retention and Productivity in Online Production Groups. (2018)."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2013.1720"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1287\/msom.1120.0385"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884783"},{"key":"e_1_2_1_53_1","first-page":"1","article-title":"Data Scientists in Software Teams: State of the Art and Challenges","volume":"1","author":"Kim Miryung","year":"2017","unstructured":"Miryung Kim, Thomas Zimmermann, Robert DeLine, and Andrew Begel. 2017. Data Scientists in Software Teams: State of the Art and Challenges. IEEE Transactions on Software Engineering 1 (2017), 1--1.","journal-title":"IEEE Transactions on Software Engineering"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1287\/isre.1110.0401"},{"volume-title":"The Oxford handbook of organizational psychology. Organizational Learning and knowledge management, 1","author":"Kozlowski Steve WJ","key":"e_1_2_1_55_1","unstructured":"Steve WJ Kozlowski. 2012. The Oxford handbook of organizational psychology. Organizational Learning and knowledge management, 1. Oxford University Press."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993400500224286"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.5555\/2804941.2804942"},{"volume-title":"Situated learning: Legitimate peripheral participation. 521423740","author":"Lave Jean","key":"e_1_2_1_58_1","unstructured":"Jean Lave, Etienne Wenger, and Etienne Wenger. 1991. Situated learning: Legitimate peripheral participation. 521423740. Cambridge university press Cambridge."},{"key":"e_1_2_1_59_1","volume-title":"Organizational learning. Annual review of sociology, 14, 1","author":"Levitt Barbara","year":"1988","unstructured":"Barbara Levitt and James G March. 1988. Organizational learning. Annual review of sociology, 14, 1 (1988), 319--338."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.11.6.B136"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1016\/0304-3932(88)90168-7"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441792"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557201"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2470728"},{"key":"e_1_2_1_65_1","volume-title":"Population-level learning. Research in Organizational Behavior: an annual series of analytical essays and critical reviews, 17","author":"Miner Anne S","year":"1995","unstructured":"Anne S Miner and Pamela R Haunschild. 1995. Population-level learning. Research in Organizational Behavior: an annual series of analytical essays and critical reviews, 17 (1995), 115--166."},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208685"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1111\/poms.12039"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.5555\/2842023.2842025"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1110.1470"},{"volume-title":"Talking about machines: An ethnography of a modern job","author":"Orr Julian E","key":"e_1_2_1_70_1","unstructured":"Julian E Orr. 2016. Talking about machines: An ethnography of a modern job .Cornell University Press."},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/1559845.1559865"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-38928-3_3"},{"key":"e_1_2_1_73_1","volume-title":"R: A Language and Environment for Statistical Computing","author":"Team R Core","year":"2018","unstructured":"R Core Team. 2018. R: A Language and Environment for Statistical Computing . R Foundation for Statistical Computing, Vienna, Austria. https:\/\/www.R-project.org\/"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207756"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1050.0366"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.2016.1078"},{"key":"e_1_2_1_77_1","volume-title":"Designing for tinkerability. Design, make, play: Growing the next generation of STEM innovators","author":"Resnick Mitchel","year":"2013","unstructured":"Mitchel Resnick and Eric Rosenbaum. 2013. Designing for tinkerability. Design, make, play: Growing the next generation of STEM innovators (2013), 163--181."},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1086\/261725"},{"key":"e_1_2_1_79_1","volume-title":"A framework for open source projects. Department of Information Technology","author":"Rothfuss Gregor J","year":"2002","unstructured":"Gregor J Rothfuss and K Bauknecht. 2002. A framework for open source projects. Department of Information Technology. Zurich, Switzerland, University of Zurich , 157 (2002)."},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/2380718.2380752"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1145\/1370750.1370779"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518713"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/800049.801754"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1937-5956.2011.01254.x"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1110.1482"},{"key":"e_1_2_1_86_1","volume-title":"Expert roles and information exchange during discussion: The importance of knowing who knows what. Journal of experimental social psychology","author":"Stasser Garold","year":"1995","unstructured":"Garold Stasser, Dennis D Stewart, and Gwen M Wittenbaum. 1995. Expert roles and information exchange during discussion: The importance of knowing who knows what. Journal of experimental social psychology (1995)."},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2014.1950"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.5121\/ijcsit.2010.2611"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568315"},{"key":"e_1_2_1_90_1","first-page":"3","article-title":"Epistemological pluralism and the revaluation of the concrete","volume":"11","author":"Turkle Sherry","year":"1992","unstructured":"Sherry Turkle and Seymour Papert. 1992. Epistemological pluralism and the revaluation of the concrete. Journal of Mathematical Behavior, 11, 1 (1992), 3--33.","journal-title":"Journal of Mathematical Behavior"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.8.1.71"},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1109\/SocialCom.2013.35"},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1109\/2.402076"},{"key":"e_1_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.49.2.436"},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1093\/restud\/rdr029"},{"key":"e_1_2_1_96_1","unstructured":"JP WHITE. 1975. PSYCHOLOGY AND EPISTEMOLOGY-TOWARDS A THEORY OF KNOWLEDGE-PIAGET J."},{"key":"e_1_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.5555\/1045759.1045805"},{"key":"e_1_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.1145\/2724660.2724674"},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1540-5915.1979.tb00026.x"},{"key":"e_1_2_1_100_1","first-page":"290","article-title":"Intellectual human capital and the birth of US biotechnology enterprises","volume":"88","author":"Zucker Lynne G.","year":"1998","unstructured":"Lynne G. Zucker, Michael R. Darby, and Marilynn B. Brewer. 1998. Intellectual human capital and the birth of US biotechnology enterprises. The American Economic Review, 88, 1 (1998), 290--306. http:\/\/www.jstor.org\/stable\/116831","journal-title":"The American Economic Review"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3274462","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3274462","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:44:36Z","timestamp":1750207476000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3274462"}},"subtitle":["An Empirical Study of Data Analyst Productivity on a Collaborative Platform at eBay"],"short-title":[],"issued":{"date-parts":[[2018,11]]},"references-count":99,"journal-issue":{"issue":"CSCW","published-print":{"date-parts":[[2018,11]]}},"alternative-id":["10.1145\/3274462"],"URL":"https:\/\/doi.org\/10.1145\/3274462","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2018,11]]},"assertion":[{"value":"2018-11-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}