{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T04:55:24Z","timestamp":1755838524586,"version":"3.41.0"},"reference-count":32,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2016,7,12]],"date-time":"2016-07-12T00:00:00Z","timestamp":1468281600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"International Cooperation in Research and Higher Education","award":["2013-019"],"award-info":[{"award-number":["2013-019"]}]},{"name":"People Programme (Marie Sk\u0142odowska-Curie Actions) of the European Union\u2019s Seventh Framework Programme","award":["290227"],"award-info":[{"award-number":["290227"]}]},{"name":"The Adlerbertska Research Foundation"},{"name":"Sixth Framework Programme\u2014Marie Curie Transfer of Knowledge Action","award":["MTKD-CT-2006-039546"],"award-info":[{"award-number":["MTKD-CT-2006-039546"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2016,7,14]]},"abstract":"<jats:p>In this article, we present a novel application domain for human computation, specifically for crowdsourcing, which can help in understanding particle-tracking problems. Through an interdisciplinary inquiry, we built a crowdsourcing system designed to detect tracer particles in industrial tomographic images, and applied it to the problem of bulk solid flow in silos. As images from silo-sensing systems cannot be adequately analyzed using the currently available computational methods, human intelligence is required. However, limited availability of experts, as well as their high cost, motivates employing additional nonexperts. We report on the results of a study that assesses the task completion time and accuracy of employing nonexpert workers to process large datasets of images in order to generate data for bulk flow research. We prove the feasibility of this approach by comparing results from a user study with data generated from a computational algorithm. The study shows that the crowd is more scalable and more economical than an automatic solution. The system can help analyze and understand the physics of flow phenomena to better inform the future design of silos, and is generalized enough to be applicable to other domains.<\/jats:p>","DOI":"10.1145\/2897370","type":"journal-article","created":{"date-parts":[[2016,7,15]],"date-time":"2016-07-15T14:36:21Z","timestamp":1468593381000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["Using Crowdsourcing for Scientific Analysis of Industrial Tomographic Images"],"prefix":"10.1145","volume":"7","author":[{"given":"Chen","family":"Chen","sequence":"first","affiliation":[{"name":"National University of Singapore, Singapore"}]},{"given":"Pawe\u0142 W.","family":"Wo\u017aniak","sequence":"additional","affiliation":[{"name":"Chalmers University of Technology, Gothenburg, Sweden"}]},{"given":"Andrzej","family":"Romanowski","sequence":"additional","affiliation":[{"name":"Lodz University of Technology, \u0141\u00f3d\u017a, Poland"}]},{"given":"Mohammad","family":"Obaid","sequence":"additional","affiliation":[{"name":"Chalmers University of Technology"}]},{"given":"Tomasz","family":"Jaworski","sequence":"additional","affiliation":[{"name":"Lodz University of Technology, \u0141\u00f3d\u017a, Poland"}]},{"given":"Jacek","family":"Kucharski","sequence":"additional","affiliation":[{"name":"Lodz University of Technology, \u0141\u00f3d\u017a, Poland"}]},{"given":"Krzysztof","family":"Grudzie\u0144","sequence":"additional","affiliation":[{"name":"Lodz University of Technology, \u0141\u00f3d\u017a, Poland"}]},{"given":"Shengdong","family":"Zhao","sequence":"additional","affiliation":[{"name":"National University of Singapore, Singapore"}]},{"given":"Morten","family":"Fjeld","sequence":"additional","affiliation":[{"name":"Chalmers University of Technology"}]}],"member":"320","published-online":{"date-parts":[[2016,7,12]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.powtec.2014.08.027"},{"key":"e_1_2_1_2_1","unstructured":"Alexander Artikis Matthias Weidlich Francois Schnitzler Ioannis Boutsis Thomas Liebig Nico Piatkowski Christian Bockermann Katharina Morik Vana Kalogeraki Jakub Marecek and others. 2014. Heterogeneous stream processing and crowdsourcing for urban traffic management. In EDBT. 712--723.  Alexander Artikis Matthias Weidlich Francois Schnitzler Ioannis Boutsis Thomas Liebig Nico Piatkowski Christian Bockermann Katharina Morik Vana Kalogeraki Jakub Marecek and others. 2014. Heterogeneous stream processing and crowdsourcing for urban traffic management. In EDBT. 712--723."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0262-8856(98)00160-7"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2005.10.003"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ces.2013.04.026"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2791285"},{"volume-title":"Human--computer interaction and collective intelligence","author":"Bigham Jeffrey P.","key":"e_1_2_1_7_1"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1890\/110273"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1006\/cviu.2001.0923"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.powtec.2010.04.032"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2159365.2159367"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1038\/nbt.2109"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2594776.2594788"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1004-9541(12)60396-6"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.2478\/v10248-012-0075-2"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0166-4115(08)62386-9"},{"volume-title":"Retrieved","year":"1962","author":"Hough Paul V. C.","key":"e_1_2_1_17_1"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2380116.2380122"},{"volume-title":"Mountain Risks: From Prediction to Management and Governance","author":"Lu Ping","key":"e_1_2_1_19_1"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-391857-4.00009-4"},{"volume-title":"7th International Congress on Environmental Modelling and Software. iEMSs.","year":"2014","author":"Meissen Ulrich","key":"e_1_2_1_21_1"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1254642"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2014.08.027"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2557500.2557512"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979148"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753846.1753873"},{"volume-title":"Characterization, Storage and Flow","author":"Schulze Dietmar","key":"e_1_2_1_27_1"},{"volume-title":"Processing of Particulate Solids","series-title":"Powder Technology Series","author":"Seville Jonathan","key":"e_1_2_1_28_1"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2010.00175"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1006\/ciun.1993.1009"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/0167-8655(90)90042-Z"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/0262-8856(90)90059-E"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897370","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2897370","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:39:02Z","timestamp":1750221542000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897370"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,7,12]]},"references-count":32,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2016,7,14]]}},"alternative-id":["10.1145\/2897370"],"URL":"https:\/\/doi.org\/10.1145\/2897370","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"type":"print","value":"2157-6904"},{"type":"electronic","value":"2157-6912"}],"subject":[],"published":{"date-parts":[[2016,7,12]]},"assertion":[{"value":"2015-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-07-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}