{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:11:28Z","timestamp":1750306288473,"version":"3.41.0"},"reference-count":33,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2016,4,25]],"date-time":"2016-04-25T00:00:00Z","timestamp":1461542400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"EC FP7 funded project CUBRIK","award":["ICT- 287704"],"award-info":[{"award-number":["ICT- 287704"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2016,7,14]]},"abstract":"<jats:p>Driven by the needs of customers and industry, online fashion search and analytics are recently gaining much attention. As fashion is mostly expressed by visual content, the analysis of fashion images in online social networks is a rich source of possible insights on evolving trends and customer preferences. Although a plethora of visual content is available, the modeling of clothes\u2019 physics and movement, the implicit semantics in fashion designs, and the subjectivity of their interpretation pose difficulties to fully automated solutions for fashion search and analysis. In this article, we present the design and evaluation of a crowd-powered system for fashion similarity search from Twitter, supporting trend analysis for fashion professionals. The system enables fashion similarity search based on specific human-based similarity criteria. This is achieved by implementing a novel machine--crowd workflow that supports complex tasks requiring highly subjective judgments where multiple true solutions may coexist. We discuss how this leads to a novel class of crowd-powered systems for which the output of the crowd is not used to verify the automatic analysis but is the desired outcome. Finally, we show how this kind of crowd involvement enables a novel kind of similarity search and represents a crucial factor for the acceptance of system results by the end user.<\/jats:p>","DOI":"10.1145\/2897365","type":"journal-article","created":{"date-parts":[[2016,4,25]],"date-time":"2016-04-25T19:51:13Z","timestamp":1461613873000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["A Crowd-Powered System for Fashion Similarity Search"],"prefix":"10.1145","volume":"7","author":[{"given":"Theodoros","family":"Semertzidis","sequence":"first","affiliation":[{"name":"Aristotle University of Thessaloniki, Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jasminko","family":"Novak","sequence":"additional","affiliation":[{"name":"European Institute for Participatory Media, University of Applied Sciences Stralsund, Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michalis","family":"Lazaridis","sequence":"additional","affiliation":[{"name":"Centre for Research and Technology Hellas, Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mark","family":"Melenhorst","sequence":"additional","affiliation":[{"name":"Technical University of Delft, Delft, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Isabel","family":"Micheel","sequence":"additional","affiliation":[{"name":"European Institute for Participatory Media, Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dimitrios","family":"Michalopoulos","sequence":"additional","affiliation":[{"name":"Centre for Research and Technology Hellas, Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martin","family":"B\u00f6ckle","sequence":"additional","affiliation":[{"name":"European Institute for Participatory Media, Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael G.","family":"Strintzis","sequence":"additional","affiliation":[{"name":"Aristotle University of Thessaloniki, Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Petros","family":"Daras","sequence":"additional","affiliation":[{"name":"Centre for Research and Technology Hellas, Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2016,4,25]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2013.2265080"},{"key":"e_1_2_2_2_1","unstructured":"Lora Aroyo and Chris Welty. 2013. Crowd truth: Harnessing disagreement in crowdsourcing a relation extraction gold standard. WebSci2013. ACM.  Lora Aroyo and Chris Welty. 2013. Crowd truth: Harnessing disagreement in crowdsourcing a relation extraction gold standard. WebSci2013. ACM."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487575.2488201"},{"key":"e_1_2_2_4_1","volume-title":"Churchill","author":"Bhardwaj Anurag","year":"2014","unstructured":"Anurag Bhardwaj , Vignesh Jagadeesh , Wei Di , Robinson Piramuthu , and Elizabeth F . Churchill . 2014 . Enhancing visual fashion recommendations with users in the loop. CoRR abs\/1405.4013 http:\/\/arxiv.org\/abs\/1405.4013 Anurag Bhardwaj, Vignesh Jagadeesh, Wei Di, Robinson Piramuthu, and Elizabeth F. Churchill. 2014. Enhancing visual fashion recommendations with users in the loop. CoRR abs\/1405.4013 http:\/\/arxiv.org\/abs\/1405.4013"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2009.5459303"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2384916.2384941"},{"volume-title":"A Manual for Repertory Grid Technique (2nd. ed.)","author":"Fransella Fay","key":"e_1_2_2_7_1","unstructured":"Fay Fransella , Richard Bell , and Don Bannister . 2003. A Manual for Repertory Grid Technique (2nd. ed.) . Wiley , New York, NY . Fay Fransella, Richard Bell, and Don Bannister. 2003. A Manual for Repertory Grid Technique (2nd. ed.). Wiley, New York, NY."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/SocialCom-PASSAT.2012.139"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327051hci1904_2"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2647868.2656405"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623332"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2788621"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461466.2461485"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2047196.2047202"},{"volume-title":"Fusion in Computer Vision","author":"Larson Martha","key":"e_1_2_2_15_1","unstructured":"Martha Larson , Mark Melenhorst , Mar\u00eda Men\u00e9ndez , and Peng Xu. 2014. Using crowdsourcing to capture complexity in human interpretations of multimedia content . In Fusion in Computer Vision . Springer , 229--269. Martha Larson, Mark Melenhorst, Mar\u00eda Men\u00e9ndez, and Peng Xu. 2014. Using crowdsourcing to capture complexity in human interpretations of multimedia content. In Fusion in Computer Vision. Springer, 229--269."},{"key":"e_1_2_2_16_1","volume-title":"Seven Months with the Devils: A Long-Term Study of Content Polluters on Twitter. Retrieved","author":"Lee Kyumin","year":"2016","unstructured":"Kyumin Lee , Brian Eoff , and James Caverlee . 2011. Seven Months with the Devils: A Long-Term Study of Content Polluters on Twitter. Retrieved March 4, 2016 from https:\/\/www.aaai.org\/ocs\/index.php\/ICWSM\/ICWSM11\/paper\/view\/2780. Kyumin Lee, Brian Eoff, and James Caverlee. 2011. Seven Months with the Devils: A Long-Term Study of Content Polluters on Twitter. Retrieved March 4, 2016 from https:\/\/www.aaai.org\/ocs\/index.php\/ICWSM\/ICWSM11\/paper\/view\/2780."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2013.2285526"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2393347.2393433"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00138-013-0580-3"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2660114.2660121"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/IV.2014.47"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1743384.1743478"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2002.1017623"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995451"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979148"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1080\/107205399266109"},{"volume-title":"Proceedings of the IEEE\/SICE International Symposium on System Integration (SII\u201911)","author":"Sakurai R.","key":"e_1_2_2_27_1","unstructured":"R. Sakurai , Joo-Ho Lee , and K. Kawagoe . 2011. People and clothes recognition based on topic model . In Proceedings of the IEEE\/SICE International Symposium on System Integration (SII\u201911) . 1191--1195. R. Sakurai, Joo-Ho Lee, and K. Kawagoe. 2011. People and clothes recognition based on topic model. In Proceedings of the IEEE\/SICE International Symposium on System Integration (SII\u201911). 1191--1195."},{"key":"e_1_2_2_28_1","volume-title":"Michael Gerassimos Strintzis, and Petros Daras","author":"Semertzidis Theodoros","year":"2014","unstructured":"Theodoros Semertzidis , Dimitrios Rafailidis , Michael Gerassimos Strintzis, and Petros Daras . 2014 . The influence of image descriptors dimensions value cardinalities on large-scale similarity search. International Journal of Multimedia Information Retrieval 1--18. Theodoros Semertzidis, Dimitrios Rafailidis, Michael Gerassimos Strintzis, and Petros Daras. 2014. The influence of image descriptors dimensions value cardinalities on large-scale similarity search. International Journal of Multimedia Information Retrieval 1--18."},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1873951.1874278"},{"volume-title":"Basics of qualitative research: Techniques and procedures for developing grounded theory","author":"Strauss Anselm","key":"e_1_2_2_30_1","unstructured":"Anselm Strauss and Juliet Corbin . 1998. Basics of qualitative research: Techniques and procedures for developing grounded theory . SAGE Publications, Thousand Oaks , CA. Anselm Strauss and Juliet Corbin. 1998. Basics of qualitative research: Techniques and procedures for developing grounded theory. SAGE Publications, Thousand Oaks, CA."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2013.2247989"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2009.154"},{"volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201912)","author":"Yamaguchi K.","key":"e_1_2_2_33_1","unstructured":"K. Yamaguchi , M. H. Kiapour , L. E. Ortiz , and T. L. Berg . 2012. Parsing clothing in fashion photographs . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201912) . 3570--3577. K. Yamaguchi, M. H. Kiapour, L. E. Ortiz, and T. L. Berg. 2012. Parsing clothing in fashion photographs. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201912). 3570--3577."}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897365","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2897365","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:39:02Z","timestamp":1750221542000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897365"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,4,25]]},"references-count":33,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2016,7,14]]}},"alternative-id":["10.1145\/2897365"],"URL":"https:\/\/doi.org\/10.1145\/2897365","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"type":"print","value":"2157-6904"},{"type":"electronic","value":"2157-6912"}],"subject":[],"published":{"date-parts":[[2016,4,25]]},"assertion":[{"value":"2015-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-04-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}