{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,12]],"date-time":"2026-05-12T21:18:03Z","timestamp":1778620683163,"version":"3.51.4"},"publisher-location":"Berlin, Heidelberg","reference-count":31,"publisher":"Springer Berlin Heidelberg","isbn-type":[{"value":"9783662439838","type":"print"},{"value":"9783662439845","type":"electronic"}],"license":[{"start":{"date-parts":[[2014,1,1]],"date-time":"2014-01-01T00:00:00Z","timestamp":1388534400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2014,1,1]],"date-time":"2014-01-01T00:00:00Z","timestamp":1388534400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2014]]},"DOI":"10.1007\/978-3-662-43984-5_29","type":"book-chapter","created":{"date-parts":[[2014,7,10]],"date-time":"2014-07-10T12:57:50Z","timestamp":1404997070000},"page":"376-387","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Skill Ontology-Based Model for Quality Assurance in Crowdsourcing"],"prefix":"10.1007","author":[{"given":"Kinda El","family":"Maarry","sequence":"first","affiliation":[]},{"given":"Wolf-Tilo","family":"Balke","sequence":"additional","affiliation":[]},{"given":"Hyunsouk","family":"Cho","sequence":"additional","affiliation":[]},{"given":"Seung-won","family":"Hwang","sequence":"additional","affiliation":[]},{"given":"Yukino","family":"Baba","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2014,7,11]]},"reference":[{"key":"29_CR1","unstructured":"Surowiecki, J.: The Wisdom of Crowds, p. 336. Anchor, New York (2005)"},{"issue":"14","key":"29_CR2","first-page":"1","volume":"14","author":"J Howe","year":"2006","unstructured":"Howe, J.: The rise of crowdsourcing. North 14(14), 1\u20135 (2006)","journal-title":"North"},{"issue":"1","key":"29_CR3","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1177\/1354856507084420","volume":"14","author":"DC Brabham","year":"2008","unstructured":"Brabham, D.C.: Crowdsourcing as a model for problem solving: an introduction and cases. Convergence Int J. Res. New Media Technol. 14(1), 75\u201390 (2008)","journal-title":"Convergence Int J. Res. New Media Technol."},{"issue":"2","key":"29_CR4","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1145\/1670564.1670567","volume":"43","author":"J Kamps","year":"2009","unstructured":"Kamps, J., Geva, S., Peters, C., Sakai, T., Trotman, A., Voorhees, E.: Report on the SIGIR 2009 workshop on the future of IR evaluation. ACM SIGIR Forum 43(2), 13 (2009)","journal-title":"ACM SIGIR Forum"},{"key":"29_CR5","unstructured":"Zhu, D., Carterette, B.: An analysis of assessor behavior in crowdsourced preference judgments. In: SIGIR 2010 Workshop on Crowdsourcing for Search Evaluation, no. Cse, pp. 17\u201320 (2010)"},{"key":"29_CR6","unstructured":"Scoring Workers in Crowdsourcing: How Many Control Questions are Enough?.pdf, 2013"},{"issue":"1","key":"29_CR7","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1007\/s13222-012-0092-8","volume":"12","author":"C Lofi","year":"2012","unstructured":"Lofi, C., Selke, J., Balke, W.-T.: Information extraction meets crowdsourcing: a promising couple. Datenbank-Spektrum 12(1), 109\u2013120 (2012)","journal-title":"Datenbank-Spektrum"},{"issue":"1","key":"29_CR8","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1007\/s10044-002-0173-7","volume":"6","author":"LI Kuncheva","year":"2003","unstructured":"Kuncheva, L.I., Whitaker, C.J., Shipp, C.A., Duin, R.P.W.: Limits on the majority vote accuracy in classifier fusion. Pattern Anal. Appl. 6(1), 22\u201331 (2003)","journal-title":"Pattern Anal. Appl."},{"issue":"2","key":"29_CR9","first-page":"165","volume":"44","author":"G Kazai","year":"2011","unstructured":"Kazai, G.: In search of quality in crowdsourcing for search engine evaluation. SIGIR Forum 44(2), 165\u2013176 (2011)","journal-title":"SIGIR Forum"},{"issue":"2","key":"29_CR10","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1145\/1809400.1809422","volume":"11","author":"W Mason","year":"2010","unstructured":"Mason, W., Watts, D.J.: Financial incentives and the \u2018performance of crowds\u2019. ACM SIGKDD Explor. Newslett. 11(2), 100 (2010)","journal-title":"ACM SIGKDD Explor. Newslett."},{"issue":"8","key":"29_CR11","doi-asserted-by":"publisher","first-page":"1122","DOI":"10.1080\/13691181003624090","volume":"13","author":"DC Brabham","year":"2010","unstructured":"Brabham, D.C.: Moving the crowd at threadless. Inf. Commun. Soc. 13(8), 1122\u20131145 (2010)","journal-title":"Inf. Commun. Soc."},{"key":"29_CR12","unstructured":"PodCastle: Collaborative training of acoustic models on the basis of wisdom of crowds for podcast transcription, (2009). https:\/\/staff.aist.go.jp\/m.goto\/PAPER\/INTERSPEECH2009ogata.pdf"},{"key":"29_CR13","doi-asserted-by":"crossref","unstructured":"Goto, M., Ogata, J.: Podcastle: recent advances of a spoken document retrieval service improved by anonymous user contributions. In: Proceedings of the 12th Annual Conference of the International Speech Communication Association (Interspeech 2011), pp. 3073\u20133076 (2011)","DOI":"10.21437\/Interspeech.2011-769"},{"key":"29_CR14","doi-asserted-by":"crossref","unstructured":"Schall, D.: Service-Oriented Crowdsourcing: Architecture, Protocols and Algorithms, p. 105. Springer, New York (2012)","DOI":"10.1007\/978-1-4614-5956-9"},{"key":"29_CR15","doi-asserted-by":"crossref","unstructured":"Lai, C.: Endorsements, licensing, and insurance for distributed system services. J. Electron. Publishing 2(1) (1996)","DOI":"10.3998\/3336451.0002.114"},{"key":"29_CR16","unstructured":"Ludwig, H., Keller, A., Dan, A., King, R.: A service level agreement language for dynamic electronic services. In: Proceedings of 4th IEEE International Workshop on Advanced Issues of E-Commerce and Web-Based Information Systems (WECWIS 2002) (2002)"},{"key":"29_CR17","unstructured":"Sahai, A., Machiraju, V., Anna, D.: Towards automated SLA management for web services (2002). http:\/\/www.hpl.hp.com\/techreports\/2001\/HPL-2001-310R1.pdf"},{"issue":"1","key":"29_CR18","first-page":"20","volume":"28","author":"AP Dawid","year":"1979","unstructured":"Dawid, A.P., Skene, A.M.: Maximum likelihood estimation of observer error-rates using the EM algorithm. J. Roy. Stat. Soc.: Ser. C (Appl. Stat.) 28(1), 20\u201328 (1979)","journal-title":"J. Roy. Stat. Soc.: Ser. C (Appl. Stat.)"},{"key":"29_CR19","first-page":"1297","volume":"11","author":"VC Raykar","year":"2010","unstructured":"Raykar, V.C., Yu, S., Zhao, L.H., Valadez, G.H., Florin, C., Bogoni, L., Moy, L.: Learning from crowds. J. Mach. Learn. Res. 11, 1297\u20131322 (2010)","journal-title":"J. Mach. Learn. Res."},{"issue":"1","key":"29_CR20","first-page":"1","volume":"22","author":"J Whitehill","year":"2009","unstructured":"Whitehill, J., Ruvolo, P., Wu, T., Bergsma, J., Movellan, J.: Whose vote should count more: optimal integration of labels from labelers of unknown expertise. Adv. Neural Inf. Process. Syst. 22(1), 1\u20139 (2009)","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"29_CR21","doi-asserted-by":"crossref","unstructured":"Ipeirotis, P.G., Provost, F., Wang, J.: Quality management on amazon mechanical turk. In: Proceedings of the ACM SIGKDD Workshop on Human Computation, pp. 64\u201367. ACM, New York (2010)","DOI":"10.1145\/1837885.1837906"},{"issue":"1","key":"29_CR22","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1111\/j.1744-6570.2010.01207.x","volume":"64","author":"MA Campion","year":"2011","unstructured":"Campion, M.A., Fink, A.A., Ruggeberg, B.J., Carr, L., Phillips, G.M., Odman, R.B.: Doing competencies well: best practices in competency modeling. Pers. Psychol. 64(1), 225\u2013262 (2011)","journal-title":"Pers. Psychol."},{"key":"29_CR23","doi-asserted-by":"publisher","first-page":"703","DOI":"10.1111\/j.1744-6570.2000.tb00220.x","volume":"53","author":"JS Shippmann","year":"2000","unstructured":"Shippmann, J.S., Ash, R.A., Battista, M., Carr, L., Eyde, L.D., Hesketh, B., Kehoe, J., Pearlman, K., Prien, E.P., Sanchez, J.I.: The practice of competency modeling. Pers. Psychol. 53, 703\u2013740 (2000)","journal-title":"Pers. Psychol."},{"key":"29_CR24","doi-asserted-by":"crossref","unstructured":"De Coi, J.L., Herder, E., Koesling, A., Lofi, C., Olmedilla, D., Papapetrou, O., Siberski, W.: A model for competence gap analysis. In: WEBIST 2007: Proceedings of the 3rd International Conference on Web Information Systems and Technologies, pp. 304\u2013312 (2007)","DOI":"10.5220\/0001272603040312"},{"issue":"12","key":"29_CR25","first-page":"1437","volume":"9","author":"S Colucci","year":"2003","unstructured":"Colucci, S., Di Noia, T., Di Sciascio, E., Donini, F.M., Mongiello, M., Mottola, M.: A formal approach to ontology-based semantic match of skills descriptions. J. Univ. Comput. Sci. 9(12), 1437\u20131454 (2003)","journal-title":"J. Univ. Comput. Sci."},{"issue":"2","key":"29_CR26","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1027\/0044-3409.216.2.61","volume":"216","author":"K Koeppen","year":"2008","unstructured":"Koeppen, K., Hartig, J., Klieme, E., Leutner, D.: Current issues in competence modeling and assessment. Zeitschrift f\u00fcr Psychologie\/J. Psychol. 216(2), 61\u201373 (2008)","journal-title":"Zeitschrift f\u00fcr Psychologie\/J. Psychol."},{"issue":"2","key":"29_CR27","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1109\/MIC.2013.20","volume":"17","author":"M Allahbakhsh","year":"2013","unstructured":"Allahbakhsh, M., Benatallah, B., Ignjatovic, A., Motahari-Nezhad, H.R., Bertino, E., Dustdar, S.: Quality control in crowdsourcing systems: issues and directions. IEEE Internet Comput. 17(2), 76\u201381 (2013)","journal-title":"IEEE Internet Comput."},{"key":"29_CR28","doi-asserted-by":"crossref","unstructured":"Allahbakhsh, M., Ignjatovic, A., Benatallah, B., Foo, N., Beheshti, S.M.R., Bertino, E.: Reputation management in crowdsourcing systems (2012)","DOI":"10.4108\/icst.collaboratecom.2012.250499"},{"key":"29_CR29","doi-asserted-by":"crossref","unstructured":"Ignjatovic, A., Foo, N., Lee, C.T.: An analytic approach to reputation ranking of participants in online transactions. In: IEEE\/WIC\/ACM International Conference on Web Intelligence and Intelligent Agent Technology, vol. 1 (2008)","DOI":"10.1109\/WIIAT.2008.14"},{"issue":"2","key":"29_CR30","doi-asserted-by":"publisher","first-page":"97","DOI":"10.4067\/S0718-18762010000200007","volume":"5","author":"Z Noorian","year":"2010","unstructured":"Noorian, Z., Ulieru, M.: The state of the art in trust and reputation systems: a framework for comparison. J. Theor. Appl. Electron. Commer. Res. 5(2), 97\u2013117 (2010)","journal-title":"J. Theor. Appl. Electron. Commer. Res."},{"key":"29_CR31","doi-asserted-by":"crossref","unstructured":"Liu, X., Song, Y., Liu, S., Wang, H.: Automatic taxonomy construction from keywords. In: Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, pp. 1433\u20131441 (2012)","DOI":"10.1145\/2339530.2339754"}],"container-title":["Lecture Notes in Computer Science","Database Systems for Advanced Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-662-43984-5_29","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,3]],"date-time":"2025-05-03T18:50:06Z","timestamp":1746298206000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-662-43984-5_29"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014]]},"ISBN":["9783662439838","9783662439845"],"references-count":31,"URL":"https:\/\/doi.org\/10.1007\/978-3-662-43984-5_29","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"value":"0302-9743","type":"print"},{"value":"1611-3349","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014]]},"assertion":[{"value":"11 July 2014","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}}]}}