{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T10:52:27Z","timestamp":1768992747765,"version":"3.49.0"},"publisher-location":"California","reference-count":0,"publisher":"International Joint Conferences on Artificial Intelligence Organization","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,7]]},"abstract":"<jats:p>End-to-end learning from crowds has recently been introduced as an EM-free approach to training deep neural networks directly from noisy crowdsourced annotations. It models the relationship between true labels and annotations with a specific type of neural layer, termed as the crowd layer, which can be trained using pure backpropagation. Parameters of the crowd layer, however, can hardly be interpreted as annotator reliability, as compared with the more principled probabilistic approach. The lack of probabilistic interpretation further prevents extensions of the approach to account for important factors of annotation processes, e.g., instance difficulty. This paper presents SpeeLFC, a structured probabilistic model that incorporates the constraints of probability axioms for parameters of the crowd layer, which allows to explicitly model annotator reliability while benefiting from the end-to-end training of neural networks. Moreover, we propose SpeeLFC-D, which further takes into account instance difficulty. Extensive validation on real-world datasets shows that our methods improve the state-of-the-art.<\/jats:p>","DOI":"10.24963\/ijcai.2020\/210","type":"proceedings-article","created":{"date-parts":[[2020,7,8]],"date-time":"2020-07-08T12:12:10Z","timestamp":1594210330000},"page":"1512-1518","source":"Crossref","is-referenced-by-count":26,"title":["Structured Probabilistic End-to-End Learning from Crowds"],"prefix":"10.24963","author":[{"given":"Zhijun","family":"Chen","sequence":"first","affiliation":[{"name":"SKLSDE Lab, School of Computer Science and Engineering, Beihang University, Beijing, China"},{"name":"Beijing Advanced Innovation Center for Big Data and Brain Computing, Beihang University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huimin","family":"Wang","sequence":"additional","affiliation":[{"name":"SKLSDE Lab, School of Computer Science and Engineering, Beihang University, Beijing, China"},{"name":"Beijing Advanced Innovation Center for Big Data and Brain Computing, Beihang University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hailong","family":"Sun","sequence":"additional","affiliation":[{"name":"SKLSDE Lab, School of Computer Science and Engineering, Beihang University, Beijing, China"},{"name":"Beijing Advanced Innovation Center for Big Data and Brain Computing, Beihang University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pengpeng","family":"Chen","sequence":"additional","affiliation":[{"name":"SKLSDE Lab, School of Computer Science and Engineering, Beihang University, Beijing, China"},{"name":"Beijing Advanced Innovation Center for Big Data and Brain Computing, Beihang University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tao","family":"Han","sequence":"additional","affiliation":[{"name":"SKLSDE Lab, School of Computer Science and Engineering, Beihang University, Beijing, China"},{"name":"Beijing Advanced Innovation Center for Big Data and Brain Computing, Beihang University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xudong","family":"Liu","sequence":"additional","affiliation":[{"name":"SKLSDE Lab, School of Computer Science and Engineering, Beihang University, Beijing, China"},{"name":"Beijing Advanced Innovation Center for Big Data and Brain Computing, Beihang University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jie","family":"Yang","sequence":"additional","affiliation":[{"name":"Web Information Systems, Delft University of Technology, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"10584","event":{"name":"Twenty-Ninth International Joint Conference on Artificial Intelligence and Seventeenth Pacific Rim International Conference on Artificial Intelligence {IJCAI-PRICAI-20}","theme":"Artificial Intelligence","location":"Yokohama, Japan","acronym":"IJCAI-PRICAI-2020","number":"28","sponsor":["International Joint Conferences on Artificial Intelligence Organization (IJCAI)"],"start":{"date-parts":[[2020,7,11]]},"end":{"date-parts":[[2020,7,17]]}},"container-title":["Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence"],"original-title":[],"deposited":{"date-parts":[[2020,7,9]],"date-time":"2020-07-09T02:13:53Z","timestamp":1594260833000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ijcai.org\/proceedings\/2020\/210"}},"subtitle":[],"proceedings-subject":"Artificial Intelligence Research Articles","short-title":[],"issued":{"date-parts":[[2020,7]]},"references-count":0,"URL":"https:\/\/doi.org\/10.24963\/ijcai.2020\/210","relation":{},"subject":[],"published":{"date-parts":[[2020,7]]}}}