{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,11]],"date-time":"2025-06-11T06:04:18Z","timestamp":1749621858798},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"value":"9781643684369","type":"print"},{"value":"9781643684376","type":"electronic"}],"license":[{"start":{"date-parts":[[2023,9,28]],"date-time":"2023-09-28T00:00:00Z","timestamp":1695859200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,9,28]]},"abstract":"<jats:p>Conventional humor analysis normally focuses on text, text-image pair, and even long video (e.g., monologue) scenarios. However, with the recent rise of short-form video sharing, humor detection in this scenario has not yet gained much exploration. To the best of our knowledge, there are two primary issues associated with short-form video humor detection (SVHD): 1) At present, there are no ready-made humor annotation samples in this scenario, and it takes a lot of manpower and material resources to obtain a large number of annotation samples; 2) Unlike the more typical audio and visual modalities, the titles (as opposed to simultaneous transcription in the lengthy film) and associated interactive comments in short-form videos may convey apparent humorous clues. Therefore, in this paper, we first collect and annotate a video dataset from DouYin (aka. TikTok in the world), namely DY24h, with hierarchical comments. Then, we also design a novel approach with comment-aided multi-modal heterogeneous pre-training (CMHP) to introduce comment modality in SVHD. Extensive experiments and analysis demonstrate that our CMHP beats several existing video-based approaches on DY24h, and that the comments modality further aids a better comprehension of humor. Our dataset, code and pre-trained models are available at https:\/\/github.com\/yliu-cs\/CMHP.<\/jats:p>","DOI":"10.3233\/faia230438","type":"book-chapter","created":{"date-parts":[[2023,9,29]],"date-time":"2023-09-29T09:14:25Z","timestamp":1695978865000},"source":"Crossref","is-referenced-by-count":3,"title":["Comment-Aware Multi-Modal Heterogeneous Pre-Training for Humor Detection in Short-Form Videos"],"prefix":"10.3233","author":[{"given":"Yang","family":"Liu","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, Soochow University, Suzhou"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huanqin","family":"Ping","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Soochow University, Suzhou"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dong","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Soochow University, Suzhou"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qingying","family":"Sun","sequence":"additional","affiliation":[{"name":"Huaiyin Normal University, Huai\u2019an"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shoushan","family":"Li","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Soochow University, Suzhou"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guodong","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Soochow University, Suzhou"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"7437","container-title":["Frontiers in Artificial Intelligence and Applications","ECAI 2023"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/FAIA230438","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,29]],"date-time":"2023-09-29T09:14:26Z","timestamp":1695978866000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/FAIA230438"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,28]]},"ISBN":["9781643684369","9781643684376"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/faia230438","relation":{},"ISSN":["0922-6389","1879-8314"],"issn-type":[{"value":"0922-6389","type":"print"},{"value":"1879-8314","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,28]]}}}