{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,7]],"date-time":"2026-04-07T16:19:22Z","timestamp":1775578762014,"version":"3.50.1"},"reference-count":77,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2021,5,8]],"date-time":"2021-05-08T00:00:00Z","timestamp":1620432000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["DFG MU 2686\/12-1"],"award-info":[{"award-number":["DFG MU 2686\/12-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Comput. Cult. Herit."],"published-print":{"date-parts":[[2021,6]]},"abstract":"<jats:p>\n            This article presents a multimodal dataset comprising various representations and annotations of Franz Schubert\u2019s song cycle\n            <jats:italic>Winterreise<\/jats:italic>\n            . Schubert\u2019s seminal work constitutes an outstanding example of the Romantic song cycle\u2014a central genre within Western classical music. Our dataset unifies several public sources and annotations carefully created by music experts, compiled in a comprehensive and consistent way. The multimodal representations comprise the singer\u2019s lyrics, sheet music in different machine-readable formats, and audio recordings of nine performances, two of which are freely accessible for research purposes. By means of explicit musical measure positions, we establish a temporal alignment between the different representations, thus enabling a detailed comparison across different performances and modalities. Using these alignments, we provide for the different versions various musicological annotations describing tonal and structural characteristics. This metadata comprises chord annotations in different granularities, local and global annotations of musical keys, and segmentations into structural parts. From a technical perspective, the dataset allows for evaluating algorithmic approaches to tasks such as automated music transcription, cross-modal music alignment, or tonal analysis, and for testing these algorithms\u2019 robustness across songs, performances, and modalities. From a musicological perspective, the dataset enables the systematic study of Schubert\u2019s musical language and style in\n            <jats:italic>Winterreise<\/jats:italic>\n            and the comparison of annotations regarding different annotators and granularities. Beyond the research domain, the data may serve further purposes such as the didactic preparation of Schubert\u2019s work and its presentation to a wider public by means of an interactive multimedia experience. With this article, we provide a detailed description of the dataset, indicate its potential for computational music analysis by means of several studies, and point out possibilities for future research.\n          <\/jats:p>","DOI":"10.1145\/3429743","type":"journal-article","created":{"date-parts":[[2021,5,8]],"date-time":"2021-05-08T11:01:21Z","timestamp":1620471681000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":26,"title":["Schubert Winterreise Dataset"],"prefix":"10.1145","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2143-4679","authenticated-orcid":false,"given":"Christof","family":"Wei\u00df","sequence":"first","affiliation":[{"name":"International Audio Laboratories Erlangen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Frank","family":"Zalkow","sequence":"additional","affiliation":[{"name":"International Audio Laboratories Erlangen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vlora","family":"Arifi-M\u00fcller","sequence":"additional","affiliation":[{"name":"International Audio Laboratories Erlangen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Meinard","family":"M\u00fcller","sequence":"additional","affiliation":[{"name":"International Audio Laboratories Erlangen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hendrik Vincent","family":"Koops","sequence":"additional","affiliation":[{"name":"Utrecht University, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anja","family":"Volk","sequence":"additional","affiliation":[{"name":"Utrecht University, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Harald G.","family":"Grohganz","sequence":"additional","affiliation":[{"name":"Blue Square Group e. V., Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,5,8]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASLP.2016.2627186"},{"key":"e_1_2_1_2_1","volume-title":"Musical Analysis\u2014Visiting the Great Composers","author":"Absil Frans G. J.","edition":"6"},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the International Society for Music Information Retrieval Conference (ISMIR). 357--363","author":"Arzt Andreas","year":"2015"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASL.2011.2108287"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03195011"},{"key":"e_1_2_1_8_1","volume-title":"Hierarchical Tonal Analysis of Music Signals. Bachelor\u2019s Thesis","author":"Br\u00fctting Leo"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the International Conference on Multimedia. 1467--1468","author":"Cannam Chris"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.3389\/fdigh.2018.00025"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the 19th International Society for Music Information Retrieval Conference (ISMIR). 90--97","author":"Chen Tsung-Ping","year":"2018"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASLP.2013.2295926"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the International Society for Music Information Retrieval Conference (ISMIR). 51--56","author":"de Haas W. Bas","year":"2008"},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the International Society for Music Information Retrieval Conference (ISMIR). 812--818","author":"Deng Jun-Qi","year":"2016"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASLP.2017.2756443"},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the International Society for Music Information Retrieval Conference (ISMIR). 618--624","author":"Dittmar Christian","year":"2015"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the International Society for Music Information Retrieval Conference (ISMIR). 789--795","author":"Dorfer Matthias","year":"2016"},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of the International Society for Music Information Retrieval Conference (ISMIR). 115--122","author":"Dorfer Matthias","year":"2017"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the International Society for Music Information Retrieval Conference (ISMIR). 239--245","author":"Driedger Jonathan","year":"2016"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2009.4959972"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2012.2190047"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the International Society for Music Information Retrieval Conference (ISMIR). 131--132","author":"Fremerey Christian","year":"2007"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSTSP.2011.2159577"},{"key":"e_1_2_1_24_1","first-page":"113","article-title":"MusicXML for notation and analysis","volume":"12","author":"Good Michael","year":"2001","journal-title":"Computing in Musicology"},{"key":"e_1_2_1_25_1","volume-title":"Deep Learning","author":"Goodfellow Ian"},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the International Society for Music Information Retrieval Conference (ISMIR). 209--214","author":"Grohganz Harald","year":"2013"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the International Society for Music Information Retrieval Conference (ISMIR). 66--71","author":"Harte Christopher","year":"2005"},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the International Society for Music Information Retrieval Conference (ISMIR). 459--464","author":"Honingh Aline","year":"2010"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA).","author":"Hu Ning","year":"2003"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASL.2007.911559"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1080\/09298215.2012.750369"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1080\/09298215.2019.1613436"},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the International Society for Music Information Retrieval Conference (ISMIR). 483--489","author":"Koops Hendrik Vincent"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the AES International Conference on Semantic Audio.","author":"Kosta Katerina","year":"2014"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.89.4.334"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICMEW.2015.7169835"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASL.2009.2032947"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASL.2011.2159595"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1098\/rsos.150081"},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the International Society for Music Information Retrieval Conference (ISMIR). 188--194","author":"McFee Brian","year":"2017"},{"key":"e_1_2_1_43_1","volume-title":"Machine Learning and Knowledge Discovery in Databases. Communications in Computer and Information Science","author":"Mimilakis Stylianos I."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0217242"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74851-9_10"},{"key":"e_1_2_1_46_1","volume-title":"Proceedings of the International Society for Music Information Retrieval Conference (ISMIR). 365--372","author":"M\u00fcller Meinard","year":"2004"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-019-52380-6"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.3389\/fdigh.2018.00016"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASL.2013.2280218"},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the International Society for Music Information Retrieval Conference (ISMIR). 671--676","author":"Ogihara Mitsunori","year":"2008"},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the International Computer Music Conference (ICMC). 155--158","author":"Orio Nicola","year":"2001"},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the International Society for Music Information Retrieval Conference (ISMIR). 312--319","author":"Paiement Jean-Fran\u00e7ois","year":"2005"},{"key":"e_1_2_1_53_1","volume-title":"Proceedings of the International Society for Music Information Retrieval Conference (ISMIR). 628--633","author":"Pampalk Elias","year":"2005"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASL.2011.2175385"},{"key":"e_1_2_1_55_1","volume-title":"Proceedings of the International Society for Music Information Retrieval Conference (ISMIR). 625--636","author":"Paulus Jouni","year":"2010"},{"key":"e_1_2_1_56_1","volume-title":"Inside the Jazzomat. Schott Campus","author":"Pfleiderer Martin"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2016.7471739"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2016.7471678"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-006-8415-3"},{"key":"e_1_2_1_60_1","volume-title":"Proceedings of the International Society for Music Information Retrieval Conference (ISMIR). 141--146","author":"Rocher Thomas","year":"2010"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1222336110"},{"key":"e_1_2_1_62_1","volume-title":"Proceedings of the International Computer Music Conference (ICMC). 423--430","author":"Sapp Craig Stuart","year":"2001"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/1095534.1095544"},{"key":"e_1_2_1_64_1","volume-title":"Proceedings of the International Workshop on Folk Music Analysis. 29--36","author":"Scherbaum Frank","year":"2017"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP40776.2020.9054642"},{"key":"e_1_2_1_67_1","volume-title":"Retrieved","author":"Schubert Franz","year":"1827"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1080\/09298215.2011.618543"},{"key":"e_1_2_1_69_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/09298215.2014.894083","article-title":"Computational approaches to the art music traditions of India and Turkey","volume":"43","author":"Serra Xavier","year":"2014","journal-title":"Journal of New Music Research: Special Issue on Computational Approaches to the Art Music Traditions of India and Turkey"},{"key":"e_1_2_1_70_1","volume-title":"Proceedings of the AES International Conference on Semantic Audio.","author":"Serra Xavier","year":"2014"},{"key":"e_1_2_1_71_1","volume-title":"Proceedings of the International Society for Music Information Retrieval Conference (ISMIR). 127--133","author":"Sigtia Siddharth","year":"2015"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2019.8683470"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.2307\/40285738"},{"key":"e_1_2_1_74_1","volume-title":"Proceedings of the International Society for Music Information Retrieval Conference (ISMIR). 359--362","author":"Viro Vladimir","year":"2011"},{"key":"e_1_2_1_75_1","volume-title":"Proceedings of the 19th International Society for Music Information Retrieval Conference (ISMIR). 416--423","author":"Weiss Christof","year":"2018"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1177\/1029864918757595"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASLP.2020.3030485"},{"key":"e_1_2_1_78_1","volume-title":"Proceedings of the Jahrestagung der Gesellschaft f\u00fcr Informatik (GI). 205--217","author":"Weiss Christof","year":"2017"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.5555\/958671.958680"},{"key":"e_1_2_1_81_1","volume-title":"Demos and Late Breaking News of the International Society for Music Information Retrieval Conference (ISMIR).","author":"Zalkow Frank","year":"2019"},{"key":"e_1_2_1_82_1","volume-title":"Proceedings of the AES International Conference on Semantic Audio. 148--155","author":"Zalkow Frank","year":"2017"},{"key":"e_1_2_1_83_1","volume-title":"Proceedings of the International Conference on Pattern Recognition (ICPR)","volume":"3","author":"Zhu Yongwei"}],"container-title":["Journal on Computing and Cultural Heritage"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3429743","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3429743","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:44Z","timestamp":1750195904000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3429743"}},"subtitle":["A Multimodal Scenario for Music Analysis"],"short-title":[],"issued":{"date-parts":[[2021,5,8]]},"references-count":77,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,6]]}},"alternative-id":["10.1145\/3429743"],"URL":"https:\/\/doi.org\/10.1145\/3429743","relation":{},"ISSN":["1556-4673","1556-4711"],"issn-type":[{"value":"1556-4673","type":"print"},{"value":"1556-4711","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,8]]},"assertion":[{"value":"2019-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-05-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}