{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T18:37:29Z","timestamp":1772908649344,"version":"3.50.1"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,1,15]],"date-time":"2024-01-15T00:00:00Z","timestamp":1705276800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,1,15]],"date-time":"2024-01-15T00:00:00Z","timestamp":1705276800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100012456","name":"National Social Science Fund of China","doi-asserted-by":"publisher","award":["21ZD19"],"award-info":[{"award-number":["21ZD19"]}],"id":[{"id":"10.13039\/501100012456","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J AUDIO SPEECH MUSIC PROC."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Melody harmonization, which involves generating a chord progression that complements a user-provided melody, continues to pose a significant challenge. A chord progression must not only be in harmony with the melody, but also interdependent on its rhythmic pattern. While previous neural network-based systems have been successful in producing chord progressions for given melodies, they have not adequately addressed controllable melody harmonization, nor have they focused on generating harmonic rhythms with flexibility in the rates or patterns of chord changes. This paper presents AutoHarmonizer, a novel system for harmonic density-controllable melody harmonization with such a flexible harmonic rhythm. AutoHarmonizer is equipped with an extensive vocabulary of 1462 chord types and can generate chord progressions that vary in harmonic density for a given melody. Experimental results indicate that the AutoHarmonizer-generated chord progressions exhibit a diverse range of harmonic rhythms and that the system\u2019s controllable harmonic density is effective.<\/jats:p>","DOI":"10.1186\/s13636-023-00314-6","type":"journal-article","created":{"date-parts":[[2024,1,15]],"date-time":"2024-01-15T08:02:34Z","timestamp":1705305754000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Generating chord progression from melody with flexible harmonic rhythm and controllable harmonic density"],"prefix":"10.1186","volume":"2024","author":[{"given":"Shangda","family":"Wu","sequence":"first","affiliation":[]},{"given":"Yue","family":"Yang","sequence":"additional","affiliation":[]},{"given":"Zhaowen","family":"Wang","sequence":"additional","affiliation":[]},{"given":"Xiaobing","family":"Li","sequence":"additional","affiliation":[]},{"given":"Maosong","family":"Sun","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,1,15]]},"reference":[{"key":"314_CR1","doi-asserted-by":"publisher","unstructured":"A. Liu, L. Zhang, Y. Mei, B. Han, Z. Cai, Z. Zhu, J. Xiao, in MMPT@ICMR2021: Proceedings of the 2021 Workshop on Multi-Modal Pre-Training for Multimedia Understanding, Taipei, Taiwan, August 21, 2021, ed. by B. Liu, J. Fu, S. Chen, Q. Jin, A.G. Hauptmann, Y. Rui. Residual recurrent CRNN for end-to-end optical music recognition on monophonic scores (ACM, 2021), pp. 23\u201327. https:\/\/doi.org\/10.1145\/3463945.3469056","DOI":"10.1145\/3463945.3469056"},{"key":"314_CR2","unstructured":"J. Calvo-Zaragoza, D. Rizo, in Proceedings of the 19th International Society for Music Information Retrieval Conference, ISMIR 2018, Paris, France, September 23-27, 2018, ed. by E. G\u00f3mez, X. Hu, E. Humphrey, E. Benetos. Camera-primus: Neural end-to-end optical music recognition on realistic monophonic scores (2018), pp. 248\u2013255. http:\/\/ismir2018.ircam.fr\/doc\/pdfs\/33_Paper.pdf"},{"key":"314_CR3","doi-asserted-by":"publisher","unstructured":"D. Ghosal, M.H. Kolekar, in Interspeech 2018, 19th Annual Conference of the International Speech Communication Association, Hyderabad, India, 2-6 September 2018, ed. by B. Yegnanarayana. Music genre recognition using deep neural networks and transfer learning (ISCA, 2018), pp. 2087\u20132091. https:\/\/doi.org\/10.21437\/Interspeech.2018-2045","DOI":"10.21437\/Interspeech.2018-2045"},{"key":"314_CR4","doi-asserted-by":"publisher","unstructured":"E. Dervakos, N. Kotsani, G. Stamou, in Artificial Intelligence in Music, Sound, Art and Design - 10th International Conference, EvoMUSART 2021, Held as Part of EvoStar 2021, Virtual Event, April 7-9, 2021, Proceedings, Lecture Notes in Computer Science, vol. 12693, ed. by J. Romero, T. Martins, N. Rodr\u00edguez-Fern\u00e1ndez. Genre recognition from symbolic music with cnns (Springer, 2021), pp. 98\u2013114. https:\/\/doi.org\/10.1007\/978-3-030-72914-1_7","DOI":"10.1007\/978-3-030-72914-1_7"},{"key":"314_CR5","unstructured":"J. Briot, G. Hadjeres, F. Pachet, Deep learning techniques for music generation - A survey. CoRR abs\/1709.01620 (2017), accessed on November 27, 2023.\n@article{DBLP:journals\/corr\/abs-1709-01620,"},{"key":"314_CR6","doi-asserted-by":"publisher","unstructured":"L. Casini, M. Gustavo, M. Roccetti. Some Reflections on the Potential and Limitations of Deep Learning for Automated Music Generation. In: Proceedings of the 29th IEEE Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) 2018, Bologna, Italy, September 9-12, 2018, pp. 27-31. [Online]. Available: https:\/\/doi.org\/10.1109\/PIMRC.2018.8581038","DOI":"10.1109\/PIMRC.2018.8581038"},{"issue":"5","key":"314_CR7","first-page":"69:1","volume":"50","author":"D Herremans","year":"2017","unstructured":"D. Herremans, C. Chuan, E. Chew, A functional taxonomy of music generation systems. ACM Comput. Surv. 50(5), 69:1\u201369:30 (2017)","journal-title":"ACM Comput. Surv."},{"key":"314_CR8","doi-asserted-by":"crossref","unstructured":"D. Makris, I. Kayrdis, S. Sioutas. Automatic melodic harmonization: An overview, challenges and future directions. Trends in music information seeking, behavior, and retrieval for creativity (2016), 146\u2013165.","DOI":"10.4018\/978-1-5225-0270-8.ch008"},{"key":"314_CR9","doi-asserted-by":"publisher","unstructured":"W. Sun, J. Wu, S. Yuan, in IEEE International Conference on Multimedia and Expo Workshops, ICME Workshops 2022, Taipei, Taiwan, July 18-22, 2022. Melodic skeleton: A musical feature for automatic melody harmonization (IEEE, 2022), pp. 1\u20136. https:\/\/doi.org\/10.1109\/ICMEW56448.2022.9859421","DOI":"10.1109\/ICMEW56448.2022.9859421"},{"key":"314_CR10","unstructured":"H. Tsushima, E. Nakamura, K. Itoyama, K. Yoshii. Function- and Rhythm-Aware Melody Harmonization Based on Tree-Structured Parsing and Split-Merge Sampling of Chord Sequences. In: Proceedings of the 18th International Society for Music Information Retrieval Conference (ISMIR) 2017, Suzhou, China, October 23-27, 2017, pp. 502\u2013508. [Online]. Available: https:\/\/ismir2017.smcnus.org\/wp-content\/uploads\/2017\/10\/2_Paper.pdf"},{"key":"314_CR11","doi-asserted-by":"publisher","unstructured":"G. Brunner, Y. Wang, R. Wattenhofer, J. Wiesendanger, in 29th IEEE International Conference on Tools with Artificial Intelligence, ICTAI 2017, Boston, MA, USA, November 6-8, 2017. Jambot: Music theory aware chord based generation of polyphonic music with lstms (IEEE Computer Society, 2017), pp. 519\u2013526. https:\/\/doi.org\/10.1109\/ICTAI.2017.00085","DOI":"10.1109\/ICTAI.2017.00085"},{"key":"314_CR12","doi-asserted-by":"publisher","unstructured":"C. Sun, Y. Chen, H. Lee, Y. Chen, H. Wang, in IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2021, Toronto, ON, Canada, June 6-11, 2021. Melody harmonization using orderless nade, chord balancing, and blocked gibbs sampling (IEEE, 2021), pp. 4145\u20134149. https:\/\/doi.org\/10.1109\/ICASSP39728.2021.9414281","DOI":"10.1109\/ICASSP39728.2021.9414281"},{"key":"314_CR13","unstructured":"Y. Yin-Cheng, H. Wen-Yi, S. Fukayama, T. Kitahara, B. Genchel, H-M. Liu, H-W. Dong, Y. Chen, T. Leong, Y-H. Yang. Automatic Melody Harmonization with Triad Chords: A Comparative Study. CoRR, volume abs\/2001.02360, 2020. [Online]. Available: http:\/\/arxiv.org\/abs\/2001.02360"},{"key":"314_CR14","unstructured":"Y-W. Chen, H-S. Lee, Y-H. Chen, H-M. Wang. SurpriseNet: Melody Harmonization Conditioning on User-controlled Surprise Contours. In: Jin Ha Lee, Alexander Lerch, Zhiyao Duan, Juhan Nam, Preeti Rao, Peter van Kranenburg, Ajay Srinivasamurthy (Eds.), Proceedings of the 22nd International Society for Music Information Retrieval Conference, ISMIR 2021, Online, November 7-12, 2021, pp. 105-112. [Online]. Available: https:\/\/archives.ismir.net\/ismir2021\/paper\/000012.pdf"},{"key":"314_CR15","unstructured":"S. Wu, M. Sun. Efficient and Training-Free Control of Language Generation. 2023. [Online]. Available: https:\/\/arxiv.org\/abs\/2205.06036"},{"key":"314_CR16","unstructured":"H. Lim, S. Rhyu, K. Lee. Chord Generation from Symbolic Melody Using BLSTM Networks. In: Proceedings of the 18th International Society for Music Information Retrieval Conference (ISMIR) 2017, Suzhou, China, October 23-27, 2017, pp. 621-627. [Online]. Available: https:\/\/ismir2017.smcnus.org\/wp-content\/uploads\/2017\/10\/134_Paper.pdf"},{"key":"314_CR17","unstructured":"F.T. Liang, M. Gotham, M. Johnson, J. Shotton. Automatic Stylistic Composition of Bach Chorales with Deep LSTM. In: Proceedings of the 18th International Society for Music Information Retrieval Conference (ISMIR) 2017, Suzhou, China, October 23-27, 2017, pp. 449-456. [Online]. Available: https:\/\/ismir2017.smcnus.org\/wp-content\/uploads\/2017\/10\/156_Paper.pdf"},{"key":"314_CR18","unstructured":"G. Hadjeres, F. Pachet, F. Nielsen. DeepBach: a Steerable Model for Bach Chorales Generation. In: Proceedings of the 34th International Conference on Machine Learning (ICML) 2017, Sydney, NSW, Australia, August 6-11, 2017, pp. 1362-1371. [Online]. Available: http:\/\/proceedings.mlr.press\/v70\/hadjeres17a.html"},{"key":"314_CR19","unstructured":"C.A. Huang, C. Hawthorne, A. Roberts, M. Dinculescu, J. Wexler, L. Hong, J. Howcroft, The bach doodle: Approachable music composition with machine learning at scale. CoRR abs\/1907.06637 (2019). 1907.06637"},{"key":"314_CR20","doi-asserted-by":"publisher","unstructured":"W. Yang, P. Sun, Y. Zhang and Y. Zhang, \"CLSTMS: A Combination of Two LSTM Models to Generate Chords Accompaniment for Symbolic Melody,\" 2019 International Conference on High Performance Big Data and Intelligent Systems (HPBD&IS), Shenzhen, China, 2019, pp. 176-180. https:\/\/doi.org\/10.1109\/HPBDIS.2019.8735487","DOI":"10.1109\/HPBDIS.2019.8735487"},{"key":"314_CR21","unstructured":"M. Majidi, R.M. Toroghi, Music harmony generation, through deep learning and using a multi-objective evolutionary algorithm. CoRR abs\/2102.07960 (2021). 2102.07960"},{"key":"314_CR22","doi-asserted-by":"publisher","first-page":"28261","DOI":"10.1109\/ACCESS.2022.3155467","volume":"10","author":"S Rhyu","year":"2022","unstructured":"S. Rhyu, H. Choi, S. Kim, K. Lee, Translating melody to chord: Structured and flexible harmonization of melody with transformer. IEEE Access 10, 28261\u201328273 (2022). https:\/\/doi.org\/10.1109\/ACCESS.2022.3155467","journal-title":"IEEE Access"},{"key":"314_CR23","unstructured":"A. Roberts, J. Engel, D. Eck. Hierarchical Variational Autoencoders for Music. In: Proceedings of [Conference Name], [Conference Date], [Conference Location]. [Online]. Available: https:\/\/api.semanticscholar.org\/CorpusID:4483033"},{"key":"314_CR24","unstructured":"Y. Luo, K. Agres, D. Herremans, in Proceedings of the 20th International Society for Music Information Retrieval Conference, ISMIR 2019, Delft, The Netherlands, November 4-8, 2019, ed. by A. Flexer, G. Peeters, J. Urbano, A. Volk. Learning disentangled representations of timbre and pitch for musical instrument sounds using gaussian mixture variational autoencoders (2019). pp. 746\u2013753. http:\/\/archives.ismir.net\/ismir2019\/paper\/000091.pdf"},{"key":"314_CR25","unstructured":"Y. Zhang, Z. Wang, D. Wang, G. Xia, (2020). BUTTER: A representation learning framework for bi-directional music-sentence retrieval and generation. In Proceedings of the 1st workshop on nlp for music and audio (nlp4musa) (pp. 54-58)."},{"key":"314_CR26","unstructured":"K. Chen, C. Wang, T. Berg-Kirkpatrick, S. Dubnov, in Proceedings of the 21th International Society for Music Information Retrieval Conference, ISMIR 2020, Montreal, Canada, October 11-16, 2020, ed. by J. Cumming, J.H. Lee, B. McFee, M. Schedl, J. Devaney, C. McKay, E. Zangerle, T. de Reuse. Music sketchnet: Controllable music generation via factorized representations of pitch and rhythm (2020), pp. 77\u201384. http:\/\/archives.ismir.net\/ismir2020\/paper\/000146.pdf"},{"key":"314_CR27","unstructured":"Z. Wang, Y. Zhang, Y. Zhang, J. Jiang, R. Yang, G. Xia, J. Zhao, in Proceedings of the 21th International Society for Music Information Retrieval Conference, ISMIR 2020, Montreal, Canada, October 11-16, 2020, ed. by J. Cumming, J.H. Lee, B. McFee, M. Schedl, J. Devaney, C. McKay, E. Zangerle, T. de Reuse. PIANOTREE VAE: structured representation learning for polyphonic music (2020), pp. 368\u2013375. http:\/\/archives.ismir.net\/ismir2020\/paper\/000096.pdf"},{"key":"314_CR28","doi-asserted-by":"publisher","unstructured":"S. Di, Z. Jiang, S. Liu, Z. Wang, L. Zhu, Z. He, H. Liu, S. Yan, in MM \u201921: ACM Multimedia Conference, Virtual Event, China, October 20 - 24, 2021, ed. by H.T. Shen, Y. Zhuang, J.R. Smith, Y. Yang, P. Cesar, F. Metze, B. Prabhakaran. Video background music generation with controllable music transformer (ACM, 2021), pp. 2037\u20132045. https:\/\/doi.org\/10.1145\/3474085.3475195","DOI":"10.1145\/3474085.3475195"},{"key":"314_CR29","doi-asserted-by":"crossref","unstructured":"C. Harte, M. Sandler, M. Gasser, (2006, October). Detecting harmonic change in musical audio. In Proceedings of the 1st ACM workshop on Audio and music computing multimedia (pp. 21-26).","DOI":"10.1145\/1178723.1178727"}],"container-title":["EURASIP Journal on Audio, Speech, and Music Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13636-023-00314-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13636-023-00314-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13636-023-00314-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,15]],"date-time":"2024-01-15T08:04:38Z","timestamp":1705305878000},"score":1,"resource":{"primary":{"URL":"https:\/\/asmp-eurasipjournals.springeropen.com\/articles\/10.1186\/s13636-023-00314-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,15]]},"references-count":29,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["314"],"URL":"https:\/\/doi.org\/10.1186\/s13636-023-00314-6","relation":{},"ISSN":["1687-4722"],"issn-type":[{"value":"1687-4722","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,15]]},"assertion":[{"value":"9 May 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 November 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 January 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"4"}}