{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,7]],"date-time":"2026-02-07T19:48:55Z","timestamp":1770493735490,"version":"3.49.0"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,6,18]],"date-time":"2021-06-18T00:00:00Z","timestamp":1623974400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,6,18]],"date-time":"2021-06-18T00:00:00Z","timestamp":1623974400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100007065","name":"Universit\u00e0 degli Studi di Salerno","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100007065","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"published-print":{"date-parts":[[2022,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Gestural expressiveness plays a fundamental role in the interaction with people, environments, animals, things, and so on. Thus, several emerging application domains would exploit the interpretation of movements to support their critical designing processes. To this end, new forms to express the people\u2019s perceptions could help their interpretation, like in the case of music. In this paper, we investigate the user\u2019s perception associated with the interpretation of sounds by highlighting how sounds can be exploited for helping users in adapting to a specific environment. We present a novel algorithm for mapping human movements into MIDI music. The algorithm has been implemented in a system that integrates a module for real-time tracking of movements through a sample based synthesizer using different types of filters to modulate frequencies. The system has been evaluated through a user study, in which several users have participated in a room experience, yielding significant results about their perceptions with respect to the environment they were immersed.<\/jats:p>","DOI":"10.1007\/s11042-021-11077-7","type":"journal-article","created":{"date-parts":[[2021,6,18]],"date-time":"2021-06-18T10:03:07Z","timestamp":1624010587000},"page":"73-94","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Enhancing spatial perception through sound: mapping human movements into MIDI"],"prefix":"10.1007","volume":"81","author":[{"given":"Bernardo","family":"Breve","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0201-2753","authenticated-orcid":false,"given":"Stefano","family":"Cirillo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mariano","family":"Cuofano","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Domenico","family":"Desiato","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,6,18]]},"reference":[{"key":"11077_CR1","doi-asserted-by":"publisher","unstructured":"Albacete PL, Chang SK, Polese G (1998) Iconic language design for people with significant speech and multiple impairments. https:\/\/doi.org\/10.1007\/BFb0055967. Springer, Berlin, pp 12\u201332","DOI":"10.1007\/BFb0055967"},{"issue":"8","key":"11077_CR2","doi-asserted-by":"publisher","first-page":"1619","DOI":"10.1109\/TPAMI.2010.226","volume":"33","author":"B Babenko","year":"2011","unstructured":"Babenko B, Yang MH, Belongie S (2011) Robust object tracking with online multiple instance learning. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 33(8):1619\u20131632","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)"},{"key":"11077_CR3","unstructured":"Bagdanov AD, Del Bimbo A, Seidenari L, Usai L (2012) Real-time hand status recognition from rgb-d imagery. In: Proc. of international conference on pattern recognition (ICPR\u201912), pp 2456\u20132459"},{"key":"11077_CR4","doi-asserted-by":"crossref","unstructured":"Bohush R, Zakharava I (2019) Robust person tracking algorithm based on convolutional neural network for indoor video surveillance systems. In: International conference on pattern recognition and information processing. Springer, pp 289\u2013300","DOI":"10.1007\/978-3-030-35430-5_24"},{"key":"11077_CR5","doi-asserted-by":"crossref","unstructured":"Bolme DS, Beveridge JR, Draper BA, Lui YM (2010) Visual object tracking using adaptive correlation filters. In: 2010 IEEE computer society conference on computer vision and pattern recognition. IEEE, pp 2544\u20132550","DOI":"10.1109\/CVPR.2010.5539960"},{"issue":"4","key":"11077_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3397462","volume":"12","author":"L Caruccio","year":"2020","unstructured":"Caruccio L, Cirillo S (2020) Incremental discovery of imprecise functional dependencies. Journal of Data and Information Quality (JDIQ) 12(4):1\u201325","journal-title":"Journal of Data and Information Quality (JDIQ)"},{"key":"11077_CR7","doi-asserted-by":"publisher","first-page":"190","DOI":"10.1016\/j.eswa.2019.04.031","volume":"131","author":"L Caruccio","year":"2019","unstructured":"Caruccio L, Polese G, Tortora G, Iannone D (2019) Edcar: a knowledge representation framework to enhance automatic video surveillance. Expert Syst Appl 131:190\u2013207","journal-title":"Expert Syst Appl"},{"issue":"3","key":"11077_CR8","doi-asserted-by":"publisher","first-page":"528","DOI":"10.3390\/app9030528","volume":"9","author":"F Chin-Shyurng","year":"2019","unstructured":"Chin-Shyurng F, Lee SE, Wu ML (2019) Real-time musical conducting gesture recognition based on a dynamic time warping classifier using a single-depth camera. Appl Sci 9(3):528","journal-title":"Appl Sci"},{"key":"11077_CR9","doi-asserted-by":"crossref","unstructured":"Choi I, Bargar R (1995) Interfacing sound synthesis to movement for exploring high-dimensional systems in a virtual environment. In: 1995 IEEE international conference on systems, man and cybernetics. Intelligent systems for the 21st century, vol 3, pp 2772\u20132777. IEEE","DOI":"10.1109\/ICSMC.1995.538582"},{"issue":"1","key":"11077_CR10","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1177\/0305735617734627","volume":"47","author":"T Cook","year":"2019","unstructured":"Cook T, Roy AR, Welker KM (2019) Music as an emotion regulation strategy: an examination of genres of music and their roles in emotion regulation. Psychol Music 47(1):144\u2013154","journal-title":"Psychol Music"},{"issue":"6","key":"11077_CR11","doi-asserted-by":"publisher","first-page":"773","DOI":"10.1109\/TKDE.2008.133","volume":"21","author":"G Costagliola","year":"2008","unstructured":"Costagliola G, Fuccella V, Giordano M, Polese G (2008) Monitoring online tests through data visualization. IEEE Trans Knowl Data Eng 21 (6):773\u2013784","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"11077_CR12","unstructured":"Flam M (2001) Musical instrument digital interface with speech capability. US Patent 6,191,349"},{"key":"11077_CR13","doi-asserted-by":"crossref","unstructured":"Grabner H, Bischof H (2006) On-line boosting and vision. In: Proc. IEEE conference on computer vision and pattern recognition (CVPR\u201906), pp 260\u2013267. IEEE","DOI":"10.1109\/CVPR.2006.215"},{"key":"11077_CR14","unstructured":"Helmholtz H (2013) On the sensations of tone. Courier Corporation"},{"issue":"3","key":"11077_CR15","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1109\/TPAMI.2014.2345390","volume":"37","author":"J Henriques","year":"2014","unstructured":"Henriques J, Caseiro R, Martins P, Batista J (2014) High-speed tracking with kernelized correlation filters. IEEE Transactions on Pattern Analysis and Machine Intelligence 37(3):583\u2013596","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"11077_CR16","unstructured":"Huber DM (2007) The MIDI manual: a practical guide to MIDI in the project studio. Taylor & Francis"},{"key":"11077_CR17","doi-asserted-by":"crossref","unstructured":"Kalal Z, Mikolajczyk K, Matas J (2010) Forward-backward error: automatic detection of tracking failures. In: Proc. of international conference on pattern recognition, pp 2756\u20132759","DOI":"10.1109\/ICPR.2010.675"},{"issue":"7","key":"11077_CR18","doi-asserted-by":"publisher","first-page":"1409","DOI":"10.1109\/TPAMI.2011.239","volume":"34","author":"Z Kalal","year":"2011","unstructured":"Kalal Z, Mikolajczyk K, Matas J (2011) Tracking-learning-detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 34 (7):1409\u20131422","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"11077_CR19","unstructured":"Marrin T, Picard R (1998) The \u201cconductor\u2019s jacket\u201d: a device for recording expressive musical gestures. In: Proceedings of international computer music conference"},{"issue":"3","key":"11077_CR20","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1109\/TSMCC.2007.893280","volume":"37","author":"S Mitra","year":"2007","unstructured":"Mitra S, Acharya T (2007) Gesture recognition: a survey. IEEE Transactions on Systems Man and Cybernetics C 37(3):311\u2013324. https:\/\/doi.org\/10.1109\/TSMCC.2007.893280","journal-title":"IEEE Transactions on Systems Man and Cybernetics C"},{"key":"11077_CR21","doi-asserted-by":"crossref","unstructured":"Moccia S, Migliorelli L, Carnielli V, Frontoni E (2019) Preterm infants\u2019 pose estimation with spatio-temporal features. IEEE Transactions on Biomedical Engineering","DOI":"10.1109\/TBME.2019.2961448"},{"issue":"1","key":"11077_CR22","doi-asserted-by":"publisher","first-page":"19","DOI":"10.2307\/3679834","volume":"12","author":"FR Moore","year":"1988","unstructured":"Moore FR (1988) The dysfunctions of midi. Computer Music Journal 12(1):19\u201328","journal-title":"Computer Music Journal"},{"key":"11077_CR23","doi-asserted-by":"crossref","unstructured":"Nikouei SY, Chen Y, Song S, Faughnan TR (2019) Kerman: a hybrid lightweight tracking algorithm to enable smart surveillance as an edge service. In: 2019 16th IEEE annual consumer communications & networking conference (CCNC), pp 1\u20136. IEEE","DOI":"10.1109\/CCNC.2019.8651791"},{"key":"11077_CR24","unstructured":"Niu W, Long J, Han D, Wang Y (2004) Human activity detection and recognition for video surveillance. In: Proc. of international conference on multimedia and expo, pp 719\u2013722"},{"key":"11077_CR25","doi-asserted-by":"crossref","unstructured":"Ortale R, Ritacco E, Pelekis N, Trasarti R, Costa G, Giannotti F, Manco G, Renso C, Theodoridis Y (2008) The daedalus framework: progressive querying and mining of movement data. In: Proc. of international conf. on advances in geographic information systems, pp 1\u20134","DOI":"10.1145\/1463434.1463497"},{"key":"11077_CR26","unstructured":"Overholt D (2001) The MATRIX: a novel controller for musical expression. In: New interfaces for musical expression. http:\/\/www.nime.org\/proceedings\/2001\/nime2001_038.pdf, pp 38\u201341"},{"key":"11077_CR27","unstructured":"Ozcan G, Isikhan C, Alpkocak A (2005) Melody extraction on midi music files. In: Seventh IEEE international symposium on multimedia (ISM\u201905), pp 8\u2013pp. IEEE"},{"key":"11077_CR28","doi-asserted-by":"crossref","unstructured":"Raaj Y, Idrees H, Hidalgo G, Sheikh Y (2019) Efficient online multi-person 2D pose tracking with recurrent spatio-temporal affinity fields. In: Proc. of IEEE conference on computer vision and pattern recognition, pp 4620\u20134628","DOI":"10.1109\/CVPR.2019.00475"},{"key":"11077_CR29","unstructured":"Rumsey F (1994) MIDI systems and control. Butterworth-Heinemann"},{"key":"11077_CR30","doi-asserted-by":"crossref","unstructured":"Shehzed A, Jalal A, Kim K (2019) Multi-person tracking in smart surveillance system for crowd counting and normal\/abnormal events detection. In: 2019 international conference on applied and engineering mathematics (ICAEM), pp 163\u2013168. IEEE","DOI":"10.1109\/ICAEM.2019.8853756"},{"key":"11077_CR31","unstructured":"Tattara M, Aureli PV (2017) The room of one\u2019s own. The architecture of the (private) room black square"},{"key":"11077_CR32","doi-asserted-by":"crossref","unstructured":"Vitiello G, Sebillo M, Fornaro L, Di Gregorio M, Cirillo S, De Rosa M, Fuccella V, Costagliola G (2018) Do you like my outfit? cromnia, a mobile assistant for blind users. In: Proceedings of the 4th EAI international conference on smart objects and technologies for social good, pp 249\u2013254","DOI":"10.1145\/3284869.3284908"},{"issue":"2","key":"11077_CR33","doi-asserted-by":"publisher","first-page":"105","DOI":"10.7763\/IJCCE.2014.V3.301","volume":"3","author":"ME Yildirim","year":"2014","unstructured":"Yildirim ME, Park J, Song J, Yoon B (2014) Gender classification based on binary haar cascade. International Journal of Computer and Communication Engineering 3(2):105","journal-title":"International Journal of Computer and Communication Engineering"},{"key":"11077_CR34","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1016\/j.smhl.2017.12.003","volume":"11","author":"H Zhao","year":"2019","unstructured":"Zhao H, Wang S, Zhou G, Zhang D (2019) Ultigesture: a wristband-based platform for continuous gesture control in healthcare. Smart Health 11:45\u201365","journal-title":"Smart Health"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-021-11077-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-021-11077-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-021-11077-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,2]],"date-time":"2024-09-02T03:07:33Z","timestamp":1725246453000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-021-11077-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,18]]},"references-count":34,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,1]]}},"alternative-id":["11077"],"URL":"https:\/\/doi.org\/10.1007\/s11042-021-11077-7","relation":{},"ISSN":["1380-7501","1573-7721"],"issn-type":[{"value":"1380-7501","type":"print"},{"value":"1573-7721","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,18]]},"assertion":[{"value":"22 June 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 February 2021","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 May 2021","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 June 2021","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}