{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,10,16]],"date-time":"2024-10-16T04:27:16Z","timestamp":1729052836301},"reference-count":51,"publisher":"MIT Press","issue":"4","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,12,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>GuiaRT is an interactive musical setup based on a nylon-string guitar equipped with hexaphonic piezoelectric pickups. It consists of a modular set of real-time tools for the symbolic transcription, variation, and triggering of selected segments during a performance, as well as some audio processing capabilities. Its development relied on an iterative approach, with distinct phases dedicated to feature extraction, transcriptions, and creative use. This article covers the motivations for this augmented instrument and several details of its implementation, including the hardware and strategies for identifying the most typical types of sound produced on a nylon-string guitar, as well as tools for symbolic musical transformations. This acoustic\u2013digital interface was primarily designed for interactive exploration, and it has also been effectively used in performance analyses and as a pedagogical tool.<\/jats:p>","DOI":"10.1162\/comj_a_00625","type":"journal-article","created":{"date-parts":[[2023,3,6]],"date-time":"2023-03-06T16:11:47Z","timestamp":1678119107000},"page":"20-39","update-policy":"http:\/\/dx.doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":0,"title":["Real-Time Symbolic Transcription and Interactive Transformation Using a Hexaphonic Nylon-String Guitar"],"prefix":"10.1162","volume":"45","author":[{"given":"S\u00e9rgio","family":"Freire","sequence":"first","affiliation":[{"name":"Laboratory for Performance with Interactive Systems Federal University of Minas Gerais, School of Music 6627 Avenida Ant\u00f4nio Carlos, Belo Horizonte, 31270-901 Brazil sfreire@musica.ufmg.br"}]},{"given":"Augusto","family":"Armondes","sequence":"additional","affiliation":[{"name":"Laboratory for Performance with Interactive Systems Federal University of Minas Gerais, School of Music 6627 Avenida Ant\u00f4nio Carlos, Belo Horizonte, 31270-901 Brazil augusto_armondes@hotmail.com"}]},{"given":"Rubens","family":"Silva","sequence":"additional","affiliation":[{"name":"Laboratory for Performance with Interactive Systems Federal University of Minas Gerais, School of Music 6627 Avenida Ant\u00f4nio Carlos, Belo Horizonte, 31270-901 Brazil rubensneto.8@gmail.com"}]}],"member":"281","published-online":{"date-parts":[[2021,12,1]]},"reference":[{"key":"2023052218355341100_B1","first-page":"187","article-title":"Hexaphonic Guitar Transcription and Visualisation","author":"Angulo","year":"2016","journal-title":"Proceedings of the International Conference on Technologies for Music Notation and Representation"},{"issue":"3","key":"2023052218355341100_B2","doi-asserted-by":"publisher","first-page":"915","DOI":"10.1109\/TASL.2011.2174227","article-title":"Automatic Transcription of Guitar Chords and Fingering from Audio","volume":"20","author":"Barbancho","year":"2012","journal-title":"IEEE Transactions on Audio, Speech, and Language Processing"},{"issue":"6","key":"2023052218355341100_B3","doi-asserted-by":"publisher","first-page":"1857","DOI":"10.1109\/TASL.2012.2191281","article-title":"Inharmonicity-Based Method for the Automatic Generation of Guitar Tablature","volume":"20","author":"Barbancho","year":"2012","journal-title":"IEEE Transactions on Audio, Speech, and Language Processing"},{"key":"2023052218355341100_B4","first-page":"771","article-title":"A Few-Sample Strategy for Guitar Tablature Transcription Based on Inharmonicity Analysis and Playability Constraints","author":"Bastas","year":"2022","journal-title":"IEEE International Conference on Acoustics, Speech and Signal Processing)"},{"issue":"5","key":"2023052218355341100_B5","doi-asserted-by":"publisher","first-page":"1035","DOI":"10.1109\/TSA.2005.851998","article-title":"A Tutorial on Onset Detection in Music Signals","volume":"13","author":"Bello","year":"2005","journal-title":"IEEE Transactions on Speech and Audio Processing"},{"volume-title":"Escuela de la guitarra: Exposici\u00f3n de la teor\u00eda instrumental","year":"1979","author":"Carlevaro","key":"2023052218355341100_B6"},{"key":"2023052218355341100_B7","first-page":"107","article-title":"Efficient Signal Extrapolation by Granulation and Convolution with Velvet Noise","author":"D'Angelo","year":"2018","journal-title":"Proceedings of the International Conference on Digital Audio Effects"},{"key":"2023052218355341100_B8","first-page":"641","article-title":"On Rhythmic Pattern Extraction in Bossa Nova Music","author":"De Lima","year":"2008","journal-title":"Proceedings of the International Society for Music Information Retrieval Conference"},{"issue":"1","key":"2023052218355341100_B9","first-page":"19","article-title":"Lexicon-Sonate: An Interactive Realtime Composition for Computer-Controlled Piano","volume":"16","author":"Essl","year":"1996","journal-title":"Array: Journal of the ICMA"},{"key":"2023052218355341100_B10","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1145\/642611.642652","article-title":"Design-Oriented Human\u2013Computer Interaction","author":"Fallman","year":"2003","journal-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems"},{"key":"2023052218355341100_B11","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1007\/978-3-319-12976-1_4","article-title":"Automatic Classification of Guitar Playing Modes","volume-title":"Sound, Music, and Motion: 10th International Symposium, CMMR 2013","author":"Foulon","year":"2014"},{"article-title":"Composing Through Computer Programming: A Sonological Experience","year":"1993","author":"Freire","key":"2023052218355341100_B12"},{"key":"2023052218355341100_B13","first-page":"509","article-title":"Analysis of Musical Textures Played on the Guitar by Means of Real-Time Extraction of Mid-Level Descriptors","author":"Freire","year":"2015","journal-title":"Proceedings of the Sound and Computing Conference"},{"key":"2023052218355341100_B14","doi-asserted-by":"publisher","first-page":"329","DOI":"10.5281\/zenodo.850407","article-title":"Study of the Tremolo Technique on the Acoustic Guitar: Experimental Setup and Preliminary Results on Regularity","author":"Freire","year":"2013","journal-title":"Proceedings of the Sound and Music Computing Conference"},{"key":"2023052218355341100_B15","doi-asserted-by":"publisher","first-page":"1010","DOI":"10.5281\/zenodo.850753","article-title":"Analysis of the Simultaneity, Voice\/Layer Balance and Rhythmic Phrasing in Works for Guitar by Rodrigo, Brouwer and Villa-Lobos","author":"Freire","year":"2014","journal-title":"Proceedings of the Sound and Computing Conference and International Computer Music Conference"},{"key":"2023052218355341100_B16","doi-asserted-by":"publisher","first-page":"543","DOI":"10.5281\/zenodo.1422685","article-title":"Strumming on an Acoustic Nylon Guitar: Microtiming, Beat Control and Rhythmic Expression in Three Different Accompaniment Patterns","author":"Freire","year":"2018","journal-title":"Proceedings of the Sound and Music Computing Conference"},{"article-title":"Multimodal Guitar: Performance Toolbox and Study Workbench","year":"2009","author":"Frisson","key":"2023052218355341100_B17"},{"volume-title":"Instrumentation in der Musik des 20. Jahrhunderts","year":"1984","author":"Gieseler","key":"2023052218355341100_B18"},{"key":"2023052218355341100_B19","first-page":"581","article-title":"SEPTAR: Audio Breakout Circuit for Multichannel Guitar","author":"Graham","year":"2015","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"issue":"1","key":"2023052218355341100_B20","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1162\/LEON_a_01120","article-title":"Diversity in NIME Research Practices","volume":"49","author":"Gurevich","year":"2016","journal-title":"Leonardo"},{"key":"2023052218355341100_B21","first-page":"151","article-title":"Estimation of Guitar String, Fret and Plucking Position Using Parametric Pitch Estimation","author":"Hjerrild","year":"2019","journal-title":"Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing"},{"key":"2023052218355341100_B22","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1109\/WASPAA.2019.8937157","article-title":"Physical Models for Fast Estimation of Guitar String, Fret and Plucking Position","author":"Hjerrild","year":"2019","journal-title":"IEEE Workshop on Applications of Signal Processing to Audio and Acoustics"},{"key":"2023052218355341100_B23","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-92069-6","volume-title":"New Directions in Music and Human\u2013Computer Interaction","author":"Holland","year":"2019"},{"issue":"2","key":"2023052218355341100_B24","doi-asserted-by":"publisher","first-page":"56","DOI":"10.2307\/3680063","article-title":"Extensions of the Karplus-Strong Plucked-String Algorithm","volume":"7","author":"Jaffe","year":"1983","journal-title":"Computer Music Journal"},{"issue":"3","key":"2023052218355341100_B25","doi-asserted-by":"publisher","first-page":"17","DOI":"10.2307\/3681155","article-title":"Plucked-String Models: From the Karplus-Strong Algorithm to Digital Waveguides and Beyond","volume":"22","author":"Karjalainen","year":"1998","journal-title":"Computer Music Journal"},{"issue":"2","key":"2023052218355341100_B26","doi-asserted-by":"publisher","first-page":"43","DOI":"10.2307\/3680062","article-title":"Digital Synthesis of Plucked-String and Drum Timbres","volume":"7","author":"Karplus","year":"1983","journal-title":"Computer Music Journal"},{"key":"2023052218355341100_B27","first-page":"219","article-title":"Automatic Tablature Transcription of Electric Guitar Recordings by Estimation of Score- and Instrument-Related Parameters","author":"Kehling","year":"2014","journal-title":"Proceedings of the International Conference on Digital Audio Effects"},{"issue":"3","key":"2023052218355341100_B28","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1162\/014892601753189529","article-title":"Methods for Modeling Realistic Playing in Acoustic Guitar Synthesis","volume":"25","author":"Laurson","year":"2001","journal-title":"Computer Music Journal"},{"article-title":"The Velvet Cloud: Infinite Sustain and Reverberation Using Velvet Noise","year":"2020","author":"L\u00e1zaro","key":"2023052218355341100_B29"},{"key":"2023052218355341100_B30","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1162\/096112100570585","article-title":"Too Many Notes: Computers, Complexity and Culture in Voyager","volume":"10","author":"Lewis","year":"2000","journal-title":"Leonardo Music Journal"},{"key":"2023052218355341100_B31","first-page":"222","article-title":"GuitarAMI and GuiaRT: Two Independent Yet Complementary Projects on Augmented Nylon Guitars","author":"Meneses","year":"2018","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"key":"2023052218355341100_B32","doi-asserted-by":"publisher","DOI":"10.1049\/cp.2009.1699","article-title":"Automatic Hexaphonic Guitar Transcription Using Non-Negative Constraints","author":"O'Grady","year":"2009","journal-title":"Proceedings of IEEE Symposium on Computers and Communications"},{"key":"2023052218355341100_B33","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1007\/978-3-642-23126-1_15","article-title":"Identifying Attacks Articulations in Classical Guitar","volume-title":"Exploring Music Contents (CMMR 2010)","author":"\u00d6zaslan","year":"2011"},{"issue":"5","key":"2023052218355341100_B34","doi-asserted-by":"publisher","first-page":"2902","DOI":"10.1121\/1.3642604","article-title":"The Timbre Toolbox: Extracting Audio Descriptors from Musical Signals","volume":"130","author":"Peeters","year":"2011","journal-title":"Journal of the Acoustical Society of America"},{"article-title":"Patch for Guitar","year":"2007","author":"Puckette","key":"2023052218355341100_B35"},{"key":"2023052218355341100_B36","doi-asserted-by":"crossref","DOI":"10.1142\/6277","volume-title":"The Theory and Technique of Electronic Music","author":"Puckette","year":"2007"},{"key":"2023052218355341100_B37","first-page":"109","article-title":"Real-Time Audio Analysis Tools for Pd and MSP","author":"Puckette","year":"1998","journal-title":"Proceedings of the International Computer Music Conference"},{"key":"2023052218355341100_B38","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.1180575","article-title":"Left and Right-Hand Guitar Playing Techniques Detection","author":"Reboursi\u00e8re","year":"2012","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"issue":"1","key":"2023052218355341100_B39","doi-asserted-by":"publisher","first-page":"62","DOI":"10.2307\/3681273","article-title":"Real-Time Performance Interaction with a Computer-Controlled Acoustic Piano","volume":"20","author":"Risset","year":"1996","journal-title":"Computer Music Journal"},{"volume-title":"Interactive Music Systems: Machine Listening and Composing","year":"1993","author":"Rowe","key":"2023052218355341100_B40"},{"key":"2023052218355341100_B41","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/4361.001.0001","volume-title":"Machine Musicianship","author":"Rowe","year":"2001"},{"volume-title":"Treatise on Musical Objects: An Essay across Disciplines","year":"2017","author":"Schaeffer","key":"2023052218355341100_B42"},{"key":"2023052218355341100_B43","first-page":"820","article-title":"Does Timbral Brightness Scale with Frequency and Spectral Centroid?","volume":"92","author":"Schubert","year":"2006","journal-title":"Acta Acustica United with Acustica"},{"key":"2023052218355341100_B44","first-page":"188","article-title":"Extraction of the Excitation Point Location on a String Using Weighted Least-Square Estimation of a Comb Filter Delay","author":"Traube","year":"2003","journal-title":"Proceedings of the International Conference on Digital Audio Effects"},{"key":"2023052218355341100_B45","first-page":"32","article-title":"Creating Endless Sounds","author":"V\u00e4lim\u00e4ki","year":"2018","journal-title":"Proceedings of the International Conference on Digital Audio Effects"},{"key":"2023052218355341100_B46","first-page":"171","article-title":"Situated Trio: An Interactive Live Performance for a Hexaphonic Guitarist and Two Computer Musicians with Expressive Controllers","author":"Wessel","year":"2002","journal-title":"Proceedings of the International Conference on New Interfaces for Musical Expression"},{"volume-title":"Composing Interactive Music: Techniques and Ideas Using Max","year":"1998","author":"Winkler","key":"2023052218355341100_B47"},{"key":"2023052218355341100_B48","first-page":"453","article-title":"Guitarset: a Dataset for Guitar Transcription","author":"Xi","year":"2018","journal-title":"Proceedings of the International Society for Music Information Retrieval Conference"},{"issue":"4","key":"2023052218355341100_B49","doi-asserted-by":"publisher","first-page":"13","DOI":"10.2307\/3680237","article-title":"M and Jam Factory","volume":"11","author":"Zicarelli","year":"1987","journal-title":"Computer Music Journal"},{"key":"2023052218355341100_B50","doi-asserted-by":"crossref","DOI":"10.1002\/9781119991298","volume-title":"DAFX: Digital Audio Effects","author":"Z\u00f6lzer","year":"2011"},{"issue":"2","key":"2023052218355341100_B51","doi-asserted-by":"publisher","DOI":"10.1121\/1.1908630","article-title":"Subdivision of the Audible Frequency Range into Critical Bands (Frequenzgruppen)","volume":"33","author":"Zwicker","year":"1961","journal-title":"Journal of the Acoustical Society of America"}],"container-title":["Computer Music Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/comj\/article-pdf\/45\/4\/20\/2104486\/comj_a_00625.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/comj\/article-pdf\/45\/4\/20\/2104486\/comj_a_00625.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,15]],"date-time":"2024-10-15T21:25:19Z","timestamp":1729027519000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/comj\/article\/45\/4\/20\/115082\/Real-Time-Symbolic-Transcription-and-Interactive"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021]]},"references-count":51,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,12,1]]},"published-print":{"date-parts":[[2021,12,1]]}},"URL":"https:\/\/doi.org\/10.1162\/comj_a_00625","relation":{},"ISSN":["0148-9267","1531-5169"],"issn-type":[{"type":"print","value":"0148-9267"},{"type":"electronic","value":"1531-5169"}],"subject":[],"published-other":{"date-parts":[[2021]]},"published":{"date-parts":[[2021]]}}}