{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T23:07:36Z","timestamp":1784934456971,"version":"3.55.0"},"reference-count":44,"publisher":"SAGE Publications","license":[{"start":{"date-parts":[[2026,1,1]],"date-time":"2026-01-01T00:00:00Z","timestamp":1767225600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2026,1,1]],"date-time":"2026-01-01T00:00:00Z","timestamp":1767225600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"name":"New South Wales Smart Sensing Network"},{"name":"Australian Future Hearing Initiative"},{"DOI":"10.13039\/501100001230","name":"Macquarie University","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001230","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Cochlear, Next Sense and the Shepherd Centre"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Trends in Hearing"],"published-print":{"date-parts":[[2026,1]]},"abstract":"<jats:p>Designing multi-sensor experiments to study interactive communication is costly, complex, and often poorly documented, particularly in terms of implementation challenges and the rationale behind decision-making. Here, we aim to demystify the process by detailing the development of a custom multi-sensor lab designed to monitor comprehensive behavioural and physiological responses during interactive communication. To illustrate the system architecture, we use an implemented paradigm as a worked example: two adults engaged in natural conversation while listening to realistic background noise scenes delivered via open Sennheiser HD-800 headphones. Multi-sensor data were collected using DPA headset microphones, Tobii Pro Glasses 3, a Vicon motion capture system (with Tobii integration), BIOPAC amplifiers (PPG, EDA, ECG, respiration, temperature), a Fitbit Sense 2 smartwatch, and six Logitech BRIO 4K ultra HD video cameras recording via Open Broadcaster Software (OBS). Due to high bandwidth demands and varying sampling rates (1 Hz to 48 kHz) among the different devices, all systems recorded independently which posed a significant synchronisation challenge. A central RME soundcard delivered trigger pulses to the Tobii, BIOPAC, OBS, and Vicon systems to mark stimulus onset\/offset. Redundant synchronisation mechanisms were implemented to mitigate the risk of trigger failure and bespoke processing pipelines were developed to synchronise data streams. We share key challenges and creative solutions encountered in building such a lab, to help researchers understand and anticipate common pain points and make more informed decisions when implementing their own multi-sensor setups.<\/jats:p>","DOI":"10.1177\/23312165261470622","type":"journal-article","created":{"date-parts":[[2026,7,21]],"date-time":"2026-07-21T14:49:02Z","timestamp":1784645342000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["Building a Multi-Sensor Lab for Interactive Communication Research: Challenges, Workarounds, and Lessons Learned"],"prefix":"10.1177","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1023-6351","authenticated-orcid":false,"given":"Ronny Kurniawan","family":"Ibrahim","sequence":"first","affiliation":[{"name":"Macquarie University Hearing Research Centre"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kelly","family":"Miles","sequence":"additional","affiliation":[{"name":"Macquarie University Hearing Research Centre"},{"name":"Macquarie University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lisa","family":"Maggs","sequence":"additional","affiliation":[{"name":"Macquarie University Hearing Research Centre"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-5284-6255","authenticated-orcid":false,"given":"Brooke","family":"Luthy","sequence":"additional","affiliation":[{"name":"Macquarie University Hearing Research Centre"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alan","family":"Kan","sequence":"additional","affiliation":[{"name":"Macquarie University Hearing Research Centre"},{"name":"Macquarie University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael J.","family":"Richardson","sequence":"additional","affiliation":[{"name":"Macquarie University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Julian","family":"Maclaren","sequence":"additional","affiliation":[{"name":"Google Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-1079-3067","authenticated-orcid":false,"given":"Simon","family":"Carlile","sequence":"additional","affiliation":[{"name":"Google Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0819-4562","authenticated-orcid":false,"given":"Zachary M.","family":"Smith","sequence":"additional","affiliation":[{"name":"Cochlear Limited"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joerg M.","family":"Buchholz","sequence":"additional","affiliation":[{"name":"Macquarie University Hearing Research Centre"},{"name":"Macquarie University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2026,7,21]]},"reference":[{"key":"e_1_3_4_2_1","doi-asserted-by":"publisher","DOI":"10.1044\/2025_JSLHR-24-00847"},{"key":"e_1_3_4_3_1","doi-asserted-by":"publisher","DOI":"10.3389\/fauot.2023.1275210"},{"key":"e_1_3_4_4_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2023-1007"},{"key":"e_1_3_4_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.heares.2025.109437"},{"key":"e_1_3_4_6_1","doi-asserted-by":"publisher","DOI":"10.1080\/02699206.2018.1498541"},{"key":"e_1_3_4_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2018.04.007"},{"key":"e_1_3_4_8_1","doi-asserted-by":"publisher","DOI":"10.7224\/1537-2073.2015-006"},{"key":"e_1_3_4_9_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-022-10414-6"},{"key":"e_1_3_4_10_1","doi-asserted-by":"publisher","DOI":"10.2196\/27677"},{"issue":"2","key":"e_1_3_4_11_1","first-page":"127","article-title":"Communication difficulties experienced by nursing home residents with a hearing loss during conversation with staff members","volume":"18","author":"Caissie R.","year":"1994","unstructured":"Caissie R., Rockwell E. (1994). Communication difficulties experienced by nursing home residents with a hearing loss during conversation with staff members. Journal of Speech-Language Pathology and Audiology, 18(2), 127\u2013134. https:\/\/www.cjslpa.ca\/detail.php?ID=265&lang=en","journal-title":"Journal of Speech-Language Pathology and Audiology"},{"key":"e_1_3_4_12_1","doi-asserted-by":"crossref","unstructured":"Cao Z. Hidalgo G. Simon T. Wei S.-E. Sheikh Y. (2019 May 30). OpenPose: Realtime multi-person 2d pose estimation using part affinity fields IEEE Transactions on Pattern Analysis and Machine Intelligence. 43(1) 172-186. https:\/\/doi.org\/10.1109\/TPAMI.2019.2929257","DOI":"10.1109\/TPAMI.2019.2929257"},{"key":"e_1_3_4_13_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461445616683592"},{"key":"e_1_3_4_14_1","volume-title":"A reference manual for training in efficient lighting principles","author":"Department of the Environment and Energy","year":"2019","unstructured":"Department of the Environment and Energy. (2019, June). A reference manual for training in efficient lighting principles. Department of the Environment and Energy. https:\/\/www.energyrating.gov.au\/sites\/default\/files\/2022-12\/Lighting_Manual_-_Main_Body_-_Final_ex_Appendices.pdf"},{"key":"e_1_3_4_15_1","volume-title":"EmbracePlus","author":"Empatica","year":"2026","unstructured":"Empatica. (2026). EmbracePlus. https:\/\/www.empatica.com\/embraceplus\/"},{"key":"e_1_3_4_16_1","volume-title":"Method for the assessment of the colorimetric properties of luminaires, the television lighting consistency index (TLCI-2012) & television luminaire matching factor (TLMF-2013)","author":"European Broadcasting Union","year":"2017","unstructured":"European Broadcasting Union. (2017). Method for the assessment of the colorimetric properties of luminaires, the television lighting consistency index (TLCI-2012) & television luminaire matching factor (TLMF-2013). European Broadcasting Union. https:\/\/tech.ebu.ch\/docs\/tech\/tech3355.pdf."},{"key":"e_1_3_4_17_1","volume-title":"Free TV australia operational practice OP\u201331: Lighting requirements for television (OP\u201331)","author":"Free TV Australia","year":"2019","unstructured":"Free TV Australia. (2019). Free TV australia operational practice OP\u201331: Lighting requirements for television (OP\u201331). Free TV Australia. https:\/\/www.freetv.com.au\/wp-content\/uploads\/2019\/08\/OP-31-Lighting-requirements-for-television-Issue-4-May-2019.pdf"},{"key":"e_1_3_4_18_1","doi-asserted-by":"publisher","DOI":"10.1177\/2331216518802701"},{"key":"e_1_3_4_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.buildenv.2024.111554"},{"key":"e_1_3_4_20_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-019-46416-0"},{"key":"e_1_3_4_21_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13423-020-01821-9"},{"key":"e_1_3_4_22_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.4978612"},{"key":"e_1_3_4_23_1","doi-asserted-by":"publisher","DOI":"10.1097\/AUD.0000000000000945"},{"key":"e_1_3_4_24_1","doi-asserted-by":"publisher","DOI":"10.1097\/AUD.0000000000000934"},{"key":"e_1_3_4_25_1","volume-title":"Methods for subjective determination of transmission quality","author":"International Telecommunication Union, Telecommunication Standardization Sector","year":"1996","unstructured":"International Telecommunication Union, Telecommunication Standardization Sector. (1996). Methods for subjective determination of transmission quality (Recommendation ITU-T P.800). https:\/\/www.itu.int\/rec\/T-REC-P.800-199608-I"},{"key":"e_1_3_4_26_1","doi-asserted-by":"publisher","DOI":"10.1375\/audi.26.1.40.55987"},{"key":"e_1_3_4_27_1","volume-title":"Eye gaze, pupil dynamics, and head movements as markers of communication difficulty in noise","author":"Luthy B.","year":"2026","unstructured":"Luthy B., Miles K., Ibrahim R. K., Maggs L., Carlile S., Richardson M. J., Smith Z., Buchholz J. M. (2026). Eye gaze, pupil dynamics, and head movements as markers of communication difficulty in noise . ECHO Laboratory, Macquarie University Hearing."},{"key":"e_1_3_4_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pragma.2006.11.012"},{"key":"e_1_3_4_29_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-023-47396-y"},{"key":"e_1_3_4_30_1","doi-asserted-by":"publisher","DOI":"10.1044\/2025_AJA-24-00226"},{"key":"e_1_3_4_31_1","doi-asserted-by":"publisher","DOI":"10.3813\/AAA.918662"},{"key":"e_1_3_4_32_1","doi-asserted-by":"publisher","DOI":"10.3389\/fcomm.2023.1173179"},{"key":"e_1_3_4_33_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2024.1289637"},{"key":"e_1_3_4_34_1","doi-asserted-by":"publisher","DOI":"10.1177\/23312165221103340"},{"key":"e_1_3_4_35_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2025.1584937"},{"key":"e_1_3_4_36_1","volume-title":"Sonova\u2019s real life lab: New heights for hearing aid research","author":"Sonible","year":"2020","unstructured":"Sonible. (2020). Sonova\u2019s real life lab: New heights for hearing aid research. sonible GmbH. https:\/\/www.sonible.com\/blog\/sonova-real-life-lab\/"},{"key":"e_1_3_4_37_1","doi-asserted-by":"publisher","DOI":"10.1177\/23312165211024482"},{"key":"e_1_3_4_38_1","doi-asserted-by":"publisher","DOI":"10.1177\/23312165241296073"},{"key":"e_1_3_4_39_1","volume-title":"Lighting for television","author":"Strand Lighting","year":"1986","unstructured":"Strand Lighting. (1986). Lighting for television. Strand Lighting. https:\/\/theatrecrafts.com\/archive\/documents\/lighting_for_television.pdf."},{"key":"e_1_3_4_40_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3404.921"},{"key":"e_1_3_4_41_1","volume-title":"Lighting ergonomics guideline","author":"University of Toronto, Environmental Health and Safety","year":"2023","unstructured":"University of Toronto, Environmental Health and Safety. (2023). Lighting ergonomics guideline. University of Toronto, Environmental Health and Safety. https:\/\/ehs.utoronto.ca\/wp-content\/uploads\/2023\/07\/Lighting-Ergonomics-Guideline-2023-Final.pdf"},{"key":"e_1_3_4_42_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.5087567"},{"key":"e_1_3_4_43_1","doi-asserted-by":"publisher","DOI":"10.1121\/10.0004774"},{"key":"e_1_3_4_44_1","volume-title":"Multi-sensor data synchronization using mobile phones","author":"W\u00e5hsl\u00e9n J.","year":"2013","unstructured":"W\u00e5hsl\u00e9n J. (2013). Multi-sensor data synchronization using mobile phones, KTH Royal Institute of Technology. https:\/\/urn.kb.se\/resolve?urn=urn:nbn:se:kth:diva-123222"},{"key":"e_1_3_4_45_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20205928"}],"container-title":["Trends in Hearing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/23312165261470622","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/23312165261470622","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/23312165261470622","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T22:46:57Z","timestamp":1784933217000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/23312165261470622"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1]]},"references-count":44,"alternative-id":["10.1177\/23312165261470622"],"URL":"https:\/\/doi.org\/10.1177\/23312165261470622","relation":{},"ISSN":["2331-2165","2331-2165"],"issn-type":[{"value":"2331-2165","type":"print"},{"value":"2331-2165","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1]]},"article-number":"23312165261470622"}}