{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T18:24:50Z","timestamp":1776363890402,"version":"3.51.2"},"reference-count":38,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2024,8,21]],"date-time":"2024-08-21T00:00:00Z","timestamp":1724198400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key R&amp;D Program of China","award":["2023YFF0904605-1"],"award-info":[{"award-number":["2023YFF0904605-1"]}]},{"name":"National Key R&amp;D Program of China","award":["2023YFF0904604"],"award-info":[{"award-number":["2023YFF0904604"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Traditional broadcasting methods often result in fatigue and decision-making errors when dealing with complex and diverse live content. Current research on intelligent broadcasting primarily relies on preset rules and model-based decisions, which have limited capabilities for understanding emotional dynamics. To address these issues, this study proposed and developed an emotion-driven intelligent broadcasting system, EmotionCast, to enhance the efficiency of camera switching during live broadcasts through decisions based on multimodal emotion recognition technology. Initially, the system employs sensing technologies to collect real-time video and audio data from multiple cameras, utilizing deep learning algorithms to analyze facial expressions and vocal tone cues for emotion detection. Subsequently, the visual, audio, and textual analyses were integrated to generate an emotional score for each camera. Finally, the score for each camera shot at the current time point was calculated by combining the current emotion score with the optimal scores from the preceding time window. This approach ensured optimal camera switching, thereby enabling swift responses to emotional changes. EmotionCast can be applied in various sensing environments such as sports events, concerts, and large-scale performances. The experimental results demonstrate that EmotionCast excels in switching accuracy, emotional resonance, and audience satisfaction, significantly enhancing emotional engagement compared to traditional broadcasting methods.<\/jats:p>","DOI":"10.3390\/s24165401","type":"journal-article","created":{"date-parts":[[2024,8,23]],"date-time":"2024-08-23T12:58:07Z","timestamp":1724417887000},"page":"5401","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["EmotionCast: An Emotion-Driven Intelligent Broadcasting System for Dynamic Camera Switching"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-1419-2772","authenticated-orcid":false,"given":"Xinyi","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Information and Communication Engineering, Communication University of China, Beijing 100024, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xinran","family":"Ba","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, Communication University of China, Beijing 100024, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Feng","family":"Hu","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, Communication University of China, Beijing 100024, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jin","family":"Yuan","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, Communication University of China, Beijing 100024, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,8,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Wang, C., Qiu, C., Xu, W., Zhu, W., Luo, H., Chen, L., Yu, Z., Fu, L., and Chen, X. (2023, January 12\u201315). Intelligent Directing System for Music Concert Scene Based on Visual and Auditory Information. Proceedings of the 2023 ACM International Conference on Interactive Media Experiences Workshops (IMXw\u201923), Nantes, France.","DOI":"10.1145\/3604321.3604336"},{"key":"ref_2","first-page":"13","article-title":"Artificial Intelligence in News Media: Current Perceptions and Future Outlook","volume":"3","author":"Ceron","year":"2022","journal-title":"J. Media"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1049\/cit2.12153","article-title":"A Semantic and Emotion-Based Dual Latent Variable Generation Model for a Dialogue System","volume":"8","author":"Yan","year":"2023","journal-title":"CAAI Trans. Intell. Technol."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Qiu, K., Zhang, Y., Zhao, J., Zhang, S., Wang, Q., and Chen, F. (2024). A Multimodal Sentiment Analysis Approach Based on a Joint Chained Interactive Attention Mechanism. Electronics, 13.","DOI":"10.3390\/electronics13101922"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"107676","DOI":"10.1016\/j.knosys.2021.107676","article-title":"Video Sentiment Analysis with Bimodal Information-Augmented Multi-Head Attention","volume":"235","author":"Wu","year":"2022","journal-title":"Knowl.-Based Syst."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Li, H., Lu, Y., and Zhu, H. (2024). Multi-Modal Sentiment Analysis Based on Image and Text Fusion Based on Cross-Attention Mechanism. Electronics, 13.","DOI":"10.3390\/electronics13112069"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Jin, C., Luo, C., Yan, M., Zhao, G., Zhang, G., and Zhang, S. (IEEE Trans. Neural Netw. Learn. Syst., 2023). Weakening the Dominant Role of Text: CMOSI Dataset and Multimodal Semantic Enhancement Network, IEEE Trans. Neural Netw. Learn. Syst., early access.","DOI":"10.1109\/TNNLS.2023.3282953"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Fang, C., Liang, F., Li, T., and Guan, F. (2024). Learning Modality Consistency and Difference Information with Multitask Learning for Multimodal Sentiment Analysis. Future Internet, 16.","DOI":"10.3390\/fi16060213"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Wright, C., Allnutt, J., Campbell, R., Evans, M., Jolly, S., Shotton, E., Lechelt, S., Phillipson, G., and Kerlin, L. (2023, January 12\u201315). AI in Production: Video Analysis and Machine Learning for Expanded Live Events Coverage. Proceedings of the 2023 ACM International Conference on Interactive Media Experiences Workshops (IMXw\u201923), Nantes, France.","DOI":"10.1145\/3604321.3604375"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Leake, M., and Li, W. (2024, January 11\u201316). ChunkyEdit: Text-first video interview editing via chunking. Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI\u201924), Honolulu, HI, USA.","DOI":"10.1145\/3613904.3642667"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1145\/3448981","article-title":"Smart Director: An Event-Driven Directing System for Live Broadcasting","volume":"17","author":"Pan","year":"2021","journal-title":"ACM Trans. Multimedia Comput. Commun. Appl."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"842","DOI":"10.3390\/ai5020042","article-title":"Real-Time Camera Operator Segmentation with YOLOv8 in Football Video Broadcasts","volume":"5","author":"Postupaiev","year":"2024","journal-title":"AI"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1145\/3072959.3073653","article-title":"Computational video editing for dialogue-driven scenes","volume":"36","author":"Leake","year":"2017","journal-title":"ACM Trans. Graph."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zuo, J., Chen, Y., Wang, L., Pan, Y., Yao, T., Wang, K., and Mei, T. (2020, January 12\u201316). IDirector: An Intelligent Directing System for Live Broadcast. Proceedings of the 28th ACM International Conference on Multimedia (MM\u201920), Seattle, WA, USA.","DOI":"10.1145\/3394171.3414453"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Moorthy, K.L.B., Kumar, M., Subramanian, R., and Gandhi, V. (2020, January 25\u201330). GAZED: Gaze-guided Cinematic Editing of Wide-Angle Monocular Video Recordings. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI\u201920), Honolulu, HI, USA.","DOI":"10.1145\/3313831.3376544"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Achary, S., Girmaji, R., Deshmukh, A., and Gandhi, V. (2024, January 4\u20138). Real Time GAZED: Online Shot Selection and Editing of Virtual Cameras from Wide-Angle Monocular Video Recordings. Proceedings of the 2024 IEEE\/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.","DOI":"10.1109\/WACV57701.2024.00406"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1145\/2601097.2601198","article-title":"Automatic editing of footage from multiple social cameras","volume":"33","author":"Arev","year":"2014","journal-title":"ACM Trans. Graph."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Xia, L., and Zhang, L. (2022, January 23\u201325). Intelligent Construction of Aesthetic Evaluation System Based on Multi-camera Automatic Switching Algorithm of Director. Proceedings of the 2022 Second International Conference on Artificial Intelligence and Smart Energy (ICAIS), Coimbatore, India.","DOI":"10.1109\/ICAIS53314.2022.9743063"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"103161","DOI":"10.1016\/j.ijhcs.2023.103161","article-title":"Attention-based automatic editing of virtual lectures for reduced production labor and effective learning experience","volume":"181","author":"Hwang","year":"2024","journal-title":"Int. J.-Hum.-Comput. Stud."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"He, R., Cao, Y., Hoorn, J.F., and Wei, H. (2024, January 11\u201316). Cinemassist: An Intelligent Interactive System for Real-Time Cinematic Composition Design. Proceedings of the Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems (CHI EA\u201924), Honolulu, HI, USA.","DOI":"10.1145\/3613905.3650898"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Najeeb, H.D., and Ghani, R.F. (2020, January 25\u201327). Automatic Camera Switching in Soccer Game using Decision Tree. Proceedings of the 2020 5th International Conference on Innovative Technologies in Intelligent Systems and Industrial Applications (CITISIA), Sydney, Australia.","DOI":"10.1109\/CITISIA50690.2020.9371815"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Ranjan, A., Birnholtz, J., and Balakrishnan, R. (2008;, January 5\u201310). Improving meeting capture by applying television production principles with audio and motion detection. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI\u201908), Florence, Italy.","DOI":"10.1145\/1357054.1357095"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Cai, L., Dong, J., and Wei, M. (2020, January 6\u20138). Multi-Modal Emotion Recognition From Speech and Facial Expression Based on Deep Learning. Proceedings of the 2020 Chinese Automation Congress (CAC), Shanghai, China.","DOI":"10.1109\/CAC51589.2020.9327178"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"LokeshNaik, S.K., Girmaji, R., Deshmukh, A., and Gandhi, V. (2023, January 23\u201325). Real Time Facial Emotion Recognition using Deep Learning and CNN. Proceedings of the 2023 International Conference on Computer Communication and Informatics (ICCCI), Coimbatore, India.","DOI":"10.1109\/ICCCI56745.2023.10128259"},{"key":"ref_25","unstructured":"Sowmiya, R., Sivakamasundari, G., and Archana, V. (2022, January 13\u201315). Facial Emotion Recognition using Deep Learning Approach. Proceedings of the 2022 International Conference on Automation, Computing and Renewable Systems (ICACRS), Pudukkottai, India."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Nguyen, B.T., Trinh, M.H., Phan, T.V., and Nguyen, H.D. (2017, January 16\u201319). An efficient real-time emotion detection using camera and facial landmarks. Proceedings of the 2017 Seventh International Conference on Information Science and Technology (ICIST), Da Nang, Vietnam.","DOI":"10.1109\/ICIST.2017.7926765"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Saadon, J.R., Yang, F., Burgert, R., Mohammad, S., Gammel, T., Sepe, M., Rafailovich, M., Mikell, C.B., Polak, P., and Mofakham, S. (2023). Real-time emotion detection by quantitative facial motion analysis. PLoS ONE, 18.","DOI":"10.1371\/journal.pone.0282730"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"\u00d6zkara, C., and Ekim, P.O. (2022, January 7\u20139). Real-Time Facial Emotion Recognition for Visualization Systems. Proceedings of the 2022 Innovations in Intelligent Systems and Applications Conference (ASYU), Antalya, Turkey.","DOI":"10.1109\/ASYU56188.2022.9925465"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"117327","DOI":"10.1109\/ACCESS.2019.2936124","article-title":"Speech Emotion Recognition Using Deep Learning Techniques: A Review","volume":"7","author":"Khalil","year":"2019","journal-title":"IEEE Access"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Diemerling, H., Stresemann, L., Braun, T., and von Oertzen, T. (2024). Implementing machine learning techniques for continuous emotion prediction from uniformly segmented voice recordings. Front. Psychol., 15.","DOI":"10.3389\/fpsyg.2024.1300996"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Tzirakis, P., Zhang, J., and Schuller, B.W. (2018, January 15\u201320). End-to-End Speech Emotion Recognition Using Deep Neural Networks. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.","DOI":"10.1109\/ICASSP.2018.8462677"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"35535","DOI":"10.1007\/s11042-021-11010-y","article-title":"Multimodal emotional analysis through hierarchical video summarization and face tracking","volume":"81","author":"Thiruthuvanathan","year":"2022","journal-title":"Multimed Tools Appl."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.inffus.2018.09.008","article-title":"Emotion recognition using deep learning approach from audio\u2013visual emotional big data","volume":"49","author":"Hossain","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1186\/1687-6180-2013-173","article-title":"Multi-modal highlight generation for sports videos using an information-theoretic excitability measure","volume":"2013","author":"Hasan","year":"2013","journal-title":"EURASIP J. Adv. Signal Process."},{"key":"ref_35","unstructured":"Wei, Q., Zhou, Y., and Zhang, Y. (2023). MSEVA: A System for Multimodal Short Videos Emotion Visual Analysis. arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"7943","DOI":"10.1109\/ACCESS.2021.3049516","article-title":"Multimodal Emotion Recognition Using a Hierarchical Fusion Convolutional Neural Network","volume":"9","author":"Zhang","year":"2021","journal-title":"IEEE Access"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Ranganathan, H., Chakraborty, S., and Panchanathan, S. (2016, January 7\u201310). Multimodal emotion recognition using deep learning architectures. Proceedings of the 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Placid, NY, USA.","DOI":"10.1109\/WACV.2016.7477679"},{"key":"ref_38","first-page":"53","article-title":"Emotion Recognition and Detection Methods: A Comprehensive Survey","volume":"2","author":"Saxena","year":"2020","journal-title":"J. Artif. Intell. Syst."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/16\/5401\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:40:24Z","timestamp":1760110824000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/16\/5401"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,21]]},"references-count":38,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2024,8]]}},"alternative-id":["s24165401"],"URL":"https:\/\/doi.org\/10.3390\/s24165401","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,21]]}}}