{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T20:29:49Z","timestamp":1780086589855,"version":"3.54.0"},"reference-count":33,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2023,8,8]],"date-time":"2023-08-08T00:00:00Z","timestamp":1691452800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union NextGenerationEU\/ PRTR","award":["101086387"],"award-info":[{"award-number":["101086387"]}]},{"name":"HORIZON-MSCA-2021-SE-0","award":["101086387"],"award-info":[{"award-number":["101086387"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Shot boundary detection is the process of identifying and locating the boundaries between individual shots in a video sequence. A shot is a continuous sequence of frames that are captured by a single camera, without any cuts or edits. Recent investigations have shown the effectiveness of the use of 3D convolutional networks to solve this task due to its high capacity to extract spatiotemporal features of the video and determine in which frame a transition or shot change occurs. When this task is used as part of a scene segmentation use case with the aim of improving the experience of viewing content from streaming platforms, the speed of segmentation is very important for live and near-live use cases such as start-over. The problem with models based on 3D convolutions is the large number of parameters that they entail. Standard 3D convolutions impose much higher CPU and memory requirements than do the same 2D operations. In this paper, we rely on depthwise separable convolutions to address the problem but with a scheme that significantly reduces the number of parameters. To compensate for the slight loss of performance, we analyze and propose the use of visual self-attention as a mechanism of improvement.<\/jats:p>","DOI":"10.3390\/s23167022","type":"journal-article","created":{"date-parts":[[2023,8,8]],"date-time":"2023-08-08T12:45:53Z","timestamp":1691498753000},"page":"7022","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Shot Boundary Detection with 3D Depthwise Convolutions and Visual Attention"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8178-5983","authenticated-orcid":false,"given":"Miguel Jose","family":"Esteve Brotons","sequence":"first","affiliation":[{"name":"Telef\u00f3nica I+D, 28050 Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Francisco Javier","family":"Lucendo","sequence":"additional","affiliation":[{"name":"Telef\u00f3nica I+D, 28050 Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-0241-5221","authenticated-orcid":false,"given":"Rodriguez-Juan","family":"Javier","sequence":"additional","affiliation":[{"name":"Computers Technology Department, University of Alicante, 03080 Alicante, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7798-3055","authenticated-orcid":false,"given":"Jose","family":"Garcia-Rodriguez","sequence":"additional","affiliation":[{"name":"Computers Technology Department, University of Alicante, 03080 Alicante, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,8,8]]},"reference":[{"key":"ref_1","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Chollet, F. (2017). Xception: Deep Learning with Depthwise Separable Convolutions. arXiv.","DOI":"10.1109\/CVPR.2017.195"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., Albanie, S., Sun, G., and Wu, E. (2019). Squeeze-and-Excitation Networks. arXiv.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Li, X., Wang, W., Hu, X., and Yang, J. (2019). Selective Kernel Networks. arXiv.","DOI":"10.1109\/CVPR.2019.00060"},{"key":"ref_5","unstructured":"Sou\u010dek, T., Moravec, J., and Loko\u010d, J. (2019). TransNet: A deep network for fast detection of common shot transitions. arXiv."},{"key":"ref_6","unstructured":"Sou\u010dek, T., and Loko\u010d, J. (2020). TransNet V2: An effective deep network architecture for fast shot transition detection. arXiv."},{"key":"ref_7","unstructured":"Jin, J., Dundar, A., and Culurciello, E. (2015). Flattened Convolutional Neural Networks for Feedforward Acceleration. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wang, M., Liu, B., and Foroosh, H. (2017, January 22\u201329). Factorized Convolutional Neural Networks. Proceedings of the 2017 IEEE International Conference on Computer Vision Workshops (ICCVW), Venice, Italy.","DOI":"10.1109\/ICCVW.2017.71"},{"key":"ref_9","unstructured":"Liu, B., Wang, M., Foroosh, H., Tappen, M., and Penksy, M. (2015, January 7\u201312). Sparse Convolutional Neural Networks. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2015). Rethinking the Inception Architecture for Computer Vision. arXiv.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A. (2016). Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning. arXiv.","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015). Deep Residual Learning for Image Recognition. arXiv.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Carreira, J., and Zisserman, A. (2018). Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset. arXiv.","DOI":"10.1109\/CVPR.2017.502"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Donahue, J., Hendricks, L.A., Rohrbach, M., Venugopalan, S., Guadarrama, S., Saenko, K., and Darrell, T. (2016). Long-term Recurrent Convolutional Networks for Visual Recognition and Description. arXiv.","DOI":"10.1109\/CVPR.2015.7298878"},{"key":"ref_15","unstructured":"Ng, J.Y.H., Hausknecht, M., Vijayanarasimhan, S., Vinyals, O., Monga, R., and Toderici, G. (2015). Beyond Short Snippets: Deep Networks for Video Classification. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Feichtenhofer, C., Pinz, A., and Zisserman, A. (2016). Convolutional Two-Stream Network Fusion for Video Action Recognition. arXiv.","DOI":"10.1109\/CVPR.2016.213"},{"key":"ref_17","unstructured":"Simonyan, K., and Zisserman, A. (2014). Two-Stream Convolutional Networks for Action Recognition in Videos. arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Tran, D., Bourdev, L., Fergus, R., Torresani, L., and Paluri, M. (2015). Learning Spatiotemporal Features with 3D Convolutional Networks. arXiv.","DOI":"10.1109\/ICCV.2015.510"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Xie, S., Sun, C., Huang, J., Tu, Z., and Murphy, K. (2018). Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classification. arXiv.","DOI":"10.1007\/978-3-030-01267-0_19"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Qiu, Z., Yao, T., and Mei, T. (2017). Learning Spatio-Temporal Representation with Pseudo-3D Residual Networks. arXiv.","DOI":"10.1109\/ICCV.2017.590"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Ye, R., Liu, F., and Zhang, L. (2018). 3D Depthwise Convolution: Reducing Model Parameters in 3D Vision Tasks. arXiv.","DOI":"10.1007\/978-3-030-18305-9_15"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zhang, X., Zhou, X., Lin, M., and Sun, J. (2017). ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices. arXiv.","DOI":"10.1109\/CVPR.2018.00716"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2019). MobileNetV2: Inverted Residuals and Linear Bottlenecks. arXiv.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_24","unstructured":"Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., and Keutzer, K. (2016). SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size. arXiv."},{"key":"ref_25","unstructured":"Awad, G., Butt, A.A., Fiscus, J.G., Joy, D., Delgado, A., Michel, M., Smeaton, A.F., Graham, Y., Jones, G.J., and Kraaij, W. (2017, January 13\u201315). TRECVID 2017: Evaluating Ad-hoc and Instance Video Search, Events Detection, Video Captioning and Hyperlinking. Proceedings of the TREC Video Retrieval Evaluation, Gaithersburg, MD, USA."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Baraldi, L., Grana, C., and Cucchiara, R. (2015, January 26\u201330). A Deep Siamese Network for Scene Detection in Broadcast Videos. Proceedings of the 23rd ACM international conference on Multimedia, Brisbane, Australia.","DOI":"10.1145\/2733373.2806316"},{"key":"ref_27","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017, January 4\u20139). Attention Is All You Need. Proceedings of the Advances in Neural Information Processing Systems 30 (NIPS 2017), Long Beach, CA, USA."},{"key":"ref_28","unstructured":"Zhang, H., Goodfellow, I., Metaxas, D., and Odena, A. (2019, January 9\u201315). Self-Attention Generative Adversarial Networks. Proceedings of the 36th International Conference on Machine Learning, Long Beach, CA, USA."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., and Lu, H. (2019, January 15\u201320). Dual Attention Network for Scene Segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00326"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"5289","DOI":"10.1109\/JBHI.2021.3066832","article-title":"An Explainable 3D Residual Self-Attention Deep Neural Network for Joint Atrophy Localization and Alzheimer\u2019s Disease Diagnosis Using Structural MRI","volume":"26","author":"Zhang","year":"2022","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"4816549","DOI":"10.1155\/2022\/4816549","article-title":"Lite-3DCNN Combined with Attention Mechanism for Complex Human Movement Recognition","volume":"2022","author":"Zhu","year":"2022","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_32","unstructured":"Tang, S., Feng, L., Kuang, Z., Chen, Y., and Zhang, W. (2018). Asian Conference on Computer Vision, Springer."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Azzopardi, G., and Petkov, N. (2015). Computer Analysis of Images and Patterns, Springer.","DOI":"10.1007\/978-3-319-23192-1"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/16\/7022\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:27:51Z","timestamp":1760128071000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/16\/7022"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,8]]},"references-count":33,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2023,8]]}},"alternative-id":["s23167022"],"URL":"https:\/\/doi.org\/10.3390\/s23167022","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,8]]}}}