{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T11:24:21Z","timestamp":1780053861652,"version":"3.54.0"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2022,2,24]],"date-time":"2022-02-24T00:00:00Z","timestamp":1645660800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,2,24]],"date-time":"2022-02-24T00:00:00Z","timestamp":1645660800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001659","name":"deutsche forschungsgemeinschaft","doi-asserted-by":"publisher","award":["251654672"],"award-info":[{"award-number":["251654672"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Math Imaging Vis"],"published-print":{"date-parts":[[2022,5]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>A large number of modern video background modeling algorithms deal with computational costly minimization problems that often need parameter adjustments. While in most cases spatial and temporal constraints are added artificially to the minimization process, our approach is to exploit Dynamic Mode Decomposition (DMD), a spectral decomposition technique that naturally extracts spatio-temporal patterns from data. Applied to video data, DMD can compute background models. However, the original DMD algorithm for background modeling is neither efficient nor robust. In this paper, we present an equivalent reformulation with constraints leading to a more suitable decomposition into fore- and background. Due to the reformulation, which uses sparse and low-dimensional structures, an efficient and robust algorithm is derived that computes accurate background models. Moreover, we show how our approach can be extended to RGB data, data with periodic parts, and streaming data enabling a versatile use.<\/jats:p>","DOI":"10.1007\/s10851-022-01068-0","type":"journal-article","created":{"date-parts":[[2022,2,24]],"date-time":"2022-02-24T11:02:41Z","timestamp":1645700561000},"page":"364-378","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Efficient and Robust Background Modeling with Dynamic Mode Decomposition"],"prefix":"10.1007","volume":"64","author":[{"given":"Tim","family":"Krake","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andr\u00e9s","family":"Bruhn","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bernhard","family":"Eberhardt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Weiskopf","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,2,24]]},"reference":[{"key":"1068_CR1","doi-asserted-by":"publisher","unstructured":"Akilan, T., Wu, Q.J., Jiang, W., Safaei, A., Huo, J.: New trend in video foreground detection using deep learning. In: IEEE 61st International Midwest Symposium on Circuits and Systems (MWSCAS), pp. 889\u2013892 (2018). https:\/\/doi.org\/10.1109\/MWSCAS.2018.8623825","DOI":"10.1109\/MWSCAS.2018.8623825"},{"key":"1068_CR2","doi-asserted-by":"publisher","unstructured":"Balzano, L., Nowak, R., Recht, B.: Online identification and tracking of subspaces from highly incomplete information. In: 48th Annual Allerton Conference on Communication, Control, and Computing, pp. 704 \u2013711 (2010). https:\/\/doi.org\/10.1109\/ALLERTON.2010.5706976","DOI":"10.1109\/ALLERTON.2010.5706976"},{"key":"1068_CR3","doi-asserted-by":"publisher","first-page":"21397","DOI":"10.1109\/ACCESS.2018.2825106","volume":"6","author":"C Bi","year":"2018","unstructured":"Bi, C., Yuan, Y., Zhang, J., Shi, Y., Xiang, Y., Wang, Y., Zhang, R.: Dynamic mode decomposition based video shot detection. IEEE Access 6, 21397\u201321407 (2018). https:\/\/doi.org\/10.1109\/ACCESS.2018.2825106","journal-title":"IEEE Access"},{"key":"1068_CR4","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1016\/j.neunet.2019.04.024","volume":"117","author":"T Bouwmans","year":"2019","unstructured":"Bouwmans, T., Javed, S., Sultana, M., Jung, S.K.: Deep neural network concepts for background subtraction: A systematic review and comparative evaluation. Neural Netw. 117, 8\u201366 (2019). https:\/\/doi.org\/10.1016\/j.neunet.2019.04.024","journal-title":"Neural Netw."},{"key":"1068_CR5","doi-asserted-by":"publisher","DOI":"10.1201\/b17223","volume-title":"Background modeling and foreground detection for video surveillance","author":"T Bouwmans","year":"2014","unstructured":"Bouwmans, T., Porikli, F., H\u00f6ferlin, B., Vacavant, A.: Background modeling and foreground detection for video surveillance. CRC Press, USA (2014)"},{"key":"1068_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.cosrev.2016.11.001","volume":"23","author":"T Bouwmans","year":"2017","unstructured":"Bouwmans, T., Sobral, A., Javed, S., Jung, S.K., Zahzah, E.H.: Decomposition into low-rank plus additive matrices for background\/foreground separation. Computer Sci. Rev. 23, 1\u201371 (2017). https:\/\/doi.org\/10.1016\/j.cosrev.2016.11.001","journal-title":"Computer Sci. Rev."},{"key":"1068_CR7","doi-asserted-by":"crossref","unstructured":"Braham, M., Van\u00a0Droogenbroeck, M.: Deep background subtraction with scene-specific convolutional neural networks. In: 2016 International Conference on Systems, Signals and Image Processing (IWSSIP), pp. 1\u20134 (2016). 10.1109\/IWSSIP.2016.7502717","DOI":"10.1109\/IWSSIP.2016.7502717"},{"key":"1068_CR8","unstructured":"Cherapanamjeri, Y., Gupta, K., Jain, P.: Nearly optimal robust matrix completion. In: International Conference on Machine Learning (ICML), pp. 797\u2013805 (2017). https:\/\/doi.org\/10.5555\/3305381.3305464"},{"issue":"5","key":"1068_CR9","doi-asserted-by":"publisher","first-page":"1479","DOI":"10.1007\/s11554-016-0655-2","volume":"16","author":"NB Erichson","year":"2019","unstructured":"Erichson, N.B., Brunton, S.L., Kutz, J.N.: Compressed dynamic mode decomposition for background modeling. J. Real-Time Image Process. (JRTIP) 16(5), 1479\u20131492 (2019). https:\/\/doi.org\/10.1007\/s11554-016-0655-2","journal-title":"J. Real-Time Image Process. (JRTIP)"},{"key":"1068_CR10","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1016\/j.cviu.2016.02.005","volume":"146","author":"NB Erichson","year":"2016","unstructured":"Erichson, N.B., Donovan, C.: Randomized low-rank dynamic mode decomposition for motion detection. Computer Vision Image Understand. (CVIU) 146, 40\u201350 (2016). https:\/\/doi.org\/10.1016\/j.cviu.2016.02.005","journal-title":"Computer Vision Image Understand. (CVIU)"},{"key":"1068_CR11","doi-asserted-by":"publisher","DOI":"10.1016\/j.cosrev.2019.100204","author":"B Garcia-Garcia","year":"2020","unstructured":"Garcia-Garcia, B., Bouwmans, T., Silva, A.J.R.: Background subtraction in real applications: challenges, current models and future directions. Computer Sci. Rev. (2020). https:\/\/doi.org\/10.1016\/j.cosrev.2019.100204","journal-title":"Computer Sci. Rev."},{"key":"1068_CR12","doi-asserted-by":"publisher","unstructured":"Giraldo, J.H., Bouwmans, T.: Graphbgs: Background subtraction via recovery of graph signals. In: 2020 25th International Conference on Pattern Recognition (ICPR), pp. 6881\u20136888 (2021). doi: https:\/\/doi.org\/10.1109\/ICPR48806.2021.9412999","DOI":"10.1109\/ICPR48806.2021.9412999"},{"key":"1068_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TPAMI.2020.3042093","volume":"56","author":"JH Giraldo","year":"2020","unstructured":"Giraldo, J.H., Javed, S., Bouwmans, T.: Graph moving object segmentation. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 56, 1\u201310 (2020). https:\/\/doi.org\/10.1109\/TPAMI.2020.3042093","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI)"},{"key":"1068_CR14","unstructured":"Grosek, J., Kutz, J.N.: Dynamic mode decomposition for real-time background\/foreground separation in video. http:\/\/arxiv.org\/abs\/1404.7592 (2014)"},{"issue":"3\u20134","key":"1068_CR15","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1007\/s00180-013-0435-4","volume":"29","author":"C Hage","year":"2014","unstructured":"Hage, C., Kleinsteuber, M.: Robust PCA and subspace tracking from incomplete observations using $$\\ell _0$$-surrogates. Comput. Stat. (CompStat) 29(3\u20134), 467\u2013487 (2014). https:\/\/doi.org\/10.1007\/s00180-013-0435-4","journal-title":"Comput. Stat. (CompStat)"},{"key":"1068_CR16","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2020.103022","author":"IU Haq","year":"2020","unstructured":"Haq, I.U., Fujii, K., Kawahara, Y.: Dynamic mode decomposition via dictionary learning for foreground modeling in videos. Computer Vision Image Understand. (CVIU) (2020). https:\/\/doi.org\/10.1016\/j.cviu.2020.103022","journal-title":"Computer Vision Image Understand. (CVIU)"},{"issue":"3","key":"1068_CR17","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1007\/s10851-014-0527-y","volume":"51","author":"M Hinterm\u00fcller","year":"2015","unstructured":"Hinterm\u00fcller, M., Wu, T.: Robust principal component pursuit via inexact alternating minimization on matrix manifolds. J. Math. Imag. Vision (JMIV) 51(3), 361\u2013377 (2015). https:\/\/doi.org\/10.1007\/s10851-014-0527-y","journal-title":"J. Math. Imag. Vision (JMIV)"},{"key":"1068_CR18","doi-asserted-by":"crossref","unstructured":"Kang, Z., Peng, C., Cheng, Q.: Robust pca via nonconvex rank approximation. In: IEEE International Conference on Data Mining (ICDM), pp. 211\u2013220 (2015). https:\/\/doi.org\/10.1109\/ICDM.2015.15","DOI":"10.1109\/ICDM.2015.15"},{"key":"1068_CR19","unstructured":"Krake, T., Weiskopf, D., Eberhardt, B.: Dynamic mode decomposition: Theory and data reconstruction. http:\/\/arxiv.org\/abs\/1909.10466 (2019)"},{"key":"1068_CR20","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1137\/1.9781611974508","volume":"2","author":"JN Kutz","year":"2016","unstructured":"Kutz, J.N., Brunton, S.L., Brunton, B.W., Proctor, J.L.: Dynamic mode decomposition data-driven modeling of complex systems. SIAM Soc. Indus. Appl. Math. 2, 51 (2016). https:\/\/doi.org\/10.1137\/1.9781611974508","journal-title":"SIAM Soc. Indus. Appl. Math."},{"key":"1068_CR21","doi-asserted-by":"crossref","unstructured":"Kutz, J.N., Fu, X., Brunton, S.L., Erichson, N.B.: Multi-resolution dynamic mode decomposition for foreground\/background separation and object tracking. IEEE International Conference on Computer Vision Workshop (ICCVW) pp. 921\u2013929 (2015). https:\/\/doi.org\/10.1109\/ICCVW.2015.122","DOI":"10.1109\/ICCVW.2015.122"},{"issue":"11","key":"1068_CR22","doi-asserted-by":"publisher","first-page":"1459","DOI":"10.1109\/TIP.2004.836169","volume":"13","author":"L Li","year":"2004","unstructured":"Li, L., Huang, W., Gu, I.Y.H., Tian, Q.: Statistical modeling of complex backgrounds for foreground object detection. IEEE Trans. Image Process. (TIP) 13(11), 1459\u20131472 (2004). https:\/\/doi.org\/10.1109\/TIP.2004.836169","journal-title":"IEEE Trans. Image Process. (TIP)"},{"key":"1068_CR23","doi-asserted-by":"crossref","unstructured":"Mandal, M., Vipparthi, S.K.: An empirical review of deep learning frameworks for change detection: Model design, experimental frameworks, challenges and research needs. IEEE Transactions on Intelligent Transportation Systems (2021). (to appear)","DOI":"10.1109\/TITS.2021.3077883"},{"key":"1068_CR24","doi-asserted-by":"crossref","unstructured":"Minematsu, T., Shimada, A., Taniguchi, R.i.: Rethinking background and foreground in deep neural network-based background subtraction. In: 2020 IEEE International Conference on Image Processing (ICIP), pp. 3229\u20133233 (2020). 10.1109\/ICIP40778.2020.9191151","DOI":"10.1109\/ICIP40778.2020.9191151"},{"issue":"5","key":"1068_CR25","doi-asserted-by":"publisher","first-page":"A3291","DOI":"10.1137\/15M101628X","volume":"38","author":"C Mu","year":"2016","unstructured":"Mu, C., Zhang, Y., Wright, J., Goldfarb, D.: Scalable robust matrix recovery: Frank-wolfe meets proximal methods. SIAM J. Scientif. Comput. (SISC) 38(5), A3291\u2013A3317 (2016). https:\/\/doi.org\/10.1137\/15M101628X","journal-title":"SIAM J. Scientif. Comput. (SISC)"},{"key":"1068_CR26","doi-asserted-by":"crossref","unstructured":"Narayanamurthy, P., Vaswani, N.: A fast and memory-efficient algorithm for robust pca (merop). In: 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 4684\u20134688 (2018). https:\/\/doi.org\/10.1109\/ICASSP.2018.8461540","DOI":"10.1109\/ICASSP.2018.8461540"},{"issue":"9","key":"1068_CR27","doi-asserted-by":"publisher","first-page":"1397","DOI":"10.3390\/sym12091397","volume":"12","author":"TT Ngo","year":"2020","unstructured":"Ngo, T.T., Nguyen, V., Pham, X.Q., Hossain, M.A., Huh, E.N.: Motion saliency detection for surveillance systems using streaming dynamic mode decomposition. Symmetry 12(9), 1397 (2020). https:\/\/doi.org\/10.3390\/sym12091397","journal-title":"Symmetry"},{"key":"1068_CR28","doi-asserted-by":"crossref","unstructured":"Pendergrass, S.D., Brunton, S.L., Kutz, J.N., Erichson, N.B., Askham, T.M.: Dynamic mode decomposition for background modeling. In: IEEE International Conference on Computer Vision Workshops (ICCVW), pp. 1862\u20131870 (2017). https:\/\/doi.org\/10.1109\/ICCVW.2017.220","DOI":"10.1109\/ICCVW.2017.220"},{"issue":"1","key":"1068_CR29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10851-015-0610-z","volume":"55","author":"P Rodriguez","year":"2016","unstructured":"Rodriguez, P., Wohlberg, B.: Incremental principal component pursuit for video background modeling. J. Math. Imag. Vision (JMIV) 55(1), 1\u201318 (2016). https:\/\/doi.org\/10.1007\/s10851-015-0610-z","journal-title":"J. Math. Imag. Vision (JMIV)"},{"key":"1068_CR30","unstructured":"Schmid, P., Sesterhenn, J.: Dynamic mode decomposition of numerical and experimental data. In 61st Annual Meeting of the APS Division of Fluid Dynamics. American Physical Society 53(15) (2008)"},{"key":"1068_CR31","doi-asserted-by":"publisher","unstructured":"Shu, X., Porikli, F., Ahuja, N.: Robust orthonormal subspace learning: Efficient recovery of corrupted low-rank matrices. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3874\u20133881 (2014). https:\/\/doi.org\/10.1109\/CVPR.2014.495","DOI":"10.1109\/CVPR.2014.495"},{"key":"1068_CR32","doi-asserted-by":"crossref","unstructured":"Sobral, A., Bouwmans, T., hadi Zahzah, E.: LRSLibrary: Low-rank and sparse tools for background modeling and subtraction in videos. Robust Low-Rank and Sparse Matrix Decomposition: Applications in Image and Video Processing (2016)","DOI":"10.1201\/b20190"},{"key":"1068_CR33","doi-asserted-by":"publisher","unstructured":"Sobral, A., Javed, S., Jung, S.K., Bouwmans, T., hadi Zahzah, E.: Online stochastic tensor decomposition for background subtraction in multispectral video sequences. In: Proceedings of the IEEE International Conference on Computer Vision Workshops (ICCVW), pp. 106\u2013113 (2015). https:\/\/doi.org\/10.1109\/ICCVW.2015.125","DOI":"10.1109\/ICCVW.2015.125"},{"key":"1068_CR34","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1016\/j.cviu.2013.12.005","volume":"122","author":"A Sobral","year":"2014","unstructured":"Sobral, A., Vacavant, A.: A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos. Computer Vision Image Understand. (CVIU) 122, 4\u201321 (2014). https:\/\/doi.org\/10.1016\/j.cviu.2013.12.005","journal-title":"Computer Vision Image Understand. (CVIU)"},{"key":"1068_CR35","doi-asserted-by":"publisher","unstructured":"Tirunagari, S., Poh, N., Bober, M., Windridge, D.: Can dmd obtain a scene background in color? In: International Conference on Image, Vision and Computing (ICIVC), pp. 46\u201350 (2016). https:\/\/doi.org\/10.1109\/ICIVC.2016.7571272","DOI":"10.1109\/ICIVC.2016.7571272"},{"issue":"3","key":"1068_CR36","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1109\/TPAMI.2016.2554555","volume":"39","author":"G Trigeorgis","year":"2016","unstructured":"Trigeorgis, G., Bousmalis, K., Zafeiriou, S., Schuller, B.W.: A deep matrix factorization method for learning attribute representations. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 39(3), 417\u2013429 (2016). https:\/\/doi.org\/10.1109\/TPAMI.2016.2554555","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI)"},{"issue":"4","key":"1068_CR37","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1109\/MSP.2018.2826566","volume":"35","author":"N Vaswani","year":"2018","unstructured":"Vaswani, N., Bouwmans, T., Javed, S., Narayanamurthy, P.: Robust subspace learning: robust pca, robust subspace tracking, and robust subspace recovery. IEEE Signal Process. Magaz. 35(4), 32\u201355 (2018). https:\/\/doi.org\/10.1109\/MSP.2018.2826566","journal-title":"IEEE Signal Process. Magaz."},{"key":"1068_CR38","doi-asserted-by":"publisher","unstructured":"Wang, Y., Jodoin, P.M., Porikli, F., Konrad, J., Benezeth, Y., Ishwar, P.: Cdnet 2014: An expanded change detection benchmark dataset. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 393\u2013400 (2014). https:\/\/doi.org\/10.1109\/CVPRW.2014.126","DOI":"10.1109\/CVPRW.2014.126"},{"issue":"1","key":"1068_CR39","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1016\/j.trit.2016.03.005","volume":"1","author":"Y Xu","year":"2016","unstructured":"Xu, Y., Dong, J., Zhang, B., Xu, D.: Background modeling methods in video analysis: a review and comparative evaluation. CAAI Trans. Intell. Technol. 1(1), 43\u201360 (2016). https:\/\/doi.org\/10.1016\/j.trit.2016.03.005","journal-title":"CAAI Trans. Intell. Technol."},{"key":"1068_CR40","doi-asserted-by":"publisher","first-page":"4152","DOI":"10.5555\/3157382.3157562","volume":"29","author":"X Yi","year":"2016","unstructured":"Yi, X., Park, D., Chen, Y., Caramanis, C.: Fast algorithms for robust PCA via gradient descent. Adv. Neural Inf. Process Syst. (NIPS) 29, 4152\u20134160 (2016). https:\/\/doi.org\/10.5555\/3157382.3157562","journal-title":"Adv. Neural Inf. Process Syst. (NIPS)"}],"container-title":["Journal of Mathematical Imaging and Vision"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10851-022-01068-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10851-022-01068-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10851-022-01068-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,4,21]],"date-time":"2022-04-21T09:34:10Z","timestamp":1650533650000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10851-022-01068-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,24]]},"references-count":40,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,5]]}},"alternative-id":["1068"],"URL":"https:\/\/doi.org\/10.1007\/s10851-022-01068-0","relation":{},"ISSN":["0924-9907","1573-7683"],"issn-type":[{"value":"0924-9907","type":"print"},{"value":"1573-7683","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,24]]},"assertion":[{"value":"18 June 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 January 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 February 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}