{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T15:31:40Z","timestamp":1760369500947,"version":"build-2065373602"},"reference-count":41,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2019,1,29]],"date-time":"2019-01-29T00:00:00Z","timestamp":1548720000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper proposes a Track-before-Detect framework for a multibody motion segmentation (named TbD-SfM). Our contribution relies on a tightly coupled tracking before detection strategy intended to reduce the complexity of existing Multibody Structure from Motion approaches. Efforts were done towards an algorithm variant closer and aimed to a further embedded implementation for dynamic scene analysis while enhancing processing time performances. This generic motion segmentation approach can be transposed to several transportation sensor systems since no constraints are considered on segmented motions (6-DOF model). The tracking scheme is analyzed and its performance is evaluated under thorough experimental conditions including full-scale driving scenarios from known and available datasets. Results on challenging scenarios including the presence of multiple and simultaneous moving objects observed from a moving camera are reported and discussed.<\/jats:p>","DOI":"10.3390\/s19030560","type":"journal-article","created":{"date-parts":[[2019,1,29]],"date-time":"2019-01-29T11:27:52Z","timestamp":1548761272000},"page":"560","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Track-Before-Detect Framework-Based Vehicle Monocular Vision Sensors"],"prefix":"10.3390","volume":"19","author":[{"given":"Hernan","family":"Gonzalez","sequence":"first","affiliation":[{"name":"Laboratory SATIE (Syst\u00e8mes et Applications des Technologies de l\u2019Information et de l\u2019Energie), CNRS (UMR 8029), Universit\u00e9 Paris Sud, 91405 Orsay, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3029-7020","authenticated-orcid":false,"given":"Sergio","family":"Rodriguez","sequence":"additional","affiliation":[{"name":"Laboratory SATIE (Syst\u00e8mes et Applications des Technologies de l\u2019Information et de l\u2019Energie), CNRS (UMR 8029), Universit\u00e9 Paris Sud, 91405 Orsay, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3665-2185","authenticated-orcid":false,"given":"Abdelhafid","family":"Elouardi","sequence":"additional","affiliation":[{"name":"Laboratory SATIE (Syst\u00e8mes et Applications des Technologies de l\u2019Information et de l\u2019Energie), CNRS (UMR 8029), Universit\u00e9 Paris Sud, 91405 Orsay, France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,1,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Elfring, J., Appeldoorn, R., van den Dries, S., and Kwakkernaat, M. (2016). Effective World Modeling: Multisensor Data Fusion Methodology for Automated Driving. Sensors, 16.","DOI":"10.3390\/s16101668"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1007\/s00138-011-0386-0","article-title":"Multi-modal object detection and localization for high integrity driving assistance","volume":"25","author":"Florez","year":"2014","journal-title":"Mach. Vis. Appl."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Li, Q., Zhou, J., Li, B., Guo, Y., and Xiao, J. (2018). Robust Lane-Detection Method for Low-Speed Environments. Sensors, 18.","DOI":"10.3390\/s18124274"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Ibarra-Arenado, M., Tjahjadi, T., P\u00e9rez-Oria, J., Robla-G\u00f3mez, S., and Jim\u00e9nez-Avello, A. (2017). Shadow-Based Vehicle Detection in Urban Traffic. Sensors, 17.","DOI":"10.3390\/s17050975"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Zhao, D., Fu, H., Xiao, L., Wu, T., and Dai, B. (2018). Multi-Object Tracking with Correlation Filter for Autonomous Vehicle. Sensors, 18.","DOI":"10.3390\/s18072004"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Aladem, M., and Rawashdeh, S.A. (2018). Lightweight Visual Odometry for Autonomous Mobile Robots. Sensors, 18.","DOI":"10.3390\/s18092837"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Sabzevari, R., and Scaramuzza, D. (June, January 31). Monocular simultaneous multi-body motion segmentation and reconstruction from perspective views. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6906585"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1023\/A:1008000628999","article-title":"A Multibody Factorization Method for Independently Moving Objects","volume":"29","author":"Costeira","year":"1998","journal-title":"Int. J. Comput. Vis."},{"key":"ref_9","unstructured":"Zappella, L., Llad\u00f3, X., and Salvi, J. (2008, January 22\u201324). Motion Segmentation: A Review. Proceedings of the 11th International Conference of the Catalan Association for Artificial Intelligence, Sant Mart\u00ed d\u2019Emp\u00faries, Spain."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/BF00129684","article-title":"Shape and motion from image streams under orthography: A factorization method","volume":"9","author":"Tomasi","year":"1992","journal-title":"Int. J. Comput. Vis."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1007\/s11263-005-4839-7","article-title":"Two-View Multibody Structure from Motion","volume":"68","author":"Vidal","year":"2006","journal-title":"Int. J. Comput. Vis."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Goh, A., and Vidal, R. (2007, January 17\u201322). Segmenting Motions of Different Types by Unsupervised Manifold Clustering. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383235"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1109\/TPAMI.2007.1179","article-title":"Three-View Multibody Structure from Motion","volume":"30","author":"Vidal","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Li, T., Kallem, V., Singaraju, D., and Vidal, R. (2007, January 17\u201322). Projective Factorization of Multiple Rigid-Body Motions. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383090"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1134","DOI":"10.1109\/TPAMI.2010.23","article-title":"Multibody Structure-from-Motion in Practice","volume":"32","author":"Ozden","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1832","DOI":"10.1109\/TPAMI.2009.191","article-title":"Motion Segmentation in the Presence of Outlying, Incomplete, or Corrupted Trajectories","volume":"32","author":"Rao","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zappella, L., Del Bue, A., Llad\u00f3, X., and Salvi, J. (2011, January 5\u20137). Simultaneous Motion Segmentation and Structure from Motion. Proceedings of the 2011 IEEE Workshop on Applications of Computer Vision (WACV), Kona, HI, USA.","DOI":"10.1109\/WACV.2011.5711570"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Dragon, R., Rosenhahn, B., and Ostermann, J. (2012, January 7\u201313). Multi-Scale Clustering of Frame-to-Frame Correspondences for Motion Segmentation. Proceedings of the 12th European Conference on Computer Vision, Florence, Italy.","DOI":"10.1007\/978-3-642-33709-3_32"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Shi, F., Zhou, Z., Xiao, J., and Wu, W. (2013, January 1\u20138). Robust Trajectory Clustering for Motion Segmentation. Proceedings of the IEEE International Conference on Computer Vision, Sydney, Australia.","DOI":"10.1109\/ICCV.2013.383"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Jung, H., Ju, J., and Kim, J. (2014, January 23\u201328). Rigid Motion Segmentation Using Randomized Voting. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.158"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Li, B., Zhang, Y., Lin, Z., and Lu, H. (2015, January 7\u201312). Subspace clustering by Mixture of Gaussian Regression. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298821"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1007\/s10846-015-0195-1","article-title":"Using In-frame Shear Constraints for Monocular Motion Segmentation of Rigid Bodies","volume":"82","author":"Tourani","year":"2016","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s41074-016-0002-3","article-title":"Multibody motion segmentation for an arbitrary number of independent motions","volume":"8","author":"Sako","year":"2016","journal-title":"IPSJ Trans. Comput. Vis. Appl."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhu, Y., and Elgammal, A. (arXiv, 2017). A Multilayer-Based Framework for Online Background Subtraction with Freely Moving Cameras, arXiv.","DOI":"10.1109\/ICCV.2017.549"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"638","DOI":"10.1109\/TRO.2016.2552548","article-title":"Multi-body Motion Estimation from Monocular Vehicle-Mounted Cameras","volume":"32","author":"Sabzevari","year":"2016","journal-title":"IEEE Trans. Robot."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1007\/s11263-012-0535-6","article-title":"Hybrid Linear Modeling via Local Best-Fit Flats","volume":"100","author":"Zhang","year":"2012","journal-title":"Int. J. Comput. Vis."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Elhamifar, E., and Vidal, R. (2010, January 14\u201319). Clustering disjoint subspaces via sparse representation. Proceedings of the 2010 IEEE International Conference on Acoustics, Speech and Signal Processing, Dallas, TX, USA.","DOI":"10.1109\/ICASSP.2010.5495317"},{"key":"ref_28","first-page":"413","article-title":"Estimation of Subspace Arrangements with Applications in Modeling and Segmenting Mixed Data","volume":"50","author":"Ma","year":"2008","journal-title":"Soc. Ind. Appl. Math."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1546","DOI":"10.1109\/TPAMI.2007.1085","article-title":"Segmentation of Multivariate Mixed Data via Lossy Data Coding and Compression","volume":"29","author":"Ma","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Yan, J., and Pollefeys, M. (2006, January 7\u201313). A General Framework for Motion Segmentation: Independent, Articulated, Rigid, Non-rigid, Degenerate and Non-degenerate. Proceedings of the European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744085_8"},{"key":"ref_31","unstructured":"Yang, A.Y., Rao, S.R., and Ma, Y. (2006, January 17\u201322). Robust Statistical Estimation and Segmentation of Multiple Subspaces. Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop, New York, NY, USA."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Sugaya, Y., and Kanatani, K. (2004, January 16). Geometric Structure of Degeneracy for Multi-body Motion Segmentation. Proceedings of the International Workshop on Statistical Methods in Video Processing, Prague, Czech Republic.","DOI":"10.1007\/978-3-540-30212-4_2"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zuliani, M., Kenney, C.S., and Manjunath, B.S. (2005, January 14). The multiransac algorithm and its application to detect planar homographies. Proceedings of the IEEE International Conference on Image Processing, Genova, Italy.","DOI":"10.1109\/ICIP.2005.1530351"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2004). Multiple View Geometry in Computer Vision, Cambridge University Press.","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Fremont, V., Rodriguez Florez, S.A., and Wang, B. (2017, January 11\u201314). Mono-Vision based Moving Object Detection in Complex Traffic Scenes. Proceedings of the 2017 IEEE Intelligent Vehicles Symposium (IV), Los Angeles, CA, USA.","DOI":"10.1109\/IVS.2017.7995857"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1177\/0278364913491297","article-title":"Vision meets Robotics: The KITTI Dataset","volume":"32","author":"Geiger","year":"2013","journal-title":"Int. J. Robot. Res."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Geiger, A., Ziegler, J., and Stiller, C. (2011, January 5\u20139). StereoScan: Dense 3D Reconstruction in Real-time. Proceedings of the 2011 IEEE Intelligent Vehicles Symposium (IV), Baden-Baden, Germany.","DOI":"10.1109\/IVS.2011.5940405"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Tron, R., and Vidal, R. (2007, January 7\u201322). A Benchmark for the Comparison of 3-D Motion Segmentation Algorithms. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.382974"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1109\/MSP.2010.939739","article-title":"Subspace Clustering","volume":"28","author":"Vidal","year":"2011","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Lebeda, K., Matas, J., and Chum, O. (2012, January 3\u20137). Fixing the Locally Optimized RANSAC\u2014Full experimental evaluation. Proceedings of the British Machine Vision Conference, Guildford, UK.","DOI":"10.5244\/C.26.95"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Chum, O., Matas, J., and Kittler, J. (2003, January 10\u201312). Locally Optimized RANSAC. Proceedings of the Joint Pattern Recognition Symposium, Magdeburg, Germany.","DOI":"10.1007\/978-3-540-45243-0_31"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/3\/560\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:29:29Z","timestamp":1760185769000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/3\/560"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,29]]},"references-count":41,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2019,2]]}},"alternative-id":["s19030560"],"URL":"https:\/\/doi.org\/10.3390\/s19030560","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2019,1,29]]}}}