{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,27]],"date-time":"2025-10-27T16:12:50Z","timestamp":1761581570954,"version":"build-2065373602"},"reference-count":32,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2017,6,28]],"date-time":"2017-06-28T00:00:00Z","timestamp":1498608000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["51675033"],"award-info":[{"award-number":["51675033"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>High accuracy target recognition and tracking systems using a single sensor or a passive multisensor set are susceptible to external interferences and exhibit environmental dependencies. These difficulties stem mainly from limitations to the available imaging frequency bands, and a general lack of coherent diversity of the available target-related data. This paper proposes an active multimodal sensor system for target recognition and tracking, consisting of a visible, an infrared, and a hyperspectral sensor. The system makes full use of its multisensor information collection abilities; furthermore, it can actively control different sensors to collect additional data, according to the needs of the real-time target recognition and tracking processes. This level of integration between hardware collection control and data processing is experimentally shown to effectively improve the accuracy and robustness of the target recognition and tracking system.<\/jats:p>","DOI":"10.3390\/s17071518","type":"journal-article","created":{"date-parts":[[2017,6,28]],"date-time":"2017-06-28T10:25:56Z","timestamp":1498645556000},"page":"1518","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Active Multimodal Sensor System for Target Recognition and Tracking"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9348-9797","authenticated-orcid":false,"given":"Yufu","family":"Qu","sequence":"first","affiliation":[{"name":"School of Instrumentation Scienc &amp; Optoelectronics Engineering, Beihang University, Beijing 100191, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guirong","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Instrumentation Scienc &amp; Optoelectronics Engineering, Beihang University, Beijing 100191, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhaofan","family":"Zou","sequence":"additional","affiliation":[{"name":"School of Instrumentation Scienc &amp; Optoelectronics Engineering, Beihang University, Beijing 100191, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ziyue","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Instrumentation Scienc &amp; Optoelectronics Engineering, Beihang University, Beijing 100191, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiansen","family":"Mao","sequence":"additional","affiliation":[{"name":"School of Instrumentation Scienc &amp; Optoelectronics Engineering, Beihang University, Beijing 100191, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2017,6,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Cho, H., Seo, Y.W., Kumar, B.V., and Rajkumar, R.R. (June, January 31). A multi-sensor fusion system for moving object detection and tracking in urban driving environments. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6907100"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Tran, D.X., Nguyen, T.D., Bui, H.M., Nguyen, S.T., Hoang, H.X., Pham, T.C., and de Souza-Daw, T. (August, January 30). Dual PTZ cameras approach for security face detection. Proceedings of the 2014 IEEE Fifth International Conference on Communications and Electronics (ICCE), Danang, Vietnam.","DOI":"10.1109\/CCE.2014.6916751"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1049\/iet-cvi.2013.0246","article-title":"Cooperative object tracking using dual-pan\u2013tilt\u2013zoom cameras based on planar ground assumption","volume":"9","author":"Cui","year":"2014","journal-title":"IET Comput. Vis."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Wang, J., and Yu, N. (2015, January 13\u201316). Cooperative Target Tracking in Dual-Camera System with Bidirectional Information Fusion. Proceedings of the International Conference on Image and Graphics, Tianjin, China.","DOI":"10.1007\/978-3-319-21963-9_6"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/s10846-010-9504-x","article-title":"A catadioptric and pan-tilt-zoom camera pair object tracking system for UAVs","volume":"61","author":"Tarhan","year":"2011","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.patrec.2012.07.005","article-title":"Intelligent multi-camera video surveillance: A review","volume":"34","author":"Wang","year":"2013","journal-title":"Pattern Recognit. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1110","DOI":"10.1109\/TMECH.2010.2077678","article-title":"Vision-aided laser Doppler vibrometry for remote automatic voice detection","volume":"16","author":"Qu","year":"2011","journal-title":"IEEE\/ASME Trans. Mechatron."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"6669","DOI":"10.1016\/j.eswa.2010.11.068","article-title":"Maritime surveillance: Tracking ships inside a dynamic background using a fast level-set","volume":"38","author":"Szpak","year":"2011","journal-title":"Expert Syst. Appl."},{"key":"ref_9","unstructured":"Sullivan, M.D.R., and Shah, M. (2008). Visual surveillance in maritime port facilities. Proc. SPIE, 6978."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Makantasis, K., Doulamis, A., and Doulamis, N. (2013, January 3\u20135). Vision-based maritime surveillance system using fused visual attention maps and online adaptable tracker. Proceedings of the International Workshop on Image Analysis for Multimedia Interactive Services, Paris, France.","DOI":"10.1109\/WIAMIS.2013.6616150"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Carthel, C., Coraluppi, S., and Grignan, P. (2007, January 9\u201312). Multisensor tracking and fusion for maritime surveillance. Proceedings of the International Conference on Information Fusion, Quebec, QC, Canada.","DOI":"10.1109\/ICIF.2007.4408025"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s11042-015-2512-x","article-title":"Semi-supervised vision-based maritime surveillance system using fused visual attention maps","volume":"75","author":"Makantasis","year":"2016","journal-title":"Multimed. Tools Appl."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Tran, T., and Le, T. (2016, January 27\u201330). Vision based boat detection for maritime surveillance. Proceedings of the 15th International Conference on Electronics, Information and Communication, Da Nang, Vietnam.","DOI":"10.1109\/ELINFOCOM.2016.7563033"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Teutsch, M., and Kruger, W. (2010, January 3\u20135). Classification of small boats in infrared images for maritime surveillance. Proceedings of the International Waterside Security Conference (WSS), Carrara, Italy.","DOI":"10.1109\/WSSC.2010.5730289"},{"key":"ref_15","unstructured":"Bouguet, J.Y. (2017, June 26). Camera Calibration Toolbox for Matlab. Available online: http:\/\/www.vision.caltech.edu\/bouguetj\/calib_doc\/."},{"key":"ref_16","unstructured":"Loop, C., and Zhang, Z. (1999, January 23\u201325). Computing rectifying homographies for stereo vision. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Fort Collins, CO, USA."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press.","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_18","unstructured":"Vapnik, V. (2013). The Nature of Statistical Learning Theory, Springer science & business media."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vision"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1109\/TPAMI.2008.275","article-title":"Faster and better: A machine learning approach to corner detection","volume":"32","author":"Rosten","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Leutenegger, S., Chli, M., and Siegwart, R.Y. (,  2011). BRISK: Binary robust invariant scalable keypoints. Proceedings of the 2011 IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126542"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2096","DOI":"10.1109\/TPAMI.2015.2509974","article-title":"Struck: Structured output tracking with kernels","volume":"38","author":"Hare","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1615","DOI":"10.1109\/TPAMI.2005.188","article-title":"A performance evaluation of local descriptors","volume":"27","author":"Mikolajczyk","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"438","DOI":"10.1137\/080732730","article-title":"ASIFT: A new framework for fully affine invariant image comparison","volume":"2","author":"Morel","year":"2009","journal-title":"SIAM J. Imaging Sci."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Lowe, D.G. (1999, January 20\u201327). Object recognition from local scale-invariant features. Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece.","DOI":"10.1109\/ICCV.1999.790410"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Fahn, C.S., and Chang, P.H. (2013, January 12\u201315). Text plates detection and recognition techniques used for an autonomous robot navigating in indoor environments. Proceedings of the 2013 6th IEEE Conference on Robotics, Automation and Mechatronics (RAM), Manila, Philippines.","DOI":"10.1109\/RAM.2013.6758556"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2767","DOI":"10.1016\/j.ijleo.2012.08.040","article-title":"Facial expression recognition based on fusion feature of PCA and LBP with SVM","volume":"124","author":"Luo","year":"2013","journal-title":"Optik-Int. J. Light Electron Opt."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhang, K., Zhang, L., and Yang, M.H. (2012, January 7\u201313). Real-time compressive tracking. Proceedings of the European Conference on Computer Vision, Florence, Italy.","DOI":"10.1007\/978-3-642-33712-3_62"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Stalder, S., Grabner, H., and Van Gool, L. (October, January 27). Beyond semi-supervised tracking: Tracking should be as simple as detection, but not simpler than recognition. Proceedings of the 2009 IEEE 12th International Conference on Computer Vision Workshops (ICCV Workshops), Kyoto, Japan.","DOI":"10.1109\/ICCVW.2009.5457445"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Grabner, H., Leistner, C., and Bischof, H. (2008, January 12\u201318). Semi-supervised on-line boosting for robust tracking. Proceedings of the 10th European Conferenceon Computer Vision, Marseille, France.","DOI":"10.1007\/978-3-540-88682-2_19"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Wu, Y., Lim, J., and Yang, M.H. (2013, January 23\u201328). Online object tracking: A benchmark. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.312"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/7\/1518\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:40:45Z","timestamp":1760208045000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/7\/1518"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,6,28]]},"references-count":32,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2017,7]]}},"alternative-id":["s17071518"],"URL":"https:\/\/doi.org\/10.3390\/s17071518","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2017,6,28]]}}}