{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:06:52Z","timestamp":1760148412017,"version":"build-2065373602"},"reference-count":57,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2023,4,26]],"date-time":"2023-04-26T00:00:00Z","timestamp":1682467200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004543","name":"China Scholarship Council","doi-asserted-by":"publisher","award":["202006540007"],"award-info":[{"award-number":["202006540007"]}],"id":[{"id":"10.13039\/501100004543","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This study focuses on solving the correspondence problem of multiple moving objects with similar appearances in stereoscopic videos. Specifically, we address the multi-camera correspondence problem by taking into account the pixel-level and feature-level stereo correspondences, and object-level cross-camera multiple object correspondence. Most correspondence algorithms rely on texture and color information of the stereo images, making it challenging to distinguish between similar-looking objects, such as ballet dancers and corporate employees wearing similar dresses, or farm animals such as chickens, ducks, and cows. However, by leveraging the low latency and high synchronization of high-speed cameras, we can perceive the phase and frequency differences between the movements of similar-looking objects. In this study, we propose using short-term velocities (STVs) of objects as motion features to determine the correspondence of multiple objects by calculating the similarity of STVs. To validate our approach, we conducted stereo correspondence experiments using markers attached to a metronome and natural hand movements to simulate simple and complex motion scenes. The experimental results demonstrate that our method achieved good performance in stereo correspondence.<\/jats:p>","DOI":"10.3390\/s23094285","type":"journal-article","created":{"date-parts":[[2023,4,26]],"date-time":"2023-04-26T04:42:54Z","timestamp":1682484174000},"page":"4285","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["HFR-Video-Based Stereo Correspondence Using High Synchronous Short-Term Velocities"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6823-2217","authenticated-orcid":false,"given":"Qing","family":"Li","sequence":"first","affiliation":[{"name":"Smart Robotics Laboratory, Graduate School of Advanced Science and Engineering, Hiroshima University, 1-4-1 Kagamiyama, Higashi-Hiroshima, Hiroshima 739-8527, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9176-3606","authenticated-orcid":false,"given":"Shaopeng","family":"Hu","sequence":"additional","affiliation":[{"name":"Smart Robotics Laboratory, Graduate School of Advanced Science and Engineering, Hiroshima University, 1-4-1 Kagamiyama, Higashi-Hiroshima, Hiroshima 739-8527, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4773-1575","authenticated-orcid":false,"given":"Kohei","family":"Shimasaki","sequence":"additional","affiliation":[{"name":"Smart Robotics Laboratory, Graduate School of Advanced Science and Engineering, Hiroshima University, 1-4-1 Kagamiyama, Higashi-Hiroshima, Hiroshima 739-8527, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7728-2363","authenticated-orcid":false,"given":"Idaku","family":"Ishii","sequence":"additional","affiliation":[{"name":"Smart Robotics Laboratory, Graduate School of Advanced Science and Engineering, Hiroshima University, 1-4-1 Kagamiyama, Higashi-Hiroshima, Hiroshima 739-8527, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,4,26]]},"reference":[{"key":"ref_1","first-page":"1663","article-title":"Stereo matching algorithm based on deep learning: A survey","volume":"34","author":"Hamid","year":"2022","journal-title":"J. King Saud-Univ.-Comput. Inf. Sci."},{"key":"ref_2","unstructured":"Oroko, J.A., and Nyakoe, G. (2022, January 5\u20137). Obstacle avoidance and path planning schemes for autonomous navigation of a mobile robot: A review. Proceedings of the Sustainable Research and Innovation Conference, Nairobi, Kenya."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"103958","DOI":"10.1016\/j.earscirev.2022.103958","article-title":"Stereoscopic hyperspectral remote sensing of the atmospheric environment: Innovation and prospects","volume":"226","author":"Liu","year":"2022","journal-title":"Earth-Sci. Rev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1371","DOI":"10.1007\/s10143-021-01623-0","article-title":"Does stereoscopic imaging improve the memorization of medical imaging by neurosurgeons? Experience of a single institution","volume":"45","author":"Schlinkmann","year":"2022","journal-title":"Neurosurg. Rev."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Macario Barros, A., Michel, M., Moline, Y., Corre, G., and Carrel, F. (2022). A comprehensive survey of visual slam algorithms. Robotics, 11.","DOI":"10.3390\/robotics11010024"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"15613","DOI":"10.1038\/s41598-022-19336-9","article-title":"A novel factor graph-based optimization technique for stereo correspondence estimation","volume":"12","author":"Shabanian","year":"2022","journal-title":"Sci. Rep."},{"key":"ref_7","first-page":"875","article-title":"Development of depth map from stereo images using sum of absolute differences and edge filters","volume":"25","author":"Hamzah","year":"2022","journal-title":"Indones. J. Electr. Eng. Comput. Sci."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"102366","DOI":"10.1016\/j.sysarc.2021.102366","article-title":"Efficient stereo matching on embedded GPUs with zero-means cross correlation","volume":"123","author":"Chang","year":"2022","journal-title":"J. Syst. Archit."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Wang, F., and Ding, L. (2022, January 24\u201326). Object recognition and localization based on binocular stereo vision. Proceedings of the 2022 2nd International Conference on Control and Intelligent Robotics, Nanjing, China.","DOI":"10.1145\/3548608.3559192"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1874","DOI":"10.1109\/TRO.2021.3075644","article-title":"Orb-slam3: An accurate open-source library for visual, visual\u2013inertial, and multimap slam","volume":"37","author":"Campos","year":"2021","journal-title":"IEEE Trans. Robot."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zbontar, J., and LeCun, Y. (2015, January 7\u201312). Computing the stereo matching cost with a convolutional neural network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298767"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1738","DOI":"10.1109\/TPAMI.2020.3032602","article-title":"A survey on deep learning techniques for stereo-based depth estimation","volume":"44","author":"Laga","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kaya, M., and Bilge, H.\u015e. (2019). Deep metric learning: A survey. Symmetry, 11.","DOI":"10.3390\/sym11091066"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"K\u00f6hl, P., Specker, A., Schumann, A., and Beyerer, J. (2020, January 14\u201319). The MTA Dataset for Multi Target Multi Camera Pedestrian Tracking by Weighted Distance Aggregation. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00529"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Li, P., Zhang, J., Zhu, Z., Li, Y., Jiang, L., and Huang, G. (2019, January 16\u201317). State-aware re-identification feature for multi-target multi-camera tracking. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, Long Beach, CA, USA.","DOI":"10.1109\/CVPRW.2019.00192"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"5191","DOI":"10.1109\/TIP.2020.2980070","article-title":"Multi-target multi-camera tracking by tracklet-to-target assignment","volume":"29","author":"He","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Magdy, N., Sakr, M.A., Mostafa, T., and El-Bahnasy, K. (2016). Review on Trajectory Similarity Measures, Institute of Electrical and Electronics Engineers Inc.","DOI":"10.1109\/IntelCIS.2015.7397286"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Li, Q., Chen, M., Gu, Q., and Ishii, I. (2022, January 23\u201327). A Flexible Calibration Algorithm for High-speed Bionic Vision System based on Galvanometer. Proceedings of the 2022 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Kyoto, Japan.","DOI":"10.1109\/IROS47612.2022.9981947"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1007\/s11633-016-1024-0","article-title":"Review of some advances and applications in real-time high-speed vision: Our views and experiences","volume":"13","author":"Gu","year":"2016","journal-title":"Int. J. Autom. Comput."},{"key":"ref_20","unstructured":"Costa, L.d.F. (2021). Comparing cross correlation-based similarities. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"8","DOI":"10.4236\/jcc.2019.73002","article-title":"Image quality assessment through FSIM, SSIM, MSE and PSNR\u2014a comparative study","volume":"7","author":"Sara","year":"2019","journal-title":"J. Comput. Commun."},{"key":"ref_22","unstructured":"Zhao, S., Wang, Y., Yang, Z., and Cai, D. (2019). Region mutual information loss for semantic segmentation. Adv. Neural Inf. Process. Syst., 32."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"9059","DOI":"10.1109\/TGRS.2019.2924684","article-title":"Fast and robust matching for multimodal remote sensing image registration","volume":"57","author":"Ye","year":"2019","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"110691","DOI":"10.1016\/j.forsciint.2021.110691","article-title":"A DWT-SVD based robust digital watermarking for medical image security","volume":"320","author":"Zermi","year":"2021","journal-title":"Forensic Sci. Int."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Yang, L., Su, H., Zhong, C., Meng, Z., Luo, H., Li, X., Tang, Y.Y., and Lu, Y. (2019). Hyperspectral image classification using wavelet transform-based smooth ordering. Int. J. Wavelets, Multiresolut. Inf. Process., 17.","DOI":"10.1142\/S0219691319500504"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Pautrat, R., Larsson, V., Oswald, M.R., and Pollefeys, M. (2020, January 23\u201328). Online invariance selection for local feature descriptors. Proceedings of the Computer Vision\u2013ECCV 2020: 16th European Conference, Glasgow, UK. Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-030-58536-5_42"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1007\/s00371-020-01814-8","article-title":"2D-human face recognition using SIFT and SURF descriptors of face\u2019s feature regions","volume":"37","author":"Gupta","year":"2021","journal-title":"Vis. Comput."},{"key":"ref_28","first-page":"224","article-title":"An improved ORB feature point image matching method based on PSO","volume":"Volume 11069","author":"Pang","year":"2019","journal-title":"Proceedings of the Tenth International Conference on Graphics and Image Processing (ICGIP 2018)"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Chengtao, C., and Mengqun, L. (2019, January 18\u201320). Tire pattern similarity detection based on template matching and LBP. Proceedings of the 2019 3rd International Conference on Electronic Information Technology and Computer Engineering (EITCE), Xiamen, China.","DOI":"10.1109\/EITCE47263.2019.9095051"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"28872","DOI":"10.1109\/ACCESS.2021.3056504","article-title":"A hitchhiker\u2019s guide to structural similarity","volume":"9","author":"Venkataramanan","year":"2021","journal-title":"IEEE Access"},{"key":"ref_31","unstructured":"Targ, S., Almeida, D., and Lyman, K. (2016). Resnet in resnet: Generalizing residual architectures. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"95","DOI":"10.3389\/fnins.2019.00095","article-title":"Going deeper in spiking neural networks: VGG and residual architectures","volume":"13","author":"Sengupta","year":"2019","journal-title":"Front. Neurosci."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Hernandez-Diaz, K., Alonso-Fernandez, F., and Bigun, J. (2019, January 4\u20137). Cross Spectral Periocular Matching using ResNet Features. Proceedings of the 2019 International Conference on Biometrics (ICB), Crete, Greece.","DOI":"10.1109\/ICB45273.2019.8987303"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"7355","DOI":"10.1007\/s11042-019-08495-z","article-title":"An efficient copy move forgery detection using deep learning feature extraction and matching algorithm","volume":"79","author":"Agarwal","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_35","unstructured":"Han, X., Leung, T., Jia, Y., Sukthankar, R., and Berg, A.C. (2016, January 27\u201330). Matchnet: Unifying feature and metric learning for patch-based matching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Zagoruyko, S., and Komodakis, N. (2015, January 7\u201312). Learning to compare image patches via convolutional neural networks. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299064"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1904","DOI":"10.1109\/TPAMI.2015.2389824","article-title":"Spatial pyramid pooling in deep convolutional networks for visual recognition","volume":"37","author":"He","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Yang, T.Y., Hsu, J.H., Lin, Y.Y., and Chuang, Y.Y. (2017, January 22\u201329). DeepCD: Learning Deep Complementary Descriptors for Patch Representations. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.359"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"5198","DOI":"10.1109\/TIP.2021.3078124","article-title":"Multi-target multi-camera tracking of vehicles using metadata-aided re-id and trajectory-based camera link model","volume":"30","author":"Hsu","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Gou, M., Karanam, S., Liu, W., Camps, O., and Radke, R.J. (2017, January 21\u201326). Dukemtmc4reid: A large-scale multi-camera person re-identification dataset. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.185"},{"key":"ref_41","unstructured":"Xiu, Y., Li, J., Wang, H., Fang, Y., and Lu, C. (2018). Pose Flow: Efficient online pose tracking. arXiv."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s00778-019-00574-9","article-title":"A survey of trajectory distance measures and performance evaluation","volume":"29","author":"Su","year":"2020","journal-title":"VLDB J."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1017\/S0373463318000723","article-title":"A novel similarity measure for clustering vessel trajectories based on dynamic time warping","volume":"72","author":"Zhao","year":"2019","journal-title":"J. Navig."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"527","DOI":"10.1016\/j.patrec.2019.06.024","article-title":"Combining graph edit distance and triplet networks for offline signature verification","volume":"125","author":"Maergner","year":"2019","journal-title":"Pattern Recognit. Lett."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Rubinstein, A., and Song, Z. (2020, January 5\u20138). Reducing approximate longest common subsequence to approximate edit distance. Proceedings of the Fourteenth Annual ACM-SIAM Symposium on Discrete Algorithms, SIAM, PA, United States.","DOI":"10.1137\/1.9781611975994.98"},{"key":"ref_46","first-page":"146","article-title":"Effectiveness of trajectory similarity measures based on truck GPS data","volume":"33","author":"Ying","year":"2020","journal-title":"China J. Highw. Transp."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Gong, L., Chen, B., Xu, W., Liu, C., Li, X., Zhao, Z., and Zhao, L. (2022). Motion similarity evaluation between human and a tri-co robot during real-time imitation with a trajectory dynamic time warping model. Sensors, 22.","DOI":"10.3390\/s22051968"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1600","DOI":"10.1109\/JAS.2019.1911534","article-title":"Vision based hand gesture recognition using 3D shape context","volume":"8","author":"Zhu","year":"2019","journal-title":"IEEE\/CAA J. Autom. Sin."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Patel, C.I., Labana, D., Pandya, S., Modi, K., Ghayvat, H., and Awais, M. (2020). Histogram of oriented gradient-based fusion of features for human action recognition in action video sequences. Sensors, 20.","DOI":"10.3390\/s20247299"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"29987","DOI":"10.1109\/ACCESS.2020.2972299","article-title":"Abnormal trajectory detection based on a sparse subgraph","volume":"8","author":"Zhao","year":"2020","journal-title":"IEEE Access"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Liang, X., Zhang, H.B., Zhang, Y.X., and Huang, J.L. (2019, January 3\u20136). JTCR: Joint Trajectory Character Recognition for human action recognition. Proceedings of the 2019 IEEE Eurasia Conference on IOT, Communication and Engineering (ECICE), Yunlin, Taiwan.","DOI":"10.1109\/ECICE47484.2019.8942672"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Cao, J., Liang, M., Li, Y., Chen, J., Li, H., Liu, R.W., and Liu, J. (2018, January 9\u201312). PCA-based hierarchical clustering of AIS trajectories with automatic extraction of clusters. Proceedings of the 2018 IEEE 3rd International Conference on Big Data Analysis (ICBDA), Shanghai, China.","DOI":"10.1109\/ICBDA.2018.8367725"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Xiao, Z., Wang, Y., Fu, K., and Wu, F. (2017). Identifying Different Transportation Modes from Trajectory Data Using Tree-Based Ensemble Classifiers. ISPRS Int. J. -Geo-Inf., 6.","DOI":"10.3390\/ijgi6020057"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Bagheri, M.A., Gao, Q., and Escalera, S. (2016, January 7\u201310). Support vector machines with time series distance kernels for action classification. Proceedings of the 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Placid, NY, USA.","DOI":"10.1109\/WACV.2016.7477591"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Yao, D., Zhang, C., Zhu, Z., Huang, J., and Bi, J. (2017, January 14\u201319). Trajectory clustering via deep representation learning. Proceedings of the 2017 International Joint Conference on Neural Networks (IJCNN), Anchorage, AK, USA.","DOI":"10.1109\/IJCNN.2017.7966345"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Zhang, R., Xie, P., Jiang, H., Xiao, Z., Wang, C., and Liu, L. (2019, January 10\u201313). Clustering noisy trajectories via robust deep attention auto-encoders. Proceedings of the 2019 20th IEEE International Conference on Mobile Data Management (MDM), Hong Kong, China.","DOI":"10.1109\/MDM.2019.00-73"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"108803","DOI":"10.1016\/j.oceaneng.2021.108803","article-title":"An unsupervised learning method with convolutional auto-encoder for vessel trajectory similarity computation","volume":"225","author":"Liang","year":"2021","journal-title":"Ocean. Eng."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/9\/4285\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:23:45Z","timestamp":1760124225000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/9\/4285"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,26]]},"references-count":57,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2023,5]]}},"alternative-id":["s23094285"],"URL":"https:\/\/doi.org\/10.3390\/s23094285","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2023,4,26]]}}}