{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:41:05Z","timestamp":1760362865696,"version":"build-2065373602"},"reference-count":53,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2020,5,1]],"date-time":"2020-05-01T00:00:00Z","timestamp":1588291200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Knowing who is where is a common task for many computer vision applications. Most of the literature focuses on one of two approaches: determining who a detected person is (appearance-based re-identification) and collating positions into a list, or determining the motion of a person (spatio-temporal-based tracking) and assigning identity labels based on tracks formed. This paper presents a model fusion approach, aiming towards combining both sources of information together in order to increase the accuracy of determining identity classes for detected people using re-ranking. First, a Sequential k-Means re-identification approach is presented, followed by a Kalman filter-based spatio-temporal tracking approach. A linear weighting approach is used to fuse the outputs from these models together, with modification of the weights using a decay function and a rule-based system to reflect the strengths and weaknesses of the models under different conditions. Preliminary experimental results with two different person detection algorithms on an indoor person tracking dataset show that fusing the appearance and spatio-temporal models significantly increases the overall accuracy of the classification operation.<\/jats:p>","DOI":"10.3390\/jimaging6050027","type":"journal-article","created":{"date-parts":[[2020,5,4]],"date-time":"2020-05-04T03:29:39Z","timestamp":1588562979000},"page":"27","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Fusing Appearance and Spatio-Temporal Models for Person Re-Identification and Tracking"],"prefix":"10.3390","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6239-8443","authenticated-orcid":false,"given":"Andrew Tzer-Yeu","family":"Chen","sequence":"first","affiliation":[{"name":"Embedded Systems Research Group, Department of Electrical, Computer, and Software Engineering, The University of Auckland, Auckland 1010, New Zealand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8094-5343","authenticated-orcid":false,"given":"Morteza","family":"Biglari-Abhari","sequence":"additional","affiliation":[{"name":"Embedded Systems Research Group, Department of Electrical, Computer, and Software Engineering, The University of Auckland, Auckland 1010, New Zealand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8450-2558","authenticated-orcid":false,"given":"Kevin I-Kai","family":"Wang","sequence":"additional","affiliation":[{"name":"Embedded Systems Research Group, Department of Electrical, Computer, and Software Engineering, The University of Auckland, Auckland 1010, New Zealand"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,5,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.patrec.2012.07.005","article-title":"Intelligent Multi-camera Video Surveillance: A Review","volume":"34","author":"Wang","year":"2013","journal-title":"Pattern Recognit. Lett."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Kumar, S., Marks, T.K., and Jones, M. (2014, January 23\u201328). Improving person tracking using an inexpensive thermal infrared sensor. Proceedings of the Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Columbus, OH, USA.","DOI":"10.1109\/CVPRW.2014.41"},{"key":"ref_3","unstructured":"Petrushin, V.A., Wei, G., Shakil, O., Roqueiro, D., and Gershman, V. (2006, January 7\u20139). Multiple-Sensor Indoor Surveillance System. Proceedings of the Canadian Conference on Computer and Robot Vision (CRV), Quebec City, QC, Canada."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Huh, J.H., and Seo, K. (2017). An Indoor Location-Based Control System Using Bluetooth Beacons for IoT Systems. Sensors, 17.","DOI":"10.3390\/s17122917"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Nazare, A.C., de O. Costa, F., and Schwartz, W.R. (2018, January 27\u201330). Content-Based Multi-Camera Video Alignment using Accelerometer Data. Proceedings of the International Conference on Advanced Video and Signal-based Surveillance (AVSS), Auckland, New Zealand.","DOI":"10.1109\/AVSS.2018.8639468"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Ahmed, E., Jones, M., and Marks, T.K. (2015, January 7\u201312). An Improved Deep Learning Architecture for Person Re-Identification. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299016"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1012","DOI":"10.1109\/JSTARS.2013.2295313","article-title":"Gabor-filtering-based nearest regularized subspace for hyperspectral image classification","volume":"7","author":"Li","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.cviu.2017.11.009","article-title":"Structured deep hashing with convolutional neural networks for fast person re-identification","volume":"167","author":"Wu","year":"2018","journal-title":"Comput. Vis. Image Underst. (CVIU)"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Xiao, T., Li, S., Wang, B., Lin, L., and Wang, X. (2017, January 1\u201326). Joint Detection and Identification Feature Learning for Person Search. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.360"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"540","DOI":"10.1109\/TCSVT.2016.2556538","article-title":"From the Lab to the Real World: Re-identification in an Airport Camera Network","volume":"27","author":"Camps","year":"2017","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_11","unstructured":"Filkovi\u0107, I., Kalafati\u0107, Z., and Hrka\u0107, T. (June, January 30). Deep metric learning for person Re-identification and De-identification. Proceedings of the International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), Opatija, Croatia."},{"key":"ref_12","unstructured":"Khan, F.M., and Br\u00e9mond, F. (2016). Person Re-identification for Real-world Surveillance Systems. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Paisitkriangkrai, S., Shen, C., and van den Hengel, A. (2015, January 7\u201312). Learning to rank in person re-identification with metric ensembles. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298794"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1016\/j.compeleceng.2019.06.009","article-title":"Investigating Fast Re-identification for Multi-camera Indoor Person Tracking","volume":"77","author":"Chen","year":"2019","journal-title":"Comput. Electr. Eng."},{"key":"ref_15","unstructured":"Shu, G., Dehghan, A., Oreifej, O., Hand, E., and Shah, M. (2012, January 16\u201321). Part-based multiple-person tracking with partial occlusion handling. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1627","DOI":"10.1109\/TPAMI.2009.167","article-title":"Object Detection with Discriminatively Trained Part-Based Models","volume":"32","author":"Felzenszwalb","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Pedagadi, S., Orwell, J., Velastin, S., and Boghossian, B. (2013, January 23\u201328). Local Fisher discriminant analysis for pedestrian reidentification. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.426"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1016\/j.imavis.2014.04.002","article-title":"Covariance Descriptor based on Bio-inspired Features for Person Re-identification and Face Verification","volume":"32","author":"Ma","year":"2014","journal-title":"Image Vis. Comput."},{"key":"ref_19","first-page":"49","article-title":"On the generalized distance in statistics","volume":"2","author":"Mahalanobis","year":"1936","journal-title":"Proc. Natl. Inst. Sci. USA"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"13-es","DOI":"10.1145\/1177352.1177355","article-title":"Object Tracking: A Survey","volume":"38","author":"Yilmaz","year":"2006","journal-title":"ACM Comput. Surv."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Wu, Y., Lim, J., and Yang, M.H. (2013, January 23\u201328). Online Object Tracking: A Benchmark. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.312"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press.","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_23","unstructured":"Ma, Y., Soatto, S., Kosecka, J., and Sastry, S.S. (2003). An Invitation to 3-D Vision: From Images to Geometric Models, Springer."},{"key":"ref_24","first-page":"27599-3175","article-title":"An introduction to the Kalman filter","volume":"8","author":"Bishop","year":"2001","journal-title":"Spec. Interest Group Comput. Graph. Interact. Tech. (SIGGRAPH)"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1442","DOI":"10.1109\/TPAMI.2013.230","article-title":"Visual tracking: An experimental survey","volume":"36","author":"Smeulders","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"237","DOI":"10.3233\/AIS-2011-0111","article-title":"A hybrid probabilistic neural model for person tracking based on a ceiling-mounted camera","volume":"3","author":"Yan","year":"2011","journal-title":"J. Ambient Intell. Smart Environ."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3991","DOI":"10.1109\/TIE.2012.2206330","article-title":"Directional people counter based on head tracking","volume":"60","author":"Gardel","year":"2013","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1109\/MAES.2010.5546308","article-title":"Particle filter theory and practice with positioning applications","volume":"25","author":"Gustafsson","year":"2010","journal-title":"IEEE Aerosp. Electron. Syst. Mag."},{"key":"ref_29","first-page":"551","article-title":"Robust Multi-person Tracking for Real-Time Intelligent Video Surveillance","volume":"37","author":"Choi","year":"2015","journal-title":"Electron. Telecommun. Res. Inst. J."},{"key":"ref_30","unstructured":"Lucas, B.D., and Kanade, T. (1981, January 24\u201328). An iterative image registration technique with an application to stereo vision. Proceedings of the International Joint Conference on Artificial Intelligence, Vancouver, BC, Canada."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Kamen, E.W., and Su, J.K. (1999). Introduction to Optimal Estimation, Springer.","DOI":"10.1007\/978-1-4471-0417-9"},{"key":"ref_32","unstructured":"Zarchan, P., and Musoff, H. (2000). Fundamentals of Kalman Filtering: A Practical Approach, American Institute of Aeronautics and Astronautics."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1016\/j.cviu.2014.06.003","article-title":"Joint multi-person detection and tracking from overlapping cameras","volume":"128","author":"Liem","year":"2014","journal-title":"Comput. Vis. Image Underst. (CVIU)"},{"key":"ref_34","first-page":"120","article-title":"The OpenCV Library","volume":"25","author":"Bradski","year":"2000","journal-title":"Dr. Dobb\u2019s J. Softw. Tools"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Kuo, C.H., and Nevatia, R. (2011, January 20\u201325). How does person identity recognition help multi-person tracking?. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995384"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Tang, S., Andriluka, M., Andres, B., and Schiele, B. (2017, January 21\u201326). Multiple People Tracking by Lifted Multicut and Person Re-identification. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.394"},{"key":"ref_37","unstructured":"Beyer, L., Breuers, S., Kurin, V., and Leibe, B. (July, January 26). Towards a Principled Integration of Multi-Camera Re-Identification and Tracking Through Optimal Bayes Filters. Proceedings of the Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Las Vegas, NV, USA."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Liu, C., Change Loy, C., Gong, S., and Wang, G. (2013, January 1\u20138). POP: Person Re-identification Post-rank Optimisation. Proceedings of the International Conference on Computer Vision (ICCV), Sydney, Australia.","DOI":"10.1109\/ICCV.2013.62"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"6989","DOI":"10.1007\/s11042-014-1949-7","article-title":"Person re-identification with content and context re-ranking","volume":"74","author":"Leng","year":"2015","journal-title":"Multimed. Tools Appl."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zhong, Z., Zheng, L., Cao, D., and Li, S. (2017, January 21\u201326). Re-ranking Person Re-identification with k-Reciprocal Encoding. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.389"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1109\/TPAMI.2018.2807450","article-title":"A Systematic Evaluation and Benchmark for Person Re-Identification: Features, Metrics, and Datasets","volume":"41","author":"Karanam","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1002\/wics.111","article-title":"Rank Aggregation Methods","volume":"2","author":"Lin","year":"2010","journal-title":"Wiley Interdiscip. Rev. Comput. Stat."},{"key":"ref_43","unstructured":"Zalta, E.N. (2017). Voting Methods. The Stanford Encyclopedia of Philosophy, Stanford University."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1007\/BF00143070","article-title":"Condorcet\u2019s paradox","volume":"15","author":"Gehrlein","year":"1983","journal-title":"Theory Decis."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1109\/34.3885","article-title":"A Statistical Viewpoint on the Theory of Evidence","volume":"10","author":"Hummel","year":"1988","journal-title":"IEEE Trans. Patern Anal. Mach. Intell."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1007\/BF02703729","article-title":"Bayesian and Dempster-Shafer Fusion","volume":"29","author":"Challa","year":"2004","journal-title":"S\u0101dhan\u0101"},{"key":"ref_47","unstructured":"Anderson, T.W. (1958). An Introduction to Multivariate Statistical Analysis, Wiley."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"985","DOI":"10.1093\/clinchem\/25.6.985","article-title":"Application of Bayes\u2019s theorem to results of quantitative clinical chemical determinations","volume":"25","author":"Hische","year":"1979","journal-title":"Clin. Chem."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Chen, A.T.Y., Biglari-Abhari, M., and Wang, K.I.K. (2017, January 4\u20136). A Computationally Efficient Pipeline for Camera-based Indoor Person Tracking. Proceedings of the Image and Vision Computing New Zealand (IVCNZ), Christchurch, New Zealand.","DOI":"10.1109\/IVCNZ.2017.8402479"},{"key":"ref_50","unstructured":"Figueira, D., Taiana, M., Nambiar, A., Nascimento, J., and Bernardino, A. (2014, January 6\u201312). The HDA+ Data Set for Research on Fully Automated Re-identification Systems. Proceedings of the European Conference on Computer Vision Workshop (ECCV), Zurich, Switzerland."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1532","DOI":"10.1109\/TPAMI.2014.2300479","article-title":"Fast Feature Pyramids for Object Detection","volume":"36","author":"Appel","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"De Smedt, F., and Goedem\u00e9, T. (2015, January 11\u201314). Open framework for combined pedestrian detection. Proceedings of the International Conference on Computer Vision Theory and Applications (VISIGRAPP), Berlin, Germany.","DOI":"10.5220\/0005359205510558"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Nguyen, V., Ngo, T.D., Nguyen, K.M.T.T., Duong, D.A., Nguyen, K., and Le, D. (2013, January 15\u201318). Re-ranking for person re-identification. Proceedings of the International Conference on Soft Computing and Pattern Recognition (SoCPaR), Hanoi, Vietnam.","DOI":"10.1109\/SOCPAR.2013.7054148"}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/6\/5\/27\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:25:07Z","timestamp":1760361907000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/6\/5\/27"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,1]]},"references-count":53,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2020,5]]}},"alternative-id":["jimaging6050027"],"URL":"https:\/\/doi.org\/10.3390\/jimaging6050027","relation":{},"ISSN":["2313-433X"],"issn-type":[{"type":"electronic","value":"2313-433X"}],"subject":[],"published":{"date-parts":[[2020,5,1]]}}}