{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,17]],"date-time":"2026-02-17T11:14:14Z","timestamp":1771326854044,"version":"3.50.1"},"reference-count":43,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2020,1,22]],"date-time":"2020-01-22T00:00:00Z","timestamp":1579651200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61671126"],"award-info":[{"award-number":["61671126"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Pedestrian tracking in dense crowds is a challenging task, even when using a multi-camera system. In this paper, a new Markov random field (MRF) model is proposed for the association of tracklet couplings. Equipped with a new potential function improvement method, this model can associate the small tracklet coupling segments caused by dense pedestrian crowds. The tracklet couplings in this paper are obtained through a data fusion method based on image mutual information. This method calculates the spatial relationships of tracklet pairs by integrating position and motion information, and adopts the human key point detection method for correction of the position data of incomplete and deviated detections in dense crowds. The MRF potential function improvement method for dense pedestrian scenes includes assimilation and extension processing, as well as a message selective belief propagation algorithm. The former enhances the information of the fragmented tracklets by means of a soft link with longer tracklets and expands through sharing to improve the potentials of the adjacent nodes, whereas the latter uses a message selection rule to prevent unreliable messages of fragmented tracklet couplings from being spread throughout the MRF network. With the help of the iterative belief propagation algorithm, the potentials of the model are improved to achieve valid association of the tracklet coupling fragments, such that dense pedestrians can be tracked more robustly. Modular experiments and system-level experiments are conducted using the PETS2009 experimental data set, where the experimental results reveal that the proposed method has superior tracking performance.<\/jats:p>","DOI":"10.3390\/s20030628","type":"journal-article","created":{"date-parts":[[2020,1,22]],"date-time":"2020-01-22T11:17:57Z","timestamp":1579691877000},"page":"628","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Multiple Object Tracking for Dense Pedestrians by Markov Random Field Model with Improvement on Potentials"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9907-6050","authenticated-orcid":false,"given":"Peixin","family":"Liu","sequence":"first","affiliation":[{"name":"School of Information and Communication Engineering, University of Electronic Science and Technology of China (UESTC), 2006 Xiyuan Avenue, Chengdu 611731, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaofeng","family":"Li","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, University of Electronic Science and Technology of China (UESTC), 2006 Xiyuan Avenue, Chengdu 611731, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7122-1113","authenticated-orcid":false,"given":"Yang","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, University of Electronic Science and Technology of China (UESTC), 2006 Xiyuan Avenue, Chengdu 611731, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhizhong","family":"Fu","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, University of Electronic Science and Technology of China (UESTC), 2006 Xiyuan Avenue, Chengdu 611731, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,1,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1627","DOI":"10.1109\/TPAMI.2009.167","article-title":"Object detection with discriminatively trained part-based models","volume":"32","author":"Felzenszwalb","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1532","DOI":"10.1109\/TPAMI.2014.2300479","article-title":"Fast feature pyramids for object detection","volume":"36","author":"Dollar","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster r-cnn: Towards real-time object detection with region proposal networks","volume":"39","author":"Ren","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1670","DOI":"10.1016\/j.patcog.2014.12.004","article-title":"Robust multiple cameras pedestrian detection with multi-view Bayesian network","volume":"48","author":"Peng","year":"2015","journal-title":"Pattern Recognit."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Cao, Z., Simon, T., Wei, S.E., and Sheikh, Y. (2017, January 21\u201326). Realtime multi-person 2D pose estimation using part affinity fields. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.143"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1983","DOI":"10.1109\/TPAMI.2015.2509979","article-title":"Exploiting hierarchical dense structures on hypergraphs for multi-object tracking","volume":"38","author":"Wen","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1007\/s11263-013-0666-4","article-title":"Multi-target tracking by online learning a crf model of appearance and motion patterns","volume":"107","author":"Yang","year":"2014","journal-title":"Int. J. Comput. Vis."},{"key":"ref_8","unstructured":"Zhang, L., Li, Y., and Nevatia, R. (2008, January 23\u201328). Global data association for multi-object tracking using network flows. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1109\/TPAMI.2013.103","article-title":"Continuous energy minimization for multitarget tracking","volume":"36","author":"Milan","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Pirsiavash, H., Ramanan, D., and Fowlkes, C.C. (2011, January 20\u201325). Globally optimal greedy algorithms for tracking a variable number of objects. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995604"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Wen, L., Li, W., Yan, J., Lei, Z., Yi, D., and Li, S.Z. (2014, January 23\u201328). Multiple target tracking based on undirected hierarchical relation hypergraph. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.167"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Leal-Taix\u00e9, L., Pons-Moll, G., and Rosenhahn, B. (2012, January 16\u201321). Branch-and-price global optimization for multi-view multi-target tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6247901"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Hofmann, M., Wolf, D., and Rigoll, G. (2013, January 23\u201328). Hypergraphs for Joint Multi-view Reconstruction and Multi-object Tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.468"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1007\/s11263-016-0943-0","article-title":"Multi-Camera Multi-Target Tracking with Space-Time-View Hyper-graph","volume":"122","author":"Wen","year":"2017","journal-title":"Int. J. Comput.Vis."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wu, Z., Hristov, N.I., Kunz, T.H., and Betke, M. (2009, January 8\u20139). Tracking-reconstruction or reconstruction-tracking? Comparison of two multiple hypothesis tracking approaches to interpret 3D object motion from several camera views. Proceedings of the 2009 Workshop on Motion and Video Computing (WMVC), Snowbird, UT, USA.","DOI":"10.1109\/WMVC.2009.5399245"},{"key":"ref_16","first-page":"689","article-title":"Generalized Belief Propagation","volume":"13","author":"Yedidia","year":"2000","journal-title":"Adv. Neural Inf. Process. Syst. (NIPS)"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"787","DOI":"10.1109\/TPAMI.2003.1206509","article-title":"Stereo matching using belief propagation","volume":"25","author":"Sun","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","unstructured":"Dockstader, S.L., and Tekalp, A.M. (2001, January 8\u20138). Multiple camera fusion for multi-object tracking. Proceedings of the IEEE Workshop on Multi-Object Tracking, Vancouver, BC, Canada."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Eshel, R., and Moses, Y. (2008, January 23\u201328). Homography based multiple camera detection and tracking of people in a dense crowd. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA.","DOI":"10.1109\/CVPR.2008.4587539"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"841","DOI":"10.1016\/S0262-8856(02)00094-X","article-title":"A relaxation algorithm for real-time multiple view 3D-tracking","volume":"20","author":"Li","year":"2002","journal-title":"Image Vis. Comput."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1023\/A:1021849801764","article-title":"M2Tracker: A Multi-View Approach to Segmenting and Tracking People in a Cluttered Scene","volume":"51","author":"Mittal","year":"2003","journal-title":"Int. J. Comput.Vis."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1806","DOI":"10.1109\/TPAMI.2011.21","article-title":"Multiple Object Tracking Using K-Shortest Paths Optimization","volume":"33","author":"Berclaz","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1109\/TPAMI.2007.1174","article-title":"Multi-camera People Tracking with a Probabilistic Occupancy Map","volume":"30","author":"Fleuret","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Leal-Taixe, L., Pons-Moll, G., and Rosenhahn, B. (2011, January 6\u201313). Everybody needs somebody: Modeling social and grouping behavior on a linear programming multiple people tracker. Proceedings of the IEEE Conference on Computer Vision Workshops (ICCV Workshops), Barcelona, Spain.","DOI":"10.1109\/ICCVW.2011.6130233"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Duanmu, F., Feng, X., Zhu, X., Tan, W., and Wang, Y. (2018, January 10\u201312). A Multi-View Pedestrian Tracking Framework Based on Graph Matching. Proceedings of the IEEE Conference on Multimedia Information Processing and Retrieval (MIPR), Miami, FL, USA.","DOI":"10.1109\/MIPR.2018.00072"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1016\/j.neucom.2014.02.040","article-title":"Single\/cross-camera multiple-person tracking by graph matching","volume":"139","author":"Nie","year":"2014","journal-title":"Neurocomputing"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1109\/TCSVT.2016.2615538","article-title":"Multi-camera tracklet association and fusion using ensemble of visual and geometric cues","volume":"27","author":"Nithin","year":"2017","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2884","DOI":"10.1109\/TCSVT.2017.2781738","article-title":"A stochastic attribute grammar for robust cross-view human tracking","volume":"28","author":"Liu","year":"2018","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Butt, A.A., and Collins, R.T. (2013, January 23\u201328). Multi-target Tracking by Lagrangian Relaxation to Min-cost Network Flow. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.241"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Liu, P., Li, X., Feng, H., and Fu, Z. (2017, January 17\u201320). Multi-object tracking by virtual nodes added min-cost network flow. Proceedings of the IEEE International Conference on Image Processing, Beijing, China.","DOI":"10.1109\/ICIP.2017.8296748"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Schulter, S., Vernaza, P., Choi, W., and Chandraker, M. (2017, January 21\u201326). Deep network flow for multi-object tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.292"},{"key":"ref_32","unstructured":"Yang, B., Huang, C., Nevatia, R., and Chandraker, M. (2017, January 20\u201325). Learning affinities and dependencies for multi-target tracking using a CRF model. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Colorado Springs, CO, USA."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2054","DOI":"10.1109\/TPAMI.2015.2505309","article-title":"Multi-Target Tracking by Discrete-Continuous Energy Minimization","volume":"38","author":"Milan","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_34","first-page":"58","article-title":"Deep continuous conditional random fields with asymmetric inter-object constraints for online multi-object tracking","volume":"36","author":"Zhou","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Feng, H., Li, X., Liu, P., and Zhou, N. (2017, January 13\u201315). Using stacked auto-encoder to get feature with continuity and distinguishability in multi-object tracking. Proceedings of the International Conference on Image and Graphics, Shanghai, China.","DOI":"10.1007\/978-3-319-71607-7_31"},{"key":"ref_36","unstructured":"Xiang, J., Ma, C., Xu, G., and Hou, J. (2019). End-to-end learning deep CRF models for multi-object tracking. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Wang, B., Wang, L., Shuai, B., Zuo, Z., Liu, T., Chan, K.L., and Wang, G. (2016, January 26\u201330). Joint learning of convolutional neural networks and temporally constrained metrics for tracklet association. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Las Vegas, NV, USA.","DOI":"10.1109\/CVPRW.2016.55"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Liu, P., Li, X., Liu, H., and Fu, Z. (2019). Online Learned Siamese Network with Auto-Encoding Constraints for Robust Multi-Object Tracking. Electronics, 8.","DOI":"10.3390\/electronics8060595"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1109\/42.993135","article-title":"Volume image registration by cross-entropy optimization","volume":"21","author":"Zhu","year":"2002","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"4328","DOI":"10.1109\/TGRS.2013.2281391","article-title":"A Novel Coarse-to-Fine Scheme for Automatic Image Registration Based on SIFT and Mutual Information","volume":"52","author":"Gong","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_41","first-page":"1","article-title":"Evaluating multiple object tracking performance: The clear mot metrics","volume":"2008","author":"Stiefelhagen","year":"2008","journal-title":"EURASIP J. Image Video Process."},{"key":"ref_42","unstructured":"Milan, A., Leal-Taix\u00e9, L., Schindler, K., Cremers, D., Roth, S., and Reid, I. (2019, November 01). Multiple object tracking benchmark. Available online: https:\/\/motchallenge.net."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Ferryman, J., and Shahrokni, A. (2009, January 7\u20139). PETS-2009: Dataset and challenge. Proceedings of the IEEE Workshop on Performance Evaluation of Tracking and Surveillance, Snowbird, UT, USA.","DOI":"10.1109\/PETS-WINTER.2009.5399556"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/3\/628\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:44:28Z","timestamp":1760363068000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/3\/628"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,22]]},"references-count":43,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2020,2]]}},"alternative-id":["s20030628"],"URL":"https:\/\/doi.org\/10.3390\/s20030628","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,22]]}}}