{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,14]],"date-time":"2026-03-14T22:38:59Z","timestamp":1773527939440,"version":"3.50.1"},"reference-count":38,"publisher":"Institute of Electronics, Information and Communications Engineers (IEICE)","issue":"9","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IEICE Trans. Inf. & Syst."],"published-print":{"date-parts":[[2024,9,1]]},"DOI":"10.1587\/transinf.2023edp7106","type":"journal-article","created":{"date-parts":[[2024,8,31]],"date-time":"2024-08-31T22:19:18Z","timestamp":1725142758000},"page":"1192-1205","source":"Crossref","is-referenced-by-count":4,"title":["A mmWave Sensor and Camera Fusion System for Indoor Occupancy Detection and Tracking"],"prefix":"10.1587","volume":"E107.D","author":[{"given":"Shenglei","family":"LI","sequence":"first","affiliation":[{"name":"Graduate School of Creative Science and Engineering, Waseda University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haoran","family":"LUO","sequence":"additional","affiliation":[{"name":"Graduate School of Creative Science and Engineering, Waseda University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tengfei","family":"SHAO","sequence":"additional","affiliation":[{"name":"Graduate School of Creative Science and Engineering, Waseda University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Reiko","family":"HISHIYAMA","sequence":"additional","affiliation":[{"name":"Graduate School of Creative Science and Engineering, Waseda University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"532","reference":[{"key":"1","doi-asserted-by":"publisher","unstructured":"[1] M.A. Ram\u00edrez-Moreno, S. Keshtkar, D.A. Padilla-Reyes, E. Ramos-L\u00f3pez, M. Garc\u00eda-Mart\u00ednez, M.C. Hern\u00e1ndez-Luna, A.E. Mogro, J. Mahlknecht, J.I. Huertas, R.E. Peimbert-Garc\u00eda, R.A. Ram\u00edrez-Mendoza, A.M. Mangini, M. Roccotelli, B.L. P\u00e9rez-Henr\u00edquez, S.C. Mukhopadhyay, and J.J. Lozoya-Santos, \u201cSensors for sustainable smart cities: A review,\u201d Applied Sciences, vol.11, no.17, p.8198, 2021. 10.3390\/app11178198","DOI":"10.3390\/app11178198"},{"key":"2","doi-asserted-by":"crossref","unstructured":"[2] P. Zhao, C.X. Lu, J. Wang, C. Chen, W. Wang, N. Trigoni, and A. Markham, \u201cmid: Tracking and identifying people with millimeter wave radar,\u201d 2019 15th International Conference on Distributed Computing in Sensor Systems (DCOSS), pp.33-40, IEEE, 2019. 10.1109\/dcoss.2019.00028","DOI":"10.1109\/DCOSS.2019.00028"},{"key":"3","unstructured":"[3] S. Li and R. Hishiyama, \u201cA field people counting test using millimeter wave radar in the restaurant,\u201d 2021 20th forum on information technology (FIT), pp.53-56, 2021."},{"key":"4","doi-asserted-by":"crossref","unstructured":"[4] M. Kastek, H. Madura, and T. Sosnowski, \u201cPassive infrared detector for security systems design, algorithm of people detection and field tests result,\u201d International Journal of Safety and Security Engineering, vol.3, no.1, pp.10-23, 2013.","DOI":"10.2495\/SAFE-V3-N1-10-23"},{"key":"5","unstructured":"[5] J. Redmon and A. Farhadi, \u201cYolov3: An incremental improvement,\u201d arXiv preprint arXiv:1804.02767, 2018."},{"key":"6","doi-asserted-by":"crossref","unstructured":"[6] M. Simon, S. Milz, K. Amende, and H.M. Gross, \u201cComplex-yolo: Real-time 3d object detection on point clouds,\u201d arXiv preprint arXiv:1803.06199, 2018.","DOI":"10.1109\/CVPRW.2019.00158"},{"key":"7","doi-asserted-by":"crossref","unstructured":"[7] R. Girshick, \u201cFast r-cnn,\u201d Proceedings of the IEEE international conference on computer vision, pp.1440-1448, 2015. 10.1109\/iccv.2015.169","DOI":"10.1109\/ICCV.2015.169"},{"key":"8","doi-asserted-by":"publisher","unstructured":"[8] A.M. Ashleibta, A. Taha, M.A. Khan, W. Taylor, A. Tahir, A. Zoha, Q.H. Abbasi, and M.A. Imran, \u201c5g-enabled contactless multi-user presence and activity detection for independent assisted living,\u201d Scientific Reports, vol.11, no.1, p.17590, 2021. 10.1038\/s41598-021-96689-7","DOI":"10.1038\/s41598-021-96689-7"},{"key":"9","doi-asserted-by":"crossref","unstructured":"[9] A. Banerjee, K. Vaesen, A. Visweswaran, K. Khalaf, Q. Shi, S. Brebels, D. Guermandi, C.-H. Tsai, J. Nguyen, A. Medra, Y. Liu, G. Mangraviti, O. Furxhi, B. Gyselinckx, A. Bourdoux, J. Craninckx, and P. Wambacq, \u201cMillimeter-wave transceivers for wireless communication, radar, and sensing,\u201d 2019 IEEE Custom Integrated Circuits Conference (CICC), pp.1-11, IEEE, 2019. 10.1109\/cicc.2019.8780147","DOI":"10.1109\/CICC.2019.8780147"},{"key":"10","doi-asserted-by":"crossref","unstructured":"[10] D.D. Ferris Jr and N.C. Currie, \u201cMicrowave and millimeter-wave systems for wall penetration,\u201d Targets and Backgrounds: Characterization and Representation IV, pp.269-279, SPIE, 1998. 10.1117\/12.327159","DOI":"10.1117\/12.327159"},{"key":"11","unstructured":"[11] \u201cPeople counting demonstration using ti mmwave sensors.\u201d Online, 2017. Accessed: Aug. 1. 2022."},{"key":"12","doi-asserted-by":"crossref","unstructured":"[12] T. Wei and X. Zhang, \u201cMtrack: High-precision passive tracking using millimeter wave radios,\u201d Proceedings of the 21st Annual International Conference on Mobile Computing and Networking, MobiCom '15, New York, NY, USA, p.117-129, Association for Computing Machinery, 2015. 10.1145\/2789168.2790113","DOI":"10.1145\/2789168.2790113"},{"key":"13","doi-asserted-by":"publisher","unstructured":"[13] X. Huang, H. Cheena, A. Thomas, and J.K. Tsoi, \u201cIndoor detection and tracking of people using mmwave sensor,\u201d Journal of Sensors, vol.2021, 2021. 10.1155\/2021\/6657709","DOI":"10.1155\/2021\/6657709"},{"key":"14","doi-asserted-by":"publisher","unstructured":"[14] S. Li and R. Hishiyama, \u201cCounting and tracking people to avoid from crowded in a restaurant using mmwave radar,\u201d IEICE Transactions on Information and Systems, vol.106, no.6, pp.1142-1154, 2023. 10.1587\/transinf.2022edp7145","DOI":"10.1587\/transinf.2022EDP7145"},{"key":"15","doi-asserted-by":"crossref","unstructured":"[15] H. Cho, Y.-W. Seo, B.V.K.V. Kumar, and R.R. Rajkumar, \u201cA multi-sensor fusion system for moving object detection and tracking in urban driving environments,\u201d 2014 IEEE International Conference on Robotics and Automation (ICRA), pp.1836-1843, IEEE, 2014. 10.1109\/icra.2014.6907100","DOI":"10.1109\/ICRA.2014.6907100"},{"key":"16","doi-asserted-by":"publisher","unstructured":"[16] C. Yi, K. Zhang, and N. Peng, \u201cA multi-sensor fusion and object tracking algorithm for self-driving vehicles,\u201d Proceedings of the Institution of Mechanical Engineers, Part D: Journal of automobile engineering, vol.233, no.9, pp.2293-2300, 2019. 10.1177\/0954407019867492","DOI":"10.1177\/0954407019867492"},{"key":"17","doi-asserted-by":"publisher","unstructured":"[17] A. Motwani, S. Sharma, R. Sutton, and P. Culverhouse, \u201cInterval kalman filtering in navigation system design for an uninhabited surface vehicle,\u201d The Journal of Navigation, vol.66, no.5, pp.639-652, 2013. 10.1017\/s0373463313000283","DOI":"10.1017\/S0373463313000283"},{"key":"18","doi-asserted-by":"publisher","unstructured":"[18] J. Zhang, G. Welch, G. Bishop, and Z. Huang, \u201cA two-stage kalman filter approach for robust and real-time power system state estimation,\u201d IEEE Transactions on Sustainable Energy, vol.5, no.2, pp.629-636, 2013. 10.1109\/tste.2013.2280246","DOI":"10.1109\/TSTE.2013.2280246"},{"key":"19","doi-asserted-by":"publisher","unstructured":"[19] J. Wu, K. Hu, Y. Cheng, H. Zhu, X. Shao, and Y. Wang, \u201cData-driven remaining useful life prediction via multiple sensor signals and deep long short-term memory neural network,\u201d ISA transactions, vol.97, pp.241-250, 2020. 10.1016\/j.isatra.2019.07.004","DOI":"10.1016\/j.isatra.2019.07.004"},{"key":"20","doi-asserted-by":"publisher","unstructured":"[20] V. Lekic and Z. Babic, \u201cAutomotive radar and camera fusion using generative adversarial networks,\u201d Computer Vision and Image Understanding, vol.184, pp.1-8, 2019. 10.1016\/j.cviu.2019.04.002","DOI":"10.1016\/j.cviu.2019.04.002"},{"key":"21","doi-asserted-by":"crossref","unstructured":"[21] J. Kim, Y. Kim, and D. Kum, \u201cLow-level sensor fusion network for 3d vehicle detection using radar range-azimuth heatmap and monocular image,\u201d Proceedings of the Asian Conference on Computer Vision, pp.388-402, 2020. 10.1007\/978-3-030-69535-4_24","DOI":"10.1007\/978-3-030-69535-4_24"},{"key":"22","doi-asserted-by":"crossref","unstructured":"[22] X. Shuai, Y. Shen, Y. Tang, S. Shi, L. Ji, and G. Xing, \u201cmillieye: A lightweight mmwave radar and camera fusion system for robust object detection,\u201d Proceedings of the International Conference on Internet-of-Things Design and Implementation, pp.145-157, 2021. 10.1145\/3450268.3453532","DOI":"10.1145\/3450268.3453532"},{"key":"23","doi-asserted-by":"publisher","unstructured":"[23] D. Liu, X. Guan, Y. Du, and Q. Zhao, \u201cMeasuring indoor occupancy in intelligent buildings using the fusion of vision sensors,\u201d Measurement Science and Technology, vol.24, no.7, p.074023, 2013. 10.1088\/0957-0233\/24\/7\/074023","DOI":"10.1088\/0957-0233\/24\/7\/074023"},{"key":"24","doi-asserted-by":"crossref","unstructured":"[24] M. Bijelic, T. Gruber, F. Mannan, F. Kraus, W. Ritter, K. Dietmayer, and F. Heide, \u201cSeeing through fog without seeing fog: Deep multimodal sensor fusion in unseen adverse weather,\u201d Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp.11682-11692, 2020. 10.1109\/cvpr42600.2020.01170","DOI":"10.1109\/CVPR42600.2020.01170"},{"key":"25","doi-asserted-by":"crossref","unstructured":"[25] S. Chadwick, W. Maddern, and P. Newman, \u201cDistant vehicle detection using radar and vision,\u201d 2019 International Conference on Robotics and Automation (ICRA), pp.8311-8317, IEEE, 2019. 10.1109\/icra.2019.8794312","DOI":"10.1109\/ICRA.2019.8794312"},{"key":"26","doi-asserted-by":"crossref","unstructured":"[26] R. Nabati and H. Qi, \u201cRrpn: Radar region proposal network for object detection in autonomous vehicles,\u201d 2019 IEEE International Conference on Image Processing (ICIP), pp.3093-3097, IEEE, 2019. 10.1109\/icip.2019.8803392","DOI":"10.1109\/ICIP.2019.8803392"},{"key":"27","doi-asserted-by":"crossref","unstructured":"[27] R. Beringer, A. Sixsmith, M. Campo, J. Brown, and R. McCloskey, \u201cThe \u201cacceptance\u201d of ambient assisted living: Developing an alternate methodology to this limited research lens,\u201d International Conference on Smart Homes and Health Telematics, pp.161-167, Springer, 2011. 10.1007\/978-3-642-21535-3_21","DOI":"10.1007\/978-3-642-21535-3_21"},{"key":"28","doi-asserted-by":"publisher","unstructured":"[28] S. Li and R. Hishiyama, \u201cAn indoor people counting and tracking system using mmwave sensor and sub-sensors,\u201d IFAC-PapersOnLine, vol.56, no.2, pp.7096-7101, 2023. 10.1016\/j.ifacol.2023.10.577","DOI":"10.1016\/j.ifacol.2023.10.577"},{"key":"29","unstructured":"[29] C. Iovescu and S. Rao, \u201cThe fundamentals of millimeter wave sensors,\u201d Texas Instruments, pp.1-8, 2017."},{"key":"30","doi-asserted-by":"crossref","unstructured":"[30] W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C.Y. Fu, and A.C. Berg, \u201cSsd: Single shot multibox detector,\u201d Computer Vision-ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, Oct. 11-14, 2016, Proceedings, Part I 14, pp.21-37, Springer, 2016. 10.1007\/978-3-319-46448-0_2","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"31","unstructured":"[31] S. Ren, K. He, R. Girshick, and J. Sun, \u201cFaster r-cnn: Towards real-time object detection with region proposal networks,\u201d Advances in neural information processing systems, vol.28, 2015."},{"key":"32","unstructured":"[32] J. Dai, Y. Li, K. He, and J. Sun, \u201cR-fcn: Object detection via region-based fully convolutional networks,\u201d Advances in neural information processing systems, vol.29, 2016."},{"key":"33","doi-asserted-by":"publisher","unstructured":"[33] Z. Yi, S. Yongliang, and Z. Jun, \u201cAn improved tiny-yolov3 pedestrian detection algorithm,\u201d Optik, vol.183, pp.17-23, 2019. 10.1016\/j.ijleo.2019.02.038","DOI":"10.1016\/j.ijleo.2019.02.038"},{"key":"34","unstructured":"[34] J. MacQueen, \u201cClassification and analysis of multivariate observations,\u201d 5th Berkeley Symp. Math. Statist. Probability, pp.281-297, 1967."},{"key":"35","doi-asserted-by":"publisher","unstructured":"[35] R.E. Kalman, \u201cA New Approach to Linear Filtering and Prediction Problems,\u201d Journal of Basic Engineering, vol.82, no.1, pp.35-45, 1960. 10.1115\/1.3662552","DOI":"10.1115\/1.3662552"},{"key":"36","doi-asserted-by":"crossref","unstructured":"[36] H.W. Kuhn, \u201cThe hungarian method for the assignment problem,\u201d Naval research logistics quarterly, vol.2, no.1-2, pp.83-97, 1955. 10.1002\/nav.3800020109","DOI":"10.1002\/nav.3800020109"},{"key":"37","doi-asserted-by":"crossref","unstructured":"[37] T.Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Doll\u00e1r, and C.L. Zitnick, \u201cMicrosoft coco: Common objects in context,\u201d Computer Vision-ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part V 13, pp.740-755, Springer, 2014. 10.1007\/978-3-319-10602-1_48","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"38","doi-asserted-by":"publisher","unstructured":"[38] Y.P. Loh and C.S. Chan, \u201cGetting to know low-light images with the exclusively dark dataset,\u201d Computer Vision and Image Understanding, vol.178, pp.30-42, 2019. 10.1016\/j.cviu.2018.10.010","DOI":"10.1016\/j.cviu.2018.10.010"}],"container-title":["IEICE Transactions on Information and Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transinf\/E107.D\/9\/E107.D_2023EDP7106\/_pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,7]],"date-time":"2024-09-07T04:17:00Z","timestamp":1725682620000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transinf\/E107.D\/9\/E107.D_2023EDP7106\/_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,1]]},"references-count":38,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2024]]}},"URL":"https:\/\/doi.org\/10.1587\/transinf.2023edp7106","relation":{},"ISSN":["0916-8532","1745-1361"],"issn-type":[{"value":"0916-8532","type":"print"},{"value":"1745-1361","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,1]]},"article-number":"2023EDP7106"}}