{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T21:32:40Z","timestamp":1769549560488,"version":"3.49.0"},"reference-count":27,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2023,10,17]],"date-time":"2023-10-17T00:00:00Z","timestamp":1697500800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Science and Technology Council (NSTC)","award":["112-2221-E-033-023"],"award-info":[{"award-number":["112-2221-E-033-023"]}]},{"name":"National Science and Technology Council (NSTC)","award":["110-2622-8-A49-022"],"award-info":[{"award-number":["110-2622-8-A49-022"]}]},{"name":"National Science and Technology Council (NSTC)","award":["NSTC112-2221-E-A49-049"],"award-info":[{"award-number":["NSTC112-2221-E-A49-049"]}]},{"name":"NCKU Miin Wu School of Computing, Research Center for Information Technology Innovation","award":["112-2221-E-033-023"],"award-info":[{"award-number":["112-2221-E-033-023"]}]},{"name":"NCKU Miin Wu School of Computing, Research Center for Information Technology Innovation","award":["110-2622-8-A49-022"],"award-info":[{"award-number":["110-2622-8-A49-022"]}]},{"name":"NCKU Miin Wu School of Computing, Research Center for Information Technology Innovation","award":["NSTC112-2221-E-A49-049"],"award-info":[{"award-number":["NSTC112-2221-E-A49-049"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Deep learning models are often trained with a large amount of labeled data to improve the accuracy for moving object detection in new fields. However, the model may not be robust enough due to insufficient training data in the new field, resulting in some moving objects not being successfully detected. Training with data that is not successfully detected by the pre-trained deep learning model can effectively improve the accuracy for the new field, but it is costly to retrieve the image data containing the moving objects from millions of images per day to train the model. Therefore, we propose FenceTalk, a moving object detection system, which compares the difference between the current frame and the background image based on the structural similarity index measure (SSIM). FenceTalk automatically selects suspicious images with moving objects that are not successfully detected by the Yolo model, so that the training data can be selected at a lower labor cost. FenceTalk can effectively define and update the background image in the field, reducing the misjudgment caused by changes in light and shadow, and selecting images containing moving objects with an optimal threshold. Our study has demonstrated its performance and generality using real data from different fields. For example, compared with the pre-trained Yolo model using the MS COCO dataset, the overall recall of FenceTalk increased from 72.36% to 98.39% for the model trained with the data picked out by SSIM. The recall of FenceTalk, combined with Yolo and SSIM, can reach more than 99%.<\/jats:p>","DOI":"10.3390\/a16100481","type":"journal-article","created":{"date-parts":[[2023,10,17]],"date-time":"2023-10-17T08:10:19Z","timestamp":1697530219000},"page":"481","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["FenceTalk: Exploring False Negatives in Moving Object Detection"],"prefix":"10.3390","volume":"16","author":[{"given":"Yun-Wei","family":"Lin","sequence":"first","affiliation":[{"name":"The College of Artificial Intelligence, National Yang Ming Chiao Tung University, Tainan 711, Taiwan"}]},{"given":"Yuh-Hwan","family":"Liu","sequence":"additional","affiliation":[{"name":"Faculty of Technology Management, China Medical University, Taichung 404, Taiwan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6841-4718","authenticated-orcid":false,"given":"Yi-Bing","family":"Lin","sequence":"additional","affiliation":[{"name":"College of Computer Science, National Yang Ming Chiao Tung University, Hsinchu 300, Taiwan"},{"name":"College of Biomedical Engineering, China Medical University, Taichung 404, Taiwan"},{"name":"Miin Wu School of Computing, National Cheng Kung University, Tainan 701, Taiwan"},{"name":"Research Center for Information Technology Innovation, Academia Sinica, Taipei 115, Taiwan"}]},{"given":"Jian-Chang","family":"Hong","sequence":"additional","affiliation":[{"name":"The College of Artificial Intelligence, National Yang Ming Chiao Tung University, Tainan 711, Taiwan"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,17]]},"reference":[{"key":"ref_1","first-page":"50","article-title":"The Various Types of sensors used in the Security Alarm system","volume":"10","author":"Ahmad","year":"2020","journal-title":"Int. J. New Comput. Archit. Their Appl."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Chauhan, R., Ghanshala, K.K., and Joshi, R.C. (2018, January 15\u201317). Convolutional Neural Network (CNN) for Image Detection and Recognition. Proceedings of the 2018 First International Conference on Secure Cyber Computing and Communication (ICSCCC), Jalandhar, India.","DOI":"10.1109\/ICSCCC.2018.8703316"},{"key":"ref_3","first-page":"67","article-title":"Convolutional neural network for person and car detection using yolo framework","volume":"10","author":"Putra","year":"2018","journal-title":"J. Telecommun. Electron. Comput. Eng. (JTEC)"},{"key":"ref_4","unstructured":"Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Raju, K.N., and Reddy, K.S.P. (2017, January 6\u20137). Comparative study of Structural Similarity Index (SSIM) by using different edge detection approaches on live video frames for different color models. Proceedings of the 2017 International Conference on Intelligent Computing, Instrumentation and Control Technologies (ICICICT), Kannur, India.","DOI":"10.1109\/ICICICT1.2017.8342690"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1109\/TPAMI.2022.3152247","article-title":"A Survey on Vision Transformer","volume":"45","author":"Han","year":"2023","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Lin, Y.-B., Chen, W.-E., and Chang, T.C.-Y. (2023). Moving from Cloud to Fog\/Edge: The Smart Agriculture Experience. IEEE Commun. Mag. (Early Access), 1\u20137.","DOI":"10.1109\/MCOM.001.2200633"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Priyadharshini, G., and Dolly, D.R.J. (2023, January 17\u201318). Comparative Investigations on Tomato Leaf Disease Detection and Classification Using CNN, R-CNN, Fast R-CNN and Faster R-CNN. Proceedings of the International Conference on Advanced Computing and Communication Systems (ICACCS), Coimbatore, India.","DOI":"10.1109\/ICACCS57279.2023.10112860"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Juyal, P., and Kundaliya, A. (2023, January 14\u201316). Multilabel Image Classification using the CNN and DC-CNN Model on Pascal VOC 2012 Dataset. Proceedings of the International Conference on Sustainable Computing and Smart Systems (ICSCSS), Coimbatore, India.","DOI":"10.1109\/ICSCSS57650.2023.10169541"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Hmidani, O., and Alaoui, E.M.I. (2022, January 12\u201314). A Comprehensive Survey of the R-CNN Family for Object Detection. Proceedings of the International Conference on Advanced Communication Technologies and Networking (CommNet), Marrakech, Morocco.","DOI":"10.1109\/CommNet56067.2022.9993862"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Lin, Y.-B., Liu, C.-Y., Chen, W.-L., Chang, C.-H., Ng, F.-L., Yang, K., and Hsung, J. (2023). IoT-based Strawberry Disease Detection with Wall-mounted Monitoring Cameras. IEEE Internet Things J., 1.","DOI":"10.1109\/JIOT.2023.3288603"},{"key":"ref_12","unstructured":"Wang, C.-Y., Bochkovskiy, A., and Liao, H.Y.M. (25, January 20\u201325). Scaled-yolov4: Scaling cross stage partial network. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014, January 6\u201312). Microsoft coco: Common objects in context. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_14","unstructured":"Li, C., Li, L., Jiang, H., Weng, K., Geng, Y., Li, L., Ke, Z., Li, Q., Cheng, M., and Nie, W. (2022). YOLOv6: A Single-Stage Object Detection Framework for Industrial Applications. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"012131","DOI":"10.1088\/1742-6596\/1871\/1\/012131","article-title":"Pedestrian detection based on one-stage YOLO algorithm","volume":"1871","author":"Zuo","year":"2021","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Korhonen, J., and You, J. (2012, January 5\u20137). Peak signal-to-noise ratio revisited: Is simple beautiful?. Proceedings of the 2012 Fourth International Workshop on Quality of Multimedia Experience, Melbourne, VIC, Australia.","DOI":"10.1109\/QoMEX.2012.6263880"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1109\/MSP.2008.930649","article-title":"Mean squared error: Love it or leave it? A new look at signal fidelity measures","volume":"26","author":"Wang","year":"2009","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wibowo, H.T., Wibowo, E.P., and Harahap, R.K. (2021, January 3\u20134). Implementation of Background Subtraction for Counting Vehicle Using Mixture of Gaussians with ROI Optimization. Proceedings of the 2021 Sixth International Conference on Informatics and Computing (ICIC), Jakarta, Indonesia.","DOI":"10.1109\/ICIC54025.2021.9632950"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Rukundo, O., Wu, K., and Cao, H. (2011, January 19\u201321). Image interpolation based on the pixel value corresponding to the smallest absolute difference. Proceedings of the Fourth International Workshop on Advanced Computational Intelligence, Wuhan, China.","DOI":"10.1109\/IWACI.2011.6160045"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Hore, A., and Ziou, D. (2010, January 23\u201326). Image quality metrics: PSNR vs. SSIM. Proceedings of the 2010 20th International Conference on Pattern Recognition, Istanbul, Turkey.","DOI":"10.1109\/ICPR.2010.579"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Loza, A., Wang, F., Yang, J., and Mihaylova, L. (2011, January 22\u201327). Video object tracking with differential Structural SIMilarity index. Proceedings of the 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Prague, Czech Republic.","DOI":"10.1109\/ICASSP.2011.5946676"},{"key":"ref_23","unstructured":"Chen, G., Shen, Y., Yao, F., Liu, P., and Liu, Y. (2015, January 19\u201320). Region-based moving object detection using SSIM. Proceedings of the 2015 4th International Conference on Computer Science and Network Technology (ICCSNT), Harbin, China."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhou, M., Wang, G., Wang, J., Hui, C., and Yang, W. (2017, January 13\u201316). Defect detection of printing images on cans based on SSIM and chromatism. Proceedings of the 2017 3rd IEEE International Conference on Computer and Communications (ICCC), Chengdu, China.","DOI":"10.1109\/CompComm.2017.8322912"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1527","DOI":"10.1016\/j.asej.2016.10.001","article-title":"Event triggered intelligent video recording system using MS-SSIM for smart home security","volume":"9","author":"Khalaf","year":"2018","journal-title":"AIN Shams Eng. J."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Xia, B., Cao, J., and Wang, C. (2019, January 22\u201324). SSIM-NET: Real-time PCB defect detection based on SSIM and MobileNet-V3. Proceedings of the 2019 2nd World Conference on Mechanical Engineering and Intelligent Manufacturing (WCMEIM), Shanghai, China.","DOI":"10.1109\/WCMEIM48965.2019.00159"},{"key":"ref_27","unstructured":"(2023, October 07). Xiao-Dragon, yolov7-GradCAM. Available online: https:\/\/gitee.com\/xiao-dragon\/yolov7-GradCAM."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/16\/10\/481\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:08:19Z","timestamp":1760130499000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/16\/10\/481"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,17]]},"references-count":27,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["a16100481"],"URL":"https:\/\/doi.org\/10.3390\/a16100481","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,17]]}}}