{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:24:49Z","timestamp":1760149489902,"version":"build-2065373602"},"reference-count":30,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2023,8,10]],"date-time":"2023-08-10T00:00:00Z","timestamp":1691625600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100018557","name":"Science and Technology Project of Nantong City","doi-asserted-by":"publisher","award":["JC22022075"],"award-info":[{"award-number":["JC22022075"]}],"id":[{"id":"10.13039\/501100018557","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Vision plays a crucial role in the ability of compound-eyed insects to perceive the characteristics of their surroundings. Compound-eyed insects (such as the honeybee) can change the optical flow input of the visual system by autonomously controlling their behavior, and this is referred to as visual\u2013motor coordination (VMC). To analyze an insect\u2019s VMC mechanism in dynamic scenes, we developed a platform for studying insects that actively shape the optic flow of visual stimuli by adapting their flight behavior. Image-processing technology was applied to detect the posture and direction of insects\u2019 movement, and automatic control technology provided dynamic scene stimulation and automatic acquisition of perceptual insect behavior. In addition, a virtual mapping technique was used to reconstruct the visual cues of insects for VMC analysis in a dynamic obstacle scene. A simulation experiment at different target speeds of 1\u201312 m\/s was performed to verify the applicability and accuracy of the platform. Our findings showed that the maximum detection speed was 8 m\/s, and triggers were 95% accurate. The outdoor experiments showed that flight speed in the longitudinal axis of honeybees was more stable when facing dynamic barriers than static barriers after analyzing the change in geometric optic flow. Finally, several experiments showed that the platform can automatically and efficiently monitor honeybees\u2019 perception behavior, and can be applied to study most insects and their VMC.<\/jats:p>","DOI":"10.3390\/s23167073","type":"journal-article","created":{"date-parts":[[2023,8,10]],"date-time":"2023-08-10T10:52:40Z","timestamp":1691664760000},"page":"7073","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["FlyDetector\u2014Automated Monitoring Platform for the Visual\u2013Motor Coordination of Honeybees in a Dynamic Obstacle Scene Using Digital Paradigm"],"prefix":"10.3390","volume":"23","author":[{"given":"Yuanyuan","family":"Huang","sequence":"first","affiliation":[{"name":"School of Mechanical Engineering, Nantong University, Nantong 226019, China"}]},{"given":"Guyue","family":"Lu","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Nantong University, Nantong 226019, China"}]},{"given":"Wei","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Nantong University, Nantong 226019, China"}]},{"given":"Xinyao","family":"Zhang","sequence":"additional","affiliation":[{"name":"Shanghai Aerospace System Engineering Institute, Shanghai 201108, China"}]},{"given":"Jiawen","family":"Jiang","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Nantong University, Nantong 226019, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9129-1146","authenticated-orcid":false,"given":"Qiang","family":"Xing","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Nantong University, Nantong 226019, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,8,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"eaar7650","DOI":"10.1126\/scirobotics.aar7650","article-title":"The Grand Challenges of Science Robotics","volume":"3","author":"Yang","year":"2018","journal-title":"Sci. Robot."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1783","DOI":"10.1242\/jeb.066498","article-title":"The Visual Control of Landing and Obstacle Avoidance in the Fruit Fly Drosophila Melanogaster","volume":"215","author":"Dickinson","year":"2012","journal-title":"J. Exp. Biol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/s003590050015","article-title":"Prey Pursuit and Interception in Dragonflies","volume":"186","author":"Olberg","year":"2000","journal-title":"J. Comp. Physiol. A"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1111\/j.1365-3032.1991.tb00551.x","article-title":"Flying Mate Detection and Chasing by Tsetse Flies (Glossina)","volume":"16","author":"BRADY","year":"2008","journal-title":"Physiol. Entomol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.conb.2021.09.007","article-title":"Small Brains for Big Science","volume":"71","author":"Makarova","year":"2021","journal-title":"Curr. Opin. Neurobiol."},{"unstructured":"Floreano, D., Zufferey, J.-C., Srinivasan, M.V., and Ellington, C. (2009). Active Vision in Blowflies: Strategies and Mechanisms of Spatial Orientation, Springer.","key":"ref_6"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"R207","DOI":"10.1016\/j.cub.2020.12.027","article-title":"Animal cognition: The self-image of a bumblebee","volume":"31","author":"Brebner","year":"2021","journal-title":"Curr. Biol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"108","DOI":"10.3389\/fncir.2012.00108","article-title":"Spatial Vision in Insects Is Facilitated by Shaping the Dynamics of Visual Input through Behavioral Action. Front","volume":"6","author":"Egelhaaf","year":"2012","journal-title":"Front. Neural Circuits"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"eabl6334","DOI":"10.1126\/scirobotics.abl6334","article-title":"Insect-Inspired AI for Autonomous Robots","volume":"7","author":"Croon","year":"2022","journal-title":"Sci. Robot."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2073","DOI":"10.1109\/TVCG.2020.2973063","article-title":"Animals in virtual environments","volume":"26","author":"Naik","year":"2020","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1093\/aesa\/say041","article-title":"Assessing Insect Flight Behavior in the Laboratory: A Primer on Flight Mill Methodology and What Can Be Learned","volume":"112","author":"Naranjo","year":"2019","journal-title":"Ann. Entomol. Soc. Am."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"599374","DOI":"10.3389\/fnbeh.2020.599374","article-title":"The Antarium: A Reconstructed Visual Reality Device for Ant Navigation Research","volume":"14","author":"Murray","year":"2020","journal-title":"Front. Behav. Neurosci."},{"doi-asserted-by":"crossref","unstructured":"Lawson, K.K.K., and Srinivasan, M.V. (2018, January 12\u201315). A Robust Dual-Axis Virtual Reality Platform for Closed-Loop Analysis of Insect Flight. Proceedings of the 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO), Kuala Lumpur, Malaysia.","key":"ref_13","DOI":"10.1109\/ROBIO.2018.8664837"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1038\/365751a0","article-title":"Visual pattern recognition in Drosophila involves retinotopic matching","volume":"365","author":"Dill","year":"1993","journal-title":"Nature"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"jeb184135","DOI":"10.1242\/jeb.184135","article-title":"Gap Perception in Bumblebees","volume":"222","author":"Ravi","year":"2019","journal-title":"J. Exp. Biol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"jeb237867","DOI":"10.1242\/jeb.237867","article-title":"Visual and Movement Memories Steer Foraging Bumblebees along Habitual Routes","volume":"224","author":"Bertrand","year":"2021","journal-title":"J. Exp. Biol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"656","DOI":"10.1007\/s42235-022-00277-y","article-title":"Investigate the Wake Flow on Houseflies with Particle-Tracking-Velocimetry and Schlieren Photography","volume":"20","author":"Liu","year":"2023","journal-title":"J. Bionic Eng."},{"doi-asserted-by":"crossref","unstructured":"Sledevi\u0107, T., and Plonis, D. (2023, January 27\u201329). Toward Bee Behavioral Pattern Recognition on Hive Entrance using YOLOv8. Proceedings of the 2023 IEEE 10th Jubilee Workshop on Advances in Information, Electronic and Electrical Engineering (AIEEE), Vilnius, Lithuania.","key":"ref_18","DOI":"10.1109\/AIEEE58915.2023.10134563"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"20152988","DOI":"10.1098\/rspb.2015.2988","article-title":"Finding the Gap: A Brightness-Based Strategy for Guidance in Cluttered Environments","volume":"283","author":"Baird","year":"2016","journal-title":"Proc. R. Soc. B Biol. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"31494","DOI":"10.1073\/pnas.2016872117","article-title":"Bumblebees Perceive the Spatial Layout of Their Environment in Relation to Their Body Size and Form to Minimize Inflight Collisions","volume":"117","author":"Ravi","year":"2020","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"103469","DOI":"10.1016\/j.compind.2021.103469","article-title":"Digital Twin Paradigm: A Systematic Literature Review","volume":"130","author":"Semeraro","year":"2021","journal-title":"Comput. Ind."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1007\/s00359-008-0335-1","article-title":"Comparative psychophysics of bumblebee and honeybee colour discrimination and object detection","volume":"194","author":"Dyer","year":"2008","journal-title":"J. Comp. Physiol. A"},{"doi-asserted-by":"crossref","unstructured":"Brutzer, S., Hoferlin, B., and Heidemann, G. (2011, January 20\u201325). Evaluation of Background Subtraction Techniques for Video Surveillance. Proceedings of the CVPR 2011, Colorado Springs, CO, USA.","key":"ref_23","DOI":"10.1109\/CVPR.2011.5995508"},{"doi-asserted-by":"crossref","unstructured":"Ribak, G., Barkan, S., and Soroker, V. (2017). The Aerodynamics of Flight in an Insect Flight-Mill. PLoS ONE, 12.","key":"ref_24","DOI":"10.1371\/journal.pone.0186441"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3895","DOI":"10.1242\/jeb.01818","article-title":"Visual Control of Flight Speed in Honeybees","volume":"208","author":"Baird","year":"2005","journal-title":"J. Exp. Biol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2728","DOI":"10.1242\/jeb.121293","article-title":"Bumblebee Flight Performance in Cluttered Environments: Effects of Obstacle Orientation, Body Size and Acceleration","volume":"218","author":"Crall","year":"2015","journal-title":"J. Exp. Biol."},{"doi-asserted-by":"crossref","unstructured":"Le Mo\u00ebl, F., and Wystrach, A. (2020). Opponent Processes in Visual Memories: A Model of Attraction and Repulsion in Navigating Insects\u2019 Mushroom Bodies. PLoS Comput. Biol., 16.","key":"ref_27","DOI":"10.1371\/journal.pcbi.1007631"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1146\/annurev-neuro-061010-113632","article-title":"Collision Detection as a Model for Sensory-Motor Integration","volume":"34","author":"Fotowat","year":"2011","journal-title":"Annu. Rev. Neurosci."},{"doi-asserted-by":"crossref","unstructured":"Ong, M., Bulmer, M., Groening, J., and Srinivasan, M. (2017). Obstacle Traversal and Route Choice in Flying Honeybees: Evidence for Individual Handedness. PLoS ONE, 12.","key":"ref_29","DOI":"10.1371\/journal.pone.0184343"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"7707","DOI":"10.1038\/s41598-019-44187-2","article-title":"The Role of Optic Flow Pooling in Insect Flight Control in Cluttered Environments","volume":"9","author":"Lecoeur","year":"2019","journal-title":"Sci. Rep."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/16\/7073\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:30:17Z","timestamp":1760128217000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/16\/7073"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,10]]},"references-count":30,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2023,8]]}},"alternative-id":["s23167073"],"URL":"https:\/\/doi.org\/10.3390\/s23167073","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2023,8,10]]}}}