{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,26]],"date-time":"2026-03-26T18:47:03Z","timestamp":1774550823191,"version":"3.50.1"},"reference-count":48,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,1,4]],"date-time":"2024-01-04T00:00:00Z","timestamp":1704326400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neurorobot."],"abstract":"<jats:p>The development of education robots has brought tremendous potential and opportunities to the field of education. These intelligent machines can interact with students in classrooms and learning environments, providing personalized educational support. To enable education robots to fulfill their roles, they require accurate object detection capabilities to perceive and understand the surrounding environment of students, identify targets, and interact with them. Object detection in complex environments remains challenging, as classrooms or learning scenarios involve various objects, backgrounds, and lighting conditions. Improving the accuracy and efficiency of object detection is crucial for the development of education robots. This paper introduces the progress of an education robot's object detection based on a brain-inspired heuristic method, which integrates Faster R-CNN, YOLOv3, and semi-supervised learning. By combining the strengths of these three techniques, we can improve the accuracy and efficiency of object detection in education robot systems. In this work, we integrate two popular object detection algorithms: Faster R-CNN and YOLOv3. We conduct a series of experiments on the task of education robot object detection. The experimental results demonstrate that our proposed optimization algorithm significantly outperforms individual algorithms in terms of accuracy and real-time performance. Moreover, through semi-supervised learning, we achieve better performance with fewer labeled samples. This will provide education robots with more accurate perception capabilities, enabling better interaction with students and delivering personalized educational experiences. It will drive the development of the field of education robots, offering innovative and personalized solutions for education.<\/jats:p>","DOI":"10.3389\/fnbot.2023.1338104","type":"journal-article","created":{"date-parts":[[2024,1,4]],"date-time":"2024-01-04T05:12:20Z","timestamp":1704345140000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Education robot object detection with a brain-inspired approach integrating Faster R-CNN, YOLOv3, and semi-supervised learning"],"prefix":"10.3389","volume":"17","author":[{"given":"Qing","family":"Hong","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hao","family":"Dong","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei","family":"Deng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yihan","family":"Ping","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2024,1,4]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"2265","DOI":"10.1007\/s11063-020-10197-9","article-title":"An evaluation of retinanet on indoor object detection for blind and visually impaired persons assistance navigation","volume":"51","author":"Afif","year":"2020","journal-title":"Neural Process. Lett"},{"key":"B2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/ICSTSN53084.2022.9761354","article-title":"\u201cEducational robotics and computer programming in early childhood education: a conceptual framework for assessing elementary school students' computational thinking for designing powerful educational scenarios,\u201d","volume-title":"2022 International Conference on Smart Technologies and Systems for Next Generation Computing (ICSTSN)","author":"Alam","year":"2022"},{"key":"B3","doi-asserted-by":"publisher","first-page":"101182","DOI":"10.1016\/j.ecoinf.2020.101182","article-title":"Plant leaf disease classification using efficientnet deep learning model","volume":"61","author":"Atila","year":"2021","journal-title":"Ecol. Inform"},{"key":"B4","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1007\/978-981-13-9042-5_56","article-title":"\u201cDeep learning techniques-R-CNN to mask R-CNN: a survey,\u201d","volume-title":"Computational Intelligence in Pattern Recognition: Proceedings of CIPR 2019","author":"Bharati","year":"2020"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1904.08138","article-title":"Complementary fusion of multi-features and multi-modalities in sentiment analysis","author":"Chen","year":"2019","journal-title":"arXiv"},{"key":"B6","doi-asserted-by":"publisher","first-page":"308","DOI":"10.1007\/978-3-030-31654-9_27","article-title":"\u201cSemi-supervised deep neural networks for object detection in video surveillance systems,\u201d","author":"Chen","year":"2019","journal-title":"Pattern Recognition and Computer Vision: Second Chinese Conference, PRCV 2019"},{"key":"B7","doi-asserted-by":"crossref","first-page":"7283","DOI":"10.1109\/ICRA.2019.8793744","article-title":"\u201cSegmenting unknown 3D objects from real depth images using mask r-cnn trained on synthetic data,\u201d","volume-title":"2019 International Conference on Robotics and Automation (ICRA)","author":"Danielczuk","year":"2019"},{"key":"B8","doi-asserted-by":"publisher","first-page":"5974","DOI":"10.1109\/LRA.2023.3301306","article-title":"Class incremental robotic pick-and-place via incremental few-shot object detection","volume":"8","author":"Deng","year":"2023","journal-title":"IEEE Robot. Autom. Lett"},{"key":"B9","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1007\/s11554-023-01263-1","article-title":"Object detection method based on lightweight yolov4 and attention mechanism in security scenes","volume":"20","author":"Ding","year":"2023","journal-title":"J. Real-Time Image Process"},{"key":"B10","doi-asserted-by":"publisher","first-page":"190","DOI":"10.1016\/j.jcat.2023.01.013","article-title":"Adsorption, surface reactions and hydrodeoxygenation of acetic acid on platinum and nickel catalysts","volume":"418","author":"Ezeonu","year":"2023","journal-title":"J. Catal"},{"key":"B11","doi-asserted-by":"publisher","first-page":"2518","DOI":"10.1007\/s10489-020-01918-7","article-title":"Efficientpose: scalable single-person pose estimation","volume":"51","author":"Groos","year":"2021","journal-title":"Appl. Intell"},{"key":"B12","doi-asserted-by":"publisher","first-page":"43119","DOI":"10.26717\/BJSTR.2023.51.008166","article-title":"Fabrication and control of porous structures via layer-by-layer assembly on PAH\/PAA polyelectrolyte coatings","volume":"51","author":"He","year":"2023","journal-title":"Biomed. J. Sci. Tech. Res"},{"key":"B13","first-page":"1","article-title":"\u201cDetection of COVID 19 from CT image by the novel lenet-5 cnn architecture,\u201d","volume-title":"2020 23rd International Conference on Computer and Information Technology (ICCIT)","author":"Islam","year":"2020"},{"key":"B14","doi-asserted-by":"publisher","first-page":"1936","DOI":"10.1007\/s10618-020-00710-y","article-title":"Inceptiontime: finding alexnet for time series classification","volume":"34","author":"Ismail Fawaz","year":"2020","journal-title":"Data Min. Knowl. Discov"},{"key":"B15","doi-asserted-by":"publisher","first-page":"1066","DOI":"10.1016\/j.procs.2022.01.135","article-title":"A review of yolo algorithm developments","volume":"199","author":"Jiang","year":"2022","journal-title":"Procedia Comput. Sci"},{"key":"B16","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1016\/j.isprsjprs.2020.12.010","article-title":"Review on convolutional neural networks (CNN) in vegetation remote sensing","volume":"173","author":"Kattenborn","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens"},{"key":"B17","first-page":"665","article-title":"\u201cCross-modal weighting network for RGB-D salient object detection,\u201d","volume-title":"European Conference on Computer Vision","author":"Li","year":"2020"},{"key":"B18","doi-asserted-by":"publisher","first-page":"334","DOI":"10.1109\/TPAMI.2019.2922396","article-title":"Towards safe weakly supervised learning","volume":"43","author":"Li","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell"},{"key":"B19","first-page":"289","article-title":"Who is watching your financials? A brief overview of audit engagement partners for oil and gas companies","volume":"71","author":"Liu","year":"2022","journal-title":"Oil Gas Energy Q"},{"key":"B20","doi-asserted-by":"publisher","first-page":"106217","DOI":"10.1016\/j.engappai.2023.106217","article-title":"Lightweight object detection algorithm for robots with improved YOLOv5","volume":"123","author":"Liu","year":"2023","journal-title":"Eng. Appl. Artif. Intell"},{"key":"B21","doi-asserted-by":"publisher","first-page":"9709","DOI":"10.1038\/s41598-021-89235-y","article-title":"Spectroscopically clean au nanoparticles for catalytic decomposition of hydrogen peroxide","volume":"11","author":"Liu","year":"2021","journal-title":"Sci. Rep"},{"key":"B22","first-page":"143","article-title":"\u201cOpen-set semi-supervised object detection,\u201d","volume-title":"European Conference on Computer Vision","author":"Liu","year":"2022"},{"key":"B23","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1109\/MLBDBI48998.2019.00032","article-title":"\u201cContextual-YOLOv3: implement better small object detection based deep learning,\u201d","volume-title":"2019 International Conference on Machine Learning, Big Data and Business Intelligence (MLBDBI)","author":"Luo","year":"2019"},{"key":"B24","first-page":"80","article-title":"\u201cAudio sentiment analysis by heterogeneous signal features learned from utterance-based parallel neural network,\u201d","volume-title":"AffCon@ AAAI","author":"Luo","year":"2019"},{"key":"B25","doi-asserted-by":"publisher","first-page":"23251","DOI":"10.1007\/s11042-022-14253-5","article-title":"Automatic robot manoeuvres detection using computer vision and deep learning techniques: a perspective of internet of robotics things (IORT)","volume":"82","author":"Mahajan","year":"2023","journal-title":"Multimed. Tools Appl"},{"key":"B26","doi-asserted-by":"crossref","first-page":"1442","DOI":"10.1109\/ICCMC51019.2021.9418274","article-title":"\u201cFaster R-CNN and Yolo based vehicle detection: a survey,\u201d","volume-title":"2021 5th International Conference on Computing Methodologies and Communication (ICCMC)","author":"Maity","year":"2021"},{"key":"B27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/LGRS.2021.3085139","article-title":"Contrasting YOLOv5, transformer, and efficientdet detectors for crop circle detection in desert","volume":"19","author":"Mekhalfi","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Lett"},{"key":"B28","doi-asserted-by":"publisher","first-page":"104046","DOI":"10.1016\/j.imavis.2020.104046","article-title":"Deep learning-based object detection in low-altitude uav datasets: a survey","volume":"104","author":"Mittal","year":"2020","journal-title":"Image Vis. Comput"},{"key":"B29","doi-asserted-by":"publisher","first-page":"100757","DOI":"10.1016\/j.ascom.2023.100757","article-title":"Deep learning for crescent detection and recognition: implementation of mask R-CNN to the observational lunar dataset collected with the robotic lunar telescope system","volume":"45","author":"Muztaba","year":"2023","journal-title":"Astron. Comput"},{"key":"B30","first-page":"370","article-title":"\u201cDetMatch: two teachers are better than one for joint 2D and 3D semi-supervised object detection,\u201d","volume-title":"European Conference on Computer Vision","author":"Park","year":"2022"},{"key":"B31","first-page":"13846","article-title":"\u201cIncremental few-shot object detection,\u201d","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Perez-Rua","year":"2020"},{"key":"B32","doi-asserted-by":"publisher","first-page":"411","DOI":"10.3390\/a16090411","article-title":"End-to-end approach for autonomous driving: a supervised learning method using computer vision algorithms for dataset creation","volume":"16","author":"Ribeiro","year":"2023","journal-title":"Algorithms"},{"key":"B33","doi-asserted-by":"publisher","first-page":"29180","DOI":"10.1021\/acs.jpcc.8b06555","article-title":"Guaiacol adsorption and decomposition on platinum","volume":"122","author":"Scoullos","year":"2018","journal-title":"J. Phys. Chem. C"},{"key":"B34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/0951192X.2022.2162601","article-title":"Performance analysis of object detection algorithms for robotic welding applications in planar environment","volume":"36","author":"Singh","year":"2023","journal-title":"Int. J. Comput. Integr. Manuf"},{"key":"B35","author":"Sun","year":"2022","journal-title":"The Effects of Offshore Activities on Financial Analyst Forecasts and Restatements"},{"key":"B36","doi-asserted-by":"publisher","first-page":"714","DOI":"10.1007\/s11263-019-01243-8","article-title":"Augmented autoencoders: implicit 3D orientation learning for 6D object detection","volume":"128","author":"Sundermeyer","year":"2020","journal-title":"Int. J. Comput. Vis"},{"key":"B37","volume-title":"Molecular Fundamentals of Upgrading Biomass-Derived Feedstocks over Platinum-Molybdenum Catalysts","author":"Tang","year":"2022"},{"key":"B38","doi-asserted-by":"publisher","first-page":"34899","DOI":"10.48550\/arXiv.2205.13764","article-title":"Fully convolutional one-stage 3D object detection on lidar range images","volume":"35","author":"Tian","year":"2022","journal-title":"Adv. Neural Inf. Process. Syst"},{"key":"B39","author":"Wang","year":"2023","journal-title":"Balanced Training for Sparse Gans"},{"key":"B40","doi-asserted-by":"publisher","first-page":"639","DOI":"10.3390\/agronomy13061625","article-title":"Object detection and recognition techniques based on digital image processing and traditional machine learning for fruit and vegetable harvesting robots: an overview and review","volume":"13","author":"Xiao","year":"2023","journal-title":"Agronomy"},{"key":"B41","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1016\/j.neucom.2019.10.115","article-title":"A cascade adaboost and cnn algorithm for drogue detection in uav autonomous aerial refueling","volume":"408","author":"Xu","year":"2020","journal-title":"Neurocomputing"},{"key":"B42","first-page":"220","article-title":"\u201cCenternet heatmap propagation for real-time video object detection,\u201d","volume-title":"Computer Vision-ECCV 2020, 16th. European Conference, Glasgow, UK, August 23-28, 2020, Proceedings, Part XXV 16","author":"Xu","year":"2020"},{"key":"B43","doi-asserted-by":"publisher","first-page":"034002","DOI":"10.1088\/2634-4386\/ace64c","article-title":"Brain-inspired methods for achieving robust computation in heterogeneous mixed-signal neuromorphic processing systems","volume":"3","author":"Zendrikov","year":"2023","journal-title":"Neuromorphic Comput. Eng"},{"key":"B44","doi-asserted-by":"publisher","first-page":"128271","DOI":"10.1016\/j.jhazmat.2022.128271","article-title":"Mil series of metal organic frameworks (MOFS) as novel adsorbents for heavy metals in water: a review","volume":"429","author":"Zhang","year":"2022","journal-title":"J. Hazard. Mater"},{"key":"B45","doi-asserted-by":"publisher","first-page":"75742","DOI":"10.1109\/ACCESS.2022.3192026","article-title":"Fine segmentation on faces with masks based on a multistep iterative segmentation algorithm","volume":"10","author":"Zhang","year":"2022","journal-title":"IEEE Access"},{"key":"B46","doi-asserted-by":"publisher","first-page":"4036","DOI":"10.1039\/D2CC00283C","article-title":"Spectroscopic observation and structure-insensitivity of hydroxyls on gold","volume":"58","author":"Zheng","year":"2022","journal-title":"Chem. Commun"},{"key":"B47","doi-asserted-by":"publisher","first-page":"103649","DOI":"10.1016\/j.cviu.2023.103649","article-title":"SSDA-YOLO: semi-supervised domain adaptive yolo for cross-domain object detection","volume":"229","author":"Zhou","year":"2023","journal-title":"Comput. Vis. Image Underst"},{"key":"B48","doi-asserted-by":"publisher","DOI":"10.1155\/2023\/1998218","article-title":"Surrounding object material detection and identification method for robots based on ultrasonic echo signals","author":"Zhu","year":"2023","journal-title":"Appl. Bionics Biomech"}],"container-title":["Frontiers in Neurorobotics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2023.1338104\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,4]],"date-time":"2024-01-04T05:12:33Z","timestamp":1704345153000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2023.1338104\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,4]]},"references-count":48,"alternative-id":["10.3389\/fnbot.2023.1338104"],"URL":"https:\/\/doi.org\/10.3389\/fnbot.2023.1338104","relation":{},"ISSN":["1662-5218"],"issn-type":[{"value":"1662-5218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,4]]},"article-number":"1338104"}}