{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T14:36:10Z","timestamp":1780583770678,"version":"3.54.1"},"reference-count":40,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2020,1,3]],"date-time":"2020-01-03T00:00:00Z","timestamp":1578009600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Automation of agricultural processes requires systems that can accurately detect and classify produce in real industrial environments that include variation in fruit appearance due to illumination, occlusion, seasons, weather conditions, etc. In this paper we combine a visual processing approach inspired by colour-opponent theory in humans with recent advancements in one-stage deep learning networks to accurately, rapidly and robustly detect ripe soft fruits (strawberries) in real industrial settings and using standard (RGB) camera input. The resultant system was tested on an existent data-set captured in controlled conditions as well our new real-world data-set captured on a real strawberry farm over two months. We utilise     F 1     score, the harmonic mean of precision and recall, to show our system matches the state-of-the-art detection accuracy (    F 1    : 0.793 vs. 0.799) in controlled conditions; has greater generalisation and robustness to variation of spatial parameters (camera viewpoint) in the real-world data-set (    F 1    : 0.744); and at a fraction of the computational cost allowing classification at almost 30fps. We propose that the L*a*b*Fruits system addresses some of the most pressing limitations of current fruit detection systems and is well-suited to application in areas such as yield forecasting and harvesting. Beyond the target application in agriculture this work also provides a proof-of-principle whereby increased performance is achieved through analysis of the domain data, capturing features at the input level rather than simply increasing model complexity.<\/jats:p>","DOI":"10.3390\/s20010275","type":"journal-article","created":{"date-parts":[[2020,1,3]],"date-time":"2020-01-03T11:55:07Z","timestamp":1578052507000},"page":"275","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":65,"title":["L*a*b*Fruits: A Rapid and Robust Outdoor Fruit Detection System Combining Bio-Inspired Features with One-Stage Deep Learning Networks"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5118-9358","authenticated-orcid":false,"given":"Raymond","family":"Kirk","sequence":"first","affiliation":[{"name":"Lincoln Centre for Autonomous Systems, School of Computer Science, University of Lincoln, Lincoln LN6 7TS, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6299-8465","authenticated-orcid":false,"given":"Grzegorz","family":"Cielniak","sequence":"additional","affiliation":[{"name":"Lincoln Centre for Autonomous Systems, School of Computer Science, University of Lincoln, Lincoln LN6 7TS, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0293-8874","authenticated-orcid":false,"given":"Michael","family":"Mangan","sequence":"additional","affiliation":[{"name":"Sheffield Robotics, School of Computer Science, University of Sheffield, Sheffield S10 2TN, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,1,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1016\/j.compag.2015.01.010","article-title":"Location of apples in trees using stereoscopic vision","volume":"112","author":"Si","year":"2015","journal-title":"Comput. Electron. Agric."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.compag.2016.11.022","article-title":"Stereo vision with Equal Baseline Multiple Camera Set (EBMCS) for obtaining depth maps of plants","volume":"135","author":"Kaczmarek","year":"2017","journal-title":"Comput. Electron. Agric."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1109\/MIM.2016.7777651","article-title":"Photonics enhanced sensors for food monitoring: Part 1","volume":"19","author":"Meulebroeck","year":"2016","journal-title":"IEEE Instrum. Meas. Mag."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"572","DOI":"10.1016\/j.compag.2016.07.023","article-title":"Automatic green fruit counting in orange trees using digital images","volume":"127","author":"Maldonado","year":"2016","journal-title":"Comput. Electron. Agric."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Dey, D., Mummert, L., and Sukthankar, R. (2012, January 9\u201311). Classification of plant structures from uncalibrated image sequences. Proceedings of the IEEE Workshop on Applications of Computer Vision, Breckenridge, CO, USA.","DOI":"10.1109\/WACV.2012.6163017"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/j.biosystemseng.2013.12.008","article-title":"Automatic fruit recognition and counting from multiple images","volume":"118","author":"Song","year":"2014","journal-title":"Biosyst. Eng."},{"key":"ref_7","unstructured":"Qureshi, W.S., Satoh, S., Dailey, M.N., and Ekpanyapong, M. (2014, January 5\u20138). Dense segmentation of textured fruits in video sequences. Proceedings of the International Conference on Computer Vision Theory and Applications (VISAPP), Lisbon, Portugal."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Sa, I., Ge, Z., Dayoub, F., Upcroft, B., Perez, T., and McCool, C. (2016). DeepFruits: A Fruit Detection System Using Deep Neural Networks. Sensors, 16.","DOI":"10.3390\/s16081222"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Doll\u00e1r, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21\u201326). Feature Pyramid Networks for Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA. Technical report.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Goyal, P., Girshick, R., He, K., and Doll\u00e1r, P. (2017). Focal loss for dense object detection. arXiv.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/j.compag.2015.05.021","article-title":"Sensors and systems for fruit detection and localization: A review","volume":"116","author":"Gongal","year":"2015","journal-title":"Comput. Electron. Agric."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.compag.2018.02.016","article-title":"Deep learning in agriculture: A survey","volume":"147","author":"Kamilaris","year":"2018","journal-title":"Comput. Electron. Agric."},{"key":"ref_14","unstructured":"Ren, S., He, K., Girshick, R.B., and Sun, J. (2015). Faster {R-CNN:} Towards Real-Time Object Detection with Region Proposal Networks. CoRR."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Chinchor, N. (1992, January 16\u201318). MUC-4 Evaluation Metrics. Proceedings of the 4th Conference on Message Understanding, Association for Computational Linguistics, Stroudsburg, PA, USA.","DOI":"10.3115\/1072064.1072067"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Roy, A., Banerjee, S., Roy, D., and Mukhopadhyay, A. (2011, January 15\u201317). Statistical video tracking of pomegranate fruits. Proceedings of the 2011 3rd National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics, NCVPRIPG 2011, Hubli, India.","DOI":"10.1109\/NCVPRIPG.2011.67"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Forss\u00e9n, P.E. (2007, January 17\u201322). Maximally stable colour regions for recognition and matching. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383120"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1016\/j.agrformet.2018.05.001","article-title":"Rice heading stage automatic observation by multi-classifier cascade based rice spike detection method","volume":"259","author":"Bai","year":"2018","journal-title":"Agric. For. Meteorol."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask R-CNN. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S.E., Fu, C.Y., and Berg, A.C. (2016). SSD: Single Shot MultiBox Detector. Computer Vision \u2013 ECCV 2016, Proceedings of the 14th European Conference, Amsterdam, The Netherlands, 11\u201314 October 2016, Springer.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Cheng, M.M., Zhang, Z., Lin, W.Y., and Torr, P. (2014, January 24\u201327). BING: Binarized Normed Gradients for Objectness Estimation at 300fps. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA. Technical report.","DOI":"10.1109\/CVPR.2014.414"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1007\/s11263-013-0620-5","article-title":"Selective Search for Object Recognition","volume":"104","author":"Uijlings","year":"2013","journal-title":"Int. J. Comput. Vis."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Lu, C., Liu, S., Jia, J., and Tang, C.-K. (2015, January 7\u201313). Contour Box: Rejecting Object Proposals without Explicit Closed Contours; Technical report. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.234"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Soviany, P., and Ionescu, R.T. (2018). Optimizing the Trade-off between Single-Stage and Two-Stage Deep Object Detectors using Image Difficulty Prediction. arXiv.","DOI":"10.1109\/SYNASC.2018.00041"},{"key":"ref_25","unstructured":"MacLeod, R.B., Hering, E., Hurvich, L.M., and Jamieson, D. (2006). Outlines of a Theory of the Light Sense, Springer."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Mathibela, B., Posner, I., and Newman, P. (2013, January 3\u20137). A roadwork scene signature based on the opponent colour model. Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Tokyo, Japan.","DOI":"10.1109\/IROS.2013.6696987"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2274","DOI":"10.1109\/TPAMI.2012.120","article-title":"SLIC superpixels compared to state-of-the-art superpixel methods","volume":"34","author":"Achanta","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1016\/j.compag.2013.08.022","article-title":"Crop segmentation from images by morphology modeling in the CIE L*a*b*color space","volume":"99","author":"Bai","year":"2013","journal-title":"Comput. Electron. Agric."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.biosystemseng.2014.06.015","article-title":"Vegetation segmentation robust to illumination variations based on clustering and morphology modelling","volume":"125","author":"Bai","year":"2014","journal-title":"Biosyst. Eng."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.compag.2014.04.008","article-title":"A novel artificial neural networks assisted segmentation algorithm for discriminating almond nut and shell from background and shadow","volume":"105","author":"Teimouri","year":"2014","journal-title":"Comput. Electron. Agric."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Schanda, J. (2007). CIE Colorimetry. Colorimetry, Wiley-Blackwell. Chapter 3.","DOI":"10.1002\/9780470175637"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Maire, M., Belongie, S.J., Bourdev, L.D., Girshick, R.B., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014). Microsoft COCO: Common Objects in Context. Computer Vision \u2013 ECCV 2014, Proceedings of the 13th European Conference, Zurich, Switzerland, 6\u201312 September 2014, Springer.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). ImageNet: A Large-Scale Hierarchical Image Database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA. Technical report.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"104846","DOI":"10.1016\/j.compag.2019.06.001","article-title":"Fruit detection for strawberry harvesting robot innon-structural environment based on Mask-RCNN","volume":"163","author":"Yu","year":"2019","journal-title":"Comput. Electron. Agric."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Chen, Y., Lee, W.S., Gan, H., Peres, N., Fraisse, C., Zhang, Y., and He, Y. (2019). Strawberry Yield Prediction Based on a Deep Neural Network Using High-Resolution Aerial Orthoimages. Remote Sens., 11.","DOI":"10.3390\/rs11131584"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Lamb, N., and Chuah, M.C. (2018, January 10\u201313). A Strawberry Detection System Using Convolutional Neural Networks. Proceedings of the 2018 IEEE International Conference on Big Data (Big Data), Seattle, WA, USA.","DOI":"10.1109\/BigData.2018.8622466"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"147642","DOI":"10.1109\/ACCESS.2019.2946369","article-title":"Fruit Localization and Environment Perception for Strawberry Harvesting Robots","volume":"7","author":"Ge","year":"2019","journal-title":"IEEE Access"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"McCool, C., Sa, I., Dayoub, F., Lehnert, C., Perez, T., and Upcroft, B. (2016, January 16\u201321). Visual detection of occluded crop: For automated harvesting. Proceedings of the IEEE International Conference on Robotics and Automation, Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487405"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1145\/3161534.3161537","article-title":"An Efficient Visual Fiducial Localisation System","volume":"17","author":"Lightbody","year":"2017","journal-title":"ACM SIGAPP Appl. Comput. Rev."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Grimstad, L., and From, P. (2017). The Thorvald II Agricultural Robotic System. Robotics, 6.","DOI":"10.3390\/robotics6040024"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/1\/275\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:28:42Z","timestamp":1760362122000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/1\/275"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,3]]},"references-count":40,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,1]]}},"alternative-id":["s20010275"],"URL":"https:\/\/doi.org\/10.3390\/s20010275","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,3]]}}}