{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,2]],"date-time":"2026-08-02T19:59:45Z","timestamp":1785700785049,"version":"3.56.0"},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2025,3,10]],"date-time":"2025-03-10T00:00:00Z","timestamp":1741564800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,3,10]],"date-time":"2025-03-10T00:00:00Z","timestamp":1741564800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100005192","name":"Technical University of Denmark","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005192","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Appl Intell"],"published-print":{"date-parts":[[2025,5]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>The adoption of robotics and automated solutions in life sciences R&amp;D has accelerated in recent years, driven by the need to process increasing sample volumes, protect laboratory staff from hazardous substances, and manage financial pressures. Various automation systems, each with distinct levels of sample processing, transportation tasks, and data management, are available to meet specific application requirements, with liquid handling robots taking pivotal positions in these systems. However, current liquid handling robots, such as the Opentrons OT-2, lack integrated vision-based quality control, which limits their accuracy and reliability. This study presents an AI-driven computer vision model designed to enhance quality control in laboratory automation. By integrating the YOLOv8 object detection model with the OT-2, our model enables precise detection of pipette tips and liquid volumes, providing real-time feedback on errors, such as missing tips and incorrect liquid levels. Our results demonstrate the model's effectiveness and accessibility, presenting an affordable solution for improving automation in academic and research laboratories. This closed-loop system transforms the OT-2 into a robust tool for automated laboratory tasks, making it an accessible and cost-effective approach for enhancing quality control in laboratory automation and addressing a critical gap in available tools for resource-limited settings.<\/jats:p>","DOI":"10.1007\/s10489-025-06334-3","type":"journal-article","created":{"date-parts":[[2025,3,10]],"date-time":"2025-03-10T15:25:48Z","timestamp":1741620348000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Real-time AI-driven quality control for laboratory automation: a novel computer vision solution for the opentrons OT-2 liquid handling robot"],"prefix":"10.1007","volume":"55","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-9295-4341","authenticated-orcid":false,"given":"Sana Ullah","family":"Khan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-9695-2864","authenticated-orcid":false,"given":"Vilhelm Krarup","family":"M\u00f8ller","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3799-6062","authenticated-orcid":false,"given":"Rasmus John Normand","family":"Frandsen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6492-7858","authenticated-orcid":false,"given":"Marjan","family":"Mansourvar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,3,10]]},"reference":[{"key":"6334_CR1","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/10_2021_170","volume":"182","author":"K Thurow","year":"2022","unstructured":"Thurow K (2022) Automation for Life Science Laboratories. Adv Biochem Eng Biotechnol 182:3\u201322. https:\/\/doi.org\/10.1007\/10_2021_170","journal-title":"Adv Biochem Eng Biotechnol"},{"key":"6334_CR2","unstructured":"Preu\u00dfe S (2013) Technologies for engineering manufacturing systems control in closed loop, Vol 10. Logos Verlag Berlin GmbH"},{"key":"6334_CR3","doi-asserted-by":"publisher","DOI":"10.3389\/fbioe.2020.571777","author":"EC Ferreira","year":"2020","unstructured":"Ferreira EC, Mesbah NM, Hillson N, Holland I, Davies JA (2020) Automation in the life science research laboratory. Front Bioeng Biotechnol. https:\/\/doi.org\/10.3389\/fbioe.2020.571777","journal-title":"Front Bioeng Biotechnol"},{"key":"6334_CR4","first-page":"23","volume":"8","author":"C Archetti","year":"2017","unstructured":"Archetti C, Montanelli A, Finazzi D, Caimi L, Garrafa E (2017) Clinical laboratory automation: a case study. J Public Health Res 8:23\u201327","journal-title":"J Public Health Res"},{"key":"6334_CR5","first-page":"1819","volume":"11","author":"BB Christo","year":"2016","unstructured":"Christo BB, Jebarani MRE (2016) An automatic liquid dispensing robot with database management and biometric security systems. ARPN J Eng Appl Sci 11:1819\u20136608 (Accessed 16 July 2024)","journal-title":"ARPN J Eng Appl Sci"},{"key":"6334_CR6","doi-asserted-by":"publisher","unstructured":"Yu H, M\u00f8ller VK, Frandsen RJN, Mansourvar M (2023) Image processing for robotic control in life science laboratory automation.\u00a0In: 2023 5th International Conference on Robotics and Computer Vision (ICRCV). pp 305\u2013309. IEEE. https:\/\/doi.org\/10.1109\/ICRCV59470.2023.10329251","DOI":"10.1109\/ICRCV59470.2023.10329251"},{"key":"6334_CR7","doi-asserted-by":"crossref","unstructured":"Liu B, Che C, Hu H, Yu L, Lin Q, Zhao X (2024) Integration and performance analysis of artificial intelligence and computer vision based on deep learning algorithms. arXiv preprint arXiv:2312.12872","DOI":"10.54254\/2755-2721\/64\/20241374"},{"key":"6334_CR8","doi-asserted-by":"crossref","unstructured":"Hassaballah M, Awad AI (Eds) (2020) Deep learning in computer vision: principles and applications. CRC Press","DOI":"10.1201\/9781351003827"},{"key":"6334_CR9","doi-asserted-by":"crossref","unstructured":"Che C, Zheng H, Huang Z, Jiang W, Liu B (2024) Intelligent robotic control system based on computer vision technology. Preprint at https:\/\/arxiv.org\/abs\/2404.01116","DOI":"10.54254\/2755-2721\/64\/20241373"},{"key":"6334_CR10","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1145\/3570731","volume":"12","author":"N Robinson","year":"2023","unstructured":"Robinson N, Tidd B, Campbell D, Kuli\u0107 D, Corke P (2023) Robotic vision for human-robot interaction and collaboration: a survey and systematic review. ACM Trans Hum Robot Interact 12:12. https:\/\/doi.org\/10.1145\/3570731","journal-title":"ACM Trans Hum Robot Interact"},{"key":"6334_CR11","doi-asserted-by":"publisher","first-page":"3601","DOI":"10.1017\/pds.2023.361","volume":"3","author":"NH Ghoson","year":"2023","unstructured":"Ghoson NH, Hakam N, Shakeri Z, Meyrueis V, Loub\u00e8re S, Benfriha K (2023) Towards remote control of manufacturing machines through robot vision sensors. Proc Des Soc 3:3601\u20133610. https:\/\/doi.org\/10.1017\/pds.2023.361","journal-title":"Proc Des Soc"},{"key":"6334_CR12","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1016\/J.PROCS.2023.12.195","volume":"231","author":"A Ettalibi","year":"2024","unstructured":"Ettalibi A, Elouadi A, Mansour A (2024) AI and computer vision-based real-time quality control: a review of industrial applications. Procedia Comput Sci 231:212\u2013220. https:\/\/doi.org\/10.1016\/J.PROCS.2023.12.195","journal-title":"Procedia Comput Sci"},{"key":"6334_CR13","doi-asserted-by":"publisher","unstructured":"Chen Y, Goorden MC, Beekman FJ, Du J (2018) Understanding of object detection based on CNN family and YOLO. J Phys 12029. https:\/\/doi.org\/10.1088\/1742-6596\/1004\/1\/012029","DOI":"10.1088\/1742-6596\/1004\/1\/012029"},{"key":"6334_CR14","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y Lecun","year":"2015","unstructured":"Lecun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521:436\u2013444. https:\/\/doi.org\/10.1038\/nature14539","journal-title":"Nature"},{"key":"6334_CR15","doi-asserted-by":"publisher","first-page":"7068349","DOI":"10.1155\/2018\/7068349","volume":"2018","author":"A Voulodimos","year":"2018","unstructured":"Voulodimos A, Doulamis N, Doulamis A, Protopapadakis E (2018) Deep learning for computer vision: a brief review. Comput Intell Neurosci 2018:7068349. https:\/\/doi.org\/10.1155\/2018\/7068349","journal-title":"Comput Intell Neurosci"},{"key":"6334_CR16","unstructured":"Nazarkevych M, Kostiak M, Oleksiv N, Vysotska V, Shvahuliak A-T (2024) A YOLO-based method for object contour detection and recognition in video sequences.\u00a0\u00a0In CPITS pp 49\u201358"},{"key":"6334_CR17","unstructured":"Reis D, Kupec J, Hong J, Daoudi A (2023) Real-time flying object detection with YOLOv8. Preprint at https:\/\/arxiv.org\/abs\/2305.09972"},{"key":"6334_CR18","doi-asserted-by":"publisher","first-page":"677","DOI":"10.3390\/MACHINES11070677","volume":"11","author":"M Hussain","year":"2023","unstructured":"Hussain M (2023) YOLO-v1 to YOLO-v8, the rise of YOLO and Its complementary nature toward digital manufacturing and industrial defect detection. Machines 11:677. https:\/\/doi.org\/10.3390\/MACHINES11070677","journal-title":"Machines"},{"key":"6334_CR19","doi-asserted-by":"publisher","first-page":"104283","DOI":"10.1016\/J.DSP.2023.104283","volume":"144","author":"H Li","year":"2024","unstructured":"Li H, Wu D, Zhang W, Xiao C (2024) YOLO-PL: helmet wearing detection algorithm based on improved YOLOv4. Digit Signal Process 144:104283. https:\/\/doi.org\/10.1016\/J.DSP.2023.104283","journal-title":"Digit Signal Process"},{"key":"6334_CR20","doi-asserted-by":"publisher","first-page":"496","DOI":"10.28991\/ESJ-2024-08-02-08","volume":"8","author":"V Moya","year":"2024","unstructured":"Moya V, Quito A, Pilco A, V\u00e1sconez JP, Vargas C (2024) Crop detection and maturity classification using a YOLOv5-based image analysis. Emerging Sci J 8:496\u2013512. https:\/\/doi.org\/10.28991\/ESJ-2024-08-02-08","journal-title":"Emerging Sci J"},{"key":"6334_CR21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/S11554-024-01519-4\/TABLES\/8","volume":"21","author":"CL Ji","year":"2024","unstructured":"Ji CL, Yu T, Gao P, Wang F, Yuan RY (2024) Yolo-tla: an efficient and lightweight small object detection model based on YOLOv5. J Real Time Image Process 21:1\u201316. https:\/\/doi.org\/10.1007\/S11554-024-01519-4\/TABLES\/8","journal-title":"J Real Time Image Process"},{"key":"6334_CR22","doi-asserted-by":"publisher","unstructured":"Guillermo M, et al. (2020, November). Implementation of automated annotation through mask RCNN object detection model in CVAT using AWS EC2 instance. In 2020 IEEE region 10 conference (TENCON)\u00a0(pp. 708-713). IEEE, Osaka, Japan, 16-19 November 2020. https:\/\/doi.org\/10.1109\/TENCON50793.2020.9293906","DOI":"10.1109\/TENCON50793.2020.9293906"},{"key":"6334_CR23","unstructured":"Cheng X, Khomtchouk B, Matloff N, Mohanty P (2018) Polynomial regression as an alternative to neural nets. Preprint at https:\/\/arxiv.org\/abs\/1806.06850"},{"key":"6334_CR24","first-page":"21002","volume":"33","author":"X Li","year":"2020","unstructured":"Li X et al (2020) Generalized focal loss: learning qualified and distributed bounding boxes for dense object detection. Adv Neural Inf Process Syst 33:21002\u201321012","journal-title":"Adv Neural Inf Process Syst"},{"key":"6334_CR25","unstructured":"Powers DM (2020) Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation. Preprint at https:\/\/arxiv.org\/abs\/2010.16061"},{"key":"6334_CR26","doi-asserted-by":"publisher","first-page":"279","DOI":"10.3390\/ELECTRONICS10030279","volume":"10","author":"R Padilla","year":"2021","unstructured":"Padilla R, Passos WL, Dias TL, Netto SL, Da Silva EAB (2021) A comparative analysis of object detection metrics with a companion open-source toolkit. Electronics 10:279. https:\/\/doi.org\/10.3390\/ELECTRONICS10030279","journal-title":"Electronics"},{"key":"6334_CR27","doi-asserted-by":"publisher","first-page":"7307","DOI":"10.3758\/S13428-024-02420-5\/FIGURES\/22","volume":"56","author":"F Hermens","year":"2024","unstructured":"Hermens F (2024) Automatic object detection for behavioural research using YOLOv8. Behav Res Methods 56:7307\u20137330. https:\/\/doi.org\/10.3758\/S13428-024-02420-5\/FIGURES\/22","journal-title":"Behav Res Methods"},{"key":"6334_CR28","doi-asserted-by":"crossref","unstructured":"Sohan M, Sai Ram T, Reddy R, Venkata C (2024) A review on yolov8 and its advancements. In: international conference on data intelligence and cognitive informatics. Springer, Singapore, pp 529\u2013545","DOI":"10.1007\/978-981-99-7962-2_39"}],"container-title":["Applied Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-025-06334-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10489-025-06334-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-025-06334-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,19]],"date-time":"2025-09-19T19:32:23Z","timestamp":1758310343000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10489-025-06334-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,10]]},"references-count":28,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2025,5]]}},"alternative-id":["6334"],"URL":"https:\/\/doi.org\/10.1007\/s10489-025-06334-3","relation":{},"ISSN":["0924-669X","1573-7497"],"issn-type":[{"value":"0924-669X","type":"print"},{"value":"1573-7497","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,10]]},"assertion":[{"value":"1 February 2025","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 March 2025","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declaration"}},{"value":"The authors declare that there is no competing financial interest or personal relationship that could have appeared to influence the work reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"524"}}