{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,13]],"date-time":"2025-12-13T07:12:57Z","timestamp":1765609977688,"version":"build-2065373602"},"reference-count":35,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2019,11,20]],"date-time":"2019-11-20T00:00:00Z","timestamp":1574208000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Intracytoplasmic sperm injection (ICSI) is an infertility treatment where a single sperm is immobilised and injected into the egg using a glass injection pipette. Minimising vibration in three orthogonal axes is essential to have precise injector motion and full control during the egg injection procedure. Vibration displacement sensing using physical sensors in ICSI operation is challenging since the sensor interfacing is not practically feasible. This study proposes a non-invasive technique to measure the three-dimensional vibrational motion of the injection pipette by a single microscope camera during egg injection. The contrast-limited adaptive histogram equalization (CHALE) method and blob analyses technique were employed to measure the vibration displacement in axial and lateral axes, while the actual dimension of the focal axis was directly measured using the Brenner gradient algorithm as a focus measurement algorithm. The proposed algorithm operates between the magnifications range of 4\u00d7 to 40\u00d7 with a resolution of half a pixel. Experiments using the proposed vision-based algorithm were conducted to measure and verify the vibration displacement in axial and lateral axes at various magnifications. The results were compared against manual procedures and the differences in measurements were up to 2% among all magnifications. Additionally, the effect of injection speed on lateral vibration displacement was measured experimentally and was used to determine the values for egg deformation, force fluctuation, and penetration force. It was shown that increases in injection speed significantly increases the lateral vibration displacement of the injection pipette by as much as 54%. It has been demonstrated successfully that visual sensing has played a key role in identifying the limitation of the egg injection speed created by lateral vibration displacement of the injection pipette tip.<\/jats:p>","DOI":"10.3390\/s19235074","type":"journal-article","created":{"date-parts":[[2019,11,20]],"date-time":"2019-11-20T11:06:03Z","timestamp":1574247963000},"page":"5074","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Vision-Based Sensor for Three-Dimensional Vibrational Motion Detection in Biological Cell Injection"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2391-4836","authenticated-orcid":false,"given":"Ferhat","family":"Sadak","sequence":"first","affiliation":[{"name":"Department of Mechanical Engineering, School of Engineering, University of Birmingham, Birmingham B15 2TT, UK"}]},{"given":"Mozafar","family":"Saadat","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, School of Engineering, University of Birmingham, Birmingham B15 2TT, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6666-7866","authenticated-orcid":false,"given":"Amir","family":"Hajiyavand","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, School of Engineering, University of Birmingham, Birmingham B15 2TT, UK"}]}],"member":"1968","published-online":{"date-parts":[[2019,11,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1016\/j.sna.2015.09.028","article-title":"An overview of micro-force sensing techniques","volume":"234","author":"Wei","year":"2015","journal-title":"Sens. Actuators A Phys."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"5375","DOI":"10.1007\/s00542-017-3378-9","article-title":"Analysis and optimization of a micro\u2014Displacement sensor for compliant microgripper","volume":"23","author":"Dao","year":"2017","journal-title":"Microsyst. Technol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.sna.2019.07.007","article-title":"Recent advances in non-contact force sensors used for micro\/nano manipulation","volume":"296","author":"Zang","year":"2019","journal-title":"Sens. Actuators A Phys."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1016\/j.ndteint.2005.12.003","article-title":"A vision-based system for remote sensing of bridge displacement","volume":"39","author":"Lee","year":"2006","journal-title":"NDT E Int."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"861","DOI":"10.1177\/0278364902021010833","article-title":"Biological cell injection using an autonomous microrobotic system","volume":"21","author":"Sun","year":"2002","journal-title":"Int. J. Robot. Res."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1095\/biolreprod52.4.709","article-title":"Intracytoplasmic Sperm Injection in the Mouse","volume":"52","author":"Kimura","year":"1995","journal-title":"Biol. Reprod."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Sadak, F., Saadat, M., Hajiyavand, A.M., and Nomicos, G. (2018, January 4\u20138). Vibrational Analysis during Cell Injection in ICSI Operation. Proceedings of the 2018 International Conference on Manipulation, Automation and Robotics at Small Scales (MARSS), Nagoya, Japan.","DOI":"10.1109\/MARSS.2018.8481184"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Hajiyavand, A.M., Saadat, M., Abena, A., Sadak, F., and Sun, X. (2019). Effect of Injection Speed on Oocyte Deformation in ICSI. Micromachines, 10.","DOI":"10.3390\/mi10040226"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Avci, E., Nguyen, C., Ohara, K., Kojima, M., Mae, Y., and Arai, T. (2013, January 6\u201310). Towards High-Speed Automated Micromanipulation. Proceedings of the 2013 IEEE International Conference on Robotics and Automation, Karlsruhe, Germany.","DOI":"10.1109\/ICRA.2013.6630802"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1349","DOI":"10.1080\/01691864.2017.1362996","article-title":"Design and development of a piezo-driven microinjection system with force feedback","volume":"31","author":"Wang","year":"2017","journal-title":"Adv. Robot."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/0140-6736(92)92425-F","article-title":"Pregnancies after intracytoplasmic injection of single spermatozoon into an oocyte","volume":"340","author":"Palermo","year":"1992","journal-title":"Lancet"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1093\/humrep\/16.2.306","article-title":"Embryo development and chromosomal anomalies after ICSI: Effect of the injection procedure","volume":"16","author":"Dumoulin","year":"2001","journal-title":"Hum. Reprod."},{"key":"ref_13","first-page":"41908","article-title":"Dynamic response of micropipettes during piezo-assisted intracytoplasmic sperm injection","volume":"84","author":"Olgac","year":"2011","journal-title":"Phys. Rev."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1262","DOI":"10.1109\/TBME.2004.827346","article-title":"Microdynamics of the piezo-driven pipettes in ICSI","volume":"51","author":"Ediz","year":"2004","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1109\/TRO.2013.2280060","article-title":"Locating end-effector tips in robotic micromanipulation","volume":"30","author":"Liu","year":"2014","journal-title":"IEEE Trans. Robot."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1564","DOI":"10.1152\/jn.00386.2016","article-title":"Integration of autopatching with automated pipette and cell detection in vitro","volume":"116","author":"Wu","year":"2016","journal-title":"J. Neurophysiol."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Saadat, M., Hajiyavand, A.M., and Bedi, A.S. (2018). Oocyte Positional Recognition for Automatic Manipulation in ICSI. Micromachines, 9.","DOI":"10.3390\/mi9090429"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2033","DOI":"10.1063\/1.1753106","article-title":"Image-based autonomous micromanipulation system for arrangement of spheres in a scanning electron microscope","volume":"75","author":"Kasaya","year":"2004","journal-title":"Rev. Sci. Instrum."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1109\/TMECH.2010.2040900","article-title":"Robotic Micromanipulation and Microassembly Using Monoview and Multiscale Visual Servoing","volume":"16","author":"Tamadazte","year":"2011","journal-title":"IEEE ASME Trans. Mechatron."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1109\/TIE.2008.925771","article-title":"Vision-servo system for automated cell injection","volume":"56","author":"Zhang","year":"2009","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"9435","DOI":"10.1364\/AO.56.009435","article-title":"Micro-motion detection of the 3-DOF precision positioning stage based on iterative optimized template matching","volume":"56","author":"Li","year":"2017","journal-title":"Appl. Opt."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1016\/j.ymssp.2019.01.046","article-title":"Realtime in-plane displacements tracking of the precision positioning stage based on computer micro-vision","volume":"124","author":"Li","year":"2019","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"55301","DOI":"10.1063\/1.4983034","article-title":"A high accuracy algorithm of displacement measurement for a micro-positioning stage","volume":"7","author":"Zhang","year":"2017","journal-title":"AIP Adv."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"55402","DOI":"10.1088\/1361-6501\/aaa560","article-title":"A robust rotation-invariance displacement measurement method for a micro-\/nano-positioning system","volume":"29","author":"Zhang","year":"2018","journal-title":"Meas. Sci. Technol."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zuiderveld, K. (1994). Contrast Limited Adaptive Histogram Equalization. Graphics Gems IV, Academic Press Professional, Inc.","DOI":"10.1016\/B978-0-12-336156-1.50061-6"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"920","DOI":"10.1109\/TFUZZ.2008.924358","article-title":"Impulse noise removal from digital images by a detail-preserving filter based on type-2 fuzzy logic","volume":"16","author":"Yildirim","year":"2008","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_27","unstructured":"Deng, G., and Cahill, L.W. (November, January 31). Adaptive Gaussian Filter For Noise Reduction and Edge Detection. Proceedings of the IEEE Conference Record Nuclear Science Symposium and Medical Imaging, San Francisco, CA, USA."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1080\/2151237X.2007.10129236","article-title":"Adaptive Thresholding using the Integral Image","volume":"12","author":"Bradley","year":"2007","journal-title":"J. Graph. Tools"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1109\/TPAMI.1986.4767851","article-title":"A Computational Approach to Edge Detection","volume":"8","author":"Canny","year":"1986","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"99360","DOI":"10.1109\/ACCESS.2019.2925465","article-title":"Three Dimensional Auto-Alignment of the ICSI Pipette","volume":"7","author":"Sadak","year":"2019","journal-title":"IEEE Access"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1007\/BF00127822","article-title":"Focusing","volume":"1","author":"Krotkov","year":"1988","journal-title":"Int. J. Comput. Vis."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2824","DOI":"10.1117\/12.147706","article-title":"Focusing techniques","volume":"32","author":"Subbarao","year":"1993","journal-title":"Opt. Eng."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1177\/24.1.1254907","article-title":"An automated microscope for cytologic research a preliminary evaluation","volume":"24","author":"Brenner","year":"1976","journal-title":"J. Histochem. Cytochem."},{"key":"ref_34","unstructured":"Navar, K. (1989). Shape from Focus, Carnegie Mellon University."},{"key":"ref_35","unstructured":"Krotkov, E.P. (2012). Active Computer Vision by Cooperative Focus and Stereo, Springer Science & Business Media."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/23\/5074\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:36:10Z","timestamp":1760189770000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/23\/5074"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,20]]},"references-count":35,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2019,12]]}},"alternative-id":["s19235074"],"URL":"https:\/\/doi.org\/10.3390\/s19235074","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2019,11,20]]}}}