{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T21:27:38Z","timestamp":1767994058616,"version":"3.49.0"},"reference-count":51,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,2,21]],"date-time":"2021-02-21T00:00:00Z","timestamp":1613865600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Michigan Translational Research and Commercialization(MTRAC)","award":["380137\/23R343"],"award-info":[{"award-number":["380137\/23R343"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>Unintentional vascular damage can result from a surgical instrument\u2019s abrupt movements during minimally invasive surgery (laparoscopic or robotic). A novel real-time image processing algorithm based on local entropy is proposed that can detect abrupt movements of surgical instruments and predict bleeding occurrence. The uniform nature of the texture of surgical tools is utilized to segment the tools from the background. By comparing changes in entropy over time, the algorithm determines when the surgical instruments are moved abruptly. We tested the algorithm using 17 videos of minimally invasive surgery, 11 of which had tool-induced bleeding. Our preliminary testing shows that the algorithm is 88% accurate and 90% precise in predicting bleeding. The average advance warning time for the 11 videos is 0.662 s, with the standard deviation being 0.427 s. The proposed approach has the potential to eventually lead to a surgical early warning system or even proactively attenuate tool movement (for robotic surgery) to avoid dangerous surgical outcomes.<\/jats:p>","DOI":"10.3390\/robotics10010037","type":"journal-article","created":{"date-parts":[[2021,2,21]],"date-time":"2021-02-21T23:59:31Z","timestamp":1613951971000},"page":"37","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Visual Intelligence: Prediction of Unintentional Surgical-Tool-Induced Bleeding during Robotic and Laparoscopic Surgery"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5277-7135","authenticated-orcid":false,"given":"Mostafa","family":"Daneshgar Rahbar","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Engineering, Wayne State University, Detroit, MI 48202, USA"}]},{"given":"Hao","family":"Ying","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Wayne State University, Detroit, MI 48202, USA"}]},{"given":"Abhilash","family":"Pandya","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Wayne State University, Detroit, MI 48202, USA"}]}],"member":"1968","published-online":{"date-parts":[[2021,2,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1077","DOI":"10.1520\/JFS2003218","article-title":"Postmortem analysis of anastomotic suture line disruption following carotid endarterectomy","volume":"49","author":"Melinek","year":"2004","journal-title":"J. Forensic Sci."},{"key":"ref_2","unstructured":"Fard, M.J., Ameri, S., Chinnam, R.B., Pandya, A.K., Klein, M.D., and Ellis, R.D. (2016). Machine learning approach for skill evaluation in robotic-assisted surgery. arXiv."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1109\/TMRB.2019.2913282","article-title":"Autonomy for surgical robots: Concepts and paradigms","volume":"1","author":"Haidegger","year":"2019","journal-title":"IEEE Trans. Med. Robot. Bionics"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"356","DOI":"10.1007\/s00464-010-1190-z","article-title":"Review of methods for objective surgical skill evaluation","volume":"25","author":"Reiley","year":"2011","journal-title":"Surg. Endosc."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"220","DOI":"10.3109\/10929080600989189","article-title":"Towards automatic skill evaluation: Detection and segmentation of robot-assisted surgical motions","volume":"11","author":"Lin","year":"2006","journal-title":"Comput. Aided Surg."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1109\/TBME.2005.869771","article-title":"Generalized approach for modeling minimally invasive surgery as a stochastic process using a discrete Markov model","volume":"53","author":"Rosen","year":"2006","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"448","DOI":"10.1197\/jamia.M1107","article-title":"Development and validation of assessment measures for a newly developed physical examination simulator","volume":"9","author":"Pugh","year":"2002","journal-title":"J. Am. Med Inform. Assoc."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1007\/s004640000230","article-title":"Skills evaluation in minimally invasive surgery using force\/torque signatures","volume":"14","author":"Richards","year":"2000","journal-title":"Surg. Endosc."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1032","DOI":"10.1136\/bmj.327.7422.1032","article-title":"Objective assessment of technical skills in surgery","volume":"327","author":"Moorthy","year":"2003","journal-title":"BMJ"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1109\/10.918597","article-title":"Markov modeling of minimally invasive surgery based on tool\/tissue interaction and force\/torque signatures for evaluating surgical skills","volume":"48","author":"Rosen","year":"2001","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Yamauchi, Y., Yamashita, J., Morikawa, O., Hashimoto, R., Mochimaru, M., Fukui, Y., Uno, H., and Yokoyama, K. (2002, January 25\u201328). Surgical skill evaluation by force data for endoscopic sinus surgery training system. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Tokyo, Japan.","DOI":"10.1007\/3-540-45786-0_6"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1007\/s11701-007-0067-1","article-title":"Objective evaluation of expert performance during human robotic surgical procedures","volume":"1","author":"Judkins","year":"2008","journal-title":"J. Robot. Surg."},{"key":"ref_13","first-page":"1227","article-title":"Construct validation of the ProMIS simulator using a novel laparoscopic suturing task","volume":"19","author":"McClusky","year":"2005","journal-title":"Surg. Endosc. Other Interv. Tech."},{"key":"ref_14","first-page":"8","article-title":"Haptic laparoscopic skills trainer with practical user evaluation metrics","volume":"111","author":"Acosta","year":"2005","journal-title":"Stud. Health Technol. Inform."},{"key":"ref_15","first-page":"372","article-title":"Qualitative and quantitative analysis of the learning curve of a simulated surgical task on the da Vinci system","volume":"18","author":"Hernandez","year":"2004","journal-title":"Surg. Endosc. Other Interv. Tech."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"49","DOI":"10.3109\/10929080209146016","article-title":"Task decomposition of laparoscopic surgery for objective evaluation of surgical residents\u2032 learning curve using hidden Markov model","volume":"7","author":"Rosen","year":"2002","journal-title":"Comput. Aided Surg."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Cao, C., MacKenzie, C., and Payandeh, S. (1996, January 17\u201322). Task and motion analyses in endoscopic surgery. Proceedings of the ASME Dynamic Systems and Control Division, Atlanta, Georgia.","DOI":"10.1115\/IMECE1996-0386"},{"key":"ref_18","unstructured":"Padoy, N., Blum, T., Essa, I., Feussner, H., Berger, M.-O., and Navab, N. (November, January 29). A boosted segmentation method for surgical workflow analysis. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Brisbane, Australia."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Leong, J.J., Nicolaou, M., Atallah, L., Mylonas, G.P., Darzi, A.W., and Yang, G.-Z. (2006, January 1\u20136). HMM assessment of quality of movement trajectory in laparoscopic surgery. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Copenhagen, Denmark.","DOI":"10.1007\/11866565_92"},{"key":"ref_20","unstructured":"Mayer, H., Nagy, I., Knoll, A., Schirmbeck, E.U., and Bauernschmitt, R. (October, January 18). The Endo [PA] R system for minimally invasive robotic surgery. Proceedings of the 2004 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS)(IEEE Cat. No. 04CH37566), Sendai, Japan."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Castellani, A., Botturi, D., Bicego, M., and Fiorini, P. (May, January 26). Hybrid HMM\/SVM model for the analysis and segmentation of teleoperation tasks. Proceedings of the IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA\u203204, New Orleans, LA, USA.","DOI":"10.1109\/ROBOT.2004.1307504"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1007\/s00268-002-6769-7","article-title":"Measurement of surgical dexterity using motion analysis of simple bench tasks","volume":"27","author":"Bann","year":"2003","journal-title":"World J. Surg."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.artmed.2018.08.002","article-title":"Surgical motion analysis using discriminative interpretable patterns","volume":"91","author":"Forestier","year":"2018","journal-title":"Artif. Intell. Med."},{"key":"ref_24","unstructured":"Ko, S.-Y., and Kwon, D.-S. (2004, January 22). A surgical knowledge based interaction method for a laparoscopic assistant robot. Proceedings of the RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No. 04TH8759), Kurashiki, Japan."},{"key":"ref_25","unstructured":"Westwood, J.D. (1999). Gaze patterns in laparoscopic surgery. Medicine Meets Virtual Reality: The Convergence of Physical & Informational Technologies: Options for a New Era in Healthcare, IOS Press."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Speidel, S., Delles, M., Gutt, C., and Dillmann, R. (2006). Tracking of Instruments in Minimally Invasive Surgery for Surgical Skill Analysis, Springer.","DOI":"10.1007\/11812715_19"},{"key":"ref_27","unstructured":"Bracewell, R.N., and Bracewell, R.N. (1986). The Fourier Transform and Its Applications, McGraw-Hill."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2429","DOI":"10.1109\/78.224251","article-title":"Discrete gabor transform","volume":"41","author":"Qian","year":"1993","journal-title":"IEEE Trans.Signal Process."},{"key":"ref_29","unstructured":"Walnut, D.F. (2013). An Introduction to Wavelet Analysis, Springer Science & Business Media."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"786","DOI":"10.1109\/PROC.1979.11328","article-title":"Statistical and structural approaches to texture","volume":"67","author":"Haralick","year":"1979","journal-title":"Proc. IEEE"},{"key":"ref_31","first-page":"1350","article-title":"An overview of image analysis techniques in endoscopic bleeding detection","volume":"1","author":"Brzeski","year":"2013","journal-title":"Int. J. Innov. Res. Comput. Commun. Eng."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/rcs.2166","article-title":"An Entropy-Based Approach to Detect and Localize Intraoperative Bleeding During Minimally Invasive Surgery","volume":"16","author":"Rahbar","year":"2020","journal-title":"Int. J. Med Robot. Comput. Assist. Surg."},{"key":"ref_33","unstructured":"Dinstein, I.H., Fong, A.C., Ni, L.M., and Wong, K.Y. (August, January 30). Fast Discrimination between Homogeneous and Textured Regions. Proceedings of the 7th International Conference on Pattern Recognition, Montreal, QC, Canada."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1437","DOI":"10.1016\/0031-3203(96)00004-0","article-title":"Is there any texture in the image?","volume":"29","author":"Karu","year":"1996","journal-title":"Pattern Recognit."},{"key":"ref_35","unstructured":"Fukunaga, K. (2013). Introduction to Statistical Pattern Recognition, Elsevier."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1109\/TPAMI.2002.1017623","article-title":"Multiresolution gray-scale and rotation invariant texture classification with local binary patterns","volume":"24","author":"Ojala","year":"2002","journal-title":"IEEE Trans. Pattern Analysis Mach. Intell."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1109\/TPAMI.2008.33","article-title":"Texture analysis and segmentation using modulation features, generative models, and weighted curve evolution","volume":"31","author":"Kokkinos","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1016\/0165-1684(88)90015-1","article-title":"Low-level image processing by max-min filters","volume":"15","author":"Verbeek","year":"1988","journal-title":"Signal Process."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Zingman, I., Saupe, D., and Lambers, K. (2012, January 22\u201327). Morphological operators for segmentation of high contrast textured regions in remotely sensed imagery. Proceedings of the 2012 IEEE International Geoscience and Remote Sensing Symposium, Munich, Germany.","DOI":"10.1109\/IGARSS.2012.6350678"},{"key":"ref_40","first-page":"35","article-title":"Morphological method, pca and lda with neural networks-face recognition","volume":"2","author":"Jaiswal","year":"2011","journal-title":"J. Glob. Res. Comput. Sci."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Chaudhari, A., and Kulkarni, J. (2013, January 22\u201323). Local entropy based brain MR image segmentation. Proceedings of the 2013 3rd IEEE International Advance Computing Conference (IACC), Ghaziabad, India.","DOI":"10.1109\/IAdCC.2013.6514403"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","article-title":"A threshold selection method from gray-level histograms","volume":"9","author":"Otsu","year":"1979","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Singh, N.P., Kumar, R., and Srivastava, R. (2015, January 15\u201316). Local entropy thresholding based fast retinal vessels segmentation by modifying matched filter. Proceedings of the International Conference on Computing, Communication & Automation, Noida, India.","DOI":"10.1109\/CCAA.2015.7148552"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/0734-189X(88)90022-9","article-title":"A survey of thresholding techniques","volume":"41","author":"Sahoo","year":"1988","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1183","DOI":"10.1016\/S0301-5629(96)00167-6","article-title":"A two-dimensional extension of minimum cross entropy thresholding for the segmentation of ultrasound images","volume":"22","author":"Zimmer","year":"1996","journal-title":"Ultrasound Med. Biol."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"292","DOI":"10.21037\/acs.2019.02.03","article-title":"Management of robotic bleeding complications","volume":"8","author":"Novellis","year":"2019","journal-title":"Ann. Cardiothorac. Surg."},{"key":"ref_47","first-page":"90","article-title":"Are the surgeon\u2032s movements repeatable? An analysis of the feasibility and expediency of implementing support procedures guiding the surgical tools and increasing motion accuracy during the performance of stereotypical movements by the surgeon","volume":"11","author":"Moll","year":"2014","journal-title":"Kardiochirurgia i torakochirurgia polska = Pol. J. Cardio-Thoracic Surg."},{"key":"ref_48","first-page":"1475","article-title":"Reaction times and the decision-making process in endoscopic surgery","volume":"17","author":"Zheng","year":"2003","journal-title":"Surg. Endosc. Other Interv. Tech."},{"key":"ref_49","first-page":"141","article-title":"Robot-assisted minimally invasive surgical skill assessment\u2014Manual and automated platforms","volume":"16","author":"Haidegger","year":"2019","journal-title":"Acta Polytech. Hung."},{"key":"ref_50","unstructured":"Lin, B. (2015). Visual SLAM and Surface Reconstruction for Abdominal Minimally Invasive Surgery. [Ph.D. Thesis, University of South Florida]."},{"key":"ref_51","unstructured":"Grazzini, J., Turiel, A., and Yahia, H. (2002, January 11\u201315). Entropy estimation and multiscale processing in meteorological satellite images. Proceedings of the Object recognition supported by user interaction for service robots, Quebec City, QC, Canada."}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/10\/1\/37\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:27:35Z","timestamp":1760160455000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/10\/1\/37"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,21]]},"references-count":51,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,3]]}},"alternative-id":["robotics10010037"],"URL":"https:\/\/doi.org\/10.3390\/robotics10010037","relation":{},"ISSN":["2218-6581"],"issn-type":[{"value":"2218-6581","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,21]]}}}