Tehran University of Medical Sciences

Science Communicator Platform

Stay connected! Follow us on X network (Twitter):
Share this content! On (X network) By
Automatic Tracking of Laparoscopic Instruments for Autonomous Control of a Cameraman Robot Publisher Pubmed



Amini Khoiy K1, 2 ; Mirbagheri A1, 3 ; Farahmand F1, 4
Authors
Show Affiliations
Authors Affiliations
  1. 1. RCBTR, Tehran University of Medical Sciences, Tehran, Iran
  2. 2. Biomedical Engineering Department, University of Akron, Akron, Ohio, United States
  3. 3. Medical Physics and Biomedical Engng. Dept., School of Medicine, Tehran University of Medical Sciences, Tehran, Iran
  4. 4. Mechanical Engineering Department, Sharif University of Technology, Biomechanics and Biomedical Robotics Section, Azadi Avenue, Tehran, Iran

Source: Minimally Invasive Therapy and Allied Technologies Published:2016


Abstract

Background An automated instrument tracking procedure was designed and developed for autonomous control of a cameraman robot during laparoscopic surgery. Material and methods The procedure was based on an innovative marker-free segmentation algorithm for detecting the tip of the surgical instruments in laparoscopic images. A compound measure of Saturation and Value components of HSV color space was incorporated that was enhanced further using the Hue component and some essential characteristics of the instrument segment, e.g., crossing the image boundaries. The procedure was then integrated into the controlling system of the RoboLens cameraman robot, within a triple-thread parallel processing scheme, such that the tip is always kept at the center of the image. Results Assessment of the performance of the system on prerecorded real surgery movies revealed an accuracy rate of 97% for high quality images and about 80% for those suffering from poor lighting and/or blood, water and smoke noises. A reasonably satisfying performance was also observed when employing the system for autonomous control of the robot in a laparoscopic surgery phantom, with a mean time delay of 200ms. Conclusion It was concluded that with further developments, the proposed procedure can provide a practical solution for autonomous control of cameraman robots during laparoscopic surgery operations. © 2016 Taylor & Francis.