Orientation Matters: 6-DoF Autonomous Camera Movement for Minimally Invasive Surgery

by   Alaa Eldin Abdelaal, et al.

We propose a new method for six-degree-of-freedom (6-DoF) autonomous camera movement for minimally invasive surgery, which, unlike previous methods, takes into account both the position and orientation information from structures in the surgical scene. In addition to locating the camera for a good view of the manipulated object, our autonomous camera takes into account workspace constraints, including the horizon and safety constraints. We developed a simulation environment to test our method on the "wire chaser" surgical training task from validated training curricula in conventional laparoscopy and robot-assisted surgery. Furthermore, we propose, for the first time, the application of the proposed autonomous camera method in video-based surgical skill assessment, an area where videos are typically recorded using fixed cameras. In a study with N=30 human subjects, we show that video examination of the autonomous camera view as it tracks the ring motion over the wire leads to more accurate user error (ring touching the wire) detection than when using a fixed camera view, or camera movement with a fixed orientation. Our preliminary work suggests that there are potential benefits to autonomous camera positioning informed by scene orientation, and this can direct designers of automated endoscopes and surgical robotic systems, especially when using chip-on-tip cameras that can be wristed for 6-DoF motion.


page 1

page 3

page 4


A Reactive Autonomous Camera System for the RAVEN II Surgical Robot

The endoscopic camera of a surgical robot provides surgeons with a magni...

Predicting the Timing of Camera Movements From the Kinematics of Instruments in Robotic-Assisted Surgery Using Artificial Neural Networks

Robotic-assisted surgeries benefit both surgeons and patients, however, ...

Deep Selection: A Fully Supervised Camera Selection Network for Surgery Recordings

Recording surgery in operating rooms is an essential task for education ...

Autonomous task planning and situation awareness in robotic surgery

The use of robots in minimally invasive surgery has improved the quality...

Stargazer: An Interactive Camera Robot for Capturing How-To Videos Based on Subtle Instructor Cues

Live and pre-recorded video tutorials are an effective means for teachin...

CineMPC: Controlling Camera Intrinsics and Extrinsics for Autonomous Cinematography

We present CineMPC, an algorithm to autonomously control a UAV-borne vid...

Effect of Timing Error: A Case Study of Navigation Camera

We focus on the problem of timing errors in navigation camera as a case ...

Please sign up or login with your details

Forgot password? Click here to reset