10/04/2017
1:30 pm - 4:00 pm
Expo Hall/Career Fair

Objective: Inspiration
Audience Level: All
Session Type: Poster

While medical imaging technology may have improved the visualization of anatomy during surgery, verbal communication is inefficient to clarify images on screen. Since surgeons must keep their hands sterile, they cannot use standard equipment like a computer mouse to point out structures. Potentially, non-touch gesture-based annotation systems will improve communication efficiency, and thus surgical outcomes. In our study, we analyze changes in communication patterns between instructor and student in a simulated surgical training setting with a gesture-based annotation system. We use the Microsoft Kinect to translate arm movements and hand gestures into annotations, superimposed on live video feed.

Speaker(s)