Volume visualization using a spatially aware mobile display device

Abstract

Volume visualization is a difficult three-dimensional task and a significant amount of research is devoted to the development of a suitable computer input device for it. Most of the proposed models use fixed displays, thus rendering extracted slices in orientations unrelated to their real locations within the volume. We present a new device which takes a different approach, as it leaves the volume in a fixed location and demands the user to change his or her posture to explore it from different angles. To implement this, we built a prototype based on a mobile display equipped with sensors that allows it to track its position, which is related to the location of the slice plane within the volume. Therefore, the user can manipulate this plane by displacing and rotating the display, which is a very intuitive method with minimum learning time. Furthermore, the postural changes required to use the device add a new channel of feedback, which effectively helps to reduce the cognitive load imposed on the user. We built a prototype device and tested it with two groups of volunteers who were asked to use it in a medical imaging application. Statistical analysis of the results shows that explorations made with the proposed device were considerably faster with no penalty in precision. We believe that, with further work, the proposed device can be developed into an useful tool for radiology and neurosurgery.