Augmented Reality Simulator for Training in Two-Dimensional Echocardiography

Abstract

In two-dimensional echocardiography the sonographer must synthesize multiple tomographic slices into a mental three-dimensional (3D) model of the heart. Computer graphics and virtual reality environments are ideal to visualize complex 3D spatial relationships. In augmented reality (AR) applications, real and virtual image data are linked, to increase the information content. In the presented AR simulator a 3D surface model of the human heart is linked with echocardiographic volume data sets. The 3D echocardiographic data sets are registered with the heart model to establish spatial and temporal congruence. The heart model, together with an animated ultrasound sector represents a reference scenario, which displays the currently selected two-dimensional echocardiographic cutting plane calculated from the volume data set. Modifications of the cutting plane within the echocardiographic data are transferred and visualized simultaneously and in real time within the reference scenario. The trainee can interactively explore the 3D heart model and the registered 3D echocardiographic data sets by an animated ultrasound probe, whose position is controlled by an electromagnetic tracking system. The tracking system is attached to a dummy transducer and placed on a plastic puppet to give a realistic impression of a two-dimensional echocardiographic examination.