Augmented Reality system to help medical professionals

Researcher(s)

Dr Ian Williams, Digital Media Technology (DMT) Lab

Background

Academics at Birmingham City University's DMT Lab are developing a mixed reality system that'll allow medical practitioners to view and interact with virtual replicas of patients' organs, bones and/or body parts.

Method

The system allows users to manipulate, navigate and demonstrate patient data using hand motions and gestures, so that practitioners can showcase medical procedures, lifestyle choices and treatment effects using customised 3D virtual models and patients' real medical records. It could also be used to demonstrate medical problems, the areas where surgery will be conducted, improvements which could be made following treatment or the damage caused by harmful addictive substances such as tobacco.

The technology uses motion detecting sensors, combined with DMT Lab expertise in freehand interaction in mixed reality, to create a more realistic experience in virtual environments, bridging the gap between users and technology.

Aims

The system will help practitioners by creating a new way to view patient data in an array of settings, as well as enabling medical practitioners to showcase medical procedures and treatment effects on customised medical models. The use of customised models and the interactive environment that can be shared with the patient will also help to boost patients' engagement and understanding with their treatment.