VizARd (Visual Augmented Reality Assistant for Spatial Mapping) Research Project
Before certain operations are carried out, three-dimensional cross-sectional images (e.g. computed tomography, magnetic resonance tomography) are created to allow precise planning. In future, surgeons should be able to call on an augmented reality solution developed by the VizARd project. The image data can be visualized directly on the patient’s skin at the location of the incision in a way that is both intuitive and user-friendly. The challenge: while there is a great deal of data on the human body and its “inner workings” a body is anything but an immovable “object”. The relative positions of the epidermis, soft tissue and organs change with every shift in the body’s position. To meet these research challenges, the project team makes use of technologies developed over the past few years for assistance systems such as image-based position recognition on the basis of deep-learning technologies. What has hitherto served the digitalization of the operator, his tools and his work pieces in the assembly hall is now being transferred to the medical personnel in the operating theatre. Another central aspect is the changing shape of soft tissue which has to be taken into account when visualizing the image data.
This project receives funding through the Austrian Research Promotion Agency (FFG) under the “IKT der Zukunft” (ICT for the future) scheme.