Tutorials

Tutorial AR/VR:
Perceptual Capacities and Constraints in AR/VR for the visualization of 3D biomedical image data

Roy Eagleson (CDN), Georges Hattab (D)

The use of AR and VR modalities for visualization of 3D biomedical image data is feasible thanks to a growing number of hardware and software solutions. As the technical challenges and development hurdles subside, it is increasingly important to consider the special capacities and constraints of the human perceptual, motor, and cognitive systems. From a system design perspective, empirical research into the human-computer interface performance should inform the development process. We will present essential design notions including, but not limited to, task oriented design, lateral and vertical transformations, and user interface design principles. For the purpose of this tutorial, we plan a practical or hands-on session. Given different visualization tasks, participants work in small groups to create appropriate visualizations.

Tutorial SlicerIGT:
Deep learning and computer vision for real-time procedure annotation

Tamas Ungi (CDN), Sonia M. Pujol (USA), Javier Pascau (E), Gabor Fichtinger (CDN)

SlicerIGT is an established open-source platform for navigation of interventional medical procedures. It has been used to implement experimental and clinical research systems in many specialties from ultrasound-guided injections to brain surgery. The platform supports real time communication with most tracking, imaging, and sensor devices. It also supports communication with major commercial navigation systems to experiment with additional features for existing procedures. The tutorial will focus on computer vision and deep learning for real time annotation of surgical events. The tutorial consists of two sessions. First, invited speakers give an overview of open-source resources and talk about their vision for the future applications of these research tools. In the second session, the audience will build a working surgical simulation software on their laptops, using devices provided by the presenters. Participants will gain hands-on experience in the basics of intervention navigation technology, as well as integration of advanced real-time image processing algorithms.

Tutorial on Applied Deep Learning for Medical Scientists working with Image Data

Daniel L├╝ckehe (D), Gabriele von Voigt (D)

In this tutorial, we show medical scientists how to use methods from the field of deep learning (DL) as tools to solve problems in their decision processes. It is designed for medical experts with no or only a little experience in the field of DL. No prior knowledge is required. An introduction to the field of Deep Learning (DL) and neural network implementations with Tensorflow is given. Then, there will be hands-on examples for three types of Deep Neural Networks (DNNs) which are especially relevant for the medical field: Convolutional Neural Networks, Deep Residual Networks, and the U-Net from Convolutional Networks for Biomedical Image Segmentation.

Tutorial on Advanced Deep Learning for Medical Imaging Data

John D.H. Baxter (F)

This tutorial will focus on the following points: 1) Introduction to complex loss functions and how they relate to the underlying medical imaging problem: Interpret output activation functions and develop losses accordingly, introduce adversarial networks in the context of loss functions and 2) Introduce GANs and discuss mode collapse.