Model-Based and Data-Driven Strategies in Medical Image Computing

09/23/2019
by   Daniel Rueckert, et al.
30

Model-based approaches for image reconstruction, analysis and interpretation have made significant progress over the last decades. Many of these approaches are based on either mathematical, physical or biological models. A challenge for these approaches is the modelling of the underlying processes (e.g. the physics of image acquisition or the patho-physiology of a disease) with appropriate levels of detail and realism. With the availability of large amounts of imaging data and machine learning (in particular deep learning) techniques, data-driven approaches have become more widespread for use in different tasks in reconstruction, analysis and interpretation. These approaches learn statistical models directly from labelled or unlabeled image data and have been shown to be very powerful for extracting clinically useful information from medical imaging. While these data-driven approaches often outperform traditional model-based approaches, their clinical deployment often poses challenges in terms of robustness, generalization ability and interpretability. In this article, we discuss what developments have motivated the shift from model-based approaches towards data-driven strategies and what potential problems are associated with the move towards purely data-driven approaches, in particular deep learning. We also discuss some of the open challenges for data-driven approaches, e.g. generalization to new unseen data (e.g. transfer learning), robustness to adversarial attacks and interpretability. Finally, we conclude with a discussion on how these approaches may lead to the development of more closely coupled imaging pipelines that are optimized in an end-to-end fashion.

READ FULL TEXT

page 5

page 9

page 15

research
03/12/2019

Parallel Medical Imaging: A New Data-Knowledge-Driven Evolutionary Framework for Medical Image Analysis

There has been much progress in data-driven artificial intelligence tech...
research
10/24/2021

Light-Field Microscopy for optical imaging of neuronal activity: when model-based methods meet data-driven approaches

Understanding how networks of neurons process information is one of the ...
research
06/23/2019

A Review on Deep Learning in Medical Image Reconstruction

Medical imaging is crucial in modern clinics to guide the diagnosis and ...
research
03/29/2022

Synergizing Physics/Model-based and Data-driven Methods for Low-Dose CT

Since 2016, deep learning (DL) has advanced tomographic imaging with rem...
research
04/09/2022

Ultrasound Signal Processing: From Models to Deep Learning

Medical ultrasound imaging relies heavily on high-quality signal process...
research
04/29/2021

Predicting publication productivity for authors: Shallow or deep architecture?

Academic administrators and funding agencies must predict the publicatio...
research
06/21/2019

Database Meets Deep Learning: Challenges and Opportunities

Deep learning has recently become very popular on account of its incredi...

Please sign up or login with your details

Forgot password? Click here to reset