Medical Image Analysis using Deep Relational Learning

03/28/2023
by   Zhihua Liu, et al.
0

In the past ten years, with the help of deep learning, especially the rapid development of deep neural networks, medical image analysis has made remarkable progress. However, how to effectively use the relational information between various tissues or organs in medical images is still a very challenging problem, and it has not been fully studied. In this thesis, we propose two novel solutions to this problem based on deep relational learning. First, we propose a context-aware fully convolutional network that effectively models implicit relation information between features to perform medical image segmentation. The network achieves the state-of-the-art segmentation results on the Multi Modal Brain Tumor Segmentation 2017 (BraTS2017) and Multi Modal Brain Tumor Segmentation 2018 (BraTS2018) data sets. Subsequently, we propose a new hierarchical homography estimation network to achieve accurate medical image mosaicing by learning the explicit spatial relationship between adjacent frames. We use the UCL Fetoscopy Placenta dataset to conduct experiments and our hierarchical homography estimation network outperforms the other state-of-the-art mosaicing methods while generating robust and meaningful mosaicing result on unseen frames.

READ FULL TEXT

page 30

page 38

page 39

research
08/21/2019

Boundary Aware Networks for Medical Image Segmentation

Fully convolutional neural networks (CNNs) have proven to be effective a...
research
03/10/2021

TransMed: Transformers Advance Multi-modal Medical Image Classification

Over the past decade, convolutional neural networks (CNN) have shown ver...
research
04/22/2020

A review: Deep learning for medical image segmentation using multi-modality fusion

Multi-modality is widely used in medical imaging, because it can provide...
research
04/17/2023

When SAM Meets Medical Images: An Investigation of Segment Anything Model (SAM) on Multi-phase Liver Tumor Segmentation

Learning to segmentation without large-scale samples is an inherent capa...
research
10/29/2020

Volumetric Medical Image Segmentation: A 3D Deep Coarse-to-fine Framework and Its Adversarial Examples

Although deep neural networks have been a dominant method for many 2D vi...
research
07/29/2022

Beyond CNNs: Exploiting Further Inherent Symmetries in Medical Image Segmentation

Automatic tumor or lesion segmentation is a crucial step in medical imag...
research
02/08/2023

Multi-Modal Evaluation Approach for Medical Image Segmentation

Manual segmentation of medical images (e.g., segmenting tumors in CT sca...

Please sign up or login with your details

Forgot password? Click here to reset