Multi-task Attention-Based Semi-supervised Learning for Medical Image Segmentation
Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review
We propose a novel semi-supervised image segmentation method that simultaneously optimizes a supervised segmentation and an unsupervised reconstruction objectives. The reconstruction objective uses an attention mechanism that separates the reconstruction of image areas corresponding to different classes. The proposed approach was evaluated on two applications: brain tumor and white matter hyperintensities segmentation. Our method, trained on unlabeled and a small number of labeled images, outperformed supervised CNNs trained with the same number of images and CNNs pre-trained on unlabeled data. In ablation experiments, we observed that the proposed attention mechanism substantially improves segmentation performance. We explore two multi-task training strategies: joint training and alternating training. Alternating training requires fewer hyperparameters and achieves a better, more stable performance than joint training. Finally, we analyze the features learned by different methods and find that the attention mechanism helps to learn more discriminative features in the deeper layers of encoders.
Original language | English |
---|---|
Title of host publication | Medical Image Computing and Computer Assisted Intervention – MICCAI 2019 - 22nd International Conference, Proceedings |
Editors | Dinggang Shen, Pew-Thian Yap, Tianming Liu, Terry M. Peters, Ali Khan, Lawrence H. Staib, Caroline Essert, Sean Zhou |
Number of pages | 9 |
Publisher | Springer VS |
Publication date | 1 Jan 2019 |
Pages | 457-465 |
ISBN (Print) | 9783030322472 |
DOIs | |
Publication status | Published - 1 Jan 2019 |
Event | 22nd International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2019 - Shenzhen, China Duration: 13 Oct 2019 → 17 Oct 2019 |
Conference
Conference | 22nd International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2019 |
---|---|
Land | China |
By | Shenzhen |
Periode | 13/10/2019 → 17/10/2019 |
Series | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
---|---|
Volume | 11766 LNCS |
ISSN | 0302-9743 |
- Attention, Brain tumor, Deep learning, Multi-task learning, Segmentation, Semi-supervised learning, White matter hyperintensities
Research areas
Links
- http://arxiv.org/pdf/1907.12303
Submitted manuscript
ID: 231952993