Multisource Transfer Learning With Convolutional Neural Networks for Lung Pattern Analysis
Stergios Christodoulidis, Marios Anthimopoulos, Lukas Ebner et al. · IEEE Journal of Biomedical and Health Informatics · 2016
Early diagnosis of interstitial lung diseases is crucial for their treatment, but even experienced physicians find it difficult, as their clinical manifestations are similar. In order to assist with the diagnosis, computer-aided diagnosis systems have been developed. These commonly rely on a fixed scale classifier that scans CT images, recognizes textural lung patterns, and generates a map of pathologies. In a previous study, we proposed a method for classifying lung tissue patterns using a deep convolutional neural network (CNN), with an architecture designed for the specific problem. In this study, we present an improved method for training the proposed network by transferring knowledge from the similar domain of general texture classification. Six publicly available texture databases are used to pretrain networks with the proposed architecture, which are then fine-tuned on the lung tissue data. The resulting CNNs are combined in an ensemble and their fused knowledge is compressed back to a network with the original architecture. The proposed approach resulted in an absolute increase of about 2% in the performance of the proposed CNN. The results demonstrate the potential of transfer learning in the field of medical image analysis, indicate the textural nature of the problem and show that the method used for training a network can be as important as designing its architecture.
Cited by 296 works. doi:10.1109/jbhi.2016.2636929 Open-access PDF
Authors
References
- ImageNet classification with deep convolutional neural networks
- Gradient-based learning applied to document recognition
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Adam: A Method for Stochastic Optimization
- A Survey on Transfer Learning
- Distilling the Knowledge in a Neural Network
- Multitask Learning
- CNN Features Off-the-Shelf: An Astounding Baseline for Recognition
- Ensemble Methods in Machine Learning
- How transferable are features in deep neural networks?