Enhancing Annotation Efficiency with Machine Learning: Automated Partitioning of a Lung Ultrasound Dataset by View
Bennett VanBerlo, Delaney Smith, Jared N. Tschirhart et al. · Diagnostics · 2022
BACKGROUND: Annotating large medical imaging datasets is an arduous and expensive task, especially when the datasets in question are not organized according to deep learning goals. Here, we propose a method that exploits the hierarchical organization of annotating tasks to optimize efficiency. METHODS: We trained a machine learning model to accurately distinguish between one of two classes of lung ultrasound (LUS) views using 2908 clips from a larger dataset. Partitioning the remaining dataset by view would reduce downstream labelling efforts by enabling annotators to focus on annotating pathological features specific to each view. RESULTS: In a sample view-specific annotation task, we found that automatically partitioning a 780-clip dataset by view saved 42 min of manual annotation time and resulted in 55±6 additional relevant labels per hour. CONCLUSIONS: Automatic partitioning of a LUS dataset by view significantly increases annotator efficiency, resulting in higher throughput relevant to the annotating task at hand. The strategy described in this work can be applied to other hierarchical annotation schemes.
Cited by 5 works. doi:10.3390/diagnostics12102351 Open-access PDF
Authors
- Bennett VanBerlo
- Delaney Smith
- Jared N. Tschirhart
- Blake VanBerlo
- Derek Wu
- Alex Ford
- Joseph McCauley
- Rushil Chaudhary
- Chintan Dave
- Jordan Ho
- Jason Deglint
- Brian Li
- Robert T. Arntfield
References
- Deep Residual Learning for Image Recognition
- ImageNet: A large-scale hierarchical image database
- Dropout: a simple way to prevent neural networks from overfitting
- Rethinking the Inception Architecture for Computer Vision
- EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
- Relevance of Lung Ultrasound in the Diagnosis of Acute Respiratory Failure*: The BLUE Protocol
- The Comet-tail Artifact
- Grad-CAM++: Generalized Gradient-Based Visual Explanations for Deep Convolutional Networks
- Lung ultrasound in the critically ill
- BLUE-Protocol and FALLS-Protocol