Transfer-Based Semantic Anomaly Detection
Lucas Deecke, Lukas Ruff, Robert A. Vandermeulen et al. · Edinburgh Research Explorer (University of Edinburgh) · 2021
Detecting semantic anomalies is challenging due to the countless ways in which they may appear in real-world data. While enhancing the robustness of networks may be sufficient for modeling simplistic anomalies, there is no good known way of preparing models for all potential and unseen anomalies that can potentially occur, such as the appearance of new object classes. In this paper, we show that a previously overlooked strategy for anomaly detection (AD) is to introduce an explicit inductive bias toward representations transferred over from some large and varied semantic task. We rigorously verify our hypothesis in controlled trials that utilize intervention, and show that it gives rise to surprisingly effective auxiliary objectives that outperform previous AD paradigms.
Cited by 5 works.
Authors
References
- Deep Residual Learning for Image Recognition
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
- Backpropagation Applied to Handwritten Zip Code Recognition
- Learning Multiple Layers of Features from Tiny Images
- Visualizing and Understanding Convolutional Networks
- Visualizing Data using t-SNE
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
- GAN(Generative Adversarial Nets)
- DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
- 80 Million Tiny Images: A Large Data Set for Nonparametric Object and Scene Recognition