FlexISP
Felix Heide, Markus Steinberger, Yun‐Ta Tsai et al. · ACM Transactions on Graphics · 2014
Conventional pipelines for capturing, displaying, and storing images are usually defined as a series of cascaded modules, each responsible for addressing a particular problem. While this divide-and-conquer approach offers many benefits, it also introduces a cumulative error, as each step in the pipeline only considers the output of the previous step, not the original sensor data. We propose an end-to-end system that is aware of the camera and image model, enforces natural-image priors, while jointly accounting for common image processing steps like demosaicking, denoising, deconvolution, and so forth, all directly in a given output representation (e.g., YUV, DCT). Our system is flexible and we demonstrate it on regular Bayer images as well as images from custom sensors. In all cases, we achieve large improvements in image quality and signal reconstruction compared to state-of-the-art techniques. Finally, we show that our approach is capable of very efficiently handling high-resolution images, making even mobile implementations feasible.
Cited by 292 works. doi:10.1145/2661229.2661260
Authors
- Felix Heide
- Markus Steinberger
- Yun‐Ta Tsai
- Mushfiqur Rouf
- Dawid Pająk
- Orazio Gallo
- Jing Liu
- Wolfgang Heidrich
- Karen Egiazarian
- Jan Kautz
- Kari Pulli
References
- Nonlinear total variation based noise removal algorithms
- The JPEG still picture compression standard
- Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering
- A Non-Local Algorithm for Image Denoising
- Improving resolution by image registration
- A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging
- Curvelets: A Surprisingly Effective Nonadaptive Representation for Objects with Edges
- Proximal Algorithms
- From learning models of natural image patches to whole image restoration
- SIFT Flow: Dense Correspondence across Different Scenes