Opt
Zachary DeVito, Michael Mara, Michael Zollhöfer et al. · ACM Transactions on Graphics · 2017
Many graphics and vision problems can be expressed as non-linear least squares optimizations of objective functions over visual data, such as images and meshes. The mathematical descriptions of these functions are extremely concise, but their implementation in real code is tedious, especially when optimized for real-time performance on modern GPUs in interactive applications. In this work, we propose a new language, Opt, 1 for writing these objective functions over image- or graph-structured unknowns concisely and at a high level. Our compiler automatically transforms these specifications into state-of-the-art GPU solvers based on Gauss-Newton or Levenberg-Marquardt methods. Opt can generate different variations of the solver, so users can easily explore tradeoffs in numerical precision, matrix-free methods, and solver approaches. In our results, we implement a variety of real-world graphics and vision applications. Their energy functions are expressible in tens of lines of code and produce highly optimized GPU solver implementations. These solvers are competitive in performance with the best published hand-tuned, application-specific GPU solvers, and orders of magnitude beyond a general-purpose auto-generated solver.
Cited by 43 works. doi:10.1145/3132188
Authors
- Zachary DeVito
- Michael Zollhöfer
- Gilbert Bernstein
- Jonathan Ragan‐Kelley
- Christian Theobalt
- Pat Hanrahan
- Matthew Fisher
- Matthias Nießner
References
- Convex Optimization
- An Algorithm for Least-Squares Estimation of Nonlinear Parameters
- A method for the solution of certain non-linear problems in least squares
- Determining optical flow
- Determining Optical Flow
- Lightness and Retinex Theory
- Numerical Optimization
- Photo tourism
- Bundle Adjustment — A Modern Synthesis
- Numerical methods for least squares problems