MLI: An API for Distributed Machine Learning
Evan Sparks, Ameet Talwalkar, Virginia Smith et al. · Proceedings · 2013
MLI is an Application Programming Interface designed to address the challenges of building Machine Learning algorithms in a distributed setting based on data-centric computing. Its primary goal is to simplify the development of high-performance, scalable, distributed algorithms. Our initial results show that, relative to existing systems, this interface can be used to build distributed implementations of a wide variety of common Machine Learning algorithms with minimal complexity and highly competitive performance and scalability.
Cited by 145 works. doi:10.1109/icdm.2013.158
Authors
- Evan Sparks
- Ameet Talwalkar
- Virginia Smith
- Jey Kottalam
- Xinghao Pan
- Joseph E. Gonzalez
- Michael J. M. Franklin
- Michael I. Jordan
- Tim Kraska
References
- ImageNet: A large-scale hierarchical image database
- LIBLINEAR: A Library for Large Linear Classification
- Matrix Factorization Techniques for Recommender Systems
- Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing
- DryadLINQ: a system for general-purpose distributed data-parallel computing using a high-level language
- PowerGraph: distributed graph-parallel computation on natural graphs
- MLbase: A Distributed Machine-learning System
- GraphLab: A New Framework For Parallel Machine Learning
- SystemML: Declarative machine learning on MapReduce
- Hyracks: A flexible and extensible foundation for data-intensive computing