MLI: An API for Distributed Machine Learning
Evan Sparks, Ameet Talwalkar, Virginia Smith et al. · arXiv (Cornell University) · 2013
MLI is an Application Programming Interface designed to address the challenges of building Machine Learn- ing algorithms in a distributed setting based on data-centric computing. Its primary goal is to simplify the development of high-performance, scalable, distributed algorithms. Our initial results show that, relative to existing systems, this interface can be used to build distributed implementations of a wide variety of common Machine Learning algorithms with minimal complexity and highly competitive performance and scalability.
Cited by 32 works. doi:10.48550/arxiv.1310.5426 Open-access PDF
Authors
- Evan Sparks
- Ameet Talwalkar
- Virginia Smith
- Jey Kottalam
- Xinghao Pan
- Joseph E. Gonzalez
- Michael J. M. Franklin
- Michael I. Jordan
- Tim Kraska
References
- ImageNet: A large-scale hierarchical image database
- Matrix Factorization Techniques for Recommender Systems
- DryadLINQ: a system for general-purpose distributed data-parallel computing using a high-level language
- PowerGraph: distributed graph-parallel computation on natural graphs
- MLbase: A Distributed Machine-learning System
- GraphLab: A New Framework For Parallel Machine Learning
- SystemML: Declarative machine learning on MapReduce
- SEJITS: Getting Productivity and Performance With Selective Embedded JIT Specialization
- Scaling Datalog for Machine Learning on Big Data
- The MADlib Analytics Library or MAD Skills, the SQL