TensorFlow: A system for large-scale machine learning
Martı́n Abadi, Paul Barham, Chen, Jianmin et al. · arXiv (Cornell University) · 2016
TensorFlow is a machine learning system that operates at large scale and in heterogeneous environments. TensorFlow uses dataflow graphs to represent computation, shared state, and the operations that mutate that state. It maps the nodes of a dataflow graph across many machines in a cluster, and within a machine across multiple computational devices, including multicore CPUs, general-purpose GPUs, and custom designed ASICs known as Tensor Processing Units (TPUs). This architecture gives flexibility to the application developer: whereas in previous "parameter server" designs the management of shared state is built into the system, TensorFlow enables developers to experiment with novel optimizations and training algorithms. TensorFlow supports a variety of applications, with particularly strong support for training and inference on deep neural networks. Several Google services use TensorFlow in production, we have released it as an open-source project, and it has become widely used for machine learning research. In this paper, we describe the TensorFlow dataflow model in contrast to existing systems, and demonstrate the compelling performance that TensorFlow achieves for several real-world applications.
Cited by 11,822 works. doi:10.48550/arxiv.1605.08695 Open-access PDF
Authors
- Martı́n Abadi
- Paul Barham
- Zhifeng Chen
- Andy Davis
- Matthieu Devin
- Sanjay Ghemawat
- Geoffrey Irving
- Michael Isard
- Manjunath Kudlur
- Josh Levenberg
- Rajat Monga
- Sherry Moore
- Derek Gordon Murray
- Benoit Steiner
- Vijay Vasudevan
- Pete Warden
- Martin Wicke
References
- Deep Residual Learning for Image Recognition
- ImageNet classification with deep convolutional neural networks
- Long Short-Term Memory
- Going deeper with convolutions
- Learning representations by back-propagating errors
- ImageNet Large Scale Visual Recognition Challenge
- Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
- Efficient Estimation of Word Representations in Vector Space
- Human-level control through deep reinforcement learning
- Large Scale Distributed Deep Networks