Python Array API Standard: Toward Array Interoperability in the Scientific Python Ecosystem
Aaron Meurer, Athan Reines, Ralf Gommers et al. · Proceedings of the Python in Science Conferences · 2023
The Python array API standard specifies standardized application programming interfaces (APIs) and behaviors for array and tensor objects and operations as commonly found in libraries such as NumPy [1], CuPy [2], PyTorch [3], JAX [4], TensorFlow [5], Dask [6], and MXNet [7]. The establishment and subsequent adoption of the standard aims to reduce ecosystem fragmentation and facilitate array library interoperability in user code and among array-consuming libraries, such as scikit-learn [8] and SciPy [9].A key benefit of array interoperability for downstream consumers of the standard is device agnosticism, whereby previously CPU-bound implementations can more readily leverage hardware acceleration via graphics processing units (GPUs), tensor processing units (TPUs), and other accelerator devices.In this paper, we first introduce the Consortium for Python Data API Standards and define the scope of the array API standard.We then discuss the current status of standardization and associated tooling (including a test suite and compatibility layer).We conclude by outlining plans for future work.
Cited by 4 works. doi:10.25080/gerudo-f2bc6f59-001 Open-access PDF
Authors
- Aaron Meurer
- Athan Reines
- Ralf Gommers
- Yao-Lung L. Fang
- Stephan Hoyer
- Sheng Zha
- Saul Shanabrook
- Stephannie Jimenz Gacha
- Mario Lezcano-Casado
- Thomas Fan
- Tyler J. Reddy
- Alexandre Passos
- Travis E. Oliphant
References
- Scikit-learn: Machine Learning in Python
- Matplotlib: A 2D Graphics Environment
- The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms
- SciPy 1.0: fundamental algorithms for scientific computing in Python
- TensorFlow: A system for large-scale machine learning
- The NumPy Array: A Structure for Efficient Numerical Computation
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
- Array programming with NumPy
- SciPy 1.0: fundamental algorithms for scientific computing in Python
- scikit-image: image processing in Python