Horovod (machine learning) explained

Horovod
Developer:	Uber
Released:	^[1]
Latest Release Version:	v0.28.1^[2]
Programming Language:	Python, C++, CUDA
Platform:	Linux, macOS, Windows
Genre:	Artificial intelligence ecosystem
License:	Apache License 2.0

Horovod is a free and open-source software framework for distributed deep learning training using TensorFlow, Keras, PyTorch, and Apache MXNet. Horovod is hosted under the Linux Foundation AI (LF AI).^[3] Horovod has the goal of improving the speed, scale, and resource allocation when training a machine learning model.^[4]

See also

• Comparison of deep learning software
• Differentiable programming
• All-Reduce

Notes and References

1. Web site: Release v0.9.0 · horovod/horovod . Alex Sergeev . horovod . 9 August 2017 . 9 July 2020 . Initial release .
2. Web site: Releases · horovod/horovod . horovod . 11 July 2023 .
3. Web site: Uber brings Horovod project for distributed deep learning to Linux Foundation . Khari Johnson . VentureBeat . 13 December 2018 . 9 July 2020 .
4. Web site: Projects - LF AI . Linux Foundation - LF AI . 9 July 2020 . Horovod, a distributed training framework for TensorFlow, Keras and PyTorch, improves speed, scale and resource allocation in machine learning training activities. Uber uses Horovod for self-driving vehicles, fraud detection, and trip forecasting. It is also being used by Alibaba, Amazon and NVIDIA. .