Horovod — Uber’s open source distributed Deep Learning framework

Horovod is a distributed training framework for TensorFlow. The goal of Horovod is to make distributed Deep Learning fast and easy to use.