Provides differentiable communication primitives such as Send/Recv/Gather etc for pytorch. Autograd can backpropagate through those, making distributed model parallel models easy to implement. | |
https://github.com/ag14774/diffdist | |
diffdist-0.1 | GNU GPLv3 |
download~amd64 ~x86 | pypi |