We should evaluate if we could leverage these horovod interfaces:
Communication Profiling and Characterization of Deep-Learning Workloads on Clusters With High-Performance Interconnects
DOI: 10.1109/MM.2019.2949986
https://ieeexplore.ieee.org/abstract/document/8887216
We should evaluate if we could leverage these horovod interfaces:
Communication Profiling and Characterization of Deep-Learning Workloads on Clusters With High-Performance Interconnects
DOI: 10.1109/MM.2019.2949986
https://ieeexplore.ieee.org/abstract/document/8887216