Commit f8276b39 authored by Laanait, Nouamane's avatar Laanait, Nouamane

add readme

parent 6a150cc0
### Description
See code under **mpi_nccl_groups**:
1. ``: Demonstrates how to use a single mpi process to "control" a single device that is communicating with other devices using multiple communicators. All communication across devices is done using `nccl`. We spawn multiple mpi sub-communicators, then inherit on the `nccl` side.
2. ``: Same as before, except each mpi process controls multiple devices and there is communication across devices and across groups of devices.
\ No newline at end of file
Markdown is supported
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment