Nvidia, a giant in the HPC industry, acquired Mellanox, a network chip company, for nearly $7billion. This is a clear signal of how valuable fast interconnects between machines are for distributed training (and all the other HPC and ML applications that Nvidia works on).
Nvidia, a giant in the HPC industry, acquired Mellanox, a network chip company, for nearly $7billion. This is a clear signal of how valuable fast interconnects between machines are for distributed training (and all the other HPC and ML applications that Nvidia works on).