inarizuuuushi https://blog.hatena.ne.jp/inarizuuuushi/ Sabrou-mal サブロウ丸 https://inarizuuuushi.hatenablog.com/ 分散処理 MPI 故きを温ねて新しきを知る Fast Multi-GPU collectives with NCCL NCCL: Collective Operations Collective communication: theory, practice, and experience A Generalization of the Allreduce Operation TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches A Communication Efficient ADMM-based Distrib… 190 <iframe src="https://hatenablog-parts.com/embed?url=https%3A%2F%2Finarizuuuushi.hatenablog.com%2Fentry%2F2023%2F07%2F17%2F090000" title="集団通信の可視化方法について - Sabrou-mal サブロウ丸" class="embed-card embed-blogcard" scrolling="no" frameborder="0" style="display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;"></iframe> https://github.com/nariaki3551/library/assets/21208556/3169ba8b-1606-49eb-8b16-164f527a4c35 Hatena Blog https://hatena.blog 2023-07-17 09:00:00 rich https://inarizuuuushi.hatenablog.com/entry/2023/07/17/090000 1.0 100%