Collective communication includes many kinds of global communication, such as Broadcast, Barrier, Reduce, Scatter, Gather etc.

• 聚合通信包括很多全局操作,比如广播通信(Broadcast),同步(Barrier)、全局归约(Reduce),散布(Scatter)、聚集(gather)等等。