Huawei uses machine translation combined with human proofreading to translate this document to different languages in order to help you better understand the content of this document.
Note: Even the most advanced machine translation cannot match the quality of professional translators.
Huawei shall not bear any responsibility for translation accuracy and it is recommended that you refer to the English document (a link for which has been provided).
Setting the Backward Gradient Segmentation Policy
You can call the gradient segmentation APIs to set the AllReduce segmentation and fusion policy in the backward pass phase.
set_split_strategy_by_idx: sets the backward gradient segmentation policy in the collective communication group based on the gradient index ID.
from hccl.split.api import set_split_strategy_by_idx set_split_strategy_by_idx([20, 100, 159])
set_split_strategy_by_size: sets the backward gradient segmentation policy in the collective communication group by ratio.
from hccl.split.api import set_split_strategy_by_size set_split_strategy_by_size([60, 20, 20])