Commit Graph

31 Commits

Author SHA1 Message Date
huangxinjing f5889750f4 Move the AllSwap to the _AllSwap 2021-12-13 14:19:29 +08:00
chujinjin 3c3d8c3962 remove useless python ut 2021-10-15 15:26:45 +08:00
yao_yf 636f82a466 parallel ut modify 2021-10-13 14:28:13 +08:00
lilei 62e832eaab modify parallel API 2021-09-06 11:45:10 +08:00
yao_yf 3ca73a6d6b broadcast using seqarates world group 2021-09-03 11:21:36 +08:00
zhoufeng ecae690a19 Revert "fix same node is used by two comm op"
This reverts commit b09d411dc4.

add AlltoAll and NeighborExchange as interface
2021-08-30 16:54:38 +08:00
Zhang Qinghua a137fa1d0b Optimize the Executors routines.
- Fix the key generating.
- Distinguish the executors.
2021-08-28 17:36:12 +08:00
yao_yf e967f1939b parallel envs variable check 2021-05-07 09:12:53 +08:00
l00591931 9ec100d069 Change TensorAdd to Add, from r1.1 to master 2021-02-01 17:53:52 +08:00
mindspore-ci-bot 9fa0499fa0 Change GatherV2 to Gather r1.1 to master 2021-01-30 14:13:47 +08:00
huangxinjing 565ce81b29 Fix allsawp 2020-12-23 17:17:03 +08:00
mindspore-ci-bot 8980bc3de7 !8675 support allreduce prod
From: @yao_yf
Reviewed-by: @stsuteng,@kisnwang
Signed-off-by: @stsuteng
2020-11-19 20:21:27 +08:00
huangxinjing 23284f0b35 Add AllSwap Op 2020-11-18 18:35:28 +08:00
yao_yf 1529d544b9 add allreduce prod 2020-11-18 11:08:56 +08:00
lichenever aaf7045cdf add checks for init 2020-09-14 14:40:41 +08:00
yao_yf d4cfe55c04 rename mirror_mean to gradients_mean 2020-09-04 14:47:36 +08:00
yao_yf 07117e4dd4 mv ParallelMode to context 2020-08-28 19:13:55 +08:00
Yi Huaijie 394be43492 raise RuntimeError when set different mode after Initializer created 2020-08-24 14:08:09 +08:00
Yi Huaijie 89a4ebf8a1 parallel mode must be set before create an initializer 2020-08-20 19:20:46 +08:00
Yi Huaijie 2eb739de6e change HostAllGather and HostReduceScatter to internal interface 2020-06-23 16:56:04 +08:00
Yi Huaijie 2f8e7ff693 add operator HostAllGather and HostReduceScatter 2020-05-26 17:41:20 +08:00
Yi Huaijie 14fe72f383 fix pylint warnings 2020-05-22 14:54:36 +08:00
jinyaohui 5a914994ba clean pylint 2020-05-18 16:42:35 +08:00
jinyaohui bcfaff97f9 clean pylint 2020-05-18 10:31:46 +08:00
mindspore-ci-bot 5b3327d103 !746 reducescatter backforward operator
Merge pull request !746 from lirongzhen1/bp_reducescatter
2020-04-28 14:11:53 +08:00
lirongzhen1 0b4648881b add reducescatter bprop 2020-04-28 09:58:34 +08:00
zhouyuanshen c046874b03 fix bug in infer_dtype function of hcom operations 2020-04-27 18:49:21 +08:00
yao_yf 371b3338b6 support one node communication group 2020-04-21 21:16:22 +08:00
c00425699 d62f560b50 add_bool_type_check_in_comm_op 2020-04-13 17:34:29 +08:00
buxue 7541d3b067 Develop op MaxPoolWithArgMax 2020-04-08 20:47:49 +08:00
zhunaipan 930a1fb0a8 initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
2020-03-27 22:54:54 +08:00