Ziyan
|
d19d42ee44
|
modify grad accu and comm fusion api
|
2021-03-19 15:11:40 +08:00 |
liujunzhu
|
6541b96c40
|
Add communication parallel mode.
|
2021-03-05 21:36:03 +08:00 |
yangzhenzhang
|
7303c3d3b8
|
add group ckpt
|
2021-01-21 14:41:05 +08:00 |
yangzhenzhang
|
9da3f9bec9
|
mini step grad accumulation
|
2021-01-06 09:25:06 +08:00 |
lizhenyu
|
7eb49cfce7
|
[bugfix] server core dump after traning
|
2020-12-28 20:25:45 +08:00 |
jinyaohui
|
e6f9806cfb
|
add broadcast
|
2020-11-18 09:32:27 +08:00 |
lichenever
|
cfffff2875
|
add check for allreduce fusion
|
2020-10-12 16:55:30 +08:00 |
huangxinjing
|
2fa6a3b3c2
|
Fix doc error
|
2020-09-28 19:17:26 +08:00 |
mindspore-ci-bot
|
9bd34a1b29
|
!6673 Add stage information for ops and strategy
Merge pull request !6673 from huangxinjing/stage_strategy
|
2020-09-27 11:31:07 +08:00 |
huangxinjing
|
4ef439e27b
|
Add stage information for ops and strategy
|
2020-09-25 10:42:43 +08:00 |
lichenever
|
395d3f0848
|
add_limit_for_allreduce_fusion
|
2020-09-24 15:06:58 +08:00 |
huangxinjing
|
8ba1503135
|
Add default value for auto search parallel mode
|
2020-09-18 19:44:30 +08:00 |
yao_yf
|
b70204c080
|
auto parallel context add notes and func mv
|
2020-09-17 21:09:11 +08:00 |
Ziyan
|
8ea177e614
|
fix_api_problems
|
2020-09-17 11:32:13 +08:00 |
lichenever
|
f2d3fd34ce
|
rectification_allreduce_fusion_api
|
2020-09-07 16:38:58 +08:00 |
yao_yf
|
d4cfe55c04
|
rename mirror_mean to gradients_mean
|
2020-09-04 14:47:36 +08:00 |
yao_yf
|
8f7aa5bd5a
|
auto parallel context modify
|
2020-08-31 21:19:49 +08:00 |
Yi Huaijie
|
394be43492
|
raise RuntimeError when set different mode after Initializer created
|
2020-08-24 14:08:09 +08:00 |
Yi Huaijie
|
89a4ebf8a1
|
parallel mode must be set before create an initializer
|
2020-08-20 19:20:46 +08:00 |
yuchaojie
|
64a1560f1a
|
add allreduce group for resnet gpu version
|
2020-08-11 17:26:39 +08:00 |
yuchaojie
|
ed9cf2036c
|
add nccl default allreduce fusion group
|
2020-07-28 09:47:36 +08:00 |
Ziyan
|
39f08eb7dd
|
enable optimizer parallel
|
2020-07-16 11:47:41 +08:00 |
Ziyan
|
0925e35252
|
enable optimizer parallel with broadcast
|
2020-06-27 14:36:17 +08:00 |
hongxing
|
d798325127
|
supplement description about default value
|
2020-06-20 08:28:51 +01:00 |
hongxing
|
3ad3a71fc7
|
change interface
|
2020-06-19 00:08:55 +01:00 |
mindspore-ci-bot
|
4df861cb62
|
!1672 support load full dataset on each device
Merge pull request !1672 from yihuaijie/dev
|
2020-06-12 09:24:04 +08:00 |
kswang
|
699166e552
|
default fusion group for ge
|
2020-06-11 20:44:24 +08:00 |
Yi Huaijie
|
e5c351690b
|
support load full dataset on each device
|
2020-06-11 19:48:06 +08:00 |
kswang
|
503dd297c5
|
set all reduce fusion default group
|
2020-05-19 21:29:07 +08:00 |
kswang
|
362bbacf19
|
add group for allreduce fusion
|
2020-05-18 10:59:08 +08:00 |
yao_yf
|
6cde5f6d91
|
auto parallel strategy checkpoint
|
2020-04-28 15:48:41 +08:00 |
lirongzhen
|
4ff418084c
|
enable/disable allreduce_fusion
|
2020-04-24 10:34:59 +08:00 |
leonwanghui
|
24b26ee1a8
|
Move args_type_check function to _checkparam.py
|
2020-04-21 10:20:09 +08:00 |
yao_yf
|
6fdcc24585
|
Integrate two allreduce fusion set interfaces into one
|
2020-04-09 16:46:05 +08:00 |
zhunaipan
|
930a1fb0a8
|
initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
|
2020-03-27 22:54:54 +08:00 |