yangzhenzhang
ef0361a449
fix bugs for conv2d
2021-08-03 10:48:05 +08:00
Xiaoda Zhang
4b4b3cdaf4
add reduceany operator and extend onehot to multi-dimensions
2021-08-02 08:53:43 +08:00
huangxinjing
615d1a179d
Add transformer layer
2021-07-29 11:10:43 +08:00
i-robot
9f296c58d6
!20960 [AutoParallel]Add replace graph for conv2d
...
Merge pull request !20960 from lichen/add_replace_graph_for_conv2d
2021-07-28 07:06:41 +00:00
lichenever
a7f8024c29
add_replace_graph_for_conv2d
2021-07-28 11:02:21 +08:00
yao_yf
dc7dc7d3fa
dataset strategy set
2021-07-27 18:44:10 +08:00
yangzhenzhang
80e5cc0e52
add parallel op for gatherd
2021-07-26 11:14:25 +08:00
Xiaoda Zhang
bb5d4212f7
enable All2All in infering redistribution ops
2021-07-24 09:09:01 +08:00
lichenever
3c7cfb7c08
auto_parallel_support_control_flow
2021-07-22 17:31:31 +08:00
i-robot
a7d40fc220
!20520 [AutoParallel]Add op AllToAllv
...
Merge pull request !20520 from lichen/add_op_AllToAllv
2021-07-20 07:57:03 +00:00
lichenever
8c1998fd6b
add_op_AllToAllv
2021-07-20 10:49:28 +08:00
i-robot
c9d3c1d346
!20411 enable optimizer parallel for inference
...
Merge pull request !20411 from gziyan/enable_opt_shard_predict
2021-07-20 01:37:06 +00:00
yangzhenzhang
b31cd27a08
update check strategy for conv2d
2021-07-19 15:03:26 +08:00
Ziyan
1c9166e0a6
remove restriction for opt shard in inference
2021-07-16 17:16:12 +08:00
Xiaoda Zhang
04381273b3
Add the sharding propagation function:
...
1) users configure sharding strategies for operators;
2) framework will propagate the strategies from configured-ops to
non-configured ops using BFS;
3) the propagation goal is to minimize redistribution communication
cost;
2021-07-14 10:54:18 +08:00
chenhaozhe
086a871975
Change Loss to LossBase
2021-07-02 16:41:02 +08:00
lichenever
db8850a4a3
pipeline_support_predict_master
2021-06-26 09:25:59 +08:00
Ziyan
be1f5a43d7
opt shard fit micro batch
2021-06-24 14:52:19 +08:00
yangzhenzhang
69acf757d0
add parallel op for conv2d backprop input
2021-06-24 10:01:49 +08:00
yangzhenzhang
24370b5613
add parallel op for maxpool
2021-06-21 09:00:56 +08:00
yangzhenzhang
af0d28de48
add parallel op for batchnorm
2021-06-17 15:43:24 +08:00
i-robot
85d860e6a2
!16457 [AutoParallel]pipeline_split_adapt_master
...
Merge pull request !16457 from lichen/pipeline_split_adapt_master
2021-06-11 11:37:40 +08:00
lichenever
db5d508356
pipeline_split_adapt_master
2021-06-10 20:17:33 +08:00
yangzhenzhang
7a40741048
add parallel operator for conv2d
2021-06-10 14:58:51 +08:00
Ziyan
95ac0f6d58
fix optimizer weight shard config
2021-06-08 10:44:17 +08:00
chenhaozhe
9da8534396
change _Loss to Loss
2021-06-03 15:26:59 +08:00
mindspore-ci-bot
1c8fda25ef
!16478 handle load op in step parallel
...
From: @gong_zi_yan
Reviewed-by: @yangzhenzhang,@stsuteng
Signed-off-by: @stsuteng
2021-05-29 09:32:35 +08:00
mindspore-ci-bot
b45b63fc58
!17239 add parallel gathernd test case
...
From: @hanyang001
Reviewed-by: @stsuteng,@yangzhenzhang
Signed-off-by: @stsuteng
2021-05-29 09:11:25 +08:00
Wan Hanyang
c51dff2634
add parallel gathernd test case
2021-05-28 17:21:11 +08:00
Wan Hanyang
3ce521d78f
add parallel layernorm test case
2021-05-28 17:20:04 +08:00
Ziyan
4b17493e52
handle load in step parallel
2021-05-28 09:16:40 +08:00
yangzhenzhang
d711d98f07
clean duplicate code
2021-05-25 17:25:34 +08:00
yao_yf
732d13ccff
parallel dropout support repeated compute
2021-05-20 19:42:13 +08:00
yangzhenzhang
6aa3859131
modify check strategy for scatter update
2021-05-10 11:22:00 +08:00
Ziyan
2a752f24bf
enable not fully use opt shard
2021-05-07 15:32:48 +08:00
yao_yf
e967f1939b
parallel envs variable check
2021-05-07 09:12:53 +08:00
mindspore-ci-bot
78fcdbc7c9
!15790 modify scatter update op
...
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
2021-04-28 10:48:19 +08:00
yangzhenzhang
075f680a42
modify scatter update op
2021-04-27 20:23:14 +08:00
Xiaoda Zhang
aa52399200
Making the Tile operator to have more parallel strategies
2021-04-27 11:36:40 +08:00
yao_yf
093ef784de
dont insert virtualoutput for scalar
2021-04-26 19:55:16 +08:00
mindspore-ci-bot
3cfd58e8e0
!15643 insert virtual div only for first input of dropout do mask
...
From: @yangzhenzhang
Reviewed-by: @stsuteng,@kisnwang
Signed-off-by: @stsuteng
2021-04-26 09:21:00 +08:00
mindspore-ci-bot
49d6c029a6
!15542 split axis and batch for gather
...
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng,@stsuteng
Signed-off-by: @stsuteng,@stsuteng
2021-04-25 19:33:09 +08:00
yangzhenzhang
5828973978
fix bug for dropout do mask
2021-04-25 16:47:44 +08:00
yao_yf
21276408b8
parallel virtual_out_ops
2021-04-25 11:18:54 +08:00
yangzhenzhang
213922574e
split axis and batch for gatherv2
2021-04-23 16:59:35 +08:00
yangzhenzhang
c2ca2232c5
add select op
2021-04-20 09:23:22 +08:00
mindspore-ci-bot
1c9d3c0aa0
!15353 add parallel operator for scatter update
...
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
2021-04-20 09:03:08 +08:00
mindspore-ci-bot
0fd1726e79
!15172 Clean GraphKernel's codes from frontend
...
From: @dayschan
Reviewed-by: @gaoxiong1,@dylangeng,@gaoxiong1
Signed-off-by: @dylangeng,@dylangeng
2021-04-19 09:34:35 +08:00
yangzhenzhang
9cdd70433f
add scatterupdate op
2021-04-17 17:32:48 +08:00
yangzhenzhang
d070af122f
add topk op
2021-04-17 14:12:49 +08:00