like20
/
mindspore2022
forked from huawei/mindspore2022
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
28,928 Commits 18 Branches 0 Tags 564 MiB
Commit Graph

361 Commits

Author SHA1 Message Date
dingpeifei b4bc6000dc set device id master 0813 2021-09-02 20:51:50 +08:00
i-robot 63445ff6fd !21627 alltoall exception handle 
Merge pull request !21627 from zhoufeng/alltoall_exception
 2021-08-12 01:40:22 +00:00
yangzhenzhang d18c813ee4 check strategy for conv2d 2021-08-11 19:12:48 +08:00
zhoufeng 03a56f2bb0 alltoall exception handle 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-08-11 17:30:49 +08:00
i-robot 4aaa8126a0 !21528 Add Parallel Print Support 
Merge pull request !21528 from huangxinjing/add_print
 2021-08-09 10:55:04 +00:00
huangxinjing 92bad162bd Add print 2021-08-09 11:14:25 +08:00
huangbingjian 53b31abf12 remove useless depend 2021-08-05 20:21:24 +08:00
yangzhenzhang ef0361a449 fix bugs for conv2d 2021-08-03 10:48:05 +08:00
Xiaoda Zhang 4b4b3cdaf4 add reduceany operator and extend onehot to multi-dimensions 2021-08-02 08:53:43 +08:00
huangxinjing 615d1a179d Add transformer layer 2021-07-29 11:10:43 +08:00
i-robot 9f296c58d6 !20960 [AutoParallel]Add replace graph for conv2d 
Merge pull request !20960 from lichen/add_replace_graph_for_conv2d
 2021-07-28 07:06:41 +00:00
lichenever a7f8024c29 add_replace_graph_for_conv2d 2021-07-28 11:02:21 +08:00
yao_yf dc7dc7d3fa dataset strategy set 2021-07-27 18:44:10 +08:00
yangzhenzhang 80e5cc0e52 add parallel op for gatherd 2021-07-26 11:14:25 +08:00
Xiaoda Zhang bb5d4212f7 enable All2All in infering redistribution ops 2021-07-24 09:09:01 +08:00
lichenever 3c7cfb7c08 auto_parallel_support_control_flow 2021-07-22 17:31:31 +08:00
i-robot a7d40fc220 !20520 [AutoParallel]Add op AllToAllv 
Merge pull request !20520 from lichen/add_op_AllToAllv
 2021-07-20 07:57:03 +00:00
lichenever 8c1998fd6b add_op_AllToAllv 2021-07-20 10:49:28 +08:00
i-robot c9d3c1d346 !20411 enable optimizer parallel for inference 
Merge pull request !20411 from gziyan/enable_opt_shard_predict
 2021-07-20 01:37:06 +00:00
yangzhenzhang b31cd27a08 update check strategy for conv2d 2021-07-19 15:03:26 +08:00
Ziyan 1c9166e0a6 remove restriction for opt shard in inference 2021-07-16 17:16:12 +08:00
Xiaoda Zhang 04381273b3 Add the sharding propagation function: 
1) users configure sharding strategies for operators;
2) framework will propagate the strategies from configured-ops to
non-configured ops using BFS;
3) the propagation goal is to minimize redistribution communication
cost;
 2021-07-14 10:54:18 +08:00
chenhaozhe 086a871975 Change Loss to LossBase 2021-07-02 16:41:02 +08:00
lichenever db8850a4a3 pipeline_support_predict_master 2021-06-26 09:25:59 +08:00
Ziyan be1f5a43d7 opt shard fit micro batch 2021-06-24 14:52:19 +08:00
yangzhenzhang 69acf757d0 add parallel op for conv2d backprop input 2021-06-24 10:01:49 +08:00
yangzhenzhang 24370b5613 add parallel op for maxpool 2021-06-21 09:00:56 +08:00
yangzhenzhang af0d28de48 add parallel op for batchnorm 2021-06-17 15:43:24 +08:00
i-robot 85d860e6a2 !16457 [AutoParallel]pipeline_split_adapt_master 
Merge pull request !16457 from lichen/pipeline_split_adapt_master
 2021-06-11 11:37:40 +08:00
lichenever db5d508356 pipeline_split_adapt_master 2021-06-10 20:17:33 +08:00
yangzhenzhang 7a40741048 add parallel operator for conv2d 2021-06-10 14:58:51 +08:00
Ziyan 95ac0f6d58 fix optimizer weight shard config 2021-06-08 10:44:17 +08:00
chenhaozhe 9da8534396 change _Loss to Loss 2021-06-03 15:26:59 +08:00
mindspore-ci-bot 1c8fda25ef !16478 handle load op in step parallel 
From: @gong_zi_yan
Reviewed-by: @yangzhenzhang,@stsuteng
Signed-off-by: @stsuteng
 2021-05-29 09:32:35 +08:00
mindspore-ci-bot b45b63fc58 !17239 add parallel gathernd test case 
From: @hanyang001
Reviewed-by: @stsuteng,@yangzhenzhang
Signed-off-by: @stsuteng
 2021-05-29 09:11:25 +08:00
Wan Hanyang c51dff2634 add parallel gathernd test case 2021-05-28 17:21:11 +08:00
Wan Hanyang 3ce521d78f add parallel layernorm test case 2021-05-28 17:20:04 +08:00
Ziyan 4b17493e52 handle load in step parallel 2021-05-28 09:16:40 +08:00
yangzhenzhang d711d98f07 clean duplicate code 2021-05-25 17:25:34 +08:00
yao_yf 732d13ccff parallel dropout support repeated compute 2021-05-20 19:42:13 +08:00
yangzhenzhang 6aa3859131 modify check strategy for scatter update 2021-05-10 11:22:00 +08:00
Ziyan 2a752f24bf enable not fully use opt shard 2021-05-07 15:32:48 +08:00
yao_yf e967f1939b parallel envs variable check 2021-05-07 09:12:53 +08:00
mindspore-ci-bot 78fcdbc7c9 !15790 modify scatter update op 
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng
Signed-off-by: @stsuteng
 2021-04-28 10:48:19 +08:00
yangzhenzhang 075f680a42 modify scatter update op 2021-04-27 20:23:14 +08:00
Xiaoda Zhang aa52399200 Making the Tile operator to have more parallel strategies 2021-04-27 11:36:40 +08:00
yao_yf 093ef784de dont insert virtualoutput for scalar 2021-04-26 19:55:16 +08:00
mindspore-ci-bot 3cfd58e8e0 !15643 insert virtual div only for first input of dropout do mask 
From: @yangzhenzhang
Reviewed-by: @stsuteng,@kisnwang
Signed-off-by: @stsuteng
 2021-04-26 09:21:00 +08:00
mindspore-ci-bot 49d6c029a6 !15542 split axis and batch for gather 
From: @yangzhenzhang
Reviewed-by: @kisnwang,@stsuteng,@stsuteng
Signed-off-by: @stsuteng,@stsuteng
 2021-04-25 19:33:09 +08:00
yangzhenzhang 5828973978 fix bug for dropout do mask 2021-04-25 16:47:44 +08:00