Commit Graph

139 Commits

Author SHA1 Message Date
zhihenghu ce12c02343 Add Sparse Attention
adjut the file structure and name

Deleted extra information

Do some formatting work

Add test case and fix some document

fix imports
2021-08-28 11:50:58 +08:00
i-robot 04c2e928c4 !21622 modify code check for Master
Merge pull request !21622 from lilei/modify_code_check_master
2021-08-26 12:18:11 +00:00
i-robot 8d00a8d803 !22360 Fix Transformer Mirror Error
Merge pull request !22360 from huangxinjing/fix_transformer_mirror_error
2021-08-26 08:16:33 +00:00
huangxinjing 62496d75f3 less the interface exposed 2021-08-25 21:22:40 +08:00
baihuawei a9694a9230 ascend add nontask sink mode 2021-08-25 14:45:58 +08:00
huangxinjing eaa8027903 Fix document api error 2021-08-24 20:50:16 +08:00
i-robot 20df29faba !22257 add parallel owners yao_yf
Merge pull request !22257 from yao_yf/code_docs_add_owners
2021-08-23 11:58:48 +00:00
yao_yf e97f2d3655 add commiter yao_yf 2021-08-23 19:50:10 +08:00
ms_yan 36a8886ca2 Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset"
This reverts commit b077aa1cab.

Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"

This reverts commit 4e6f7dc97d.

delete pass_registry_test.cc

comment  hiai_nlu_model_multi.pb related  line
2021-08-23 01:46:38 +08:00
djc 4e6f7dc97d [feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset 2021-08-22 13:39:37 +08:00
huangxinjing d777742904 1. Move the class to mindspore.parallel, support activation sharding 2021-08-20 14:34:10 +08:00
lilei 5714d68d1d modify code check for master 2021-08-16 15:58:15 +08:00
yao_yf a83bf73298 union auto_parallel_context interface dataset_strategy 2021-08-16 10:54:46 +08:00
yao_yf dc7dc7d3fa dataset strategy set 2021-07-27 18:44:10 +08:00
Xiaoda Zhang bb5d4212f7 enable All2All in infering redistribution ops 2021-07-24 09:09:01 +08:00
i-robot c9d3c1d346 !20411 enable optimizer parallel for inference
Merge pull request !20411 from gziyan/enable_opt_shard_predict
2021-07-20 01:37:06 +00:00
jin-xiulang 276b1b1638 Fix issues of federated's secure aggregation 2021-07-18 15:45:18 +08:00
Ziyan 1c9166e0a6 remove restriction for opt shard in inference 2021-07-16 17:16:12 +08:00
ZPaC a9a0f590e6 Fix master static check 2021-07-15 20:42:42 +08:00
Xiaoda Zhang 04381273b3 Add the sharding propagation function:
1) users configure sharding strategies for operators;
2) framework will propagate the strategies from configured-ops to
non-configured ops using BFS;
3) the propagation goal is to minimize redistribution communication
cost;
2021-07-14 10:54:18 +08:00
i-robot eeeabf5d07 !20064 fix_pipeline_opt_shard_master
Merge pull request !20064 from yao_yf/fix_pipeline_opt_shard_master
2021-07-13 01:21:54 +00:00
yao_yf 4aae231a8a fix_pipeline_opt_shard 2021-07-12 16:09:03 +08:00
jin-xiulang 33de9e66d3 Fix issues of mindspore federated 2021-07-12 11:14:31 +08:00
ZPaC f15f4f3377 Add value check 2021-07-10 11:49:48 +08:00
jin-xiulang 257cc23ca2 Add secure parameters for mindspore federated learning.
fix prime initialization and build key bug

fix reconstruct access bug and kernels' retcode.

Fix init issue

Add fl secure parameter cipher_time_window
2021-07-08 09:58:32 +08:00
jin-xiulang ebc71d3306 Add secure parameters for mindspore federated learning. 2021-07-05 21:08:02 +08:00
ZPaC fb76361d81 sync bug fix 2021-07-05 11:52:16 +08:00
i-robot d33adf825b !18475 cipher calling code
Merge pull request !18475 from ql_12345/master_merge_0617_1
2021-07-02 01:15:53 +00:00
ql_12345 5af0c890a1 cipher calling code 2021-07-01 00:23:06 +08:00
ZPaC c053100ef6 Add hybrid script 2021-06-30 22:04:12 +08:00
Ziyan be1f5a43d7 opt shard fit micro batch 2021-06-24 14:52:19 +08:00
ZPaC 9a8a7c215d Sync from enterprise 2021-06-20 17:18:20 +08:00
chendongsheng bfaab72934 add node recovery 2021-06-17 23:52:09 +08:00
lichenever cb438ce350 rectification_log 2021-06-17 09:23:17 +08:00
Ziyan 95ac0f6d58 fix optimizer weight shard config 2021-06-08 10:44:17 +08:00
ZPaC 2ab4d78374 Add server round kernel for hybrid. 2021-06-03 11:57:52 +08:00
Xiaoda Zhang 07e1e39a82 fix some codestyle warnings 2021-05-29 10:09:46 +08:00
chendongsheng 1a72c6ac35 added scale out and scale in 2021-05-27 10:28:44 +08:00
ZPaC 768f6b40c3 Optimize ps doc 2021-05-25 20:50:30 +08:00
huangxinjing e79db658e8 Fix codex for python file 2021-05-21 08:57:35 +08:00
ZPaC 19a2585ba4 Optimize server log 2021-05-12 20:32:59 +08:00
chendongsheng 2aae0b01ec tcp support ssl 2021-05-10 14:08:38 +08:00
mindspore-ci-bot ee885b4e58 !15180 enable not fully use opt shard
From: @gong_zi_yan
Reviewed-by: @stsuteng
Signed-off-by: @stsuteng
2021-05-08 14:57:58 +08:00
ZPaC a6f9814552 Add Server part 3 2021-05-07 21:10:08 +08:00
Ziyan 2a752f24bf enable not fully use opt shard 2021-05-07 15:32:48 +08:00
Ziyan b3eebea4de fix shard strategy for batchnorm 2021-04-17 17:01:13 +08:00
Ziyan 27c7c8618e fix get seed validation 2021-04-06 09:38:20 +08:00
mindspore-ci-bot 444ff97206 !13505 typo fix
From: @wudenggang
Reviewed-by: @ouwenchang,@Hanshize,@kingxian
Signed-off-by: @kingxian
2021-03-23 21:48:31 +08:00
Ziyan 6e475bea3f add warning for parameter share among multi devices 2021-03-22 15:53:43 +08:00
Ziyan d19d42ee44 modify grad accu and comm fusion api 2021-03-19 15:11:40 +08:00