Commit Graph

394 Commits

Author SHA1 Message Date
wangrao124 b643e3f4ff Add CSRTensor/COOTensor attr 2022-03-02 17:37:46 +08:00
i-robot 97811c2422
!30697 modify tensor shape chinese api
Merge pull request !30697 from lianliguang/code_docs_ms
2022-03-01 08:46:41 +00:00
i-robot fcf6e63045
!30666 fix chinese comments
Merge pull request !30666 from liutongtong9/code_docs_fix_commt
2022-03-01 08:40:47 +00:00
lianliguang abd403ee8a modif tensorshape chinese api 2022-03-01 16:35:02 +08:00
i-robot 1a7541fd9d
!30669 Fix boost cn api bug.
Merge pull request !30669 from linqingke/code_docs_api
2022-03-01 07:25:24 +00:00
liutongtong d6dc279e04 fix chinese api comments 2022-03-01 14:34:04 +08:00
i-robot 5554b062e9
!30643 modify cn api docs
Merge pull request !30643 from changzherui/code_docs_mod_cn_api_0228
2022-03-01 01:51:23 +00:00
linqingke bab76f547e fix boost cn api bug. 2022-02-28 19:09:11 +08:00
i-robot cf5248276e
!30579 add auto parallel adasum docs
Merge pull request !30579 from yao_yf/adasum_docs
2022-02-28 09:41:12 +00:00
i-robot f9ba4caba5
!30497 Initializer CN
Merge pull request !30497 from wanyiming/code_docs_inits
2022-02-28 09:34:48 +00:00
i-robot e3cab1c4eb
!30655 complete doc description for shard function
Merge pull request !30655 from wangjun/code_docs_shard_completion
2022-02-28 09:30:12 +00:00
wangjun 379782c3fe doc complete 2022-02-28 17:00:33 +08:00
i-robot 8317a44d3e
!30612 Add api document for pynative hook interface
Merge pull request !30612 from JoyLvliang/add_api_document_for_pynative_hook
2022-02-28 08:16:44 +00:00
huodagu 1d48f7387b 输入参数校准v1 2022-02-28 15:04:55 +08:00
changzherui f6b36166cd modify cn api comment 2022-02-28 14:39:35 +08:00
yao_yf 87c8e74fbb adasum docs 2022-02-28 14:28:29 +08:00
7347157+joylvliang@user.noreply.gitee.com 077c78921d add_api_document_for_pynative_hook 2022-02-28 11:41:53 +08:00
i-robot c419c10b83
!30592 add tensorshape api
Merge pull request !30592 from lianliguang/code_docs_ms
2022-02-28 02:26:03 +00:00
lianliguang b7d07da370 add chinese api for tensorshape 2022-02-28 09:56:36 +08:00
i-robot 91e66f6c91
!30616 modify format
Merge pull request !30616 from 俞涵/code_docs_1
2022-02-26 10:36:29 +00:00
yu-han39 fec5a02beb 修改格式v1 2022-02-26 18:06:11 +08:00
i-robot d3274bebca
!30602 fix comments
Merge pull request !30602 from liutongtong9/code_docs_fix_dataset
2022-02-26 09:44:23 +00:00
liutongtong d6854000b4 fix comments related with dataset 2022-02-26 16:44:55 +08:00
[songyuanwei] d6c46cedc1 modify summarylandscape chinese api 2022-02-26 10:45:32 +08:00
i-robot 8aa1bec061
!30610 modify apiformat
Merge pull request !30610 from xumengjuan1/code_docs_xx5
2022-02-26 01:43:51 +00:00
i-robot 7fde42cece
!30566 add note in function comment
Merge pull request !30566 from changzherui/code_docs_add_note
2022-02-26 01:40:37 +00:00
xumengjuan1 afd50a401b modify apiformat 2022-02-26 09:31:52 +08:00
changzherui 61fa6d9022 modify function note 2022-02-26 00:10:08 +08:00
wanyiming 4fa06dd9a2 code_docs_init 2022-02-25 22:22:31 +08:00
i-robot 20c27bbb00
!30568 add landscape Chinese api to summary_record
Merge pull request !30568 from Songyuanwei/api
2022-02-25 07:24:04 +00:00
i-robot 0341d96dd6
!30469 add shard function to support part of the graph executed in auto_parallel under pynative mode
Merge pull request !30469 from wangjun/0223_pp
2022-02-25 06:52:24 +00:00
i-robot 32265f7c1d
!30575 modify doc
Merge pull request !30575 from xumengjuan1/code_docs_xx3
2022-02-25 06:50:25 +00:00
xumengjuan1 f84b422992 modify doc 2022-02-25 14:34:33 +08:00
i-robot 3ae5651de3
!30567 [AutoParallel] Add TransformerRecomputeConfig API
Merge pull request !30567 from lichen/code_docs_TransformerRecomputeConfig_API
2022-02-25 06:11:13 +00:00
wangshengnan12@huawei.com bb761a47be add_TransformerRecomputeConfig_API 2022-02-25 11:18:51 +08:00
[songyuanwei] 1edaf5e9e5 add chinese landscape api to summary_record 2022-02-25 11:07:52 +08:00
xumengjuan1 c84a6d078b modify api format 2022-02-25 10:40:32 +08:00
i-robot cfe0f76d2b
!30491 ut for allgather fusion
Merge pull request !30491 from jiahongQian/master
2022-02-25 01:30:24 +00:00
wangjun 24d448239c add pynative_parallel 2022-02-24 21:07:51 +08:00
i-robot 3219508ecd
!30494 Supplement the docs and log to recompute api of Cell
Merge pull request !30494 from YuJianfeng/recompute
2022-02-24 13:04:57 +00:00
i-robot 2e091cca4d
!30531 code_docs_auto_parallel_optimizer
Merge pull request !30531 from zhuyuxiao/I4S85V_doc
2022-02-24 11:27:41 +00:00
jiahongQian 25f57505bf ut for allgather fusion 2022-02-24 17:40:32 +08:00
zhuyuxiao 5f2ddb66fd update api doc 2022-02-24 17:32:31 +08:00
i-robot bbcfbce9e0
!29997 [Auto parallel] [MoE] Support data_parallel + expert_parallel
Merge pull request !29997 from Xiaoda/124-moe-changes
2022-02-24 09:23:47 +00:00
i-robot 33ec98ded5
!30512 modify format for chinese python api.
Merge pull request !30512 from zhangyi/code_docs_master
2022-02-24 09:08:39 +00:00
i-robot 99fbcec2ce
!30432 add ckpt check and mod cn api
Merge pull request !30432 from changzherui/add_ckpt_check
2022-02-24 08:43:17 +00:00
zhangyi 5f22461db9 modify format for chinese python api. 2022-02-24 16:39:33 +08:00
i-robot 121f6b1def
!30460 Fix some API docs
Merge pull request !30460 from xiaotianci/modify_api_docs
2022-02-24 07:28:28 +00:00
yujianfeng 951f830b9a Supplement the docs and warning log to recompute api of Cell 2022-02-24 11:28:26 +08:00
Xiaoda Zhang b714451937 implementing expert_parallel+data_parallel in MoE:
1) extending _Linear's input as 4-dimension tensor: [outer_batch, expert_dim, -1, hidden], and _Liner's BatchMatMul becomes BatchMatMul(4_dim_tensor, 3_dim_tensor);
2) configuring the _Linear's BatchMatMul sharding strategy as [[dp, ep, 1, 1], [ep, 1, mp]];
3) introducing a new parameter 'expert_parallel' in TransformerOpParallelConfig, creating a new class MoEParallelConfig to include 'data_parallel', 'model_parallel' and 'expert_parallel';
4) changing parallel config for FeedForward, TransformerEncoderLayer, TransformerDecoderLayer.
2022-02-24 09:24:27 +08:00