8 Commits

Author	SHA1	Message	Date
xumengjuan1	5f6b6d0970	modify apiformat	2022-03-04 15:40:30 +08:00
huangxinjing	158b5b474e	Add Chinese API	2022-03-02 10:33:12 +08:00
huodagu	1d48f7387b	输入参数校准v1	2022-02-28 15:04:55 +08:00
wangshengnan12@huawei.com	bb761a47be	add_TransformerRecomputeConfig_API	2022-02-25 11:18:51 +08:00
Xiaoda Zhang	b714451937	implementing expert_parallel+data_parallel in MoE: ... 1) extending _Linear's input as 4-dimension tensor: [outer_batch, expert_dim, -1, hidden], and _Liner's BatchMatMul becomes BatchMatMul(4_dim_tensor, 3_dim_tensor); 2) configuring the _Linear's BatchMatMul sharding strategy as [[dp, ep, 1, 1], [ep, 1, mp]]; 3) introducing a new parameter 'expert_parallel' in TransformerOpParallelConfig, creating a new class MoEParallelConfig to include 'data_parallel', 'model_parallel' and 'expert_parallel'; 4) changing parallel config for FeedForward, TransformerEncoderLayer, TransformerDecoderLayer.	2022-02-24 09:24:27 +08:00
zhangyi	5d8887baab	modify error format for api.	2022-02-22 17:02:04 +08:00
zhangyi	eddb5f9ca0	modify error format for chinese python api.	2022-02-21 19:01:22 +08:00
wangshengnan12@huawei.com	3a27ee3533	code_docs_add_transformer_api	2022-02-21 10:41:16 +08:00