16 Commits

Author	SHA1	Message	Date
huangxinjing	b16dbf2b5d	1. Fix optimizer check error, as the check is done by the class name, too naive ... 2. Add virutal assign add to the operator	2022-04-05 20:16:03 +08:00
huangxinjing	8c9b2b93a8	Add transformer	2021-12-03 09:08:57 +08:00
yao_yf	188d39da83	slice_activation_in_recompute ... slice recompute activation	2021-11-19 10:51:54 +08:00
huangxinjing	f354ab22a3	add pipeline shard interface ... Add support for no pipeline accugradient Add delay tag for fusion op Optimizer the visite order add mirror for mini step control Move the group to attributes Add gradient_shard control for the mini step Fix code stype Fix ut description Add interface	2021-11-09 09:11:13 +08:00
linqingke	acde7febef	update pangu reshape and softmax performance. ... Add layer norm judge Fix layer norm name error Fix input tyoe check Fix ut test Add 3d supports	2021-09-24 09:06:16 +08:00
huangxinjing	0b89d5c9c4	fix batch size error	2021-09-16 10:56:40 +08:00
huangxinjing	e02f553010	Fix spell error and add mode check	2021-09-09 18:50:53 +08:00
huangxinjing	6cea07f749	Add args check	2021-09-08 09:12:35 +08:00
yao_yf	82889ec56b	fixed sparse attention	2021-08-31 16:11:56 +08:00
zhihenghu	ce12c02343	Add Sparse Attention ... adjut the file structure and name Deleted extra information Do some formatting work Add test case and fix some document fix imports	2021-08-28 11:50:58 +08:00
huangxinjing	62496d75f3	less the interface exposed	2021-08-25 21:22:40 +08:00
ms_yan	36a8886ca2	Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset" ... This reverts commit b077aa1cab. Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset" This reverts commit 4e6f7dc97d. delete pass_registry_test.cc comment hiai_nlu_model_multi.pb related line	2021-08-23 01:46:38 +08:00
djc	4e6f7dc97d	[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset	2021-08-22 13:39:37 +08:00
huangxinjing	d777742904	1. Move the class to mindspore.parallel, support activation sharding	2021-08-20 14:34:10 +08:00
huangxinjing	18044aff0f	1. Add docstring, elimitate attention mask, tuple append the deocoder return layer past ... split attention inputs from two into three Add input check and modify test case Fix check error and add check to transformer inputs add input check to the transformers	2021-08-16 21:08:48 +08:00
huangxinjing	615d1a179d	Add transformer layer	2021-07-29 11:10:43 +08:00