15 Commits

Author	SHA1	Message	Date
zhuyuxiao	d0e0e305d3	good	2022-02-24 16:10:18 +08:00
yangzhenzhang	6ad6304b77	add output strategy	2021-11-04 16:28:54 +08:00
Zhang Qinghua	a137fa1d0b	Optimize the Executors routines. ... - Fix the key generating. - Distinguish the executors.	2021-08-28 17:36:12 +08:00
Ziyan	2a752f24bf	enable not fully use opt shard	2021-05-07 15:32:48 +08:00
mindspore-ci-bot	b67aaf6773	!9832 expose_allgather_fusion_to_users ... From: @gong_zi_yan Reviewed-by: Signed-off-by:	2020-12-28 09:54:57 +08:00
Ziyan	bbf8ec82b9	expose allgather fusion interface to users	2020-12-27 17:44:45 +08:00
Ziyan	c5c905fdf5	add restriction for opt shard	2020-12-19 17:43:55 +08:00
Ziyan	c33f2cd796	fix auto optimizer weight shard	2020-11-02 16:25:48 +08:00
yao_yf	65d8e63580	set last node data parallel or repeat calculate in eval/predict	2020-10-26 20:05:00 +08:00
Ziyan	ddc0113058	enable parallel optimizer in auto parallel	2020-10-08 14:51:15 +08:00
lichenever	f2d3fd34ce	rectification_allreduce_fusion_api	2020-09-07 16:38:58 +08:00
Ziyan	98e2ee90de	fix optimizer parallel problems	2020-07-29 20:55:31 +08:00
wangnan39@huawei.com	082433183d	uniform learning_rate behavior of optimizers	2020-07-20 21:09:20 +08:00
Ziyan	39f08eb7dd	enable optimizer parallel	2020-07-16 11:47:41 +08:00
Ziyan	0925e35252	enable optimizer parallel with broadcast	2020-06-27 14:36:17 +08:00