8 Commits

Author	SHA1	Message	Date
Ziyan	c33f2cd796	fix auto optimizer weight shard	2020-11-02 16:25:48 +08:00
yao_yf	65d8e63580	set last node data parallel or repeat calculate in eval/predict	2020-10-26 20:05:00 +08:00
Ziyan	ddc0113058	enable parallel optimizer in auto parallel	2020-10-08 14:51:15 +08:00
lichenever	f2d3fd34ce	rectification_allreduce_fusion_api	2020-09-07 16:38:58 +08:00
Ziyan	98e2ee90de	fix optimizer parallel problems	2020-07-29 20:55:31 +08:00
wangnan39@huawei.com	082433183d	uniform learning_rate behavior of optimizers	2020-07-20 21:09:20 +08:00
Ziyan	39f08eb7dd	enable optimizer parallel	2020-07-16 11:47:41 +08:00
Ziyan	0925e35252	enable optimizer parallel with broadcast	2020-06-27 14:36:17 +08:00