Commit Graph

34 Commits

Author SHA1 Message Date
Jiaqi a30ccea62c sparse optimizer 2020-10-20 17:56:45 +08:00
panyifeng 1a54785fe2 remove name arg from gradoperation 2020-08-26 11:16:57 +08:00
panyifeng 637e812347 remove global grad ops 2020-08-24 16:50:09 +08:00
wangnan39@huawei.com 082433183d uniform learning_rate behavior of optimizers 2020-07-20 21:09:20 +08:00
wangnan39@huawei.com 86889c59cb optimizer adapt IndexedSlices 2020-07-17 15:57:50 +08:00
panyifeng 44e74ad5aa Apply indexed_slices 2020-07-13 15:36:25 +08:00
panyifeng d6635bbbe2 Add IndexedSlices 2020-06-30 17:38:24 +08:00
wangnan39@huawei.com 172728a6a6 support weight decay for sparse optimizer 2020-06-28 17:49:03 +08:00
Ziyan 41ddc153a6 modify lars interface 2020-06-23 11:23:28 +08:00
panyifeng 3c2057297e support multi param for tuple grad 2020-06-20 08:39:42 +08:00
lilei 497067d7b2 add sparse proximal ada grad optimizer 2020-06-19 09:56:28 +08:00
mindspore-ci-bot 2d84011504 !2071 optimizer support loss scale for sparse situation
Merge pull request !2071 from wangnan39/support_loss_scale_for_sparse_optimizer
2020-06-16 15:01:49 +08:00
wangnan39@huawei.com d4e3d69f37 support loss scale for sparse situation 2020-06-15 22:17:53 +08:00
kingfo 9708e58259 fix TupleToArray & Cast operator issue 2020-06-15 14:39:10 +08:00
mindspore-ci-bot 3536185f5b !2007 add lazy adam optimizer and support sparse adam&ftrl for cpu backend
Merge pull request !2007 from wangnan39/add_lazy_adam_optim_and_support_sparse_admm_for_cpu_backend
2020-06-12 17:22:03 +08:00
wangnan39@huawei.com 4042f16ce4 add lazy adam optim and support sparse adam & ftrl for cpu backend 2020-06-12 16:06:11 +08:00
mindspore-ci-bot f859dfecc8 !1920 SupportPynativeIndexing
Merge pull request !1920 from amongo/SupportPynativeIndexing
2020-06-11 21:11:36 +08:00
huangdongrun 9522f59b87 support for tensor indexing in pynative
support tensor slice using constexpr

remove tensorslice metagraph

add pynative testcases
2020-06-11 19:14:22 +08:00
mindspore-ci-bot 9dfb1011fe !1854 add SparseApplyAdam and SparseApplyLazyAdam ops
Merge pull request !1854 from wangnan39/add_ops_sparse_adam_and_sparse_lazy_adam
2020-06-11 16:35:03 +08:00
wangnan39@huawei.com de21dbdaef add ops SparseApplyAdam and SparseApplyLazyAdam 2020-06-11 15:50:28 +08:00
mindspore-ci-bot 3b8edd5a5b !1918 sparse grad for gatherv2
Merge pull request !1918 from riemann_penn/sparse_grad_for_gatherv2
2020-06-11 14:11:49 +08:00
panyifeng acaa66a738 sparse grad for gatherv2 2020-06-11 12:00:53 +08:00
lilei 36d9e353a5 add proximal_ada_grad optimizer 2020-06-10 09:21:36 +08:00
wangnan39@huawei.com c9b7d95c2c fix lr check bug in AdamWeightDecayDynamicLR 2020-06-03 19:20:36 +08:00
wangnan39@huawei.com 810ccf80d8 fix_bug_in_check_lamb_warmup_step 2020-05-28 12:15:12 +08:00
“liuxiao” ebbccca78b pylint clean 2020-05-26 19:36:54 +08:00
guohongzilong 2d2f9ba8fd fix group parameter code for check 2020-05-22 11:05:45 +08:00
jinyaohui 5a914994ba clean pylint 2020-05-18 16:42:35 +08:00
jinyaohui 26fd75895d pylint waring clean 2020-05-13 11:30:27 +08:00
guohongzilong 824bc30a94 learning rate and weight decay support group mode 2020-05-07 09:38:03 +08:00
wangnan39@huawei.com 7f602016f4 add parameter verification for rmsprop, and modify default value in annotation 2020-04-29 16:12:58 +08:00
root 7d700295f8 add dynamic lr and enhance optim 2020-04-13 13:48:01 +00:00
Ziyan 4cbcd8e907 enable use float type learning rate in lars optimizer 2020-03-30 19:05:33 +08:00
zhunaipan 930a1fb0a8 initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
2020-03-27 22:54:54 +08:00