SuLe
/
mindspore2022
forked from huawei/mindspore2022
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
42,203 Commits 18 Branches 22 Tags 3.6 GiB
Commit Graph

46 Commits

Author SHA1 Message Date
He Wei 723543eb5d Modify Optimizer to support flatten parameters 
1. Provide method to create Parameter from Tensor without copy;
2. Adapt optimizer.py to support flattened parameters;
3. Add unit test cases for parameter and optimizer.
 2022-04-07 14:11:32 +08:00
Margaret_wangrui 462c38813d [ME] Add parameter name check. 2022-02-14 10:07:43 +08:00
liuyang_655 15a153a40d Modify error info 2022-01-06 01:28:53 -05:00
wanyiming ab65f4ac98 addut 2021-11-26 09:48:34 +08:00
yanghaoran 0ced8775c4 upgrade Ascend software package 09 Sep 21 2021-09-09 20:30:22 +08:00
Zhang Qinghua a137fa1d0b Optimize the Executors routines. 
- Fix the key generating.
- Distinguish the executors.
 2021-08-28 17:36:12 +08:00
jiangzhenguang a3bb780ce4 optimize run memory 2021-08-10 20:45:25 +08:00
wangnan39@huawei.com 2761776699 add check for optimizer parameters 2021-05-17 22:23:03 +08:00
He Wei 7d9a783993 [auto-monad] Support side-effects by auto-monad 
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.

The ControlDepend primitive is removed and there are two primitives added:

1. UpdateState:
```
  a = Assign(para, value)
```
became:
```
  a = Assign(para, value, u)
  u = UpdateState(u, a)
```

2. Load:
```
  x = Add(para, value)
```
became:
```
  p = Load(para, u)
  x = Add(p, value)
  u = UpdateState(u, p)
```
 2021-02-08 09:01:15 +08:00
wangnan39@huawei.com 0fe9e2e4cb support import dynamic_lr from nn 2020-12-09 17:47:52 +08:00
zhuyuxiao 37bebc751b add adagrad optim 2020-12-08 09:38:15 +08:00
wangnan39@huawei.com ab811fca8f add AdamOffload optimizer 2020-11-18 16:13:47 +08:00
Jiaqi a30ccea62c sparse optimizer 2020-10-20 17:56:45 +08:00
panyifeng 1a54785fe2 remove name arg from gradoperation 2020-08-26 11:16:57 +08:00
panyifeng 637e812347 remove global grad ops 2020-08-24 16:50:09 +08:00
wangnan39@huawei.com 082433183d uniform learning_rate behavior of optimizers 2020-07-20 21:09:20 +08:00
wangnan39@huawei.com 86889c59cb optimizer adapt IndexedSlices 2020-07-17 15:57:50 +08:00
panyifeng 44e74ad5aa Apply indexed_slices 2020-07-13 15:36:25 +08:00
panyifeng d6635bbbe2 Add IndexedSlices 2020-06-30 17:38:24 +08:00
wangnan39@huawei.com 172728a6a6 support weight decay for sparse optimizer 2020-06-28 17:49:03 +08:00
Ziyan 41ddc153a6 modify lars interface 2020-06-23 11:23:28 +08:00
panyifeng 3c2057297e support multi param for tuple grad 2020-06-20 08:39:42 +08:00
lilei 497067d7b2 add sparse proximal ada grad optimizer 2020-06-19 09:56:28 +08:00
mindspore-ci-bot 2d84011504 !2071 optimizer support loss scale for sparse situation 
Merge pull request !2071 from wangnan39/support_loss_scale_for_sparse_optimizer
 2020-06-16 15:01:49 +08:00
wangnan39@huawei.com d4e3d69f37 support loss scale for sparse situation 2020-06-15 22:17:53 +08:00
kingfo 9708e58259 fix TupleToArray & Cast operator issue 2020-06-15 14:39:10 +08:00
mindspore-ci-bot 3536185f5b !2007 add lazy adam optimizer and support sparse adam&ftrl for cpu backend 
Merge pull request !2007 from wangnan39/add_lazy_adam_optim_and_support_sparse_admm_for_cpu_backend
 2020-06-12 17:22:03 +08:00
wangnan39@huawei.com 4042f16ce4 add lazy adam optim and support sparse adam & ftrl for cpu backend 2020-06-12 16:06:11 +08:00
mindspore-ci-bot f859dfecc8 !1920 SupportPynativeIndexing 
Merge pull request !1920 from amongo/SupportPynativeIndexing
 2020-06-11 21:11:36 +08:00
huangdongrun 9522f59b87 support for tensor indexing in pynative 
support tensor slice using constexpr

remove tensorslice metagraph

add pynative testcases
 2020-06-11 19:14:22 +08:00
mindspore-ci-bot 9dfb1011fe !1854 add SparseApplyAdam and SparseApplyLazyAdam ops 
Merge pull request !1854 from wangnan39/add_ops_sparse_adam_and_sparse_lazy_adam
 2020-06-11 16:35:03 +08:00
wangnan39@huawei.com de21dbdaef add ops SparseApplyAdam and SparseApplyLazyAdam 2020-06-11 15:50:28 +08:00
mindspore-ci-bot 3b8edd5a5b !1918 sparse grad for gatherv2 
Merge pull request !1918 from riemann_penn/sparse_grad_for_gatherv2
 2020-06-11 14:11:49 +08:00
panyifeng acaa66a738 sparse grad for gatherv2 2020-06-11 12:00:53 +08:00
lilei 36d9e353a5 add proximal_ada_grad optimizer 2020-06-10 09:21:36 +08:00
wangnan39@huawei.com c9b7d95c2c fix lr check bug in AdamWeightDecayDynamicLR 2020-06-03 19:20:36 +08:00
wangnan39@huawei.com 810ccf80d8 fix_bug_in_check_lamb_warmup_step 2020-05-28 12:15:12 +08:00
“liuxiao” ebbccca78b pylint clean 2020-05-26 19:36:54 +08:00
guohongzilong 2d2f9ba8fd fix group parameter code for check 2020-05-22 11:05:45 +08:00
jinyaohui 5a914994ba clean pylint 2020-05-18 16:42:35 +08:00
jinyaohui 26fd75895d pylint waring clean 2020-05-13 11:30:27 +08:00
guohongzilong 824bc30a94 learning rate and weight decay support group mode 2020-05-07 09:38:03 +08:00
wangnan39@huawei.com 7f602016f4 add parameter verification for rmsprop, and modify default value in annotation 2020-04-29 16:12:58 +08:00
root 7d700295f8 add dynamic lr and enhance optim 2020-04-13 13:48:01 +00:00
Ziyan 4cbcd8e907 enable use float type learning rate in lars optimizer 2020-03-30 19:05:33 +08:00
zhunaipan 930a1fb0a8 initial version 
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
 2020-03-27 22:54:54 +08:00