mindspore2022/tests/ut/python/nn/optim
He Wei 7d9a783993 [auto-monad] Support side-effects by auto-monad
The basic idea is: exploits data dependency to control the execution order
of side-effect operations, and keep the semantics of ANF unchanged.

The ControlDepend primitive is removed and there are two primitives added:

1. UpdateState:
```
  a = Assign(para, value)
```
became:
```
  a = Assign(para, value, u)
  u = UpdateState(u, a)
```

2. Load:
```
  x = Add(para, value)
```
became:
```
  p = Load(para, u)
  x = Add(p, value)
  u = UpdateState(u, p)
```
2021-02-08 09:01:15 +08:00
..
__init__.py initial version 2020-03-27 22:54:54 +08:00
test_ada_grad.py [auto-monad] Support side-effects by auto-monad 2021-02-08 09:01:15 +08:00
test_adam.py [auto-monad] Support side-effects by auto-monad 2021-02-08 09:01:15 +08:00
test_ftrl.py [auto-monad] Support side-effects by auto-monad 2021-02-08 09:01:15 +08:00
test_lamb.py uniform learning_rate behavior of optimizers 2020-07-20 21:09:20 +08:00
test_lars.py modify lars interface 2020-06-23 11:23:28 +08:00
test_lazyadam.py [auto-monad] Support side-effects by auto-monad 2021-02-08 09:01:15 +08:00
test_lr_schedule.py remove name arg from gradoperation 2020-08-26 11:16:57 +08:00
test_momentum.py pylint waring clean 2020-05-13 11:30:27 +08:00
test_optimizer.py uniform learning_rate behavior of optimizers 2020-07-20 21:09:20 +08:00
test_proximal_ada_grad.py [auto-monad] Support side-effects by auto-monad 2021-02-08 09:01:15 +08:00
test_rmsprop.py support weight decay for sparse optimizer 2020-06-28 17:49:03 +08:00
test_target.py [auto-monad] Support side-effects by auto-monad 2021-02-08 09:01:15 +08:00