forked from huawei/mindspore2022
The basic idea is: exploits data dependency to control the execution order of side-effect operations, and keep the semantics of ANF unchanged. The ControlDepend primitive is removed and there are two primitives added: 1. UpdateState: ``` a = Assign(para, value) ``` became: ``` a = Assign(para, value, u) u = UpdateState(u, a) ``` 2. Load: ``` x = Add(para, value) ``` became: ``` p = Load(para, u) x = Add(p, value) u = UpdateState(u, p) ``` |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| test_ada_grad.py | ||
| test_adam.py | ||
| test_ftrl.py | ||
| test_lamb.py | ||
| test_lars.py | ||
| test_lazyadam.py | ||
| test_lr_schedule.py | ||
| test_momentum.py | ||
| test_optimizer.py | ||
| test_proximal_ada_grad.py | ||
| test_rmsprop.py | ||
| test_target.py | ||