forked from huawei/mindspore2022
1) extend the Liner cell for including BatchMatMul implementation, in which the first dimension indicates the expert number; 2) implement a Switch (top1) router; 3) implement a MoE cell, which extends the FeedForward cell. |
||
|---|---|---|
| .. | ||
| mindspore_test_framework | ||
| perf_test | ||
| st | ||
| ut | ||
| vm_impl | ||
| .gitignore | ||
| CMakeLists.txt | ||
| OWNERS | ||
| __init__.py | ||
| dataset_mock.py | ||
| ops_common.py | ||
| summary_utils.py | ||
| train_step_wrap.py | ||