1 Commits

Author	SHA1	Message	Date
Xiaoda Zhang	5613c0b974	add a moe implementation: ... 1) extend the Liner cell for including BatchMatMul implementation, in which the first dimension indicates the expert number; 2) implement a Switch (top1) router; 3) implement a MoE cell, which extends the FeedForward cell.	2021-09-09 11:53:42 +08:00