Commit Graph

397 Commits

Author SHA1 Message Date
i-robot 77424eaad5 !23004 Add args Check for Transformer
Merge pull request !23004 from huangxinjing/args_check
2021-09-08 08:24:06 +00:00
huangxinjing 6cea07f749 Add args check 2021-09-08 09:12:35 +08:00
yao_yf 3ef26288a2 parallel_sparse_attention_ops_fix_repeated_cal 2021-09-06 19:57:22 +08:00
i-robot fa12d62d4d !21776 set device_id master 0813
Merge pull request !21776 from mindspore_ding/set_device_id_master_0813
2021-09-06 03:02:58 +00:00
dingpeifei b4bc6000dc set device id master 0813 2021-09-02 20:51:50 +08:00
i-robot d87d0e07c2 !22255 recompute_interface_modify
Merge pull request !22255 from yao_yf/recompute_interface_modify
2021-09-01 08:09:36 +00:00
yao_yf 39055af6e4 recompute interface modify 2021-09-01 10:59:59 +08:00
i-robot cc8d614b25 !22650 fixed sparse attention modify
Merge pull request !22650 from yao_yf/fixed_sparse_attention_modify
2021-09-01 01:29:45 +00:00
i-robot 389f3a6b6c !21835 make alltoall and neighborexchange to be interface && revert pr 21395
Merge pull request !21835 from zhoufeng/revert-same-input-to-comm-op
2021-08-31 08:53:46 +00:00
yao_yf 82889ec56b fixed sparse attention 2021-08-31 16:11:56 +08:00
yao_yf 68dd138462 add parallel sparse attention ops: dsd_matmul 2021-08-30 18:46:52 +08:00
zhoufeng ecae690a19 Revert "fix same node is used by two comm op"
This reverts commit b09d411dc4.

add AlltoAll and NeighborExchange as interface
2021-08-30 16:54:38 +08:00
yao_yf b8a9cbe2a3 add cus_matmul_dds parallel ops 2021-08-30 09:44:48 +08:00
Zhang Qinghua a137fa1d0b Optimize the Executors routines.
- Fix the key generating.
- Distinguish the executors.
2021-08-28 17:36:12 +08:00
zhihenghu ce12c02343 Add Sparse Attention
adjut the file structure and name

Deleted extra information

Do some formatting work

Add test case and fix some document

fix imports
2021-08-28 11:50:58 +08:00
i-robot e6e1f37ae4 !22346 [Core] Fix the bug of scope setting when cloning nodes
Merge pull request !22346 from Xiaoda/86-fix-the-fullname-scope-bug
2021-08-26 13:04:15 +00:00
i-robot 8d00a8d803 !22360 Fix Transformer Mirror Error
Merge pull request !22360 from huangxinjing/fix_transformer_mirror_error
2021-08-26 08:16:33 +00:00
Xiaoda Zhang b2703879c6 fix the scope setting error when cloning nodes 2021-08-26 10:25:38 +08:00
i-robot edcbb68d71 !22386 fix neighborexchange empty input case
Merge pull request !22386 from zhoufeng/fix-neighbor-empty-input-bak
2021-08-26 01:52:10 +00:00
zhoufeng e5a1582e4b fix neighborexchange empty input case
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2021-08-25 21:41:22 +08:00
huangxinjing 62496d75f3 less the interface exposed 2021-08-25 21:22:40 +08:00
yangzhenzhang 0b9b2a9458 add test cases 2021-08-25 17:22:20 +08:00
lichenever 5812076512 Refactor_part_of_pipeline 2021-08-24 21:37:41 +08:00
yangzhenzhang f1afaeac5a modify check strategy for conv2d 2021-08-24 16:06:16 +08:00
ms_yan 36a8886ca2 Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset"
This reverts commit b077aa1cab.

Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"

This reverts commit 4e6f7dc97d.

delete pass_registry_test.cc

comment  hiai_nlu_model_multi.pb related  line
2021-08-23 01:46:38 +08:00
djc b077aa1cab [feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset 2021-08-22 16:26:45 +08:00
djc 4e6f7dc97d [feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset 2021-08-22 13:39:37 +08:00
huangxinjing d777742904 1. Move the class to mindspore.parallel, support activation sharding 2021-08-20 14:34:10 +08:00
i-robot dde05c36b8 !21551 auto_parallel_context interface dataset_strategy union
Merge pull request !21551 from yao_yf/auto_parallel_context_dataset_strategy_union
2021-08-18 09:03:18 +00:00
i-robot 415275ae17 !21805 support adafactor model parallel
Merge pull request !21805 from yangzhenzhang/auto-parallel-support-adafactor-opt
2021-08-18 07:20:39 +00:00
i-robot 0d839fa7c6 !21809 Improved Transformer Struture and Add Args Check
Merge pull request !21809 from huangxinjing/transformer_improved
2021-08-17 12:05:25 +00:00
i-robot a77a0b968d !21761 comm_recompute_interface.
Merge pull request !21761 from yao_yf/comm_recompute_interface
2021-08-17 09:14:29 +00:00
yangzhenzhang 7ca64d2235 auto parallel support adafactor opt 2021-08-17 10:36:42 +08:00
yao_yf 5277b229be add cell comm recompute interface 2021-08-17 09:23:21 +08:00
huangxinjing 18044aff0f 1. Add docstring, elimitate attention mask, tuple append the deocoder return layer past
split attention inputs from two into three

Add input check and modify test case

Fix check error and add check to transformer inputs

add input check to the transformers
2021-08-16 21:08:48 +08:00
yao_yf a83bf73298 union auto_parallel_context interface dataset_strategy 2021-08-16 10:54:46 +08:00
yao_yf e233880e41 fix reshape depend reshape in auto parallel 2021-08-12 11:45:28 +08:00
i-robot 63445ff6fd !21627 alltoall exception handle
Merge pull request !21627 from zhoufeng/alltoall_exception
2021-08-12 01:40:22 +00:00
yangzhenzhang d18c813ee4 check strategy for conv2d 2021-08-11 19:12:48 +08:00
zhoufeng 03a56f2bb0 alltoall exception handle
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2021-08-11 17:30:49 +08:00
i-robot 4aaa8126a0 !21528 Add Parallel Print Support
Merge pull request !21528 from huangxinjing/add_print
2021-08-09 10:55:04 +00:00
huangxinjing 92bad162bd Add print 2021-08-09 11:14:25 +08:00
huangbingjian 53b31abf12 remove useless depend 2021-08-05 20:21:24 +08:00
yangzhenzhang ef0361a449 fix bugs for conv2d 2021-08-03 10:48:05 +08:00
Xiaoda Zhang 4b4b3cdaf4 add reduceany operator and extend onehot to multi-dimensions 2021-08-02 08:53:43 +08:00
huangxinjing 615d1a179d Add transformer layer 2021-07-29 11:10:43 +08:00
i-robot 9f296c58d6 !20960 [AutoParallel]Add replace graph for conv2d
Merge pull request !20960 from lichen/add_replace_graph_for_conv2d
2021-07-28 07:06:41 +00:00
lichenever a7f8024c29 add_replace_graph_for_conv2d 2021-07-28 11:02:21 +08:00
yao_yf dc7dc7d3fa dataset strategy set 2021-07-27 18:44:10 +08:00
yangzhenzhang 80e5cc0e52 add parallel op for gatherd 2021-07-26 11:14:25 +08:00