yangzhenzhang
4d0b1a47ee
support config group for batchnorm
2022-01-22 09:29:52 +08:00
yangzhenzhang
000c5b5394
support dilation for conv2d
2022-01-20 19:04:52 +08:00
i-robot
7bb5819889
!29265 fix resize_bilinear infer
...
Merge pull request !29265 from jiangzhenguang/resize_bilinear
2022-01-20 06:51:03 +00:00
jiangzhenguang
abddc993ea
fix resize_bilinear
2022-01-18 20:33:44 +08:00
yangzhenzhang
5514189257
support group for conv2d
2022-01-18 17:28:13 +08:00
yangzhenzhang
6dd7333c0b
fix bug for conv2d transpose
2022-01-14 16:36:03 +08:00
yangzhenzhang
a9d2e255f5
support single direction exchange for conv2d
2022-01-13 09:15:49 +08:00
i-robot
017cb5f3ad
!27980 auto insert VirtualDataset node for master
...
Merge pull request !27980 from lilei/insert_virtualdataset_for_master
2022-01-12 01:14:44 +00:00
yangzhenzhang
e5df74e9e4
compute top bottom overlap for conv2d
2022-01-10 16:15:04 +08:00
Xiaoda Zhang
6d8320fa66
1) fix the exact division in moe;
...
2) changing CumSum from composition to a single Operator;
3) add InferMirrorOps for CumSumInfo.
2021-12-30 19:20:05 +08:00
Xiaoda Zhang
1bdb610b34
changing default value of single-loop flag
2021-12-28 17:56:30 +08:00
i-robot
dd90a56d68
!28073 fix code warning && remove save_graphs use in st/ut
...
Merge pull request !28073 from huanghui/fix-warning
2021-12-24 09:29:25 +00:00
i-robot
22c25ec10e
!27862 [Auto parallel] [Sharding propagation] dealing with cast
...
Merge pull request !27862 from Xiaoda/119-adapting-sharding-propagation
2021-12-24 07:33:47 +00:00
huanghui
74ca50e652
fix code warning && remove save_graphs use in st/ut
2021-12-24 14:45:37 +08:00
Xiaoda Zhang
66c7474e5a
remove CastInfo from CNODE
2021-12-23 19:05:02 +08:00
zhuyuxiao
dd7bbf92dd
change API
2021-12-23 14:26:06 +08:00
lilei
017aa359a6
insert VirtualDataset node for master
2021-12-23 09:25:05 +08:00
i-robot
2fbec9a554
!27856 use neighbor-exchange-v2 for conv2d
...
Merge pull request !27856 from yangzhenzhang/use-neighborexchangev2-for-conv2d
2021-12-21 10:59:54 +00:00
yangzhenzhang
8a68577756
use neighbor-exchange-v2 for conv2d
2021-12-21 14:27:41 +08:00
wzw
a9b78682d5
parallel ut refactor 3
2021-12-21 14:26:58 +08:00
yangzhenzhang
5f6477b022
add output strategy for gather op
2021-12-16 09:24:50 +08:00
i-robot
d49f5e6caf
!27525 support optimizer parallel for adafactor
...
Merge pull request !27525 from yangzhenzhang/support-opt-parallel-for-adafactor
2021-12-15 01:25:12 +00:00
yao_yf
30576c6a75
fix reshape bool type in auto parallel
2021-12-13 20:24:33 +08:00
yangzhenzhang
2a0b528084
support opt parallel for adafactor
2021-12-13 11:21:44 +08:00
i-robot
938dc8abd0
!27439 [Auto parallel] Add new operatorInfo for Parallel: CumSum
...
Merge pull request !27439 from Xiaoda/117-add-cumsum-op
2021-12-10 07:00:06 +00:00
i-robot
0e358f4cb3
!27428 revert insert VirtualDataset node for master
...
Merge pull request !27428 from lilei/modify_virtualdataset_for_master
2021-12-09 02:47:13 +00:00
Xiaoda Zhang
8042c88223
add the new operatorInfo for parallel: CumSum
2021-12-09 09:21:52 +08:00
lilei
2edf6ab33b
revert insert VirtualDataset node for master
2021-12-08 17:39:42 +08:00
i-robot
faaec746f7
!27401 add more ut tests for allreduce fusion
...
Merge pull request !27401 from jiahongQian/master
2021-12-08 09:38:37 +00:00
jiahongQian
b03c8d18d3
add more ut tests
2021-12-08 14:17:02 +08:00
i-robot
ffca7b08a5
!27237 auto insert VirtualDataset node for master
...
Merge pull request !27237 from lilei/modify_virtualdataset_for_master
2021-12-07 09:02:50 +00:00
i-robot
f40668ef73
!27251 test_micro_batch_Interleaved
...
Merge pull request !27251 from lilei/add_parallel_ut
2021-12-07 02:18:09 +00:00
lilei
05189459ab
auto insert VirtualDataset node for master
2021-12-06 21:39:37 +08:00
lilei
e933aa268b
test_micro_batch_Interleaved
2021-12-06 18:37:21 +08:00
i-robot
2d23b698a6
!27024 add allreduce fusion by size
...
Merge pull request !27024 from jiahongQian/master
2021-12-06 05:32:12 +00:00
q00596439
de36fdc169
add allreduce fusion size and unify the interface
2021-12-05 21:35:11 +08:00
huangxinjing
8c9b2b93a8
Add transformer
2021-12-03 09:08:57 +08:00
yangzhenzhang
7454b8f8f2
check args for shard
2021-12-02 11:51:29 +08:00
Xiaoda Zhang
364858cbc9
In sharding propagation, to keep strategy consistent of parameter being used by multiple operators, we check the edge with one node of TmpIdentityInfo
2021-11-30 18:58:33 +08:00
Xiaoda Zhang
04db51a528
In a previous PR ( https://gitee.com/mindspore/mindspore/pulls/26807/ ), we replaced 'auto_parallel_search_mode' by 'search_mode' directly.
...
However, to be forward compatitable, it is suitable to keep 'auto_parallel_search_mode' available. This PR recovers the 'auto_parallel_search_mode' interface and adds a warning when using this old interface.
This PR also deals with other codestyle things.
2021-11-29 15:40:23 +08:00
i-robot
9f8ec2c5ab
!26807 [Auto parallel] [Sharding propagation] Interface change of sharding propagation
...
Merge pull request !26807 from Xiaoda/113-auto-parallel-search-mode-changes-to-search-mode
2021-11-26 01:48:58 +00:00
i-robot
6ecbc97fd6
!26804 virtual_dataset_avoid_auto_parallel
...
Merge pull request !26804 from yao_yf/virtual_dataset_avoid_auto_parallel
2021-11-26 01:48:53 +00:00
i-robot
b282414de7
!26619 arallel_ut_refactoring
...
Merge pull request !26619 from 王志伟/parallel_ut_refactoring1
2021-11-26 01:34:49 +00:00
Xiaoda Zhang
ad5ac77ae8
1) 'auto_parallel_search_mode' changes to 'search_mode';
...
2) 'sharding_propagation' moves to 'search_mode';
2021-11-25 19:38:21 +08:00
yao_yf
f29ce1fb60
virtual dataset avoid auto parallel
2021-11-25 18:47:35 +08:00
i-robot
519f14a909
!26006 slice recompute activation
...
Merge pull request !26006 from yao_yf/add_transformer_slice_activation_config
2021-11-24 06:14:28 +00:00
wzw
86c5ad20c8
parallel_ut_refactoring1
2021-11-24 09:41:52 +08:00
i-robot
1b8c2ff0e9
!26414 fault_recover_by_mirror_group_fix_opt_shard
...
Merge pull request !26414 from yao_yf/fault_recover_by_mirror_group_fix_opt_shard
2021-11-20 03:06:45 +00:00
yao_yf
188d39da83
slice_activation_in_recompute
...
slice recompute activation
2021-11-19 10:51:54 +08:00
yao_yf
01dc4bbdf9
fix fault recover in optimizer shard
2021-11-19 09:46:27 +08:00