Commit Graph

37 Commits

Author SHA1 Message Date
Yi Huaijie 89a4ebf8a1 parallel mode must be set before create an initializer 2020-08-20 19:20:46 +08:00
yao_yf cbb4363fa7 remove to_full_tensor and load_inputs in exexute stage 2020-08-14 11:40:27 +08:00
yangzhenzhang 4a0e6ff7fc update field split 2020-08-13 10:35:04 +08:00
yuchaojie 64a1560f1a add allreduce group for resnet gpu version 2020-08-11 17:26:39 +08:00
Ziyan 98e2ee90de fix optimizer parallel problems 2020-07-29 20:55:31 +08:00
yuchaojie ed9cf2036c add nccl default allreduce fusion group 2020-07-28 09:47:36 +08:00
mindspore-ci-bot edec821c50 !2876 set reshape operator no redistribution for auto parallel
Merge pull request !2876 from lirongzhen1/master
2020-07-17 10:01:06 +08:00
lirongzhen1 c1eba79b83 set reshape redistribution strategy attribute to no redistribution 2020-07-16 21:20:46 +08:00
Ziyan 39f08eb7dd enable optimizer parallel 2020-07-16 11:47:41 +08:00
He Wei f337c6bc14 Decouple ParamValue from python 2020-07-09 16:16:22 +08:00
Ziyan 0925e35252 enable optimizer parallel with broadcast 2020-06-27 14:36:17 +08:00
chenjianping 343889cdb7 building _ms_mpi with mpi_interface 2020-06-23 22:16:18 +08:00
mindspore-ci-bot a64e0de389 !2366 [CT][MS][Auto-Parallel] Recursive interface needs to be changed to external interface
Merge pull request !2366 from Chong/interface
2020-06-20 15:51:21 +08:00
hongxing d798325127 supplement description about default value 2020-06-20 08:28:51 +01:00
mindspore-ci-bot 9cddaee9b3 !2323 [CT][MS][Auto-Parallel]Recursive interface needs to be changed to external interface
Merge pull request !2323 from Chong/interface
2020-06-19 17:37:13 +08:00
hongxing 3ad3a71fc7 change interface 2020-06-19 00:08:55 +01:00
Yi Huaijie eae69a386a delete attribute seed of Initializer 2020-06-18 16:33:17 +08:00
chenjianping 6034f9c1e2 support host reduce scatter and mpi config 2020-06-15 16:33:40 +08:00
mindspore-ci-bot 4df861cb62 !1672 support load full dataset on each device
Merge pull request !1672 from yihuaijie/dev
2020-06-12 09:24:04 +08:00
kswang 699166e552 default fusion group for ge 2020-06-11 20:44:24 +08:00
Yi Huaijie e5c351690b support load full dataset on each device 2020-06-11 19:48:06 +08:00
mindspore-ci-bot 0ca626ef6c !1229 Init the slices of a Initializer on different devices
Merge pull request !1229 from yihuaijie/master
2020-05-22 08:57:58 +08:00
Yi Huaijie 7a5004cc49 init the slices of a Initialzer on different devices 2020-05-21 20:43:15 +08:00
kswang 503dd297c5 set all reduce fusion default group 2020-05-19 21:29:07 +08:00
kswang 362bbacf19 add group for allreduce fusion 2020-05-18 10:59:08 +08:00
yangzhenzhang 05fde3d23d add slice shape for param info 2020-05-11 16:01:55 +08:00
yangzhenzhang 8c9730b3c5 add parallel mode for cell 2020-05-07 20:11:20 +08:00
Xiaoda Zhang def8573275 implementing-searching-strategy-for-inference 2020-05-07 14:53:50 +08:00
yao_yf 6cde5f6d91 auto parallel strategy checkpoint 2020-04-28 15:48:41 +08:00
Xiaoda Zhang e227415673 support-the-multiple-subgraphs-in-the-ANF 2020-04-27 09:34:41 +08:00
mindspore-ci-bot 00859ae119 !586 enable/disable allreduce_fusion
Merge pull request !586 from lirongzhen1/allreduce_fusion
2020-04-24 16:02:53 +08:00
Xiaoda Zhang dfde76af88 delete the 'simplify_cal' attribute in 'set_algo_parameters' and 'get_algo_parameters' interface 2020-04-24 10:46:38 +08:00
lirongzhen 4ff418084c enable/disable allreduce_fusion 2020-04-24 10:34:59 +08:00
leonwanghui 24b26ee1a8 Move args_type_check function to _checkparam.py 2020-04-21 10:20:09 +08:00
Xiaoda Zhang ffb2cb03a4 Change 'NOT_FULLY_USE_DEVICES' to 'FULLY_USE_DEVICES' and make ALL-1 user-specified-strategy valid in auto-parallel 2020-04-15 10:14:46 +08:00
yao_yf 6fdcc24585 Integrate two allreduce fusion set interfaces into one 2020-04-09 16:46:05 +08:00
zhunaipan 930a1fb0a8 initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
2020-03-27 22:54:54 +08:00