Commit Graph

3037 Commits

Author SHA1 Message Date
yao_yf 188d39da83 slice_activation_in_recompute
slice recompute activation
2021-11-19 10:51:54 +08:00
i-robot e154dca4b1 !22193 [assistant][ops] Add new loader operator DBpedia
Merge pull request !22193 from 杨旭华/DBpedia
2021-11-12 09:02:28 +00:00
i-robot e773f0621e !25918 add Function jvp and vjp
Merge pull request !25918 from chenzhuo/jvp
2021-11-12 06:37:46 +00:00
i-robot 5869e02fa1 !26135 Enable tuple input of optimizer as variable
Merge pull request !26135 from LiangZhibo/broaden3
2021-11-12 06:29:35 +00:00
Carry955 0d26c38693 [feat][assistant][I40GXT] add new loader DBpedia 2021-11-11 19:02:22 -08:00
i-robot 7a73bae5c3 !26036 add output strategy for matmul operator
Merge pull request !26036 from yangzhenzhang/add-output-strategy-for-op-init
2021-11-12 01:22:22 +00:00
i-robot e03544685b !26049 [Auto parallel] Support reshape in sharding propagation
Merge pull request !26049 from Xiaoda/99-ad-reshape-adjusting-in-sharding-propagation
2021-11-12 01:14:18 +00:00
chenzhuo f36edec3ff add function jvp 2021-11-12 08:44:41 +08:00
i-robot 1792d5f8a4 !26131 Offload Hardware Acceleration Computing
Merge pull request !26131 from alashkari/hw_accel_move_copy
2021-11-11 13:18:07 +00:00
i-robot b910870ecc !19986 [assistant][ops] Add new dataset loading operator AGNEWS
Merge pull request !19986 from 杨旭华/AGNEWS
2021-11-11 06:22:25 +00:00
Xiaoda Zhang a772767265 support reshape in sharding propagation:
1) using 'swc index of strategy_cost_' as reshape's selected strategy;
2) when encountering reshape in BFS, select the 'swc index' with zero communication cost;
3) when encountering a reshape that is already visited, check whether there exists communication between reshape and current operator. It is OK if communication happens between two configured operators;
4) currently, two consecutive reshapes are not supported;
5) adjusting BFS structure in graph_costmodel.cc;
6) adjusting some code in step_auto_parallel.cc to avoid cyclomatic complexity.
2021-11-11 11:35:43 +08:00
l00591931 9353bd10a4 Enable tuple as variable in optimizer 2021-11-11 11:31:05 +08:00
Megalomania c34bbabed9 [feat] [assistant] [I3T96M] add new loader AGNEWS 2021-11-09 23:51:19 -08:00
yangzhenzhang 8431ba616c add output strategy for op init 2021-11-10 15:35:45 +08:00
rescue 22e03ab12e Adding offload hardware accelerator. 2021-11-10 07:03:43 +00:00
i-robot f1f7731fb2 !25964 Fix serdes multithreading bug
Merge pull request !25964 from zetongzhao/serdes_multithreading
2021-11-09 15:48:06 +00:00
i-robot 14c3517b9a !25452 Add Gradient Sharding
Merge pull request !25452 from huangxinjing/pipeline_shard_mini_step
2021-11-09 08:15:23 +00:00
huangxinjing f354ab22a3 add pipeline shard interface
Add support for no pipeline accugradient

Add delay tag for fusion op

Optimizer the visite order

add mirror for mini step control

Move the group to attributes

Add gradient_shard control for the mini step

Fix code stype

Fix ut description

Add interface
2021-11-09 09:11:13 +08:00
i-robot d89a39c661 !25851 MD Profiling Start and Stop Support
Merge pull request !25851 from cathwong/ckw_prof_startstop4
2021-11-08 16:16:42 +00:00
i-robot 527abb8ede !26003 [MD] Added restrictions on shuffle and num_samples
Merge pull request !26003 from liyong126/fix_shuffle_and_num_samples
2021-11-08 11:58:08 +00:00
i-robot efc33a8225 !25745 F.grad support get gradient by position
Merge pull request !25745 from zhang_sss/grad
2021-11-08 08:59:23 +00:00
liyong 79891feadb fix shuffle and num_samples issue 2021-11-08 15:33:01 +08:00
zhang__sss 8bae4d9d50 grad 2021-11-08 14:12:58 +08:00
Cathy Wong cdf3126459 MD Profiler Start Stop Support 2021-11-05 19:46:39 -04:00
zetongzhao 5e8377ea5c fix multithreading bug 2021-11-05 16:49:18 -04:00
i-robot ded1c77bbf !25765 neighborExchangeV2 & grad
Merge pull request !25765 from TuDouNi/neighborExchangeV2
2021-11-05 09:31:03 +00:00
ttudu e953c15cd2 NeighborExchangeV2 & Grad 2021-11-05 11:00:46 +08:00
i-robot 7c14f984ed !25793 add output strategy for shard
Merge pull request !25793 from yangzhenzhang/add-output-strategy
2021-11-05 01:19:01 +00:00
i-robot 76f4f77cc2 !24520 Add graph run history to dump structure
Merge pull request !24520 from parastooashtari/multi_root_graph_dump
2021-11-04 12:55:01 +00:00
i-robot 92b81d3221 !23257 [assistant][ops][DBToAmplitudeOp]
Merge pull request !23257 from 杨旭华/DBToAmplitude
2021-11-04 10:32:32 +00:00
yangzhenzhang 6ad6304b77 add output strategy 2021-11-04 16:28:54 +08:00
i-robot 2828f317f7 !25718 optimize implicit convert error message
Merge pull request !25718 from chujinjin/optimize_implicit_convert_error_msg
2021-11-03 12:31:56 +00:00
yujianfeng fc769a79fe Fix the unloadable bprop mindir files 2021-11-03 14:29:56 +08:00
Isaac 69f57bc5b1 [feat][assistant][I40GXD]add new data operator DBToAmplitude 2021-11-02 23:45:27 +08:00
parastooashtari 1a59dc37bf add graph execution order history to dump 2021-11-02 11:00:38 -04:00
chujinjin 26410ccf75 optimize implicit convert error message 2021-11-01 17:34:11 +08:00
liyong 41e8280f55 add mindrecord overwrite 2021-11-01 10:44:20 +08:00
i-robot 45882752ba !25644 [Fallback] Support builtin type
Merge pull request !25644 from huangbingjian/fallback_set
2021-10-30 10:01:52 +00:00
i-robot f16ed11237 !25651 Add some fallback testcases
Merge pull request !25651 from Margaret_wangrui/fallback_tests
2021-10-30 09:21:46 +00:00
huangbingjian 5063ee55bc [Fallback] Support builtin type: set, dict, slice, bool, int, float, str 2021-10-30 14:54:59 +08:00
yujianfeng 195563c67f Fix the random failure of ut tests in ci 2021-10-30 14:09:12 +08:00
i-robot b27520b6ae !25640 fix minddata ut core
Merge pull request !25640 from luoyang/serving
2021-10-30 01:35:32 +00:00
i-robot 7d50c3d5d7 !25551 [Fallback] Added test cases for python built-in functions
Merge pull request !25551 from huangbingjian/add_fallback_testcases
2021-10-29 09:15:19 +00:00
luoyang beba798e00 fix minddata ut core 2021-10-29 16:28:22 +08:00
i-robot 958c2a8e00 !25560 Support bytes input for decode op
Merge pull request !25560 from luoyang/serving
2021-10-29 06:47:02 +00:00
Margaret_wangrui 6275cdcf7a add fallback testcases 2021-10-29 12:02:16 +08:00
i-robot e43d0ee554 !25613 [MD] fix dataset ut part06
Merge pull request !25613 from liyong126/fix_md_ut_part06
2021-10-29 03:32:27 +00:00
i-robot 48699c939c !25544 add parallel op for resizenearestneighbor
Merge pull request !25544 from yangzhenzhang/add-parallel-op-for-resizenearestneighbor
2021-10-29 02:47:49 +00:00
liyong b9bad0bdbb fix md ut part06 2021-10-29 10:26:34 +08:00
huangbingjian 02f72ab3ae [Fallback] Added test cases for python built-in functions 2021-10-29 09:33:16 +08:00