Commit Graph

119 Commits

Author SHA1 Message Date
ttudu adb18b82ca dynamic shape CPU & GPU 2022-03-22 13:03:31 +08:00
zhoufeng b7bb53ff73 build libmindspore_backend.so
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-03-17 19:14:45 +08:00
zhoufeng f49b195c39 extract common as an independent shared library
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-02-26 10:55:51 +08:00
chenlei_autodiff 5df9f01310 [GraphKernel] decouple convert_const_input_to_attr. 2022-02-15 10:27:34 +08:00
marui d47e79b04c Refactor ccsrc directories and CMakeLists files 2022-02-13 14:37:51 +08:00
huanghui f3ebb1a0e1 adapt some cpp ut for unused nodes eliminate 2022-01-21 11:30:39 +08:00
TronZhang 58f386fe2a Add Custom actor nodes and custom actor support for dynamic shape case 2022-01-07 17:31:37 +08:00
zhoufeng 9d432d029d modify dev env name
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2021-12-16 14:12:24 +08:00
He Wei 41dcac9c49 Replace std::unordered_map/set with robin-hood-hashing
Robin-hood-hashing (https://github.com/martinus/robin-hood-hashing)
is considered faster then std::unordered_map/set,
so we use it to improve mindspore performance.

1. robin_hood head file in `third_party/robin_hood/include`;
2. In `utils/hash_map.h` and `utils/hash_set.h`, we define:
 - mindspore::HashMap as an alias of robin_hood::unordered_map;
 - mindspore::HashSet as an alias of robin_hood::unordered_set;
3. Replace:
 - `#include <unordered_map>` --> `#include "utils/hash_map.h"`;
 - `#include <unordered_set>` --> `#include "utils/hash_set.h"`;
 - `std::unordered_map` --> `mindspore::HashMap`;
 - `std::unordered_set` --> `mindspore::HashSet`;
 - `map.insert(std::pair(key, value))` --> `map.emplace(key, value)`;
 - `[] (const std::pair<K, V> &p) {..} ` --> `[] (const auto &p) {..} `;
4. Fix issues found by switch to robin_hood:
 - AnfNodeConfig hash and equal;
 - Fix a bug in `Slice::operator==()`;
 - Fix a bug in `CNode::HasPrimalAttr()`;
 - Fix map.erase() usage bugs: `map.erase(iter++)` --> `iter = map.erase(iter)`;
 - Fix some iterator invalidated problem;
5. Some std::unordered_map/set can not replace by robin_hood:
 - As parameter of functions that exposed to python by pybind11;
 - Use bad hash that cause robin_hood::map over_flow, such as AbstractBasePtrListHasher;
6. Update cpp unit tests;
7. Add build option '-F' to enable robin_hood, default on.
2021-11-24 10:47:40 +08:00
dayschan cbb84ff580 Move IsRealKernel and IsRealCNodeKernel from AnfAlgo to AnfUtils
the function IsOneOfPrimitive and IsOneOfPrimitiveCNode is useful,
we can move them into anf.cc
2021-11-09 14:34:21 +08:00
zhoufeng fb17c448c2 add pass switch
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2021-11-01 16:33:02 +08:00
ms_yan 36a8886ca2 Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset"
This reverts commit b077aa1cab.

Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"

This reverts commit 4e6f7dc97d.

delete pass_registry_test.cc

comment  hiai_nlu_model_multi.pb related  line
2021-08-23 01:46:38 +08:00
djc 4e6f7dc97d [feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset 2021-08-22 13:39:37 +08:00
zhoufeng 03a56f2bb0 alltoall exception handle
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2021-08-11 17:30:49 +08:00
zhoufeng 2143241092 change neighbor exchange to all to all
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2021-08-01 18:21:28 +08:00
laiyongqiang 1533435015 replace memcpy_async with tensor move 2021-04-15 16:12:01 +08:00
dingpeifei 3c9d8cb073 The input and output of batchnorm reverse operator increase pass in ascend platform under the mode of pynitve 2021-03-27 16:49:38 +08:00
dingpeifei 87e41aaeee IR operators of GPU and CPU are unified as batchnorm 2021-03-18 19:02:28 +08:00
liubuyu 518818fbef reshape type for 3d nodes 2021-03-10 08:56:10 +08:00
yuchaojie 6d195f340c add SyncBatchNorm 2021-02-27 14:32:54 +08:00
mindspore-ci-bot aebe263dce !11895 unify mindir for different backend: the output num of optimizer ops, the backward of concat
From: @wangnan39
Reviewed-by: 
Signed-off-by:
2021-02-05 16:27:19 +08:00
jinyaohui 8022f9a6ed modify pack to stack 2021-02-04 18:54:31 +08:00
wangnan39@huawei.com cd9173fdfd unify the output num of optimizer ops 2021-02-04 17:46:00 +08:00
shenghong96 49144fde37 fix UT of test_topk_no_split 2021-02-02 16:52:20 +08:00
xsmq a8259bae9b disable ut cpp case(test_topk_no_split) 2021-02-02 15:52:05 +08:00
lilei 9a45c4419c modify batch_normal 2021-01-13 20:59:46 +08:00
jjfeing 8fb7d11ecb fix topk help 4096 2020-11-26 19:16:37 +08:00
huanghui 1c6c280da7 fix unsorted_segment_sum_fission pass 2020-11-11 11:25:55 +08:00
Yi Huaijie d7faa77b5e support int64 shape 2020-11-05 21:15:49 +08:00
huanghui b7519b7418 unify save_graphs_path 2020-10-15 10:15:16 +08:00
mindspore-ci-bot c951d42c2c !6728 [Ascend][DynamicShape] Dynamic shape feature
Merge pull request !6728 from caifubi/dynamic_shape_share_2
2020-10-12 09:07:39 +08:00
caifubi d3b978147f Ascend Dynamic Shape 2020-10-10 19:11:47 +08:00
jjfeing 755863ebae insert memcpy when hccl node 2020-10-10 17:03:50 +08:00
mindspore-ci-bot 3048240f16 !5508 Add AdamApplyOneWithDecayAssign fusion pass
Merge pull request !5508 from YuJianfeng/adam_assign
2020-09-02 11:23:34 +08:00
fary86 fcbb3e0edc Refactor ms_context implementation 2020-08-30 22:51:40 +08:00
yujianfeng 4b77f6b53c Add AdamApplyOneWithDecayAssign fusion pass 2020-08-29 17:54:15 +08:00
yujianfeng e688e1df32 Fix remove internal output for unique device target 2020-08-26 17:31:35 +08:00
Wei Luning c1c30a44f1 rename param_value -> param_info 2020-08-18 11:16:28 +08:00
huanghui b8d7f6d77f add UnsortedSegmentSum fission pass 2020-08-12 19:17:19 +08:00
yujianfeng 8a77751988 Add AdamApplyOneAssign and AdamApplyOneWithDecayAssign fusion pass 2020-08-10 14:46:37 +08:00
mindspore-ci-bot b045f47428 !3983 Add ReduceMin fission pass
Merge pull request !3983 from huanghui/reduce-min-fission-pass
2020-08-05 19:46:00 +08:00
huanghui 30000fdb52 add ReduceMin fission pass 2020-08-05 10:46:01 +08:00
liubuyu d81862a916 decoupling core and context 2020-08-05 08:15:14 +08:00
Wei Luning a05c38bb63 make python Parameter inherit from Tensor 2020-08-03 09:12:24 +08:00
WilliamLian 0179724dcd spilit unspported transdata to two transdata from special format -> defualt -> default -> special 2020-07-28 14:23:31 +08:00
yujianfeng 4d18e9ec35 Fix internal multiple outputs check 2020-07-23 08:56:42 +08:00
huanghui f1563d2d37 insert memcpy async if hccl op cascade 2020-07-22 10:43:38 +08:00
mindspore-ci-bot 6f8863b65d !3198 synchronize latest Ascend software suite 18 Jul 2020, and merging branches
Merge pull request !3198 from yanghaoran/code_sync_0718
2020-07-19 14:14:45 +08:00
yanghaoran 859acc6d2a synchronize latest Ascend software suite 18 Jul 2020, and merging branches 2020-07-18 21:09:55 +08:00
yujianfeng fa0684d12d Add pack and concat fission pass 2020-07-18 15:39:06 +08:00