Commit Graph

31 Commits

Author SHA1 Message Date
zhoufeng b7bb53ff73 build libmindspore_backend.so
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-03-17 19:14:45 +08:00
zhoufeng f49b195c39 extract common as an independent shared library
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2022-02-26 10:55:51 +08:00
lilei 05189459ab auto insert VirtualDataset node for master 2021-12-06 21:39:37 +08:00
lichenever ae40fea111 add_CN_API 2021-12-03 14:12:43 +08:00
He Wei 41dcac9c49 Replace std::unordered_map/set with robin-hood-hashing
Robin-hood-hashing (https://github.com/martinus/robin-hood-hashing)
is considered faster then std::unordered_map/set,
so we use it to improve mindspore performance.

1. robin_hood head file in `third_party/robin_hood/include`;
2. In `utils/hash_map.h` and `utils/hash_set.h`, we define:
 - mindspore::HashMap as an alias of robin_hood::unordered_map;
 - mindspore::HashSet as an alias of robin_hood::unordered_set;
3. Replace:
 - `#include <unordered_map>` --> `#include "utils/hash_map.h"`;
 - `#include <unordered_set>` --> `#include "utils/hash_set.h"`;
 - `std::unordered_map` --> `mindspore::HashMap`;
 - `std::unordered_set` --> `mindspore::HashSet`;
 - `map.insert(std::pair(key, value))` --> `map.emplace(key, value)`;
 - `[] (const std::pair<K, V> &p) {..} ` --> `[] (const auto &p) {..} `;
4. Fix issues found by switch to robin_hood:
 - AnfNodeConfig hash and equal;
 - Fix a bug in `Slice::operator==()`;
 - Fix a bug in `CNode::HasPrimalAttr()`;
 - Fix map.erase() usage bugs: `map.erase(iter++)` --> `iter = map.erase(iter)`;
 - Fix some iterator invalidated problem;
5. Some std::unordered_map/set can not replace by robin_hood:
 - As parameter of functions that exposed to python by pybind11;
 - Use bad hash that cause robin_hood::map over_flow, such as AbstractBasePtrListHasher;
6. Update cpp unit tests;
7. Add build option '-F' to enable robin_hood, default on.
2021-11-24 10:47:40 +08:00
yangzhenzhang 8431ba616c add output strategy for op init 2021-11-10 15:35:45 +08:00
yangzhenzhang 6ad6304b77 add output strategy 2021-11-04 16:28:54 +08:00
huanghui ba66c0d491 add security isolate for save_graphs 2021-09-14 10:24:12 +08:00
Zhang Qinghua 7203989c26 Support fallback feature in Graph mode (1). 2021-09-06 16:00:03 +08:00
lichenever 56b31fce42 add_no_elimilate_for_comm_op 2021-09-03 16:54:56 +08:00
lichenever 108967ff7d fix_pipeline_split_bug 2021-07-06 22:51:04 +08:00
chenfei 4f50b3dfe1 add parameter eliminate pass 2021-06-04 11:53:34 +08:00
l00591931 cf7c5840e3 Change return 2021-03-04 09:38:43 +08:00
l00591931 9ec100d069 Change TensorAdd to Add, from r1.1 to master 2021-02-01 17:53:52 +08:00
yangzhenzhang 38ea8784c6 update infer mirror ops 2021-01-15 14:53:21 +08:00
Yi Huaijie d7faa77b5e support int64 shape 2020-11-05 21:15:49 +08:00
huanghui b7519b7418 unify save_graphs_path 2020-10-15 10:15:16 +08:00
zhousiyi c25e37e7bf make backend/optimizer pybind free 2020-08-28 08:56:58 +00:00
Yi Huaijie 80bdcab982 temporarily cast between int64 and int32 to wait ME support int64 2020-08-04 12:21:06 +08:00
Yi Huaijie 518cb80133 change type of Shape from int32 to int64 2020-08-04 11:30:23 +08:00
suteng 19e45ccdb1 回退 'Pull Request !3103 : change type of Shape from int32 to int64' 2020-08-03 22:06:37 +08:00
Yi Huaijie 15d5cc396d change type of Shape from int32 to int64 2020-08-03 16:47:19 +08:00
He Wei 4eb81d7934 Rename AnfNode::user_data related functions to follow naming rule 2020-07-28 15:35:48 +08:00
yangzhenzhang e6cef98e95 delete useless code for allreduce 2020-07-22 10:13:19 +08:00
He Wei 32379f3e7a Decouple ir from frontend 2020-07-21 08:57:07 +08:00
WilliamLian 50e2fda52d refactor primitive ComputeFunction function 2020-07-16 14:36:04 +08:00
liubuyu 43c79eb853 mindspore path adjust 2020-07-14 18:07:28 +08:00
Ziyan 0925e35252 enable optimizer parallel with broadcast 2020-06-27 14:36:17 +08:00
He Wei 43e0967024 Decouple ir::Tensor class from python 2020-06-24 10:28:59 +08:00
c00425699 3bb48ffee1 use std::vector instead of std::list to promote performance for parallel module 2020-03-31 15:16:00 +08:00
zhunaipan 930a1fb0a8 initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
2020-03-27 22:54:54 +08:00