Col_lin
/
mindspore2022
forked from huawei/mindspore2022
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
42,205 Commits 18 Branches 22 Tags 3.6 GiB
Commit Graph

314 Commits

Author SHA1 Message Date
Jimmy Qi c3ab951fa9 Parallelize calculating tensor statistics 2021-12-14 20:40:11 +00:00
sabrinasun 542d715217 seperate constant from pb 2021-12-14 13:19:14 -05:00
Parastoo Ashtari 26a928a888 fix sink true history file bug 2021-12-13 13:59:00 -05:00
Parastoo Ashtari 76f074b77e Debugger support ascend mindrt 2021-12-08 13:27:58 -05:00
He Wei 4f04757e16 Fix some typo issues 
1. Sequeue --> Sequence
2. Interger --> Integer
 2021-12-07 22:21:44 +08:00
Parastoo Ashtari 056d61a947 fix unchanged watchpoint condition bug 2021-12-03 17:14:30 -05:00
Parastoo Ashtari 9c036d1229 Fix GPU sink_mode True and Dump multi graph ERROR issue 2021-12-02 13:01:11 -05:00
i-robot 544b079c1e !27018 Fix ascend bug for sending wrong current_root_graph_id for each step (online debugger) 
Merge pull request !27018 from parastooashtari/online_debug_bug
 2021-12-01 06:23:22 +00:00
Parastoo Ashtari 6382ff76d3 fix ascend bug for sending current_root_graph_id 2021-11-30 16:04:48 -05:00
TinaMengtingZhang 40bc5a2f46 Fix fusion op name 2021-11-30 12:20:04 -05:00
Jimmy Qi 2a4a98ce9d Refactor original kernal name so all output tensors are included in stat 
dump
 2021-11-26 19:21:54 +00:00
i-robot a92d97adb2 !25850 Add CANN tensor data callback support for ascend async dump - part2 
Merge pull request !25850 from TinaMengtingZhang/cann_api_adapt
 2021-11-25 02:11:28 +00:00
Parastoo Ashtari 8f12b496b4 fix GPU dump sink=True issue 2021-11-24 14:33:09 -05:00
TinaMengtingZhang 07b653103e Support Cann callback api for ascend async dump 2021-11-24 10:35:29 -05:00
He Wei 41dcac9c49 Replace std::unordered_map/set with robin-hood-hashing 
Robin-hood-hashing (https://github.com/martinus/robin-hood-hashing)
is considered faster then std::unordered_map/set,
so we use it to improve mindspore performance.

1. robin_hood head file in `third_party/robin_hood/include`;
2. In `utils/hash_map.h` and `utils/hash_set.h`, we define:
 - mindspore::HashMap as an alias of robin_hood::unordered_map;
 - mindspore::HashSet as an alias of robin_hood::unordered_set;
3. Replace:
 - `#include <unordered_map>` --> `#include "utils/hash_map.h"`;
 - `#include <unordered_set>` --> `#include "utils/hash_set.h"`;
 - `std::unordered_map` --> `mindspore::HashMap`;
 - `std::unordered_set` --> `mindspore::HashSet`;
 - `map.insert(std::pair(key, value))` --> `map.emplace(key, value)`;
 - `[] (const std::pair<K, V> &p) {..} ` --> `[] (const auto &p) {..} `;
4. Fix issues found by switch to robin_hood:
 - AnfNodeConfig hash and equal;
 - Fix a bug in `Slice::operator==()`;
 - Fix a bug in `CNode::HasPrimalAttr()`;
 - Fix map.erase() usage bugs: `map.erase(iter++)` --> `iter = map.erase(iter)`;
 - Fix some iterator invalidated problem;
5. Some std::unordered_map/set can not replace by robin_hood:
 - As parameter of functions that exposed to python by pybind11;
 - Use bad hash that cause robin_hood::map over_flow, such as AbstractBasePtrListHasher;
6. Update cpp unit tests;
7. Add build option '-F' to enable robin_hood, default on.
 2021-11-24 10:47:40 +08:00
Parastoo Ashtari 574ba6930a add error_no_value error_code 2021-11-21 12:05:57 -05:00
i-robot 3269c9b881 !26335 Support MindSpore on MacOS 
Merge pull request !26335 from xulei/ms_mac_compile_br
 2021-11-19 09:49:32 +00:00
xiefangqi 24ac2382ff mac compile 2021-11-18 14:20:08 +08:00
Parastoo Ashtari 7f682ba2f6 partial support for multi root graph in online debugger 2021-11-16 10:23:59 -05:00
Jimmy Qi b21c099767 Add option to dump tensor statistics in csv format 2021-11-15 19:00:59 +00:00
yelihua cfa8c7a0e8 update OWNERS 2021-11-08 17:23:35 +08:00
i-robot 76f4f77cc2 !24520 Add graph run history to dump structure 
Merge pull request !24520 from parastooashtari/multi_root_graph_dump
 2021-11-04 12:55:01 +00:00
He Wei fd8bbb4d96 Optimize isa() and type id related code. 
1. Let 'isa<T>()' calls 'IsSameTypeId()' when T is final,
   and we add 'final' mark to some final classes derived from Base;

2. Generate type id at compile time using constexpr hash function,
   remove TypeIdManager and related code;

3. Add a tool script 'scripts/check_tid.sh' to check tid uniqueness;

4. Improve type search in 'proto_exporter.cc' and 'convert_utils_py.cc';

5. Add some missed MS_DECLARE_PARENT;

6. Ensure calls of 'parent_t::IsFromTypeId()' are all inlined.
 2021-11-03 14:14:44 +08:00
parastooashtari 1a59dc37bf add graph execution order history to dump 2021-11-02 11:00:38 -04:00
maning202007 badfaadc0d Fix code warnings in debugger 2021-10-27 19:53:56 +08:00
maning202007 8ee33007b1 add const to the data_ptr definition 
Fix pclint for debugger

fix bugs

fix duplicated code issue

Fix the depth of method over 4 issue

fix comments

fix CI errors

remove redundancy arguments
 2021-10-20 12:05:04 +08:00
i-robot 73e545c56f !23799 Fix debugger exit timing too long issue due to heartbeat thread 
Merge pull request !23799 from sabrinasun_59ee/heartbeat
 2021-10-15 01:35:19 +00:00
sabrinasun 41d737553a sync commercial branch self check fix to master 2021-10-13 23:04:49 -04:00
sabrinasun 8290c69d55 fix exit time too long issue 2021-10-13 22:37:32 -04:00
John Tzanakakis 7e7b444c63 remove verbose option from DbgServices 2021-10-06 11:38:05 -04:00
TinaMengtingZhang f84b27b444 sync code self check from dev 1.1 2021-10-04 13:24:28 -04:00
John Tzanakakis 76c6af7722 use ms logging instead of custom debugger logging 2021-09-30 00:09:51 -04:00
i-robot 8c93e77688 !24079 Sync code warning fix to master 
Merge pull request !24079 from sabrinasun_59ee/warning
 2021-09-26 04:34:40 +00:00
sabrinasun 77111054d2 sync clean warning fix to master 2021-09-24 17:27:52 -04:00
i-robot 7bcf2553a4 !23944 Add safety check for LoadParametersAndConst function call 
Merge pull request !23944 from parastooashtari/multi_root_graph_gpu
 2021-09-23 02:26:49 +00:00
TinaMengtingZhang dbed33a2ad Fix online debugger terminate with 1 issue: I3YAPB 2021-09-22 10:59:46 -04:00
Parastoo Ashtari b4bb5a7989 add safety check for LoadParametersAndConst 2021-09-22 10:12:42 -04:00
i-robot 542819f08f !23566 Support multi root graph GPU dump mindrt runtime 
Merge pull request !23566 from parastooashtari/multi_root_graph_gpu
 2021-09-22 03:06:48 +00:00
i-robot e5bdb5dd6d !23823 Clean pclint, codex warning 
Merge pull request !23823 from sabrinasun_59ee/warning
 2021-09-22 01:43:44 +00:00
i-robot 7cf815bcfa !23509 Reading mindspore version from version.txt 
Merge pull request !23509 from sabrinasun_59ee/version
 2021-09-22 01:36:12 +00:00
sabrinasun ca1e6d869e clean pclint, codex warning 2021-09-21 18:55:25 -04:00
Parastoo Ashtari 7c9ecff30b support multi network dump in GPU 2021-09-21 13:43:24 -04:00
i-robot 60b33924dc !23711 Fix the code warnings 
Merge pull request !23711 from maning202007/master
 2021-09-19 06:21:24 +00:00
rescue a67275d857 read ms version from version.txt 2021-09-18 19:52:45 -04:00
maning202007 20115564f7 Fix code warnings 2021-09-18 17:53:47 +08:00
huanghui 80416a71e0 fix warnings of pclint plus, codedex and codecheck 2021-09-18 12:13:41 +08:00
TinaMengtingZhang f4db1dabe0 Merge code safety check to master 2021-09-17 17:20:52 -04:00
sabrinasun 3a349a9219 add ut test for offline debugger 2021-09-14 18:46:22 -04:00
i-robot f1e92aeb00 !23186 use Common::CreatePrefixPath instead of Common::GetRealPath 
Merge pull request !23186 from yelihua/dev
 2021-09-10 03:35:49 +00:00
yelihua 7c3994e48e use Common::CreatePrefixPath instead of Common::GetRealPath 2021-09-09 20:34:25 +08:00
TinaMengtingZhang 1670fb9def Implement queue waiting for offline dbg memory control module 2021-09-08 14:36:04 -04:00
maning202007 de3a5ee9ad Update teh ms_version to 1.5.0 for debugger 2021-09-06 15:56:20 +08:00
TinaMengtingZhang b039cc3682 fix memory usage in header reading 2021-09-03 13:51:54 -04:00
yelihua 912d16b9a5 stop sendheartbeat when finish normally 2021-09-02 20:44:56 +08:00
TinaMengtingZhang fef60422e0 support offline debugger memory control 2021-09-01 14:55:47 +08:00
John Tzanakakis 80c566e325 fix yolov3 tiny multi root graph seg fault 2021-08-30 17:29:01 -04:00
Zhang Qinghua a137fa1d0b Optimize the Executors routines. 
- Fix the key generating.
- Distinguish the executors.
 2021-08-28 17:36:12 +08:00
yelihua a6140b8853 fix the bug about readtensor for offline debugger 2021-08-27 21:19:29 +08:00
Parastoo Ashtari bf034bddb5 Apply comments on tensor stat online and offline debugger 2021-08-26 17:40:01 -04:00
Parastoo Ashtari 5ed11885d7 Add tensor base and stat info to online debugger 2021-08-25 13:10:13 -04:00
i-robot 2edaba38bf !21389 Add Tensor Base and Stat info to offline debugger 
Merge pull request !21389 from parastooashtari/tensor_info_levels
 2021-08-25 02:08:34 +00:00
Parastoo Ashtari ff83dee704 Add tensor base and stat info to offline debugger 2021-08-24 18:19:59 -04:00
ms_yan 36a8886ca2 Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset" 
This reverts commit b077aa1cab.

Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"

This reverts commit 4e6f7dc97d.

delete pass_registry_test.cc

comment  hiai_nlu_model_multi.pb related  line
 2021-08-23 01:46:38 +08:00
djc b077aa1cab [feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset 2021-08-22 16:26:45 +08:00
djc 4e6f7dc97d [feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset 2021-08-22 13:39:37 +08:00
i-robot de9fae6ce4 !21688 Fix coredump caused by heartbeat 
Merge pull request !21688 from sabrinasun_59ee/fix
 2021-08-19 01:02:28 +00:00
Parastoo Ashtari 6d93ab5e35 Fixed old runtime GPU dump issue for multigraph 2021-08-17 18:16:25 -04:00
sabrinasun 07009fbbe8 fix core dump issue caused by heartbeat 2021-08-16 21:41:01 -04:00
sabrinasun 3150413259 change privare member name 2021-08-09 16:10:49 -04:00
i-robot fe3aa8cfc2 !19891 Sending heartbeat periodically to MI 
Merge pull request !19891 from sabrinasun_59ee/dev
 2021-08-09 13:57:55 +00:00
i-robot 6b635cc718 !21433 Recover the environment variable MS_DEBUGGER_HOST 
Merge pull request !21433 from maning202007/master
 2021-08-09 05:24:08 +00:00
sabrinasun 6e22a8c133 fix master ci warning 2021-08-06 16:57:15 -04:00
maning202007 19dd13006c revert 9cdd3bbf 
Recover the environment variable MS_DEBUGGER_HOST

Update the debugger version to 1.4.0
 2021-08-06 15:20:27 +08:00
zhangzhaoju 610ee46ebe Add file open failure info while file open failed 2021-08-03 19:52:38 +08:00
sabrinasun c59989b886 send heartbeat to ui 2021-08-02 20:55:53 -04:00
maning202007 9cdd3bbfba Remove MS_DEBUGGER_HOST 2021-07-29 10:16:38 +08:00
i-robot 0303bbf8fa !21009 Fix the problems from self codecheck 
Merge pull request !21009 from maning202007/master
 2021-07-29 01:58:26 +00:00
maning202007 5ebf2bbf63 Fix the problems from self codecheck 2021-07-28 17:48:36 +08:00
He Wei b95e592324 Implement float16 to remove Eigen dependence 2021-07-28 16:46:46 +08:00
John Tzanakakis 3a6c88e3e6 unify overflow wp support for online and offline debugger 2021-07-27 00:53:53 -04:00
i-robot f44a92c4b3 !20504 Fix warning of codes 
Merge pull request !20504 from JoyLvliang/fix_warning_of_codes
 2021-07-23 06:46:21 +00:00
i-robot 024856a006 !20605 disable mindRT in control flow 
Merge pull request !20605 from limingqi107/bug_fix3
 2021-07-22 10:43:15 +00:00
7347157+joylvliang@user.noreply.gitee.com ab32ebc758 fix_warning_of_codes 2021-07-22 16:50:48 +08:00
limingqi107 1958b436b7 disable mindRT in control flow 2021-07-22 14:33:41 +08:00
i-robot f250695387 !20579 [CodeClean]fix code clean problems of ME 
Merge pull request !20579 from chenfei_mindspore/code_clean_of_master
 2021-07-21 09:13:07 +00:00
i-robot 2c36f092e3 !20544 Fix the forever loop for multigraph on gpu 
Merge pull request !20544 from maning202007/master
 2021-07-20 11:34:40 +00:00
chenfei 868a6d558f code clean of r1.3 2021-07-20 16:48:40 +08:00
maning202007 2b3d215ef8 Fix the forever loop for multigraph on gpu 2021-07-20 11:51:31 +08:00
l00591931 d2a44c02da Code fix 2021-07-20 09:32:55 +08:00
i-robot f16a4fd94e !20381 [Debugger] Fix CodeDex and PCLint warnings master 
Merge pull request !20381 from harshvardhangupta/ci_fixes_dbg_master
 2021-07-16 15:59:38 +00:00
i-robot 51bb146e1a !20384 Fix for SinGAN net run into forever loop on GPU. 
Merge pull request !20384 from parastooashtari/multigraph
 2021-07-16 06:51:29 +00:00
Parastoo Ashtari d2f6dd1a32 remove CheckDatasetGraph from debug_actor.cc 2021-07-15 19:45:06 -04:00
harshvardhangupta 71f92a5b6d fix ci warnings in dbg 2021-07-15 14:19:10 -04:00
TinaMengtingZhang 05252d1303 remove unused files in ccsrc/debug 2021-07-15 11:19:51 -04:00
Parastoo Ashtari a5d749a521 fixed multigraph wp issue 2021-07-13 19:44:23 -04:00
i-robot 960b8cb1a8 !20116 fix online debug overflow wp 
Merge pull request !20116 from john_tzanakakis/jt_bug_fixes
 2021-07-13 11:13:53 +00:00
Parastoo Ashtari cdd7a672bd fixed core dump issue in bert net 2021-07-12 16:31:29 -04:00
John Tzanakakis 39294bedfd fix online debug overflow wp 2021-07-12 14:02:28 -04:00
i-robot c1b7791c29 !19778 Change all fullname_with_scope call in dump and debugger 
Merge pull request !19778 from TinaMengtingZhang/dump_data_diff
 2021-07-10 06:48:55 +00:00
TinaMengtingZhang b9e391b6ae Change fullname_with_scope in dump and online debugger 2021-07-09 15:54:19 -04:00