23ba47df6c
add MS_RDR_ENABLE and MS_RDR_PATH
...
MS_RDR_ENABLE should be in {0, 1}. if it is set as other value, it will
be 0 and WARNING information will be printed to tell user.
The settings in config file set by the user takes precedence over the
environment variables. If 'rdr_enable' is 0 in environment variable,
and then 'enable' is true in config file, the RDR will turned on.
2021-03-18 15:48:59 +08:00
c8ba7694c5
refactor RDR to support single name
...
1. support single name
2. add hash method for pair
3. move constructor and destructor of MemAddressInfo as public
4. remove graph_id
5. modify interval for somas info
2021-03-17 11:34:05 +08:00
0fa5a443be
fix dataset_sink_mode=True issue with GPU
2021-03-15 11:57:23 -04:00
mindspore-ci-bot
6f6d14d944
!13102 Add unique id for .dat and .dot file to avoid covering
...
From: @irmo
Reviewed-by:
Signed-off-by:
2021-03-12 14:44:54 +08:00
02ea13be38
adapt dump_proto to auto-monad
2021-03-12 11:49:20 +08:00
huanghui
a2ba47e18a
1. Add unique id for .dat and .dot file to avoid covering
...
2. Dump the end graph in gpu session and cu session
2021-03-12 09:40:00 +08:00
mindspore-ci-bot
8c34851105
!13153 [MS][RDR] saving the lastest gpu memory information of every operator
...
From: @louie5
Reviewed-by: @ouwenchang,@lixiaohui33
Signed-off-by: @lixiaohui33
2021-03-11 20:02:20 +08:00
louei5
46d78efb0c
fix saving too much gpu memory info and not skip saving kernel graph in protobuff type
2021-03-11 15:11:32 +08:00
Zhang Qinghua
f73f2d73f3
Set abstract value for reserved Depend node when merge Depend nodes.
2021-03-11 09:17:59 +08:00
mindspore-ci-bot
38da5f5536
!13048 fix rdr log when env_config_path is empty
...
From: @luopengting
Reviewed-by: @ouwenchang,@yelihua
Signed-off-by: @yelihua
2021-03-10 14:33:07 +08:00
Amir Lashkari
d83e7c41c8
Fixed log issue
...
Fixed cpplint
2021-03-09 14:23:34 -05:00
027edbb679
fix rdr log when env_config_path is empty
2021-03-09 17:32:06 +08:00
mindspore-ci-bot
68eb5125c6
!12905 reduce unnecessary blank lines, add destructor for recorders
...
From: @luopengting
Reviewed-by: @wenkai_dist,@ouwenchang
Signed-off-by: @wenkai_dist
2021-03-09 14:18:56 +08:00
e4e04c81ef
reduce unnecessary blank lines, add destructor for recorders
2021-03-09 11:09:54 +08:00
mindspore-ci-bot
82c095a4d7
!12720 add compile option H to visible hidden interface
...
From: @chuckchen521
Reviewed-by:
Signed-off-by:
2021-03-08 19:09:14 +08:00
mindspore-ci-bot
52909e6d64
!12894 [MS][RDR] Fix bugs in recording gpu memory information by RDR
...
From: @louie5
Reviewed-by:
Signed-off-by:
2021-03-08 11:31:04 +08:00
mindspore-ci-bot
a726ebd087
!12937 Log proper messege for debugger not supporting CPU
...
From: @alashkari
Reviewed-by: @john_tzanakakis,@mikef,@john_tzanakakis,@tom__chen
Signed-off-by:
2021-03-06 05:31:54 +08:00
mindspore-ci-bot
b6055f99b2
!12942 Fix UMonad type not supported in Online Debugger
...
From: @alashkari
Reviewed-by: @john_tzanakakis,@mikef
Signed-off-by: @john_tzanakakis
2021-03-06 05:30:59 +08:00
Amir Lashkari
497e717081
Fix UMonad type in online debugger
2021-03-05 14:40:59 -05:00
Amir Lashkari
e4f321ff82
Added log for debugger not supporting CPU
...
Fixed bug v1
Fixing UMonad Issue with online debug
remove
2021-03-05 14:27:16 -05:00
mindspore-ci-bot
5ba445c19f
!12872 fix log level
...
From: @jiang-shuqiang
Reviewed-by:
Signed-off-by:
2021-03-06 02:31:16 +08:00
l00591931
680324f225
Change make tuple in core.ops
2021-03-05 10:54:33 +08:00
mindspore-ci-bot
2f06178fa9
!12815 [MS][RDR] add trigger point for distribute task failed
...
From: @luopengting
Reviewed-by:
Signed-off-by:
2021-03-05 09:24:18 +08:00
chuck
89eed7aa27
add compile option H to visible hidden interface
2021-03-04 22:52:48 +08:00
louei5
6ed2ab2976
fix bugs in recording gpu memory information by RDR
2021-03-04 22:48:48 +08:00
mindspore-ci-bot
9b527cc9dd
!12800 Optimize the compile performance in Parser, FG, Manager and Renormalize.
...
From: @zh_qh
Reviewed-by:
Signed-off-by:
2021-03-04 19:46:49 +08:00
mindspore-ci-bot
423dcfc917
!12836 Change return in core_ops
...
From: @liangzhibo
Reviewed-by: @kingxian,@jpc_chenjianping
Signed-off-by: @kingxian
2021-03-04 19:27:44 +08:00
db5de7fd28
add trigger point for distribute task failed
...
1. add trigger point
2. reduce unuse import
3. modify GetRealFilePath
2021-03-04 16:52:28 +08:00
Zhang Qinghua
8b8c59f01e
Optimize the compile performance in Parser, FG, Manager and Renormalize:
...
---
Remove the routine of handling isolated nodes in Renormalize.
Add isolated nodes from Parser&Resolver.
Modify isolated nodes handling in FG&Manager.
Optimize the renormalize routines.
Other optimizations.
2021-03-04 16:01:54 +08:00
2b6a6424e2
fix log level
2021-03-04 15:26:08 +08:00
l00591931
cf7c5840e3
Change return
2021-03-04 09:38:43 +08:00
louei5
99203038a5
support recording gpu memory information and graph execute order
2021-03-03 22:04:31 +08:00
mindspore-ci-bot
6dac92aedf
!12709 Fix the segmentation fault when open debugger.
...
From: @maning202007
Reviewed-by:
Signed-off-by:
2021-03-02 19:21:09 +08:00
815a04cf75
fix the segmentation fault when open debugger.
2021-03-01 14:34:05 +08:00
7914363d25
optimize rdr mainly to reduce the redundant code
...
1. move common function to base recorder
2. add UpdataRdrEnable() for recorder manager, and update once
3. add delimiter virable for base recorder, set it as '.'
4. modify recorders to use the suffix parameter of GetFileRealPath()
5. improve the text in ms_context
Can not add RdrEnablePlatform because linux is supported only.
If os is linux, (!is_rdr_supported && rdr_enable) will be false always,
else, (is_rdr_supported && !rdr_enable) will be false always.
2021-03-01 09:32:57 +08:00
mindspore-ci-bot
5524280075
!12550 [MS][RDR] recording func_graph in pipeline and task debug info
...
From: @louie5
Reviewed-by:
Signed-off-by:
2021-02-27 15:22:24 +08:00
louei5
9a48405a41
recording func_graph in pipeline and task debug information
2021-02-26 19:20:05 +08:00
722eb2ec5a
ascend graph dump trigger at data dump
2021-02-25 12:04:59 -05:00
louei5
3d540a515a
add task_debug_info recorder
2021-02-24 14:19:24 +08:00
mindspore-ci-bot
efbda3bec5
!12534 Ignore renormalization if no changes made after last renormalization, and release all data after finished RDR checking.
...
From: @zh_qh
Reviewed-by: @ginfung,@hwhewei
Signed-off-by: @ginfung
2021-02-23 18:32:43 +08:00
Zhang Qinghua
88e4dbeb04
Ignore renormalization if no changes made after last renormalization.
...
Release all data after finished RDR checking.
2021-02-23 15:26:23 +08:00
mindspore-ci-bot
b4a3f3c1ba
!12490 support recording stream execute order
...
From: @luopengting
Reviewed-by:
Signed-off-by:
2021-02-23 15:01:58 +08:00
mindspore-ci-bot
590e889cba
!12265 [MS][RDR] optimize saving FuncGraph
...
From: @louie5
Reviewed-by:
Signed-off-by:
2021-02-23 14:26:14 +08:00
louei5
d1d5976ca2
using rdr module in proper position
2021-02-23 09:58:41 +08:00
7fe901491a
support recording stream execute order
...
1. add ExecNode and StreamRxecOrderRecorer
2. add json format and json dump for stream exec order
3. add stream exec order api
4. add in CMakeLists
2021-02-22 11:44:36 +08:00
xuxs
c70049b190
mindquantum
...
mindquantum
cmake lint
projectq patch
test pqc
space
pylint
pqc python ops
doc
check
bug
bug
bug
bug
check boundary condition
mindquantum in log_adapter
mindquantum in adapter and recorder cc
substract to subtract
public variable to private variable
public variable to private variable
commit
debug
debug
const in utils
delete dtol
clint
2021-02-20 12:33:51 +08:00
mindspore-ci-bot
1252250d7e
!12299 check ENABLE_DUMP_IR if user set env_config_path
...
From: @luopengting
Reviewed-by: @yelihua,@ouwenchang
Signed-off-by: @ouwenchang
2021-02-18 14:12:37 +08:00
bd7e5e9d37
check ENABLE_DUMP_IR if user set env_config_path
...
If the ENABLE_DUMP_IR is off, the program will raise ValueError to
remind user to turn on ENABLE_DUMP_IR.
2021-02-09 11:06:11 +08:00
b437c0d418
Change debugger version from 1.1.0 to 1.2.0
2021-02-08 14:52:34 +08:00
b4d56f6358
add functions to check for directory and filename
...
1. add validation for directory and filename
2. refactor the file operations about path
3. add in CMakeLists
4. add logger in nn_ops
2021-02-08 11:50:02 +08:00
luopengting
mindspore-ci-bot
huanghui
louei5
Zhang Qinghua
Amir Lashkari
l00591931
chuck
xuxs