Commit Graph

43 Commits

Author SHA1 Message Date
maoyaomin 99a3abe2bb fix the logger info and exception message in profiler and summary 2022-03-31 14:26:58 +08:00
helloiSCSI 7cb5ed7676 add summart ops params valid check ut 2021-12-06 20:11:27 +08:00
songyuanwei a67ac908d8 add landscape ut and st 2021-11-30 11:28:47 +08:00
jiangshuqiang 13fc005562 fix security wrap 2021-09-28 11:59:45 +08:00
jiangshuqiang c2bd061889 fix summary isolation 2021-09-18 10:59:14 +08:00
jiangshuqiang 6154f957fb fix static check 2021-05-31 16:47:21 +08:00
ougongchang e8ee209877 Optimize summary ut and delete duplicate test cases
Change the summary test case to stage3 to avoid multiple processes that cause the summary test case to fail
2021-03-08 17:36:17 +08:00
ougongchang 4309e20b1b Add heartbeat check in summary and delete test cases that do not exit 2021-03-02 15:29:15 +08:00
jiangshuqiang 0bb80995bc fix param check for unexpected_format 2021-02-02 12:03:49 +08:00
l00591931 9ec100d069 Change TensorAdd to Add, from r1.1 to master 2021-02-01 17:53:52 +08:00
ougongchang c6e4b0c85f Add more log when collect graph and use summary operators
Fix can not collect input data when batch size is 1 and total step
number is 1

Fixed spelling errors
2021-01-26 11:24:16 +08:00
jiangshuqiang ab5cc10250 add the tensor collection feature when record summary 2021-01-11 12:39:36 +08:00
mindspore-ci-bot 1f06cd63f3 !10436 Support to control whether to throw runtime exceptions in SummaryRecord
From: @ouwenchang
Reviewed-by: 
Signed-off-by:
2021-01-06 14:21:21 +08:00
ougongchang 06be546b52 Support to control whether raise RuntimeError exception in SummaryRecord
1. Support explainer raise an RuntimeError exception
2. fix the ut of SummaryRecord
2021-01-06 10:07:47 +08:00
ougongchang e5529230bf Prevent the multiprocess from capturing KeyboardInterrupt 2020-12-29 17:46:42 +08:00
ougongchang 6072b25a07 SummaryRecord support to record mindexplain data
The SummaryRecord.add_value() method is extended to record the data of
MindExplain.
2020-10-22 15:52:54 +08:00
buxue 483c8a179a improve the recognition of Parameter object and raise error when convert keywordarg to pydata 2020-09-19 18:01:00 +08:00
Li Hongzhang 066950f69e GPU dataset_sink_mode collect inputs 2020-09-07 17:12:36 +08:00
simson 5f77fbdd75 Rewrite tensor's __bool__ for pynative mode 2020-07-23 16:51:46 +08:00
ougongchang cd868aea52 fix get loss error and NoneType error cause by _proceesor_specified_data
fix get loss error when it not a scalar and fix process specified data
failed when the action is False, and collect_specified_data parameter is
not None
2020-06-30 21:11:06 +08:00
ougongchang 3dc6f6f2d9 add more ut and st for SummaryCollector
Has fixed collecting optimizer error when mode is eval
2020-06-30 17:02:03 +08:00
ougongchang 939cd29d7e Add a callback named SummaryCollector and delete SummaryStep callback
I added a SummaryCollector to help users automatically collect information
such as the network, loss, learning rate and so on, making it easier to collect this information.

It also can collect train lineage and eval lineage information which is
collected by TrainLineage Callback and EvalLineage Callback in
MindInsight.

I also add some UT for SummaryCollect to keep the code correct.
2020-06-19 21:07:55 +08:00
Li Hongzhang 0921c1e538 enhance the SummaryRecord with set_mode and add_value 2020-06-19 13:03:00 +08:00
李鸿章 ee438aaf4a callback as context manager 2020-06-17 14:07:52 +08:00
wenkai ab6b6add0b cpu support summary 2020-06-09 09:51:28 +08:00
jinyaohui 86d197dfeb clean pylint 2020-05-29 23:00:00 +08:00
“liuxiao” f4542f810b pylint clean 2020-05-26 19:11:12 +08:00
“liuxiao” 382a0124c3 pylint clean 2020-05-25 21:16:04 +08:00
ougongchang 7d78b5d89e Put the parameter validation of the Summary operator into the python layer
add some unittest for summary operator

support ScalarSummary to record number type
2020-05-22 21:23:43 +08:00
jinyaohui 5a914994ba clean pylint 2020-05-18 16:42:35 +08:00
jinyaohui bcfaff97f9 clean pylint 2020-05-18 10:31:46 +08:00
李鸿章 32c1d558f4 SummaryRecord as context manager 2020-05-13 21:53:24 +08:00
jinyaohui 26fd75895d pylint waring clean 2020-05-13 11:30:27 +08:00
wenkai ab04b3dc4b fix np.histograms(bins='auto') sometimes calc very small width and very large bucket number, which lead to error/long compute time. 2020-04-27 18:08:17 +08:00
candanzg b84deeeb5c fix summary tage check error
Signed-off-by: candanzg <zhangshucheng@huawei.com>
2020-04-26 15:43:57 +08:00
mindspore-ci-bot 18580a7867 !261 Add summary module python code to extract histogram info from tensor
Merge pull request !261 from wenkai/histogram_dev3cp
2020-04-20 11:08:34 +08:00
ougongchang 0ed6d9178e add Histogram summary operator
clean clang format errors and cpplint errors

add some test cases for histogram summary operator
2020-04-18 09:56:45 +08:00
wenkai cce61d462c histogram python dev 2020-04-17 09:42:02 +08:00
mindspore-ci-bot 55916351ee !52 remove ge depend
Merge pull request !52 from flywind/remove-ge-depend
2020-04-02 20:59:06 +08:00
Wei Luning 73ba399364 remove ge depend in cpu 2020-04-02 19:38:42 +08:00
chang zherui 1de7011bc8 delete longtime python ut 2020-04-01 11:53:35 +08:00
chang zherui eaf7146d46 modify longtime python ut 2020-03-31 16:18:04 +08:00
zhunaipan 930a1fb0a8 initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
2020-03-27 22:54:54 +08:00