yankf21
/
mindspore2022
forked from huawei/mindspore2022
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
42,203 Commits 18 Branches 22 Tags 3.6 GiB
Commit Graph

1971 Commits

Author SHA1 Message Date
wangrao124 9dfc703f7a change sparsetensor to cootensor 2022-01-25 15:39:37 +08:00
donrichnx eee07047a0 [feat] [assistant] [I40GYJ] add Captioning task of CocoDataset 2022-01-24 17:24:16 +08:00
QRICK 859f90cb85 [assistant][ops][I3T96R] Add new data operator PhaseVocoder 2022-01-24 16:00:24 +08:00
i-robot af02897be7
!29118 Refactor kernel mod class and its subclasses. 
Merge pull request !29118 from TronZhang/refact_kernel_mod_class
 2022-01-22 10:34:53 +00:00
i-robot 85ac17a8c6
!22736 [assistant][ops] Add new dataset operator LibriTTSDataset 
Merge pull request !22736 from TR-nbu/LibriTTSDataset
 2022-01-22 10:03:40 +00:00
TronZhang deac002bed refactor kernel mod class and subclass 2022-01-22 16:31:37 +08:00
i-robot 6b78c1a827
!29316 FL, update iterator func_graph_ to weak_ptr 
Merge pull request !29316 from 徐永飞/master
 2022-01-22 08:21:29 +00:00
xuyongfei 6bad80681b FL, update iterator func_graph_ to weak_ptr && fix tcp message handler memory bug 2022-01-21 20:28:56 +08:00
i-robot 690a660919
!17918 [assistant][MelScale] 
Merge pull request !17918 from QingfengLi/MelScale
 2022-01-21 09:52:56 +00:00
ZJM 8d339ccfea [assistant][ops][22736] Add new dataset operator LibriTTSDataset 2022-01-21 17:34:42 +08:00
i-robot 9aa25eaa35
!29360 adapt some cpp ut for unused nodes eliminate 
Merge pull request !29360 from huanghui/fix-unused-output-in-ascend-pass
 2022-01-21 06:13:24 +00:00
huanghui f3ebb1a0e1 adapt some cpp ut for unused nodes eliminate 2022-01-21 11:30:39 +08:00
chenx2ovo bbba4fb940 [feat][assistant][I3CEG0] add op melscale 2022-01-21 11:30:34 +08:00
ZJM fff47f3886 [assistant][ops][I3T96T] Add new dataset operator CMUArcticDataset 2022-01-20 17:40:35 +08:00
i-robot 501614a61f
!22514 [assistant][ops] Add new data operator Multi30kDataset 
Merge pull request !22514 from 杨旭华/Multi30kDataset
 2022-01-20 02:13:17 +00:00
i-robot 71767a92c9
!29271 Fix Random Failure from UT/cpp Profiler Test 
Merge pull request !29271 from zetongzhao/profiler_test
 2022-01-19 21:29:44 +00:00
zetongzhao 9ded77ffc7 small change to ensure connector gets output 2022-01-19 11:15:09 -05:00
unknown c4ee548905 [feat][assistant][I40GY6]add new data operator Multi30kDataset 2022-01-19 18:33:13 +08:00
ZJM 21973bbbec [assistant][ops][I3T96W] Add new dataset operator GTZANDataset 2022-01-19 13:48:50 +08:00
zetongzhao 3580a7f863 add profiler test 2022-01-17 08:37:44 -05:00
i-robot 19a9ad6f38
!22893 [assistant][ops] Add new data operator CreateFbMatrix 
Merge pull request !22893 from TR-nbu/CreateFbMatrix
 2022-01-17 08:33:48 +00:00
1462492739@qq.com bf5f24d62f [assistant][ops][I3T96S] Add new data operator CreateFbMatrix 2022-01-14 21:24:17 +08:00
xiao_yao1994 54fc038f0a unify infer and train compile binary 2022-01-13 17:04:34 +08:00
i-robot fc4abc99f5
!28595 Fix some code review probelms 
Merge pull request !28595 from xiaotianci/update_code_review
 2022-01-12 09:30:28 +00:00
i-robot 6d069f8b1d
!28881 Add UInt8Imm to MindAPI 
Merge pull request !28881 from hewei/core_api
 2022-01-12 07:16:39 +00:00
i-robot 68ec2be828
!28784 [GraphKernel] add lite pass manager. 
Merge pull request !28784 from chenlei_autodiff/lite_callback
 2022-01-12 06:52:10 +00:00
i-robot 7384cb2689
!28546 fused global norm for cpu adafactor 
Merge pull request !28546 from kisnwang/add-cpu-adafactor
 2022-01-11 12:22:49 +00:00
He Wei 0442c50bb0 Add UInt8Imm to MindAPI 2022-01-11 16:08:32 +08:00
Xiao Tianci 96a2e38d01 update review problems 2022-01-11 15:31:53 +08:00
kswang 643b7b7ce4 fused global norm for cpu fused adafactor 2022-01-11 14:56:48 +08:00
chenlei_autodiff 0574995198 [GraphKernel] add lite pass manager. 2022-01-11 12:08:54 +08:00
xiao_yao1994 0843910260 unify ge and vm backend 2022-01-11 11:53:58 +08:00
i-robot a28dd013f7
!28715 Eliminate unused nodes in a tuple or list node. 
Merge pull request !28715 from 张清华/eliminate_tuple_unused_item2
 2022-01-08 06:38:47 +00:00
Zhang Qinghua d2572719f7 Eliminate unused nodes in a tuple or list node. 2022-01-07 21:30:01 +08:00
TronZhang 58f386fe2a Add Custom actor nodes and custom actor support for dynamic shape case 2022-01-07 17:31:37 +08:00
i-robot a1720c210d
!22348 [assistant][ops] Add new loader EnWik9Dataset 
Merge pull request !22348 from 杨旭华/EnWik9Dataset
 2022-01-05 07:36:48 +00:00
i-robot ec485cb436
!28307 convert EnvSetItem/EnvGetItem to primitive EnvironSet/EnvironGet 
Merge pull request !28307 from xychow/EnvGetItem-conversion
 2022-01-05 07:10:30 +00:00
i-robot e4438f3028
!28310 dynamic_kernel_mod 
Merge pull request !28310 from TuDouNi/dynamic_shape_stage1
 2022-01-04 12:48:53 +00:00
ttudu 9373679c04 dynamic_kernel_mod 2022-01-04 14:13:19 +08:00
Eden 63ab65e3a4 [feat] [assistant] [#I40GYF] add new loader EnWik9Dataset 2022-01-03 21:45:43 -08:00
i-robot 69d86d9b92 !28460 Modify some error log 
Merge pull request !28460 from caifubi/master-pynative-error-modify
 2022-01-04 03:16:36 +00:00
zhousiyi 19e9571149 rename env_getitem/setitem to EnvironGet/EnvironGet 2022-01-04 02:17:30 +00:00
i-robot 241d87a8a6 !27898 convert aicpu op attr to input 
Merge pull request !27898 from yuchaojie/op_select
 2021-12-31 09:51:48 +00:00
caifubi 49328ae86d Modify Hccl Error Log 2021-12-31 17:24:54 +08:00
vddong 7449b8364b [feat][assistant][I40GYQ] add new dataset operator WIDERFace 2021-12-31 13:49:47 +08:00
yuchaojie a0a31fe651 convert aicpu op attr to input 2021-12-30 18:59:53 +08:00
jingyangxiang a7f8b3af1c [feat][assistant][ops]New operator implementation, include IMDBDataset 
Signed-off-by: zjuter0126 <977180923@qq.com>
 2021-12-30 11:16:23 +08:00
i-robot 7c241bbaf5 !22085 [assistant][ops] add new data operator WikiTextDataset 
Merge pull request !22085 from ZJUTER0126/WikiTextDataset
 2021-12-30 03:12:03 +00:00
i-robot 3058a16213 !28144 using data type to get cube size 
Merge pull request !28144 from liubuyu/SBB
 2021-12-30 02:23:56 +00:00
zjuter0126 3c2ca41886 [feat][assistant][ops] add new data operator WikiTextDataset 2021-12-29 18:54:54 +08:00
i-robot ac9e545dc8 !22546 add new dataset loading operator CaltechDataset 
Merge pull request !22546 from 杨旭华/CaltechDataset
 2021-12-29 03:40:06 +00:00
i-robot bdf0f043e7 !28288 Don't lift fv before higher order grad if closure is kept 
Merge pull request !28288 from xychow/dont-liftfv-for-higher-order-grad-in-closure
 2021-12-29 01:52:44 +00:00
lby e6857a6553 using cube to get c0 value 2021-12-29 09:00:52 +08:00
donrichnx 9a0fc0ffc1 [feat] [assistant] [I40GYH] add new dataset loading operator CaltechDataset 2021-12-28 19:04:18 +08:00
i-robot 67e843ec7f !27487 [assistant] [ops][SpectralCentroid] 
Merge pull request !27487 from 杨旭华/SpectralCentroidOp
 2021-12-28 09:10:32 +00:00
zhousiyi d9aa48bc64 Dont liftfv before grad in higher order grad if closure is kept as bprop of Partial primitive is not supported 2021-12-28 07:54:22 +00:00
i-robot 749917a819 !28197 add cpu fused adafactor 
Merge pull request !28197 from kisnwang/add-cpu-adafactor
 2021-12-28 07:04:22 +00:00
i-robot 7faf774063 !22310 [assistant][ops] Add new loader SemeionDataset 
Merge pull request !22310 from 杨旭华/SemeionDataset
 2021-12-28 03:13:02 +00:00
kswang af48f201a2 add cpu fused adafactor 2021-12-28 11:05:41 +08:00
i-robot efaf29dc44 !28268 Remove unstable RPC test case 
Merge pull request !28268 from chengang/fix_tcp_ut
 2021-12-28 01:40:54 +00:00
i-robot 0e7a059bec !28186 Add axis check and shape black list for ConfusionSoftmaxGradRule pass 
Merge pull request !28186 from yuchaojie/ir_fusion
 2021-12-28 01:34:57 +00:00
yuchaojie 343f7dbe06 Add axis check and shape black list for ConfusionSoftmaxGradRule pass 2021-12-27 21:16:38 +08:00
cristoval 00d1aa9884 Remove unstable test case 2021-12-27 20:06:49 +08:00
luqilin 896f10d6d5 [feat][assistant][I40GYK] add new dataset loading operator SemeionDataset 2021-12-27 19:49:06 +08:00
tongyue 9a1dcd60fc [fix] [assistant] [I40GXI] fix bug in the infer function of the operator SpectralCentroid 2021-12-27 01:41:31 -08:00
i-robot 69a6c7db98 !23380 [assistant][ops] Add new loader AmazonReview 
Merge pull request !23380 from 杨旭华/AmazonReview
 2021-12-27 09:36:32 +00:00
luoyang 0288480722 Python Vocab refactoring and add ids_to_tokens & tokens_to_ids 2021-12-24 15:26:15 +08:00
chengchuanxing 07aa66ee43 [feat][assistant][I40GY2] add new loader AmazonReview 2021-12-23 16:32:31 +08:00
i-robot 0ac791560c !28011 remove unused code in class EnvInstance 
Merge pull request !28011 from xychow/remove-unused-code-in-envinstance
 2021-12-23 08:15:54 +00:00
zhousiyi 07e5cdad1b remove unused code in class EnvInstance 2021-12-23 02:16:41 +00:00
fattycat 289a7997df [feat] [assistant] [#I40GYB] add new loader CoNLL2000ChunkingDataset 2021-12-21 15:31:25 +08:00
i-robot 7331629ceb !22686 [assistant][ops][Dither] 
Merge pull request !22686 from Isaac/Dither
 2021-12-20 11:16:20 +00:00
i-robot 953920112c !22553 [assistant][ops] Add new loader UDPOSDataset 
Merge pull request !22553 from 杨旭华/UDPOSDataset
 2021-12-20 06:54:54 +00:00
i-robot 11da28f24a !27060 modify dev env name 
Merge pull request !27060 from zhoufeng/modify-env-name
 2021-12-20 01:23:54 +00:00
i-robot 92f4c07611 !27732 [ME] Optimize the error message of the operator module. 
Merge pull request !27732 from Margaret_wangrui/operator
 2021-12-20 01:05:55 +00:00
haohaonannan97 f480be7c48 [feat][assistant][I40GXF] add new data operator Dither 2021-12-18 08:24:48 -08:00
王天浩 11cb3e4ef7 [fear][assistant][I40GYA] add new loader UDPOSDataset 2021-12-18 23:28:05 +08:00
Margaret_wangrui 1a37dcfa94 [ME] Optimize the error message of the operator module 2021-12-18 14:28:45 +08:00
Carry955 2320bb7c70 [feat][assistant][I40GXW] add new loader YahooAnswers 2021-12-16 18:33:47 -08:00
i-robot 35db3bccac !27568 Add TCP communicator for distributed runtime 
Merge pull request !27568 from chengang/add_tcp_comm
 2021-12-17 01:25:50 +00:00
cristoval bb5798c391 Add tcp communicator for RPC 2021-12-16 23:32:38 +08:00
i-robot 67fc03f623 !27694 [API] python frame rebuild 
Merge pull request !27694 from kingxian/master
 2021-12-16 06:49:56 +00:00
zhoufeng 9d432d029d modify dev env name 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-12-16 14:12:24 +08:00
jinxiaoxian 01fc6efc7d rebuild python frame 2021-12-16 10:50:59 +08:00
i-robot d1d516e668 !27461 Add shard operation 
Merge pull request !27461 from YuJianfeng/shard
 2021-12-16 02:36:13 +00:00
li-qiyao f4bfcb8c25 [feat][assistant][I40GXN] add new loader SogouNews 2021-12-14 22:53:38 -08:00
yujianfeng cd2a021992 Add shard api 2021-12-15 11:05:11 +08:00
i-robot dac636decd !22297 [assistant][ops] Add new loader IWSLTDataset 
Merge pull request !22297 from 杨旭华/IWSLTDataset
 2021-12-15 02:55:08 +00:00
liucunwei 238ab38211 add some of dataset ut cases about createIterator columns 2021-12-14 19:11:52 +08:00
liannai a99b5461bd [feat][assistant][I40GXH]add new data operator Gain 2021-12-13 22:03:09 +08:00
lufei9026 30bc609ce6 [feat][assistant][I40GY8]add new loader IWSLTDataset 2021-12-13 21:47:55 +08:00
i-robot 2a2cd5e4ca !22222 [assistant][ops] Add new loader PennTreebankDataset 
Merge pull request !22222 from 杨旭华/PennTreebankDataset
 2021-12-13 11:43:00 +00:00
yuximiao 393d3621a3 fix no paralle stratege if start profiler in the process of trainging 2021-12-13 10:44:07 +08:00
i-robot c01985ae9b !27495 C++ inference interface AscendDeviceInfo 
Merge pull request !27495 from 徐永飞/master
 2021-12-13 01:34:25 +00:00
xuyongfei 0a0419498f C++ inference interface Ascend310DeviceInfo+Ascend910DeviceInfo->AscendDeviceInfo 2021-12-10 16:41:10 +08:00
i-robot 32e2dfb178 !27435 fix bugs triggered by fl 
Merge pull request !27435 from wtcheng/master
 2021-12-10 03:40:26 +00:00
w00517672 0064fc7ebc fix bugs triggered by fl 2021-12-09 16:21:17 +08:00
He Wei f35554d0c6 Add more to MindAPI 
1. `TensorType` and `TensorTypePtr`;
2. `utils::isa<TensorTypePtr>()`;
3. `utils::isa<int64_t>()`, `utils::cast<int64_t>()`;
4. `GetValue<ValuePtrList>(value)`.
 2021-12-09 08:59:25 +08:00
Megalomania 259854e040 [feat] [assistant] [I40GY5] add new loader PennTreebankDataset 2021-12-08 01:22:40 -08:00
i-robot 895256f69a !20043 [assistant][ops] Add new YelpReview 
Merge pull request !20043 from 杨旭华/YelpReview
 2021-12-08 08:13:34 +00:00
lufei9026 2947f418b1 [feat][assistant][I3T96N]add new loader YelpReview 2021-12-07 17:09:41 +08:00
i-robot ffca7b08a5 !27237 auto insert VirtualDataset node for master 
Merge pull request !27237 from lilei/modify_virtualdataset_for_master
 2021-12-07 09:02:50 +00:00
i-robot 7a8e35b4f1 !26456 [assistant][ops]Add new operator Spectrogram 
Merge pull request !26456 from YJfuel123/Spectrogram
 2021-12-07 06:39:01 +00:00
i-robot 3d0f8fcc99 !22552 [assistant][ops]New operator implementation, include STL10Dataset 
Merge pull request !22552 from 王睿/stl10_dataset
 2021-12-07 06:37:04 +00:00
i-robot 4eb816008e !27066 set offload node 
Merge pull request !27066 from kisnwang/enable-set-swap-node
 2021-12-07 03:06:00 +00:00
i-robot 6b92d9bd4d !27224 [ME] Optimize the error message of the operator module 
Merge pull request !27224 from Margaret_wangrui/operator
 2021-12-07 01:21:38 +00:00
RainWang6188 c4063f0f11 [feat][assistant][I3J6VI] add new data operator STL10 2021-12-07 01:21:11 +00:00
lilei 05189459ab auto insert VirtualDataset node for master 2021-12-06 21:39:37 +08:00
郑昊 4ae41350a6 [feat][assistant][I3ALD1] add new method Spectrogram 2021-12-06 19:24:37 +08:00
Margaret_wangrui 0f4a276b7e Optimize the error message of the operator module 2021-12-06 17:25:42 +08:00
zhangzhaoju 722086435d 1. fix:unexpected eiminate of tile 
2. fix:delay memory allocat in NewTensorFilledWithData
 2021-12-06 14:49:48 +08:00
i-robot db9b66242b !21823 [assistant][ops] Add data operator CharNGram 
Merge pull request !21823 from 张渝/CharNGram
 2021-12-06 03:46:31 +00:00
i-robot 7458863fd4 !27259 Fix MindAPI unit-test random failure 
Merge pull request !27259 from hewei/core_api
 2021-12-06 03:31:42 +00:00
He Wei 5e092985e4 Fix MindAPI unit-test random failure 
Remove improper assert line: `ASSERT_TRUE(p < q);`
 2021-12-06 09:50:24 +08:00
i-robot bf0142ae4b !27242 Add unit test for persistent storage 
Merge pull request !27242 from zyli2020/ps_cache_feature
 2021-12-06 01:22:11 +00:00
lizhenyu b1a42e3525 add unit test for persistent storage 2021-12-05 13:51:17 +08:00
zhangyuqwer e934381b08 [feat][assistant][I3ZSQV] add new data operator CharNGram 2021-12-04 22:09:34 +08:00
i-robot d224c7dd18 !27192 fix error log 
Merge pull request !27192 from lianliguang/xbg
 2021-12-04 10:10:00 +00:00
lianliguang 40c3995b98 fix error log 2021-12-03 23:13:03 +08:00
tronzhang 9d3c0499a5 upgrade ascend 1201 2021-12-03 19:43:51 +08:00
i-robot 1da503448f !27168 [AutoParallel]Add_Parallel_CN_API 
Merge pull request !27168 from lichen/add_CN_API
 2021-12-03 08:37:04 +00:00
i-robot 95af195d0c !26926 Provide new mindspore core API classes 
Merge pull request !26926 from hewei/core_api
 2021-12-03 07:52:59 +00:00
kswang 391a06aad1 set offload node 2021-12-03 15:29:01 +08:00
i-robot 93db7f741f !20788 [assistant][ops] Add new dataset loading operator TedliumDataset 
Merge pull request !20788 from 杨旭华/TedliumDataset
 2021-12-03 06:29:29 +00:00
lichenever ae40fea111 add_CN_API 2021-12-03 14:12:43 +08:00
He Wei d2bb6303b7 Provide new mindspore core API classes 
1. namespace is mindspore::api;
2. API header files located in mindspore/core/mindapi;
3. We use pimpl pattern to provide a wrapper layer for api;
4. Check mindapi_test.cc for usage examples.
 2021-12-03 11:03:22 +08:00
i-robot 8a2ce38ce1 !27114 Add LayoutProto to support pipeline for compile cache and solve import package problem. 
Merge pull request !27114 from LiangZhibo/mindir
 2021-12-03 02:53:12 +00:00
i-robot f9459a871a !27061 dataset: enhance kernel part log 
Merge pull request !27061 from ms_yan/kernel_enhance
 2021-12-03 01:26:07 +00:00
i-robot 881548452c !27031 Fix intermittent failure in callback_test.cc 
Merge pull request !27031 from h.farahat/callback_test_fix
 2021-12-02 16:44:54 +00:00
ms_yan d2e0061656 enhance error msg 2021-12-02 22:35:30 +08:00
i-robot fa457b2bfa !17832 [assistant][ops]New operator implementation, include KMnistDataset 
Merge pull request !17832 from 张璇/kmnist_dataset
 2021-12-02 14:00:36 +00:00
i-robot e4fb249c87 !27147 add some of dataset ut cases about createIterator columns 
Merge pull request !27147 from liucunwei/dataset-lcw-1029
 2021-12-02 12:29:29 +00:00
i-robot 3e73e124ac !23225 [assistant][ops] Add Glove 
Merge pull request !23225 from 张渝/Glove
 2021-12-02 12:22:17 +00:00
i-robot 82542f1d4a !27108 code sync in federated learning 
Merge pull request !27108 from tan-wei-cheng-3260/develop-twc-sync2
 2021-12-02 11:57:55 +00:00
liucunwei ac27fa2cff add some of dataset ut cases about createIterator columns 2021-12-02 19:20:55 +08:00
l00591931 62e474aaf1 Enable mindir for layout 2021-12-02 17:50:43 +08:00
twc a5fcb08c00 code sync in federated learning 2021-12-02 14:41:56 +08:00
liyong d35e003def fix mindrecord log part02 2021-12-02 11:28:58 +08:00
luqilin 34bffbf768 [feat][assistant][I3T96H] add new dataset loading operator TedliumDataset 2021-12-02 09:53:39 +08:00
zy 8f9a09f79c [fix] [assistant] [I3ZSQR] add new data operator GloVe 2021-12-01 17:12:20 +08:00
hesham 828120b784 Fix intermittent failure in callback_test.cc 2021-11-30 22:36:55 -05:00
zy 5ca98a494a [fix] [assistant] [I3ZSQS] add new data operator FastText 2021-12-01 11:12:08 +08:00
“uccInf” 92d6d31750 [feat][assistant][I3J6V7] add new data operator KMnist 2021-12-01 03:05:05 +00:00
i-robot eb9537af11 !21690 [assistant][ops] Add data operator Vectors 
Merge pull request !21690 from 张渝/Vectors
 2021-12-01 01:29:45 +00:00
i-robot 2fd00935ed !20964 [assistant][ops] Add new data operator SpeechCommandsDataset 
Merge pull request !20964 from 杨旭华/SpeechCommandsDataset
 2021-11-30 09:33:03 +00:00
zhangyuqwer 6a6e73ef82 [fix] [assistant] [I3ZSQM] add new data operator Vectors 2021-11-30 14:39:42 +08:00
i-robot f513e0bfdd !26743 [GraphKernel] lite adapt for akg build. 
Merge pull request !26743 from chenlei_autodiff/lite_callback
 2021-11-30 03:38:38 +00:00
i-robot b9d56b9cce !26914 fix some error report and remove some useless code 
Merge pull request !26914 from lianliguang/master
 2021-11-29 12:34:41 +00:00
i-robot 16fa10fd38 !26875 add ut for debug info 
Merge pull request !26875 from huanghui/add-ut
 2021-11-29 03:55:52 +00:00
lianliguang 0dc5d7f4f9 modify some eroor log and remove some useless code 2021-11-29 10:23:03 +08:00
chenlei_autodiff 54227cae81 [GraphKernel] lite adapt for akg build. 2021-11-27 17:51:54 +08:00
huanghui 67a6beb1b1 add ut for debug info 2021-11-27 17:29:45 +08:00
i-robot 2bd6deaeeb !26682 GraphKernel For CPU 
Merge pull request !26682 from ZengZitao/gk_cpu
 2021-11-27 06:23:01 +00:00
vddong 91d3a7543f [feat][assistant][I3T96F] add new data operator SpeechCommands 2021-11-27 11:25:18 +08:00
i-robot 4252b24335 !26792 malloc ts memory for label 
Merge pull request !26792 from zhoufeng/change-label-memory-type
 2021-11-27 01:09:03 +00:00
zengzitao 62458b5636 adapt graph kernel for cpu 2021-11-26 18:42:34 +08:00
i-robot 04132e0c50 !26766 fix error log and move some function to inner 
Merge pull request !26766 from lianliguang/master
 2021-11-26 06:09:42 +00:00
lianliguang 5864d6a006 modify some eroor log 2021-11-26 09:24:19 +08:00
zhoufeng 881179fa10 malloc ts memory for label 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-11-26 09:17:02 +08:00
i-robot 3520f1427d !26701 MD C++ UT: Remove old tests part 3 
Merge pull request !26701 from hetshah/hs_remove_old_tests
 2021-11-25 19:29:30 +00:00
hetshah 098ca49dd3 remove instances of datasetiterator from old tests and move coverage to new method 2021-11-25 15:22:34 +00:00
i-robot 3d0f9d8aae !26683 Enable compile cache feature to load hyper parameter data from python 
Merge pull request !26683 from LiangZhibo/mindir
 2021-11-25 03:25:27 +00:00
hesham cf3ff77cfd AutoTune support non-sink mode 
Add time sts to iterator tracing
 2021-11-24 17:51:25 -05:00
i-robot d251800c62 !26705 Add the check of function return None. 
Merge pull request !26705 from Margaret_wangrui/return_none
 2021-11-24 11:09:27 +00:00
i-robot cfc6ea32ff !24714 replace rtmemcpyxx to acl memcpy 
Merge pull request !24714 from jjfeing/br_replace_rtmemcpyxx_with_acl_api
 2021-11-24 07:47:43 +00:00
Margaret_wangrui f9a384456a Add the check of function return None. 2021-11-24 15:30:35 +08:00
l00591931 21df240f23 Enable mindir to load initialize weight from python 2021-11-24 11:33:43 +08:00
He Wei 41dcac9c49 Replace std::unordered_map/set with robin-hood-hashing 
Robin-hood-hashing (https://github.com/martinus/robin-hood-hashing)
is considered faster then std::unordered_map/set,
so we use it to improve mindspore performance.

1. robin_hood head file in `third_party/robin_hood/include`;
2. In `utils/hash_map.h` and `utils/hash_set.h`, we define:
 - mindspore::HashMap as an alias of robin_hood::unordered_map;
 - mindspore::HashSet as an alias of robin_hood::unordered_set;
3. Replace:
 - `#include <unordered_map>` --> `#include "utils/hash_map.h"`;
 - `#include <unordered_set>` --> `#include "utils/hash_set.h"`;
 - `std::unordered_map` --> `mindspore::HashMap`;
 - `std::unordered_set` --> `mindspore::HashSet`;
 - `map.insert(std::pair(key, value))` --> `map.emplace(key, value)`;
 - `[] (const std::pair<K, V> &p) {..} ` --> `[] (const auto &p) {..} `;
4. Fix issues found by switch to robin_hood:
 - AnfNodeConfig hash and equal;
 - Fix a bug in `Slice::operator==()`;
 - Fix a bug in `CNode::HasPrimalAttr()`;
 - Fix map.erase() usage bugs: `map.erase(iter++)` --> `iter = map.erase(iter)`;
 - Fix some iterator invalidated problem;
5. Some std::unordered_map/set can not replace by robin_hood:
 - As parameter of functions that exposed to python by pybind11;
 - Use bad hash that cause robin_hood::map over_flow, such as AbstractBasePtrListHasher;
6. Update cpp unit tests;
7. Add build option '-F' to enable robin_hood, default on.
 2021-11-24 10:47:40 +08:00
i-robot 310bbcebe1 !26539 [GraphKernel] support lite_adapter for graph kernel. 
Merge pull request !26539 from chenlei_autodiff/lite_callback
 2021-11-23 02:44:13 +00:00
jjfeing 05485d991c replace api with acl api 2021-11-23 09:06:28 +08:00
chenlei_autodiff 4c0d5dcfe7 [GraphKernel] support lite_adapter for graph kernel. 2021-11-22 15:10:30 +08:00
i-robot 70363899e7 !24080 [assistant][ops] Add new audio operator ComputeDeltas 
Merge pull request !24080 from Rainfor/compute_detlas
 2021-11-19 12:29:49 +00:00
i-robot c6821bde0a !21648 [assistant][ops] Add new data loading operator YesNoDataset 
Merge pull request !21648 from 杨旭华/YesNoDataset
 2021-11-19 09:05:07 +00:00
vddong f465cd0242 [feat][assistant][I3T96L]add new dataset operator YesNo 2021-11-19 13:36:24 +08:00
i-robot 55463892e4 !26402 add mem offload strategy 
Merge pull request !26402 from kisnwang/add-mem-offload-strategy
 2021-11-19 03:42:52 +00:00
i-robot 3c39afad11 !24547 [MS][crowdfunding]New operator implementation, AutoAugment 
Merge pull request !24547 from yangwm/autoaugment
 2021-11-19 01:00:51 +00:00
i-robot ce00ee1ad1 !25367 use acl api to control profiling 
Merge pull request !25367 from yanghaitao/yht_condation_start_profiler
 2021-11-18 12:36:14 +00:00
zhuchuang 4c3931f5c9 [feat] [assistant] [I3CKEE] add new audio operator ComputeDeltas 2021-11-18 17:18:43 +08:00
i-robot 9d6248194e !26310 MindSpore support load custom aicpu kernels. 
Merge pull request !26310 from linqingke/aicpu
 2021-11-18 08:09:26 +00:00
kswang 7c312bd38c add mem offload strategy 2021-11-18 15:54:16 +08:00
despicablemme 09897ce7ec [feat] [assistant] [I40GZP] add new data op AutoAugment 2021-11-18 11:38:18 +08:00
yanghaitao1 c94aa6b872 use profiler acl api instead 2021-11-17 09:33:31 -05:00
linqingke bef2923acf MindSpore support load custom aicpu ops. 2021-11-17 14:58:50 +08:00
wangkc123 706f9e2cbb [feat] [assistant] [I3CKEH] add new audio operator SlidingWindowCmn 2021-11-16 22:00:09 +08:00
i-robot 58b69a05ee !20576 [assistant][ops] add new dataset loading operator LJSpeechDataset 
Merge pull request !20576 from 杨旭华/LJSpeechDataset
 2021-11-16 07:00:20 +00:00
i-robot 6bdd38399a !25811 fault_recover_by_mirror_group 
Merge pull request !25811 from yao_yf/fault_recover_by_mirror_group
 2021-11-16 02:20:58 +00:00
mohammad 5c8ab5f60c add MD Profiler Save() 2021-11-15 13:18:36 -05:00
vddong 6fe2d35ae2 [feat][assistant][I3T96D] add new dataset loading operator LJSpeechDataset 2021-11-14 14:52:15 +08:00
yao_yf 501b978d16 find data parallel common group in auto parallel 2021-11-13 10:23:45 +08:00
i-robot 04da5c2808 !26140 Add callback support to BatchOp Datasets to enable Add/Remove workers 
Merge pull request !26140 from h.farahat/cb_batch
 2021-11-12 17:23:19 +00:00
i-robot e154dca4b1 !22193 [assistant][ops] Add new loader operator DBpedia 
Merge pull request !22193 from 杨旭华/DBpedia
 2021-11-12 09:02:28 +00:00
i-robot 0f07408425 !26034 F.grad support sens_param and fix graph_mode bug 
Merge pull request !26034 from zhang_sss/grad
 2021-11-12 06:38:15 +00:00
i-robot 6c587dc2d3 !25391 Support to profiling parallel strategy 
Merge pull request !25391 from ougongchang/profiling_stategy
 2021-11-12 06:07:30 +00:00
Carry955 0d26c38693 [feat][assistant][I40GXT] add new loader DBpedia 2021-11-11 19:02:22 -08:00
i-robot 7a73bae5c3 !26036 add output strategy for matmul operator 
Merge pull request !26036 from yangzhenzhang/add-output-strategy-for-op-init
 2021-11-12 01:22:22 +00:00
hesham 2662b6d5c3 Add callback to Batch op 2021-11-11 10:58:01 -05:00
zhang__sss 0dd68aa7eb grad 2021-11-11 23:18:35 +08:00
ougongchang 9229f1c1ff profiler support to collect parallel strategy info 
If SetNodeOutputType functions forcibly splits into multiple functions, the readability decreases, so it blocks lizard scans
 2021-11-11 20:11:42 +08:00
i-robot b910870ecc !19986 [assistant][ops] Add new dataset loading operator AGNEWS 
Merge pull request !19986 from 杨旭华/AGNEWS
 2021-11-11 06:22:25 +00:00
zetongzhao 2de8142c44 profiler test 2021-11-10 11:55:19 -05:00