Col_lin
/
mindspore2022
forked from huawei/mindspore2022
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
42,205 Commits 18 Branches 22 Tags 3.6 GiB
Commit Graph

1971 Commits

Author SHA1 Message Date
i-robot ac9e545dc8 !22546 add new dataset loading operator CaltechDataset 
Merge pull request !22546 from 杨旭华/CaltechDataset
 2021-12-29 03:40:06 +00:00
i-robot bdf0f043e7 !28288 Don't lift fv before higher order grad if closure is kept 
Merge pull request !28288 from xychow/dont-liftfv-for-higher-order-grad-in-closure
 2021-12-29 01:52:44 +00:00
lby e6857a6553 using cube to get c0 value 2021-12-29 09:00:52 +08:00
donrichnx 9a0fc0ffc1 [feat] [assistant] [I40GYH] add new dataset loading operator CaltechDataset 2021-12-28 19:04:18 +08:00
i-robot 67e843ec7f !27487 [assistant] [ops][SpectralCentroid] 
Merge pull request !27487 from 杨旭华/SpectralCentroidOp
 2021-12-28 09:10:32 +00:00
zhousiyi d9aa48bc64 Dont liftfv before grad in higher order grad if closure is kept as bprop of Partial primitive is not supported 2021-12-28 07:54:22 +00:00
i-robot 749917a819 !28197 add cpu fused adafactor 
Merge pull request !28197 from kisnwang/add-cpu-adafactor
 2021-12-28 07:04:22 +00:00
i-robot 7faf774063 !22310 [assistant][ops] Add new loader SemeionDataset 
Merge pull request !22310 from 杨旭华/SemeionDataset
 2021-12-28 03:13:02 +00:00
kswang af48f201a2 add cpu fused adafactor 2021-12-28 11:05:41 +08:00
i-robot efaf29dc44 !28268 Remove unstable RPC test case 
Merge pull request !28268 from chengang/fix_tcp_ut
 2021-12-28 01:40:54 +00:00
i-robot 0e7a059bec !28186 Add axis check and shape black list for ConfusionSoftmaxGradRule pass 
Merge pull request !28186 from yuchaojie/ir_fusion
 2021-12-28 01:34:57 +00:00
yuchaojie 343f7dbe06 Add axis check and shape black list for ConfusionSoftmaxGradRule pass 2021-12-27 21:16:38 +08:00
cristoval 00d1aa9884 Remove unstable test case 2021-12-27 20:06:49 +08:00
luqilin 896f10d6d5 [feat][assistant][I40GYK] add new dataset loading operator SemeionDataset 2021-12-27 19:49:06 +08:00
tongyue 9a1dcd60fc [fix] [assistant] [I40GXI] fix bug in the infer function of the operator SpectralCentroid 2021-12-27 01:41:31 -08:00
i-robot 69a6c7db98 !23380 [assistant][ops] Add new loader AmazonReview 
Merge pull request !23380 from 杨旭华/AmazonReview
 2021-12-27 09:36:32 +00:00
luoyang 0288480722 Python Vocab refactoring and add ids_to_tokens & tokens_to_ids 2021-12-24 15:26:15 +08:00
chengchuanxing 07aa66ee43 [feat][assistant][I40GY2] add new loader AmazonReview 2021-12-23 16:32:31 +08:00
i-robot 0ac791560c !28011 remove unused code in class EnvInstance 
Merge pull request !28011 from xychow/remove-unused-code-in-envinstance
 2021-12-23 08:15:54 +00:00
zhousiyi 07e5cdad1b remove unused code in class EnvInstance 2021-12-23 02:16:41 +00:00
fattycat 289a7997df [feat] [assistant] [#I40GYB] add new loader CoNLL2000ChunkingDataset 2021-12-21 15:31:25 +08:00
i-robot 7331629ceb !22686 [assistant][ops][Dither] 
Merge pull request !22686 from Isaac/Dither
 2021-12-20 11:16:20 +00:00
i-robot 953920112c !22553 [assistant][ops] Add new loader UDPOSDataset 
Merge pull request !22553 from 杨旭华/UDPOSDataset
 2021-12-20 06:54:54 +00:00
i-robot 11da28f24a !27060 modify dev env name 
Merge pull request !27060 from zhoufeng/modify-env-name
 2021-12-20 01:23:54 +00:00
i-robot 92f4c07611 !27732 [ME] Optimize the error message of the operator module. 
Merge pull request !27732 from Margaret_wangrui/operator
 2021-12-20 01:05:55 +00:00
haohaonannan97 f480be7c48 [feat][assistant][I40GXF] add new data operator Dither 2021-12-18 08:24:48 -08:00
王天浩 11cb3e4ef7 [fear][assistant][I40GYA] add new loader UDPOSDataset 2021-12-18 23:28:05 +08:00
Margaret_wangrui 1a37dcfa94 [ME] Optimize the error message of the operator module 2021-12-18 14:28:45 +08:00
Carry955 2320bb7c70 [feat][assistant][I40GXW] add new loader YahooAnswers 2021-12-16 18:33:47 -08:00
i-robot 35db3bccac !27568 Add TCP communicator for distributed runtime 
Merge pull request !27568 from chengang/add_tcp_comm
 2021-12-17 01:25:50 +00:00
cristoval bb5798c391 Add tcp communicator for RPC 2021-12-16 23:32:38 +08:00
i-robot 67fc03f623 !27694 [API] python frame rebuild 
Merge pull request !27694 from kingxian/master
 2021-12-16 06:49:56 +00:00
zhoufeng 9d432d029d modify dev env name 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-12-16 14:12:24 +08:00
jinxiaoxian 01fc6efc7d rebuild python frame 2021-12-16 10:50:59 +08:00
i-robot d1d516e668 !27461 Add shard operation 
Merge pull request !27461 from YuJianfeng/shard
 2021-12-16 02:36:13 +00:00
li-qiyao f4bfcb8c25 [feat][assistant][I40GXN] add new loader SogouNews 2021-12-14 22:53:38 -08:00
yujianfeng cd2a021992 Add shard api 2021-12-15 11:05:11 +08:00
i-robot dac636decd !22297 [assistant][ops] Add new loader IWSLTDataset 
Merge pull request !22297 from 杨旭华/IWSLTDataset
 2021-12-15 02:55:08 +00:00
liucunwei 238ab38211 add some of dataset ut cases about createIterator columns 2021-12-14 19:11:52 +08:00
liannai a99b5461bd [feat][assistant][I40GXH]add new data operator Gain 2021-12-13 22:03:09 +08:00
lufei9026 30bc609ce6 [feat][assistant][I40GY8]add new loader IWSLTDataset 2021-12-13 21:47:55 +08:00
i-robot 2a2cd5e4ca !22222 [assistant][ops] Add new loader PennTreebankDataset 
Merge pull request !22222 from 杨旭华/PennTreebankDataset
 2021-12-13 11:43:00 +00:00
yuximiao 393d3621a3 fix no paralle stratege if start profiler in the process of trainging 2021-12-13 10:44:07 +08:00
i-robot c01985ae9b !27495 C++ inference interface AscendDeviceInfo 
Merge pull request !27495 from 徐永飞/master
 2021-12-13 01:34:25 +00:00
xuyongfei 0a0419498f C++ inference interface Ascend310DeviceInfo+Ascend910DeviceInfo->AscendDeviceInfo 2021-12-10 16:41:10 +08:00
i-robot 32e2dfb178 !27435 fix bugs triggered by fl 
Merge pull request !27435 from wtcheng/master
 2021-12-10 03:40:26 +00:00
w00517672 0064fc7ebc fix bugs triggered by fl 2021-12-09 16:21:17 +08:00
He Wei f35554d0c6 Add more to MindAPI 
1. `TensorType` and `TensorTypePtr`;
2. `utils::isa<TensorTypePtr>()`;
3. `utils::isa<int64_t>()`, `utils::cast<int64_t>()`;
4. `GetValue<ValuePtrList>(value)`.
 2021-12-09 08:59:25 +08:00
Megalomania 259854e040 [feat] [assistant] [I40GY5] add new loader PennTreebankDataset 2021-12-08 01:22:40 -08:00
i-robot 895256f69a !20043 [assistant][ops] Add new YelpReview 
Merge pull request !20043 from 杨旭华/YelpReview
 2021-12-08 08:13:34 +00:00
lufei9026 2947f418b1 [feat][assistant][I3T96N]add new loader YelpReview 2021-12-07 17:09:41 +08:00
i-robot ffca7b08a5 !27237 auto insert VirtualDataset node for master 
Merge pull request !27237 from lilei/modify_virtualdataset_for_master
 2021-12-07 09:02:50 +00:00
i-robot 7a8e35b4f1 !26456 [assistant][ops]Add new operator Spectrogram 
Merge pull request !26456 from YJfuel123/Spectrogram
 2021-12-07 06:39:01 +00:00
i-robot 3d0f8fcc99 !22552 [assistant][ops]New operator implementation, include STL10Dataset 
Merge pull request !22552 from 王睿/stl10_dataset
 2021-12-07 06:37:04 +00:00
i-robot 4eb816008e !27066 set offload node 
Merge pull request !27066 from kisnwang/enable-set-swap-node
 2021-12-07 03:06:00 +00:00
i-robot 6b92d9bd4d !27224 [ME] Optimize the error message of the operator module 
Merge pull request !27224 from Margaret_wangrui/operator
 2021-12-07 01:21:38 +00:00
RainWang6188 c4063f0f11 [feat][assistant][I3J6VI] add new data operator STL10 2021-12-07 01:21:11 +00:00
lilei 05189459ab auto insert VirtualDataset node for master 2021-12-06 21:39:37 +08:00
郑昊 4ae41350a6 [feat][assistant][I3ALD1] add new method Spectrogram 2021-12-06 19:24:37 +08:00
Margaret_wangrui 0f4a276b7e Optimize the error message of the operator module 2021-12-06 17:25:42 +08:00
zhangzhaoju 722086435d 1. fix:unexpected eiminate of tile 
2. fix:delay memory allocat in NewTensorFilledWithData
 2021-12-06 14:49:48 +08:00
i-robot db9b66242b !21823 [assistant][ops] Add data operator CharNGram 
Merge pull request !21823 from 张渝/CharNGram
 2021-12-06 03:46:31 +00:00
i-robot 7458863fd4 !27259 Fix MindAPI unit-test random failure 
Merge pull request !27259 from hewei/core_api
 2021-12-06 03:31:42 +00:00
He Wei 5e092985e4 Fix MindAPI unit-test random failure 
Remove improper assert line: `ASSERT_TRUE(p < q);`
 2021-12-06 09:50:24 +08:00
i-robot bf0142ae4b !27242 Add unit test for persistent storage 
Merge pull request !27242 from zyli2020/ps_cache_feature
 2021-12-06 01:22:11 +00:00
lizhenyu b1a42e3525 add unit test for persistent storage 2021-12-05 13:51:17 +08:00
zhangyuqwer e934381b08 [feat][assistant][I3ZSQV] add new data operator CharNGram 2021-12-04 22:09:34 +08:00
i-robot d224c7dd18 !27192 fix error log 
Merge pull request !27192 from lianliguang/xbg
 2021-12-04 10:10:00 +00:00
lianliguang 40c3995b98 fix error log 2021-12-03 23:13:03 +08:00
tronzhang 9d3c0499a5 upgrade ascend 1201 2021-12-03 19:43:51 +08:00
i-robot 1da503448f !27168 [AutoParallel]Add_Parallel_CN_API 
Merge pull request !27168 from lichen/add_CN_API
 2021-12-03 08:37:04 +00:00
i-robot 95af195d0c !26926 Provide new mindspore core API classes 
Merge pull request !26926 from hewei/core_api
 2021-12-03 07:52:59 +00:00
kswang 391a06aad1 set offload node 2021-12-03 15:29:01 +08:00
i-robot 93db7f741f !20788 [assistant][ops] Add new dataset loading operator TedliumDataset 
Merge pull request !20788 from 杨旭华/TedliumDataset
 2021-12-03 06:29:29 +00:00
lichenever ae40fea111 add_CN_API 2021-12-03 14:12:43 +08:00
He Wei d2bb6303b7 Provide new mindspore core API classes 
1. namespace is mindspore::api;
2. API header files located in mindspore/core/mindapi;
3. We use pimpl pattern to provide a wrapper layer for api;
4. Check mindapi_test.cc for usage examples.
 2021-12-03 11:03:22 +08:00
i-robot 8a2ce38ce1 !27114 Add LayoutProto to support pipeline for compile cache and solve import package problem. 
Merge pull request !27114 from LiangZhibo/mindir
 2021-12-03 02:53:12 +00:00
i-robot f9459a871a !27061 dataset: enhance kernel part log 
Merge pull request !27061 from ms_yan/kernel_enhance
 2021-12-03 01:26:07 +00:00
i-robot 881548452c !27031 Fix intermittent failure in callback_test.cc 
Merge pull request !27031 from h.farahat/callback_test_fix
 2021-12-02 16:44:54 +00:00
ms_yan d2e0061656 enhance error msg 2021-12-02 22:35:30 +08:00
i-robot fa457b2bfa !17832 [assistant][ops]New operator implementation, include KMnistDataset 
Merge pull request !17832 from 张璇/kmnist_dataset
 2021-12-02 14:00:36 +00:00
i-robot e4fb249c87 !27147 add some of dataset ut cases about createIterator columns 
Merge pull request !27147 from liucunwei/dataset-lcw-1029
 2021-12-02 12:29:29 +00:00
i-robot 3e73e124ac !23225 [assistant][ops] Add Glove 
Merge pull request !23225 from 张渝/Glove
 2021-12-02 12:22:17 +00:00
i-robot 82542f1d4a !27108 code sync in federated learning 
Merge pull request !27108 from tan-wei-cheng-3260/develop-twc-sync2
 2021-12-02 11:57:55 +00:00
liucunwei ac27fa2cff add some of dataset ut cases about createIterator columns 2021-12-02 19:20:55 +08:00
l00591931 62e474aaf1 Enable mindir for layout 2021-12-02 17:50:43 +08:00
twc a5fcb08c00 code sync in federated learning 2021-12-02 14:41:56 +08:00
liyong d35e003def fix mindrecord log part02 2021-12-02 11:28:58 +08:00
luqilin 34bffbf768 [feat][assistant][I3T96H] add new dataset loading operator TedliumDataset 2021-12-02 09:53:39 +08:00
zy 8f9a09f79c [fix] [assistant] [I3ZSQR] add new data operator GloVe 2021-12-01 17:12:20 +08:00
hesham 828120b784 Fix intermittent failure in callback_test.cc 2021-11-30 22:36:55 -05:00
zy 5ca98a494a [fix] [assistant] [I3ZSQS] add new data operator FastText 2021-12-01 11:12:08 +08:00
“uccInf” 92d6d31750 [feat][assistant][I3J6V7] add new data operator KMnist 2021-12-01 03:05:05 +00:00
i-robot eb9537af11 !21690 [assistant][ops] Add data operator Vectors 
Merge pull request !21690 from 张渝/Vectors
 2021-12-01 01:29:45 +00:00
i-robot 2fd00935ed !20964 [assistant][ops] Add new data operator SpeechCommandsDataset 
Merge pull request !20964 from 杨旭华/SpeechCommandsDataset
 2021-11-30 09:33:03 +00:00
zhangyuqwer 6a6e73ef82 [fix] [assistant] [I3ZSQM] add new data operator Vectors 2021-11-30 14:39:42 +08:00
i-robot f513e0bfdd !26743 [GraphKernel] lite adapt for akg build. 
Merge pull request !26743 from chenlei_autodiff/lite_callback
 2021-11-30 03:38:38 +00:00
i-robot b9d56b9cce !26914 fix some error report and remove some useless code 
Merge pull request !26914 from lianliguang/master
 2021-11-29 12:34:41 +00:00
i-robot 16fa10fd38 !26875 add ut for debug info 
Merge pull request !26875 from huanghui/add-ut
 2021-11-29 03:55:52 +00:00
lianliguang 0dc5d7f4f9 modify some eroor log and remove some useless code 2021-11-29 10:23:03 +08:00
chenlei_autodiff 54227cae81 [GraphKernel] lite adapt for akg build. 2021-11-27 17:51:54 +08:00
huanghui 67a6beb1b1 add ut for debug info 2021-11-27 17:29:45 +08:00
i-robot 2bd6deaeeb !26682 GraphKernel For CPU 
Merge pull request !26682 from ZengZitao/gk_cpu
 2021-11-27 06:23:01 +00:00
vddong 91d3a7543f [feat][assistant][I3T96F] add new data operator SpeechCommands 2021-11-27 11:25:18 +08:00
i-robot 4252b24335 !26792 malloc ts memory for label 
Merge pull request !26792 from zhoufeng/change-label-memory-type
 2021-11-27 01:09:03 +00:00
zengzitao 62458b5636 adapt graph kernel for cpu 2021-11-26 18:42:34 +08:00
i-robot 04132e0c50 !26766 fix error log and move some function to inner 
Merge pull request !26766 from lianliguang/master
 2021-11-26 06:09:42 +00:00
lianliguang 5864d6a006 modify some eroor log 2021-11-26 09:24:19 +08:00
zhoufeng 881179fa10 malloc ts memory for label 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-11-26 09:17:02 +08:00
i-robot 3520f1427d !26701 MD C++ UT: Remove old tests part 3 
Merge pull request !26701 from hetshah/hs_remove_old_tests
 2021-11-25 19:29:30 +00:00
hetshah 098ca49dd3 remove instances of datasetiterator from old tests and move coverage to new method 2021-11-25 15:22:34 +00:00
i-robot 3d0f9d8aae !26683 Enable compile cache feature to load hyper parameter data from python 
Merge pull request !26683 from LiangZhibo/mindir
 2021-11-25 03:25:27 +00:00
hesham cf3ff77cfd AutoTune support non-sink mode 
Add time sts to iterator tracing
 2021-11-24 17:51:25 -05:00
i-robot d251800c62 !26705 Add the check of function return None. 
Merge pull request !26705 from Margaret_wangrui/return_none
 2021-11-24 11:09:27 +00:00
i-robot cfc6ea32ff !24714 replace rtmemcpyxx to acl memcpy 
Merge pull request !24714 from jjfeing/br_replace_rtmemcpyxx_with_acl_api
 2021-11-24 07:47:43 +00:00
Margaret_wangrui f9a384456a Add the check of function return None. 2021-11-24 15:30:35 +08:00
l00591931 21df240f23 Enable mindir to load initialize weight from python 2021-11-24 11:33:43 +08:00
He Wei 41dcac9c49 Replace std::unordered_map/set with robin-hood-hashing 
Robin-hood-hashing (https://github.com/martinus/robin-hood-hashing)
is considered faster then std::unordered_map/set,
so we use it to improve mindspore performance.

1. robin_hood head file in `third_party/robin_hood/include`;
2. In `utils/hash_map.h` and `utils/hash_set.h`, we define:
 - mindspore::HashMap as an alias of robin_hood::unordered_map;
 - mindspore::HashSet as an alias of robin_hood::unordered_set;
3. Replace:
 - `#include <unordered_map>` --> `#include "utils/hash_map.h"`;
 - `#include <unordered_set>` --> `#include "utils/hash_set.h"`;
 - `std::unordered_map` --> `mindspore::HashMap`;
 - `std::unordered_set` --> `mindspore::HashSet`;
 - `map.insert(std::pair(key, value))` --> `map.emplace(key, value)`;
 - `[] (const std::pair<K, V> &p) {..} ` --> `[] (const auto &p) {..} `;
4. Fix issues found by switch to robin_hood:
 - AnfNodeConfig hash and equal;
 - Fix a bug in `Slice::operator==()`;
 - Fix a bug in `CNode::HasPrimalAttr()`;
 - Fix map.erase() usage bugs: `map.erase(iter++)` --> `iter = map.erase(iter)`;
 - Fix some iterator invalidated problem;
5. Some std::unordered_map/set can not replace by robin_hood:
 - As parameter of functions that exposed to python by pybind11;
 - Use bad hash that cause robin_hood::map over_flow, such as AbstractBasePtrListHasher;
6. Update cpp unit tests;
7. Add build option '-F' to enable robin_hood, default on.
 2021-11-24 10:47:40 +08:00
i-robot 310bbcebe1 !26539 [GraphKernel] support lite_adapter for graph kernel. 
Merge pull request !26539 from chenlei_autodiff/lite_callback
 2021-11-23 02:44:13 +00:00
jjfeing 05485d991c replace api with acl api 2021-11-23 09:06:28 +08:00
chenlei_autodiff 4c0d5dcfe7 [GraphKernel] support lite_adapter for graph kernel. 2021-11-22 15:10:30 +08:00
i-robot 70363899e7 !24080 [assistant][ops] Add new audio operator ComputeDeltas 
Merge pull request !24080 from Rainfor/compute_detlas
 2021-11-19 12:29:49 +00:00
i-robot c6821bde0a !21648 [assistant][ops] Add new data loading operator YesNoDataset 
Merge pull request !21648 from 杨旭华/YesNoDataset
 2021-11-19 09:05:07 +00:00
vddong f465cd0242 [feat][assistant][I3T96L]add new dataset operator YesNo 2021-11-19 13:36:24 +08:00
i-robot 55463892e4 !26402 add mem offload strategy 
Merge pull request !26402 from kisnwang/add-mem-offload-strategy
 2021-11-19 03:42:52 +00:00
i-robot 3c39afad11 !24547 [MS][crowdfunding]New operator implementation, AutoAugment 
Merge pull request !24547 from yangwm/autoaugment
 2021-11-19 01:00:51 +00:00
i-robot ce00ee1ad1 !25367 use acl api to control profiling 
Merge pull request !25367 from yanghaitao/yht_condation_start_profiler
 2021-11-18 12:36:14 +00:00
zhuchuang 4c3931f5c9 [feat] [assistant] [I3CKEE] add new audio operator ComputeDeltas 2021-11-18 17:18:43 +08:00
i-robot 9d6248194e !26310 MindSpore support load custom aicpu kernels. 
Merge pull request !26310 from linqingke/aicpu
 2021-11-18 08:09:26 +00:00
kswang 7c312bd38c add mem offload strategy 2021-11-18 15:54:16 +08:00
despicablemme 09897ce7ec [feat] [assistant] [I40GZP] add new data op AutoAugment 2021-11-18 11:38:18 +08:00
yanghaitao1 c94aa6b872 use profiler acl api instead 2021-11-17 09:33:31 -05:00
linqingke bef2923acf MindSpore support load custom aicpu ops. 2021-11-17 14:58:50 +08:00
wangkc123 706f9e2cbb [feat] [assistant] [I3CKEH] add new audio operator SlidingWindowCmn 2021-11-16 22:00:09 +08:00
i-robot 58b69a05ee !20576 [assistant][ops] add new dataset loading operator LJSpeechDataset 
Merge pull request !20576 from 杨旭华/LJSpeechDataset
 2021-11-16 07:00:20 +00:00
i-robot 6bdd38399a !25811 fault_recover_by_mirror_group 
Merge pull request !25811 from yao_yf/fault_recover_by_mirror_group
 2021-11-16 02:20:58 +00:00
mohammad 5c8ab5f60c add MD Profiler Save() 2021-11-15 13:18:36 -05:00
vddong 6fe2d35ae2 [feat][assistant][I3T96D] add new dataset loading operator LJSpeechDataset 2021-11-14 14:52:15 +08:00
yao_yf 501b978d16 find data parallel common group in auto parallel 2021-11-13 10:23:45 +08:00
i-robot 04da5c2808 !26140 Add callback support to BatchOp Datasets to enable Add/Remove workers 
Merge pull request !26140 from h.farahat/cb_batch
 2021-11-12 17:23:19 +00:00
i-robot e154dca4b1 !22193 [assistant][ops] Add new loader operator DBpedia 
Merge pull request !22193 from 杨旭华/DBpedia
 2021-11-12 09:02:28 +00:00
i-robot 0f07408425 !26034 F.grad support sens_param and fix graph_mode bug 
Merge pull request !26034 from zhang_sss/grad
 2021-11-12 06:38:15 +00:00
i-robot 6c587dc2d3 !25391 Support to profiling parallel strategy 
Merge pull request !25391 from ougongchang/profiling_stategy
 2021-11-12 06:07:30 +00:00
Carry955 0d26c38693 [feat][assistant][I40GXT] add new loader DBpedia 2021-11-11 19:02:22 -08:00
i-robot 7a73bae5c3 !26036 add output strategy for matmul operator 
Merge pull request !26036 from yangzhenzhang/add-output-strategy-for-op-init
 2021-11-12 01:22:22 +00:00
hesham 2662b6d5c3 Add callback to Batch op 2021-11-11 10:58:01 -05:00
zhang__sss 0dd68aa7eb grad 2021-11-11 23:18:35 +08:00
ougongchang 9229f1c1ff profiler support to collect parallel strategy info 
If SetNodeOutputType functions forcibly splits into multiple functions, the readability decreases, so it blocks lizard scans
 2021-11-11 20:11:42 +08:00
i-robot b910870ecc !19986 [assistant][ops] Add new dataset loading operator AGNEWS 
Merge pull request !19986 from 杨旭华/AGNEWS
 2021-11-11 06:22:25 +00:00
zetongzhao 2de8142c44 profiler test 2021-11-10 11:55:19 -05:00
Megalomania c34bbabed9 [feat] [assistant] [I3T96M] add new loader AGNEWS 2021-11-09 23:51:19 -08:00
yangzhenzhang 8431ba616c add output strategy for op init 2021-11-10 15:35:45 +08:00
i-robot 8bf7e28fa6 !25410 add dump flag for fusion nodes 
Merge pull request !25410 from yuchaojie/ir_fusion3
 2021-11-10 02:25:08 +00:00
i-robot d4c8dde6d2 !25923 Move IsRealKernel and IsRealCNodeKernel from AnfAlgo to AnfUtils 
Merge pull request !25923 from DeshiChen/1101_anfalgo
 2021-11-10 01:56:07 +00:00
i-robot 2e174427c9 !25963 [MD][Autotune] Add WaitFor 
Merge pull request !25963 from harshvardhangupta/hesh_tree_mod
 2021-11-09 22:43:00 +00:00
i-robot b7244ac987 !25852 MD C++ UT: Remove old tests part 2 
Merge pull request !25852 from hetshah/hs_remove_old_tests
 2021-11-09 22:07:59 +00:00
hetshah 5c703015e4 remove old tests and move coverage 2021-11-09 21:27:37 +00:00
i-robot 61b53fee3a !25980 Add callback support to Mappable Datasets to enable Add/Remove workers 
Merge pull request !25980 from h.farahat/cb_mappable
 2021-11-09 20:05:01 +00:00
hesham 17e338e909 Add WaitFor 2021-11-09 10:19:48 -05:00
dayschan cbb84ff580 Move IsRealKernel and IsRealCNodeKernel from AnfAlgo to AnfUtils 
the function IsOneOfPrimitive and IsOneOfPrimitiveCNode is useful,
we can move them into anf.cc
 2021-11-09 14:34:21 +08:00
yuchaojie 0c90aecae4 add dump flag for fusion nodes 2021-11-09 10:48:17 +08:00
hesham 040398a660 Add callback to Mappable ops 
Update mindspore/ccsrc/minddata/dataset/engine/datasetops/source/mappable_leaf_op.cc
 2021-11-08 20:17:34 -05:00
zhang__sss 8bae4d9d50 grad 2021-11-08 14:12:58 +08:00
i-robot 7c14f984ed !25793 add output strategy for shard 
Merge pull request !25793 from yangzhenzhang/add-output-strategy
 2021-11-05 01:19:01 +00:00
i-robot 92b81d3221 !23257 [assistant][ops][DBToAmplitudeOp] 
Merge pull request !23257 from 杨旭华/DBToAmplitude
 2021-11-04 10:32:32 +00:00
yangzhenzhang 6ad6304b77 add output strategy 2021-11-04 16:28:54 +08:00
i-robot 1a2a462c8f !25786 fix resnet pynative performance 
Merge pull request !25786 from baihuawei/fixpynativeperformance
 2021-11-03 08:58:09 +00:00
liucunwei a86ac516fc add some of ut about dataset IteratorOneColumn 2021-11-03 12:02:00 +08:00
baihuawei e59d07899b fix reset8p pynative performance 2021-11-03 09:13:19 +08:00
Isaac 69f57bc5b1 [feat][assistant][I40GXD]add new data operator DBToAmplitude 2021-11-02 23:45:27 +08:00
i-robot 2224f75b47 !25696 add pass switch 
Merge pull request !25696 from zhoufeng/pass-switch
 2021-11-02 01:33:15 +00:00
i-robot 1edd91c974 !25329 MD C++ UT: Remove old tests part 1 
Merge pull request !25329 from hetshah/hs_remove_old_tests
 2021-11-01 19:35:58 +00:00
i-robot eff2318bb6 !25524 [Autotune] Add TreeModifier and Remove Worker logic 
Merge pull request !25524 from h.farahat/tree_modifier
 2021-11-01 13:35:04 +00:00
i-robot 30870cc133 !25443 [MD] mindrecord support overwriting 
Merge pull request !25443 from liyong126/add_mindrecord_overwrite
 2021-11-01 13:20:48 +00:00
zhoufeng fb17c448c2 add pass switch 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-11-01 16:33:02 +08:00
LaiYongqiang 07e5ed9f16 ascend device context 2021-11-01 11:42:40 +08:00
liyong 41e8280f55 add mindrecord overwrite 2021-11-01 10:44:20 +08:00
hesham 62d9004d1e TreeModifier and Remove worker 2021-10-29 17:11:19 -04:00
i-robot 036bc4329f !25447 Check Device Shape 
Merge pull request !25447 from hwjiaorui/check-support-json
 2021-10-28 12:38:06 +00:00
liucunwei f2813b909e add some of ut cases about createIterator columns 2021-10-28 18:57:02 +08:00
i-robot 9e1370515a !25451 Make MD ProfilingManager a singleton class 
Merge pull request !25451 from h.farahat/profiling_manager_singlton
 2021-10-27 20:54:13 +00:00
hesham 843357a6d8 Make ProfilingManager a singleton 2021-10-27 11:37:02 -04:00
i-robot 0d93793e80 !25463 log improvement 
Merge pull request !25463 from laiyongqiang/step_log
 2021-10-27 07:17:27 +00:00
LaiYongqiang dc7988f4bd log improvement 2021-10-27 12:36:47 +08:00
hwjiaorui 5f494aa61b check transfrom device shape 2021-10-27 09:12:41 +08:00
i-robot 74977e548d !24624 [Autotune] Modify MD callback and AddWorker logic to ParallelOps 
Merge pull request !24624 from h.farahat/add_worker
 2021-10-27 00:41:20 +00:00
hetshah 1be909c28e removed old tests and moved additonal coverage to new test files 2021-10-26 20:43:49 +00:00
i-robot 5a49db7a36 !25212 Reduce size of queue and test 
Merge pull request !25212 from zetongzhao/resize_smaller
 2021-10-26 19:36:00 +00:00
zetongzhao 9dad5f1f46 resize to a smaller size 2021-10-25 16:03:57 -04:00
i-robot 9acbf3eb7a !25282 1、Optimize the error message in operator 2、add operator test cases 
Merge pull request !25282 from Margaret_wangrui/operator_cases
 2021-10-25 01:22:42 +00:00
i-robot cb307e24cf !25153 refactor device loop control 
Merge pull request !25153 from laiyongqiang/adjust_kernel_refactory
 2021-10-23 07:42:49 +00:00
i-robot 6f413ee29d !25155 Support ops, nn and numpy namespaces, and add test case. 
Merge pull request !25155 from 张清华/opt_fallback
 2021-10-23 03:50:53 +00:00
Margaret_wangrui 7b93e4e87c 1、Optimize the error message in operator 2、add operator test cases 2021-10-23 10:16:59 +08:00
LaiYongqiang 9bfb2d99fa refactor device loop control 2021-10-22 20:42:38 +08:00
i-robot e05a4393ef !24611 split compile and generate kernel mod 
Merge pull request !24611 from liubuyu/bug_fix2
 2021-10-22 09:02:55 +00:00
Zhang Qinghua 6a79e262ae Support ops, nn and numpy namespaces, and add test case. 2021-10-22 16:31:30 +08:00
lby 6872e67131 split compile ang gen kernel mod 2021-10-22 10:13:50 +08:00
i-robot 782874bf18 !21215 [MS][crowdfunding]New operator implementation, include phaser 
Merge pull request !21215 from Wangsong95/phaser
 2021-10-22 01:08:50 +00:00
hesham 85e077b60b Callback changes 
AddWorker logic to parallel ops
 2021-10-21 17:35:11 -04:00
i-robot 5d8be044c9 !18018 [assistant][ops]New operator implementation, include FashionMnistDataset 
Merge pull request !18018 from 张璇/fashionmnist_dataset
 2021-10-20 06:42:54 +00:00
i-robot f9bd640b09 !16269 [assistant][RandomLighting] 
Merge pull request !16269 from QingfengLi/randomlighting
 2021-10-20 06:42:12 +00:00
“uccInf” fe3123cfe8 [feat][assistant][I3J6V4] add new data operator FashionMnist 2021-10-20 02:37:56 +00:00
i-robot 440036d331 !24362 [assistant][ops]New operator implementation, include PhotoTourDataset 
Merge pull request !24362 from Wangsong95/phototour_dataset
 2021-10-20 01:46:05 +00:00
i-robot 4ea7849908 !24575 Resize operator connector queue 
Merge pull request !24575 from zetongzhao/master
 2021-10-19 20:36:43 +00:00
zetongzhao 10fdbd6c03 resize queue and test 2021-10-19 11:43:53 -04:00
yangyueren 6594b90a58 [feat][assistant][I3J6VE] add new data operator PhotoTour 2021-10-19 15:31:32 +00:00
chenx2ovo 77caf907c4 [feat][assistant][I3CEGR] add op random lighting 2021-10-19 20:38:01 +08:00
i-robot 690642d672 !18664 [assistant][ops]New operator implementation, include Places365Dataset 
Merge pull request !18664 from Wangsong95/places365_dataset
 2021-10-19 07:06:35 +00:00
i-robot 1606f19dfb !18265 [assistant][ops] Add new audio operator CreateDct 
Merge pull request !18265 from 杨旭华/CreateDct
 2021-10-19 06:30:18 +00:00
tophand 4f4777f0da [feat][assistant][I3J6U2] Add new audio operator CreateDct 2021-10-18 03:23:18 -07:00
zx d13d2413f5 [feat][assistant][I3J6UV] add new audio operator Phaser 2021-10-16 08:45:12 +08:00
yangyueren 951193c308 [feat][assistant][I3J6VF] add new data operator Places365 2021-10-15 14:56:09 +00:00
robert_luo_yibo 75e2c3041c [feat][assistant][I3CEG3] add new data OP MuLawEncoding 2021-10-14 20:24:18 +08:00
i-robot 1b9b85bbb2 !17851 [assistant][ops]New operator implementation, include FakeImageDataset 
Merge pull request !17851 from 张璇/fakeimage_dataset
 2021-10-13 09:22:55 +00:00
i-robot 0ba7872f76 !24620 add utst for mem scheduler 
Merge pull request !24620 from kisnwang/add-utst-for-mem-scheduler
 2021-10-13 08:34:46 +00:00
i-robot 18e632c7a1 !21216 [MS][crowdfunding]New operator implementation, include Overdirve 
Merge pull request !21216 from Wangsong95/overdrive
 2021-10-13 01:08:36 +00:00
G-Dragon-Liu d2f22a8726 [feat][assistant][I3J6V3] add new data operator FakeImage 2021-10-12 14:00:43 +00:00
zx 9b7d7be65c [feat][assistant][I3J6UU] add new audio operator Overdrive 2021-10-12 18:10:31 +08:00
kswang 6582744bf6 add utst for mem scheduler 2021-10-12 14:44:17 +08:00
i-robot e920a1c07e !24593 Continue execution when saving and loading mindir failed 
Merge pull request !24593 from YuJianfeng/master
 2021-10-12 01:51:12 +00:00
yujianfeng d384db6c01 Continue execution when saving and loading mindir failed 2021-10-11 19:05:25 +08:00
i-robot b9c2a84d3b !17812 [assistant][ops] Add a new audio operator Flanger 
Merge pull request !17812 from 杨旭华/Flanger
 2021-10-09 08:15:33 +00:00
i-robot 333ca7becd !24585 delete old build process 
Merge pull request !24585 from liubuyu/del_old
 2021-10-09 07:53:01 +00:00
lby 3e9fd763c3 delete old build process 2021-10-09 11:16:09 +08:00
i-robot 59b6125fe7 !24500 add ascend memory adapter for ascend memory management 
Merge pull request !24500 from laiyongqiang/memory_code_check
 2021-10-09 01:20:19 +00:00
li-qiyao 2283442855 [feat][assistant][I3J6U9] add new data operator Flanger 2021-10-08 05:03:31 -07:00
i-robot 8598d08351 !17820 [assistant][ops]New operator implementation, include EMnistDataset 
Merge pull request !17820 from 张璇/emnist_dataset
 2021-10-08 07:18:31 +00:00
i-robot 02f9e3e077 !17805 [assistant][ops] Add new audio operator DetectPitchFrequency 
Merge pull request !17805 from 杨旭华/DetectPitchFrequency
 2021-10-08 03:34:46 +00:00
LaiYongqiang 79599546ee add ascend memory adapter for ascend memory management 2021-10-08 11:01:48 +08:00
G-Dragon-Liu 32baa520bf [feat][assistant][I3J6V2] add new data operator EMnist 2021-10-08 02:53:00 +00:00
i-robot 55e165c50e !24517 MD Profiling: Move ProfilingManager from ExecutionTree to TreeConsumer 
Merge pull request !24517 from cathwong/ckw_prof_mv_to_consumer6
 2021-10-06 14:34:24 +00:00
hesham c3718327f2 Stage 1 2021-10-04 23:34:15 -04:00
Cathy Wong 0665a191dc MD Profiling: Move ProfilingManager from ExecutionTree to TreeConsumer 2021-10-04 11:12:02 -04:00
Zhang Lian b7e6520e62 [feat] [assistant] [I3J6U8] Add a new audio operator DetectPitchFrequency 2021-09-29 15:12:58 +08:00
i-robot dd544a9693 !21406 [MS][crowdfunding]New operator implementation, include TrebleBiquad 
Merge pull request !21406 from 张璇/treble_biquad
 2021-09-27 14:18:00 +00:00
i-robot bf74e7ce44 !24185 Optimize graph_utils 
Merge pull request !24185 from hewei/opt_perf
 2021-09-27 13:26:10 +00:00
i-robot d1d4797079 !24204 [MD] sync code for code review 
Merge pull request !24204 from liyong126/sync_code
 2021-09-27 11:16:03 +00:00
He Wei 205b6357ed Optimize graph_utils 2021-09-27 17:38:19 +08:00
i-robot f16c003dfa !22610 [MS][crowdfunding]New operator implementation, RandomAdjustSharpness 
Merge pull request !22610 from yangwm/sharpness
 2021-09-27 09:20:05 +00:00
liyong 567f137a39 sync code 2021-09-27 14:31:49 +08:00
zx 3da0f0f487 [feat][assistant][I3J6V0] add new audio operator TrebleBiquad 2021-09-27 13:01:26 +08:00
despicablemme d072a4e4bf [feat] [assistant] [I40GZE] add new data operator RandomAdjustSharpness 2021-09-27 11:19:33 +08:00
i-robot ab567574c4 !21451 [MS][crowdfunding]New operator implementation, include RiaaBiquad 
Merge pull request !21451 from 张璇/riaa_biquad
 2021-09-27 03:14:16 +00:00
i-robot 2969688382 !20047 [assistant][ops]New operator implementation, include QmnistDataset 
Merge pull request !20047 from Wangsong95/qmnist_dataset
 2021-09-27 01:36:08 +00:00
i-robot a4459979d4 !24104 unknown_shape attr for fusion json 
Merge pull request !24104 from liubuyu/bug_fix2
 2021-09-27 01:12:48 +00:00
lby 925778015d add unknown_shape attr for fusion json 2021-09-26 14:44:21 +08:00
despicablemme 7063907bdc [feat] [assidtant] [I40GZN] add new data ops RandomEqualize 2021-09-25 18:00:25 +08:00
i-robot ee38ffbd3d !22560 [MS][crowdfunding]New operator implementation, RandomAutoContrast 
Merge pull request !22560 from yangwm/autocontrast
 2021-09-24 09:34:37 +00:00
i-robot 858b985953 !23911 use full attrs info when build/prebuild single op 
Merge pull request !23911 from laiyongqiang/context_attrs
 2021-09-24 02:14:16 +00:00
zx 1d95e6f480 [feat][assistant][I3J6UY] add new audio operator RiaaBiquad 2021-09-23 21:36:59 +08:00