yankf21
/
mindspore2022
forked from huawei/mindspore2022
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
42,203 Commits 18 Branches 22 Tags 3.6 GiB
Commit Graph

1971 Commits

Author SHA1 Message Date
zhoufeng f49b195c39 extract common as an independent shared library 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2022-02-26 10:55:51 +08:00
shenwei41 ff75314719 upgrade ascend 20220211 2022-02-25 21:19:45 +08:00
chenlei_autodiff 9fabf8ae0d [GraphKernel] replace graph kernel node with custom in lite. 2022-02-25 17:09:24 +08:00
i-robot ac1463a192
!30298 Package the cuda operators as a dynamic link library 
Merge pull request !30298 from jinjiali-kali/cuda_ops
 2022-02-24 11:36:20 +00:00
i-robot eeb731ae3e
!18738 [assistant][ops]New operator implementation, include LSUNDataset 
Merge pull request !18738 from Wangsong95/lsun_dataset
 2022-02-23 02:28:40 +00:00
jinjiali b2d1bad62c package the cuda operations as a dynamic link library 2022-02-22 16:48:19 +08:00
yanghaoran 739c4b236a
回退 'Pull Request !30120 : Package the cuda operators as a dynamic link library' 2022-02-18 08:59:07 +00:00
zhixinaa 4ce6104ff9 [feat][assistant][I3J6V9] add new data operator LSUN 2022-02-18 15:40:32 +08:00
i-robot 8e21ffae65
!30120 Package the cuda operators as a dynamic link library 
Merge pull request !30120 from jinjiali-kali/cuda_ops_3
 2022-02-18 01:28:24 +00:00
jinjiali cd7db0f57f package the cuda operations as a dynamic link library 2022-02-17 16:51:45 +08:00
i-robot 7c32002e0b
!29930 Support List Slice 
Merge pull request !29930 from lianliguang/support-list-slice
 2022-02-17 07:24:40 +00:00
i-robot 2decc54375
!30016 Add distributed meta store module 
Merge pull request !30016 from ZPaC/metadata-store-module
 2022-02-17 02:13:30 +00:00
lianliguang 49608835c1 support list slice 2022-02-17 09:47:26 +08:00
i-robot c4c5a1c6da
!29862 MD Autotune supporting MindRecordOp 
Merge pull request !29862 from Mohammad Motallebi/autotune_addworker_mindrecord
 2022-02-16 23:34:11 +00:00
mohammad ddd3b07648 MD autotune supports mindrecord 2022-02-16 14:00:31 -05:00
ZPaC 191b65b236 Add distributed meta store module 2022-02-16 20:25:20 +08:00
i-robot 3b84ba1f1d
!29940 [GraphKernel] decouple convert_const_input_to_attr. 
Merge pull request !29940 from chenlei_autodiff/gk_lite
 2022-02-16 03:30:38 +00:00
i-robot e57633ec7f
!30027 Fix tensor with dynamic shape problem 
Merge pull request !30027 from hewei/fix_core
 2022-02-15 06:26:51 +00:00
chenlei_autodiff 5df9f01310 [GraphKernel] decouple convert_const_input_to_attr. 2022-02-15 10:27:34 +08:00
He Wei 36ab9c3d4b Fix tensor with dynamic shape problem 
Set data size to zero for tensor with dynamic shape,
prevent unexpected memory allocation for tensor data.
 2022-02-15 09:11:36 +08:00
He Wei 656b89a4da Add MakeValue related functions in MindAPI 
1. NewValueNode() by PrimitivePtr;
2. MakeValue() by vector<bool>.
 2022-02-14 15:08:43 +08:00
marui d47e79b04c Refactor ccsrc directories and CMakeLists files 2022-02-13 14:37:51 +08:00
He Wei 93328bc707 Fix a logging api bug in MindAPI 2022-02-11 08:42:04 +08:00
i-robot a42bc503f0
!29764 Add more required apis in MindAPI 
Merge pull request !29764 from hewei/core_api
 2022-02-10 07:55:37 +00:00
i-robot 7b6f7c9c87
!29786 Add TCP client and TCP server for RPC 
Merge pull request !29786 from chengang/add_tcp_server
 2022-02-10 07:47:12 +00:00
He Wei 21a9a0a73a Add more required apis in MindAPI 
1. AbstractBase::set_shape();
2. Move shape() from AbstractTensor to AbstractBase;
3. AbstractSequence construct from AbstractBasePtrList;
4. Shape construct from ShapeVector.
 2022-02-10 11:19:01 +08:00
cristoval c44d7b9100 add tcp client and tcp server 2022-02-10 09:50:40 +08:00
许志杰 ab9a32ad0d [feat] [assistant] [#I40GYE] add new loader SQuADDataset 2022-02-08 03:00:09 -08:00
zhoufeng b9b2f5bbfd delete core gvar 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2022-02-06 17:21:49 +08:00
i-robot e12d6af257
!29358 MD Child Sampler Code and UT Issues 
Merge pull request !29358 from zetongzhao/sampler_AddChild
 2022-01-31 16:55:22 +00:00
zetongzhao ea9783e18c fix sampler add_child 2022-01-31 07:45:42 -05:00
i-robot 48f4fd2f52
!29639 build core.so 
Merge pull request !29639 from zhoufeng/dynamic-core
 2022-01-30 02:00:21 +00:00
i-robot 02d63d7ad9
!23008 [assistant][ops][FilterWikipediaXML] 
Merge pull request !23008 from Isaac/FilterWikipediaXML
 2022-01-29 08:35:29 +00:00
i-robot 3d5ed14ff8
!29600 Open constrol flow closure feature. 
Merge pull request !29600 from chenfei_mindspore/open-closure
 2022-01-29 08:18:59 +00:00
zhoufeng 8e97ce5cd2 build core.so 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2022-01-29 14:11:02 +08:00
chenfei a96f0b11e0 open closure 2022-01-28 22:04:31 +08:00
tophand 797cd52c96 [feat][assistant][I40GXK]add new data operator Filter_Wikipedia_XML 2022-01-28 02:26:20 -08:00
QRICK 52c73ff1b3 [assistant][ops][I3T96S] Add new data operator MaskAlongAxis 2022-01-28 14:53:38 +08:00
i-robot a24709b46a
!22446 [assistant][ops] Add new data operator MaskAlongAxisIID 
Merge pull request !22446 from TR-nbu/MaskAlongAxisIID
 2022-01-27 08:45:24 +00:00
i-robot f2466fbff2
!29443 update ascend stream assign && add PROF log info 
Merge pull request !29443 from lyqlola/master
 2022-01-27 06:40:29 +00:00
QRICK 9ed73eae94 [assistant][ops][I3T96P] Add new data operator MaskAlongAxisIID 2022-01-27 12:20:26 +08:00
liyiqi adb33a15b5 update ascend stream assign && add PROF log info 2022-01-27 11:25:36 +08:00
i-robot 9f9ffe9539
!29152 Support frontend graph compilation cache in ps mode 
Merge pull request !29152 from YuJianfeng/compile_cache
 2022-01-27 01:22:44 +00:00
i-robot fffa272c2f
!29542 Fix construt Execute with pointers 
Merge pull request !29542 from luoyang/execute_bug
 2022-01-26 06:47:08 +00:00
i-robot 2b82ba1e49
!26244 [assistant][ops] Add new data PhaseVocoder 
Merge pull request !26244 from TR-nbu/PhaseVocoder
 2022-01-26 06:46:36 +00:00
i-robot 6fac9c5d1d
!28505 Change SparseTensor to COOTensor 
Merge pull request !28505 from wangrao124/COOTensor
 2022-01-26 06:22:28 +00:00
YangLuo ba79c3c7cb Fix construtor Execute with pointers 2022-01-26 10:28:42 +08:00
i-robot 787605d6ca
!29499 fix I4RQOC && sync code 
Merge pull request !29499 from tan-wei-cheng-3260/develop-twc-master
 2022-01-25 10:43:31 +00:00
yujianfeng dcd6f9e491 Support compile cache in ps mode 2022-01-25 17:34:57 +08:00
twc 997ae1133a fix I4RQOC && sync code 2022-01-25 15:50:45 +08:00
wangrao124 9dfc703f7a change sparsetensor to cootensor 2022-01-25 15:39:37 +08:00
donrichnx eee07047a0 [feat] [assistant] [I40GYJ] add Captioning task of CocoDataset 2022-01-24 17:24:16 +08:00
QRICK 859f90cb85 [assistant][ops][I3T96R] Add new data operator PhaseVocoder 2022-01-24 16:00:24 +08:00
i-robot af02897be7
!29118 Refactor kernel mod class and its subclasses. 
Merge pull request !29118 from TronZhang/refact_kernel_mod_class
 2022-01-22 10:34:53 +00:00
i-robot 85ac17a8c6
!22736 [assistant][ops] Add new dataset operator LibriTTSDataset 
Merge pull request !22736 from TR-nbu/LibriTTSDataset
 2022-01-22 10:03:40 +00:00
TronZhang deac002bed refactor kernel mod class and subclass 2022-01-22 16:31:37 +08:00
i-robot 6b78c1a827
!29316 FL, update iterator func_graph_ to weak_ptr 
Merge pull request !29316 from 徐永飞/master
 2022-01-22 08:21:29 +00:00
xuyongfei 6bad80681b FL, update iterator func_graph_ to weak_ptr && fix tcp message handler memory bug 2022-01-21 20:28:56 +08:00
i-robot 690a660919
!17918 [assistant][MelScale] 
Merge pull request !17918 from QingfengLi/MelScale
 2022-01-21 09:52:56 +00:00
ZJM 8d339ccfea [assistant][ops][22736] Add new dataset operator LibriTTSDataset 2022-01-21 17:34:42 +08:00
i-robot 9aa25eaa35
!29360 adapt some cpp ut for unused nodes eliminate 
Merge pull request !29360 from huanghui/fix-unused-output-in-ascend-pass
 2022-01-21 06:13:24 +00:00
huanghui f3ebb1a0e1 adapt some cpp ut for unused nodes eliminate 2022-01-21 11:30:39 +08:00
chenx2ovo bbba4fb940 [feat][assistant][I3CEG0] add op melscale 2022-01-21 11:30:34 +08:00
ZJM fff47f3886 [assistant][ops][I3T96T] Add new dataset operator CMUArcticDataset 2022-01-20 17:40:35 +08:00
i-robot 501614a61f
!22514 [assistant][ops] Add new data operator Multi30kDataset 
Merge pull request !22514 from 杨旭华/Multi30kDataset
 2022-01-20 02:13:17 +00:00
i-robot 71767a92c9
!29271 Fix Random Failure from UT/cpp Profiler Test 
Merge pull request !29271 from zetongzhao/profiler_test
 2022-01-19 21:29:44 +00:00
zetongzhao 9ded77ffc7 small change to ensure connector gets output 2022-01-19 11:15:09 -05:00
unknown c4ee548905 [feat][assistant][I40GY6]add new data operator Multi30kDataset 2022-01-19 18:33:13 +08:00
ZJM 21973bbbec [assistant][ops][I3T96W] Add new dataset operator GTZANDataset 2022-01-19 13:48:50 +08:00
zetongzhao 3580a7f863 add profiler test 2022-01-17 08:37:44 -05:00
i-robot 19a9ad6f38
!22893 [assistant][ops] Add new data operator CreateFbMatrix 
Merge pull request !22893 from TR-nbu/CreateFbMatrix
 2022-01-17 08:33:48 +00:00
1462492739@qq.com bf5f24d62f [assistant][ops][I3T96S] Add new data operator CreateFbMatrix 2022-01-14 21:24:17 +08:00
xiao_yao1994 54fc038f0a unify infer and train compile binary 2022-01-13 17:04:34 +08:00
i-robot fc4abc99f5
!28595 Fix some code review probelms 
Merge pull request !28595 from xiaotianci/update_code_review
 2022-01-12 09:30:28 +00:00
i-robot 6d069f8b1d
!28881 Add UInt8Imm to MindAPI 
Merge pull request !28881 from hewei/core_api
 2022-01-12 07:16:39 +00:00
i-robot 68ec2be828
!28784 [GraphKernel] add lite pass manager. 
Merge pull request !28784 from chenlei_autodiff/lite_callback
 2022-01-12 06:52:10 +00:00
i-robot 7384cb2689
!28546 fused global norm for cpu adafactor 
Merge pull request !28546 from kisnwang/add-cpu-adafactor
 2022-01-11 12:22:49 +00:00
He Wei 0442c50bb0 Add UInt8Imm to MindAPI 2022-01-11 16:08:32 +08:00
Xiao Tianci 96a2e38d01 update review problems 2022-01-11 15:31:53 +08:00
kswang 643b7b7ce4 fused global norm for cpu fused adafactor 2022-01-11 14:56:48 +08:00
chenlei_autodiff 0574995198 [GraphKernel] add lite pass manager. 2022-01-11 12:08:54 +08:00
xiao_yao1994 0843910260 unify ge and vm backend 2022-01-11 11:53:58 +08:00
i-robot a28dd013f7
!28715 Eliminate unused nodes in a tuple or list node. 
Merge pull request !28715 from 张清华/eliminate_tuple_unused_item2
 2022-01-08 06:38:47 +00:00
Zhang Qinghua d2572719f7 Eliminate unused nodes in a tuple or list node. 2022-01-07 21:30:01 +08:00
TronZhang 58f386fe2a Add Custom actor nodes and custom actor support for dynamic shape case 2022-01-07 17:31:37 +08:00
i-robot a1720c210d
!22348 [assistant][ops] Add new loader EnWik9Dataset 
Merge pull request !22348 from 杨旭华/EnWik9Dataset
 2022-01-05 07:36:48 +00:00
i-robot ec485cb436
!28307 convert EnvSetItem/EnvGetItem to primitive EnvironSet/EnvironGet 
Merge pull request !28307 from xychow/EnvGetItem-conversion
 2022-01-05 07:10:30 +00:00
i-robot e4438f3028
!28310 dynamic_kernel_mod 
Merge pull request !28310 from TuDouNi/dynamic_shape_stage1
 2022-01-04 12:48:53 +00:00
ttudu 9373679c04 dynamic_kernel_mod 2022-01-04 14:13:19 +08:00
Eden 63ab65e3a4 [feat] [assistant] [#I40GYF] add new loader EnWik9Dataset 2022-01-03 21:45:43 -08:00
i-robot 69d86d9b92 !28460 Modify some error log 
Merge pull request !28460 from caifubi/master-pynative-error-modify
 2022-01-04 03:16:36 +00:00
zhousiyi 19e9571149 rename env_getitem/setitem to EnvironGet/EnvironGet 2022-01-04 02:17:30 +00:00
i-robot 241d87a8a6 !27898 convert aicpu op attr to input 
Merge pull request !27898 from yuchaojie/op_select
 2021-12-31 09:51:48 +00:00
caifubi 49328ae86d Modify Hccl Error Log 2021-12-31 17:24:54 +08:00
vddong 7449b8364b [feat][assistant][I40GYQ] add new dataset operator WIDERFace 2021-12-31 13:49:47 +08:00
yuchaojie a0a31fe651 convert aicpu op attr to input 2021-12-30 18:59:53 +08:00
jingyangxiang a7f8b3af1c [feat][assistant][ops]New operator implementation, include IMDBDataset 
Signed-off-by: zjuter0126 <977180923@qq.com>
 2021-12-30 11:16:23 +08:00
i-robot 7c241bbaf5 !22085 [assistant][ops] add new data operator WikiTextDataset 
Merge pull request !22085 from ZJUTER0126/WikiTextDataset
 2021-12-30 03:12:03 +00:00
i-robot 3058a16213 !28144 using data type to get cube size 
Merge pull request !28144 from liubuyu/SBB
 2021-12-30 02:23:56 +00:00
zjuter0126 3c2ca41886 [feat][assistant][ops] add new data operator WikiTextDataset 2021-12-29 18:54:54 +08:00
i-robot ac9e545dc8 !22546 add new dataset loading operator CaltechDataset 
Merge pull request !22546 from 杨旭华/CaltechDataset
 2021-12-29 03:40:06 +00:00
i-robot bdf0f043e7 !28288 Don't lift fv before higher order grad if closure is kept 
Merge pull request !28288 from xychow/dont-liftfv-for-higher-order-grad-in-closure
 2021-12-29 01:52:44 +00:00
lby e6857a6553 using cube to get c0 value 2021-12-29 09:00:52 +08:00
donrichnx 9a0fc0ffc1 [feat] [assistant] [I40GYH] add new dataset loading operator CaltechDataset 2021-12-28 19:04:18 +08:00
i-robot 67e843ec7f !27487 [assistant] [ops][SpectralCentroid] 
Merge pull request !27487 from 杨旭华/SpectralCentroidOp
 2021-12-28 09:10:32 +00:00
zhousiyi d9aa48bc64 Dont liftfv before grad in higher order grad if closure is kept as bprop of Partial primitive is not supported 2021-12-28 07:54:22 +00:00
i-robot 749917a819 !28197 add cpu fused adafactor 
Merge pull request !28197 from kisnwang/add-cpu-adafactor
 2021-12-28 07:04:22 +00:00
i-robot 7faf774063 !22310 [assistant][ops] Add new loader SemeionDataset 
Merge pull request !22310 from 杨旭华/SemeionDataset
 2021-12-28 03:13:02 +00:00
kswang af48f201a2 add cpu fused adafactor 2021-12-28 11:05:41 +08:00
i-robot efaf29dc44 !28268 Remove unstable RPC test case 
Merge pull request !28268 from chengang/fix_tcp_ut
 2021-12-28 01:40:54 +00:00
i-robot 0e7a059bec !28186 Add axis check and shape black list for ConfusionSoftmaxGradRule pass 
Merge pull request !28186 from yuchaojie/ir_fusion
 2021-12-28 01:34:57 +00:00
yuchaojie 343f7dbe06 Add axis check and shape black list for ConfusionSoftmaxGradRule pass 2021-12-27 21:16:38 +08:00
cristoval 00d1aa9884 Remove unstable test case 2021-12-27 20:06:49 +08:00
luqilin 896f10d6d5 [feat][assistant][I40GYK] add new dataset loading operator SemeionDataset 2021-12-27 19:49:06 +08:00
tongyue 9a1dcd60fc [fix] [assistant] [I40GXI] fix bug in the infer function of the operator SpectralCentroid 2021-12-27 01:41:31 -08:00
i-robot 69a6c7db98 !23380 [assistant][ops] Add new loader AmazonReview 
Merge pull request !23380 from 杨旭华/AmazonReview
 2021-12-27 09:36:32 +00:00
luoyang 0288480722 Python Vocab refactoring and add ids_to_tokens & tokens_to_ids 2021-12-24 15:26:15 +08:00
chengchuanxing 07aa66ee43 [feat][assistant][I40GY2] add new loader AmazonReview 2021-12-23 16:32:31 +08:00
i-robot 0ac791560c !28011 remove unused code in class EnvInstance 
Merge pull request !28011 from xychow/remove-unused-code-in-envinstance
 2021-12-23 08:15:54 +00:00
zhousiyi 07e5cdad1b remove unused code in class EnvInstance 2021-12-23 02:16:41 +00:00
fattycat 289a7997df [feat] [assistant] [#I40GYB] add new loader CoNLL2000ChunkingDataset 2021-12-21 15:31:25 +08:00
i-robot 7331629ceb !22686 [assistant][ops][Dither] 
Merge pull request !22686 from Isaac/Dither
 2021-12-20 11:16:20 +00:00
i-robot 953920112c !22553 [assistant][ops] Add new loader UDPOSDataset 
Merge pull request !22553 from 杨旭华/UDPOSDataset
 2021-12-20 06:54:54 +00:00
i-robot 11da28f24a !27060 modify dev env name 
Merge pull request !27060 from zhoufeng/modify-env-name
 2021-12-20 01:23:54 +00:00
i-robot 92f4c07611 !27732 [ME] Optimize the error message of the operator module. 
Merge pull request !27732 from Margaret_wangrui/operator
 2021-12-20 01:05:55 +00:00
haohaonannan97 f480be7c48 [feat][assistant][I40GXF] add new data operator Dither 2021-12-18 08:24:48 -08:00
王天浩 11cb3e4ef7 [fear][assistant][I40GYA] add new loader UDPOSDataset 2021-12-18 23:28:05 +08:00
Margaret_wangrui 1a37dcfa94 [ME] Optimize the error message of the operator module 2021-12-18 14:28:45 +08:00
Carry955 2320bb7c70 [feat][assistant][I40GXW] add new loader YahooAnswers 2021-12-16 18:33:47 -08:00
i-robot 35db3bccac !27568 Add TCP communicator for distributed runtime 
Merge pull request !27568 from chengang/add_tcp_comm
 2021-12-17 01:25:50 +00:00
cristoval bb5798c391 Add tcp communicator for RPC 2021-12-16 23:32:38 +08:00
i-robot 67fc03f623 !27694 [API] python frame rebuild 
Merge pull request !27694 from kingxian/master
 2021-12-16 06:49:56 +00:00
zhoufeng 9d432d029d modify dev env name 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-12-16 14:12:24 +08:00
jinxiaoxian 01fc6efc7d rebuild python frame 2021-12-16 10:50:59 +08:00
i-robot d1d516e668 !27461 Add shard operation 
Merge pull request !27461 from YuJianfeng/shard
 2021-12-16 02:36:13 +00:00
li-qiyao f4bfcb8c25 [feat][assistant][I40GXN] add new loader SogouNews 2021-12-14 22:53:38 -08:00
yujianfeng cd2a021992 Add shard api 2021-12-15 11:05:11 +08:00
i-robot dac636decd !22297 [assistant][ops] Add new loader IWSLTDataset 
Merge pull request !22297 from 杨旭华/IWSLTDataset
 2021-12-15 02:55:08 +00:00
liucunwei 238ab38211 add some of dataset ut cases about createIterator columns 2021-12-14 19:11:52 +08:00
liannai a99b5461bd [feat][assistant][I40GXH]add new data operator Gain 2021-12-13 22:03:09 +08:00
lufei9026 30bc609ce6 [feat][assistant][I40GY8]add new loader IWSLTDataset 2021-12-13 21:47:55 +08:00
i-robot 2a2cd5e4ca !22222 [assistant][ops] Add new loader PennTreebankDataset 
Merge pull request !22222 from 杨旭华/PennTreebankDataset
 2021-12-13 11:43:00 +00:00
yuximiao 393d3621a3 fix no paralle stratege if start profiler in the process of trainging 2021-12-13 10:44:07 +08:00
i-robot c01985ae9b !27495 C++ inference interface AscendDeviceInfo 
Merge pull request !27495 from 徐永飞/master
 2021-12-13 01:34:25 +00:00
xuyongfei 0a0419498f C++ inference interface Ascend310DeviceInfo+Ascend910DeviceInfo->AscendDeviceInfo 2021-12-10 16:41:10 +08:00
i-robot 32e2dfb178 !27435 fix bugs triggered by fl 
Merge pull request !27435 from wtcheng/master
 2021-12-10 03:40:26 +00:00
w00517672 0064fc7ebc fix bugs triggered by fl 2021-12-09 16:21:17 +08:00
He Wei f35554d0c6 Add more to MindAPI 
1. `TensorType` and `TensorTypePtr`;
2. `utils::isa<TensorTypePtr>()`;
3. `utils::isa<int64_t>()`, `utils::cast<int64_t>()`;
4. `GetValue<ValuePtrList>(value)`.
 2021-12-09 08:59:25 +08:00
Megalomania 259854e040 [feat] [assistant] [I40GY5] add new loader PennTreebankDataset 2021-12-08 01:22:40 -08:00
i-robot 895256f69a !20043 [assistant][ops] Add new YelpReview 
Merge pull request !20043 from 杨旭华/YelpReview
 2021-12-08 08:13:34 +00:00