yankf21
/
mindspore2022
forked from huawei/mindspore2022
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,477 Commits 18 Branches 22 Tags 3.6 GiB
Commit Graph

1686 Commits

Author SHA1 Message Date
mindspore-ci-bot 2d973c9597 !3161 Set output value for dynamic graph. 
Merge pull request !3161 from flywind/output
 2020-07-23 21:14:08 +08:00
mindspore-ci-bot 366dd44ca8 !3371 support call super when class define in test_case 
Merge pull request !3371 from zhangbuxue/support_call_super_when_class_define_in_test_case
 2020-07-23 20:11:25 +08:00
panyifeng 8a89f003eb fix sparse related issues 2020-07-23 19:05:53 +08:00
buxue b812c1a17a support call super when class define in test_case. 2020-07-23 18:30:30 +08:00
kpy 570da089a8 set output value for dynamic graph 2020-07-23 17:05:47 +08:00
mindspore-ci-bot 684ff4f46b !3160 Rewrite tensor's __bool__ for pynative mode 
Merge pull request !3160 from Simson/push-to-opensource
 2020-07-23 16:55:49 +08:00
simson 5f77fbdd75 Rewrite tensor's __bool__ for pynative mode 2020-07-23 16:51:46 +08:00
mindspore-ci-bot 0a84b63fc3 !3305 modify the vgg16/lstm path to offical/{cv/npl} 
Merge pull request !3305 from caojian05/ms_master_dev
 2020-07-23 16:01:42 +08:00
fangzehua 228a959cc7 add reduce any op for vm 2020-07-23 14:43:53 +08:00
mindspore-ci-bot 48711414fc !3356 [common]Refine code & Add ToAbstruct for `FuncGraph`, `MetaFuncGraph` `Primitive` 
Merge pull request !3356 from vlne-v1/add_to_abstract_for_function
 2020-07-23 14:33:58 +08:00
Wei Luning 484d7f10c8 refine code* refine code in bert model* add ToAbstruct for `FuncGraph`, `MetaFuncGraph` `Primitive`* remove partial hard code in spec for poly* remove any in data convert cache 2020-07-23 12:43:37 +08:00
mindspore-ci-bot 7f1ccc5f3b !3311 add sparse feature test cases for auto parallel 
Merge pull request !3311 from lirongzhen1/master
 2020-07-23 11:35:49 +08:00
mindspore-ci-bot 21a5f06e93 !3328 Add testcases 
Merge pull request !3328 from shenwei41/sw_master
 2020-07-23 09:57:22 +08:00
tony_liu2 1f4251a440 add try to minddataset python tests to remove files on fail 
delete unrelated file

change finally to except else

fix spacing alignment

fix indentation

fix indentation

fix indentation

add fix to new test case

add if main for pytest

fix spacing
 2020-07-22 16:34:10 -04:00
mindspore-ci-bot 859fe6bc41 !3342 C++ API Support for Skip Dataset Op plus UTs 
Merge pull request !3342 from cathwong/ckw_c_api_skip
 2020-07-23 04:28:38 +08:00
mindspore-ci-bot df1300d9cb !3294 Refactor opt/pre passes 
Merge pull request !3294 from nsyca/removal_pass
 2020-07-23 02:51:31 +08:00
Cathy Wong 8921a6099c C++ API Support for Skip Dataset Op and UTs 2020-07-22 13:21:35 -04:00
mindspore-ci-bot c24122bb55 !3303 fix validator that checks the vocab_size is positive in vocab.from_file 
Merge pull request !3303 from ZiruiWu/fix_vocab_validator
 2020-07-23 00:49:29 +08:00
Nat Sutyanyong 9fb1904ed8 Refactoring opt/pre 2020-07-22 11:13:42 -04:00
buxue f84b055244 add check for implicit conversion when scalar is not number and bool. 2020-07-22 20:55:19 +08:00
shenwei41 4eaa396ca7 Add testcases 2020-07-22 20:21:19 +08:00
CaoJian f9fdb52373 modify the vgg16/lstm path to offical/{cv/npl} 2020-07-22 19:25:27 +08:00
mindspore-ci-bot bc20de741a !3315 restore reshape ut 
Merge pull request !3315 from yao_yf/restore_auto_parallel_reshape_ut
 2020-07-22 16:23:29 +08:00
yao_yf 1d3a06a3b0 recover reshape ut 2020-07-22 14:30:12 +08:00
lirongzhen1 5d63c60135 add sparse feature test cases for auto parallel 2020-07-22 14:27:12 +08:00
Amir Lashkari 6f186aafa0 Update Python UA op, AutoContrast Op and UT 
Updated Validators.py

Fixed UA UT

Fixed UA UT

Fixed PyLint Errors

Added aditional changes

remove old golden AutoContrast UT file

updated Autocontrast python UT

Added golden files

Fixed issue

fixed UT
 2020-07-22 14:16:16 +08:00
Zirui Wu 40ea84ae81 fix from_file validator minor error, 1 line change 
add test case
 2020-07-21 23:17:26 -04:00
mindspore-ci-bot 8da91ca3cf !3237 support call the parent class function 
Merge pull request !3237 from zhangbuxue/support_call_the_parent_class_construct_function
 2020-07-21 22:13:04 +08:00
mindspore-ci-bot c451146b14 !3255 Added cpp Equalize op to vision api 
Merge pull request !3255 from alashkari/cpp_ops
 2020-07-21 21:56:41 +08:00
mindspore-ci-bot 925172664b !3230 add bprop for sparse_tensor 
Merge pull request !3230 from riemann_penn/add_bprop_for_sparse_tensor
 2020-07-21 21:47:53 +08:00
mindspore-ci-bot cf4353f728 !3220 Add random normal op at MindSpore front-end 
Merge pull request !3220 from peixu_ren/custom_gpu
 2020-07-21 20:33:52 +08:00
mindspore-ci-bot 37cc6e2628 !3175 add ScatterNdAdd ScatterNdSub ScatterNonAliasingAdd ops 
Merge pull request !3175 from fangzehua/scatter_add_vm
 2020-07-21 20:26:07 +08:00
panyifeng 4d4e23fd9e Add bprop for sparse_tensor 2020-07-21 19:40:35 +08:00
buxue 073507a5e0 support call the parent class function 2020-07-21 16:38:11 +08:00
panfengfeng 5aad4bdfbf change size 2020-07-21 14:56:55 +08:00
xiefangqi 64a6ed56de fix annotation 2020-07-21 12:04:56 +08:00
mindspore-ci-bot ad651f38bf !3124 [MD] error occur when using numpy types 
Merge pull request !3124 from liyong126/fix_numpy_generic
 2020-07-21 11:44:34 +08:00
fangzehua dde74b227c add 5 vm op 2020-07-21 11:34:10 +08:00
peixu_ren 9b45018dfd Add random normal op at MindSpore front-end 2020-07-20 23:31:30 -04:00
mindspore-ci-bot bfc18704d5 !3254 [MD]Add more strict upper bounds to CenterCropOp and RandomCropWithBboxOp 
Merge pull request !3254 from nhussain/padding_upperbound
 2020-07-21 10:18:56 +08:00
mindspore-ci-bot 2e4bb93a1e !3250 [quant]bug fixes when export geir 
Merge pull request !3250 from vlne-v1/quant_export_geir_biasadd_after_depth_wise
 2020-07-21 09:35:28 +08:00
mindspore-ci-bot 718431429c !2755 unform learning rate behavior in optimizers 
Merge pull request !2755 from wangnan39/uniform_lr_behavior_in_optimizers
 2020-07-21 09:13:14 +08:00
mindspore-ci-bot 0e27dccbcf !3093 VOCDataset output change to multi-columns 
Merge pull request !3093 from xiefangqi/md_voc_multi_columns
 2020-07-21 09:12:01 +08:00
liyong 28ebd73096 fix bug when int or float is numpy type 2020-07-21 09:07:29 +08:00
Amir Lashkari 572750cd40 Added cpp Equalize op 
adding missed files

Fixed Errors

fixed bugs

fixed bugs

fixed bugs

fixed bugs

fixed bugs

Updated Python UT for Equalize op

Added cpp Equalize op

adding missed files

Fixed Errors

fixed bugs

fixed bugs

fixed bugs

fixed bugs

fixed bugs

Updated Python UT for Equalize op

Fixed comment style

update files

deleted files

added files

added image_utils.h

Fixed PyLint and CPPLint Errors

updated tensor_op.h
 2020-07-20 21:03:26 -04:00
nhussain b064cbab5d fix upper bound 2020-07-20 15:26:49 -04:00
mindspore-ci-bot b091f74c23 !3016 Add CSV dataset loader 
Merge pull request !3016 from jiangzhiwen/dataset/csv
 2020-07-20 22:14:52 +08:00
Wei Luning 7d5c9d52bc fix geir export bugs 2020-07-20 21:32:57 +08:00
wangnan39@huawei.com 082433183d uniform learning_rate behavior of optimizers 2020-07-20 21:09:20 +08:00
jiangzhiwen 2f506b7985 CSV dataset loader 2020-07-20 20:22:08 +08:00
mindspore-ci-bot fa7fa8a162 !3234 [MD] fix bug when save tfrecord data 
Merge pull request !3234 from liyong126/fix_save_tfrecod
 2020-07-20 20:18:12 +08:00
liyong f521532a06 fix field_name probelem from tfrecord to mindrecord 2020-07-20 17:12:21 +08:00
xulei2020 18b519ae0f add sentence piece 2020-07-20 15:50:35 +08:00
xiefangqi fbd9e3d402 vocdataset output multi-columns 2020-07-20 14:40:30 +08:00
anzhengqi 008b91b2a1 inject epoch ctrl op in the execution tree and send eos at the end of epoch 2020-07-20 13:02:47 +08:00
mindspore-ci-bot 6f8863b65d !3198 synchronize latest Ascend software suite 18 Jul 2020, and merging branches 
Merge pull request !3198 from yanghaoran/code_sync_0718
 2020-07-19 14:14:45 +08:00
yanghaoran 859acc6d2a synchronize latest Ascend software suite 18 Jul 2020, and merging branches 2020-07-18 21:09:55 +08:00
mindspore-ci-bot 05de773775 !3209 Fix bug about output of AddNGrad. 
Merge pull request !3209 from liuxiao93/AddN
 2020-07-18 19:56:31 +08:00
mindspore-ci-bot ffb7040c3c !3200 [clean]remove loop_can_unroll flag, clean some other python code 
Merge pull request !3200 from vlne-v1/remove_loop_can_unroll
 2020-07-18 19:44:29 +08:00
liuxiao93 8705545bcd Fix bug about output of AddNGrad. 2020-07-18 18:47:52 +08:00
Wei Luning f362503d57 support throw attribute error from c++ 2020-07-18 17:54:26 +08:00
Wei Luning 88e864a4a3 remove loop can unroll flag, clean some python usage 2020-07-18 17:41:34 +08:00
mindspore-ci-bot e8b26dbdaa !3151 Fix verification of BatchNorm2d input is 4D. 
Merge pull request !3151 from liuxiao93/fix-BatchNorm2d
 2020-07-18 16:22:04 +08:00
mindspore-ci-bot 4945d34a41 !3133 [MD] fix num_sample in distributed sampler 
Merge pull request !3133 from liyong126/md_num_of_samples
 2020-07-18 15:36:33 +08:00
liuxiao93 75881e5f2f check input of BatchNorm is 4D. 2020-07-18 14:53:11 +08:00
mindspore-ci-bot 4a19e6b8cb !3114 add coo_tensor 
Merge pull request !3114 from riemann_penn/coo_tensor
 2020-07-18 10:24:58 +08:00
mindspore-ci-bot a84092e89d !3102 [MD] Add additional parameter checks in RandomCropWithBBoxOp and RandomResizeWithBbox 
Merge pull request !3102 from nhussain/random_crop_fixes
 2020-07-17 22:33:50 +08:00
panyifeng 5a10383cc3 add coo_tensor 2020-07-17 18:53:03 +08:00
liyong e2ea1fa0df activate num_samples in distributed samplers 2020-07-17 16:55:57 +08:00
wangnan39@huawei.com 86889c59cb optimizer adapt IndexedSlices 2020-07-17 15:57:50 +08:00
mindspore-ci-bot 56f70e910c !3080 [parser]remove redundant phi 
Merge pull request !3080 from vlne-v1/remove-redundant-phi
 2020-07-17 15:19:41 +08:00
mindspore-ci-bot 6dd99ee35d !3130 [dump]support dump quant in binary format file 
Merge pull request !3130 from vlne-v1/quant_op_depthwise
 2020-07-17 14:25:57 +08:00
mindspore-ci-bot a10001cb58 !3152 remove 4 auto parallel reshape ut 
Merge pull request !3152 from yao_yf/reshape_ut_remove
 2020-07-17 14:12:24 +08:00
Wei Luning 28d1d37085 End at validate when export. 2020-07-17 12:44:12 +08:00
Wei Luning acbccea644 remove redundant phi 2020-07-17 11:46:09 +08:00
mindspore-ci-bot 1bcbbb08d6 !2973 [MD] Add implementation of SlidingWindow TensorOp, c++ & python 
Merge pull request !2973 from luoyang/update
 2020-07-17 11:06:35 +08:00
yao_yf abebb2004b remove 4 reshape ut 2020-07-17 10:56:24 +08:00
mindspore-ci-bot edec821c50 !2876 set reshape operator no redistribution for auto parallel 
Merge pull request !2876 from lirongzhen1/master
 2020-07-17 10:01:06 +08:00
mindspore-ci-bot 1a518e1cff !3144 [MD] Fix ResizeOp behaviour 
Merge pull request !3144 from nhussain/dataset_check
 2020-07-17 06:04:14 +08:00
nhussain c984b0fc88 fix size tuple 2020-07-16 17:02:34 -04:00
mindspore-ci-bot 35c0f1d2e6 !3143 Add python UT to MnistDataset op 
Merge pull request !3143 from TinaMengtingZhang/dataset-op-ut-mnist
 2020-07-17 04:40:26 +08:00
tinazhang ab37e87d7a adding Mnist python ut coverage 2020-07-16 14:14:20 -04:00
islam_amin 5647889c0d Added AutoContrast Op 2020-07-16 13:09:52 -04:00
mindspore-ci-bot 37e8439c0a !3077 supporting cpp invert operation 
Merge pull request !3077 from ava/invert
 2020-07-17 01:04:43 +08:00
mindspore-ci-bot c07a8d2033 !3137 Cleanup dataset UT: Remove deprecated save_and_check 
Merge pull request !3137 from cathwong/ckw_dataset_ut_cleanup7
 2020-07-17 00:45:56 +08:00
nhussain 5871ba8a05 more validator fixes 2020-07-16 10:10:36 -04:00
mindspore-ci-bot 74bbfa3cf6 !3095 modify the limit of loss scale 
Merge pull request !3095 from Simson/push-to-opensource
 2020-07-16 21:30:54 +08:00
lirongzhen1 c1eba79b83 set reshape redistribution strategy attribute to no redistribution 2020-07-16 21:20:46 +08:00
mindspore-ci-bot eeba046115 !3050 Add TBE ops Tan/TruncateDiv/TruncateMod for VM. 
Merge pull request !3050 from liuxiao93/Tan/TruncateDiv/TruncateMOd
 2020-07-16 20:36:50 +08:00
changzherui f4cb445ea8 syn code for 0715 2020-07-16 17:18:21 +08:00
mindspore-ci-bot 526770e09e !3049 [dataset] add save operator in dataset 
Merge pull request !3049 from liyong126/dataset_save_op
 2020-07-16 16:59:38 +08:00
simson 177e18f3f4 modify the limit of loss scale 2020-07-16 16:44:02 +08:00
mindspore-ci-bot 6335598fff !3111 Rollback to Normal that operates on D 
Merge pull request !3111 from peixu_ren/custom_gpu
 2020-07-16 16:09:24 +08:00
liyong bc676fe250 save op in minddataset 2020-07-16 15:10:48 +08:00
peixu_ren 1feca960aa Rollback to Normal on D 2020-07-16 00:49:23 -03:00
Ziyan 39f08eb7dd enable optimizer parallel 2020-07-16 11:47:41 +08:00
avakh 35c3a63701 support cpp invert operation 2020-07-15 23:45:45 -04:00
mindspore-ci-bot 7976d77593 !3104 fix mindspore dtype equal 
Merge pull request !3104 from fary86/fix_mstype_eq
 2020-07-16 10:26:34 +08:00
fary86 595767b4b5 Fix bug of mindspore dtype equal 2020-07-16 09:06:55 +08:00
Cathy Wong 04eb4f89c7 Cleanup dataset UT: Replace save_and_check 2020-07-15 20:47:31 -04:00
Zirui Wu d233c54139 implemented cpp random choice, apply and compos 
python part of random ops

added random select sub policy

validators added

comments added, remaining issues addressed

add more python test cases

fix ci

fix CI

fix order of include files

addr review cmts

addr review cmts

reorg file

fix compile err

address review cmts

address review cmts
 2020-07-15 13:39:10 -04:00
YangLuo 4136892a3e add SlidingWindow Op 2020-07-15 19:55:33 +08:00
mindspore-ci-bot 3e691e54f5 !3071 change ValueError to TypeError for enumerate start 
Merge pull request !3071 from zhangbuxue/change_ValueError_to_TypeError_for_enumerate_start
 2020-07-15 15:42:22 +08:00
mindspore-ci-bot bacbb26e3b !3062 fix valuenode simplify 
Merge pull request !3062 from riemann_penn/fix_value_node_simplify
 2020-07-15 14:42:49 +08:00
mindspore-ci-bot 45ad430af2 !3048 support use valuelist or valuetuple of primitives 
Merge pull request !3048 from amongo/SupportPrimitiveList
 2020-07-15 10:45:36 +08:00
buxue 60b0ded440 change ValueError to TypeError for enumerate start 2020-07-15 10:39:03 +08:00
panyifeng 394178569e fix valuenode simplify 2020-07-15 10:09:30 +08:00
mindspore-ci-bot 683920d1c8 !2987 Add random normal op at MindSpore front-end 
Merge pull request !2987 from peixu_ren/custom_gpu2
 2020-07-15 09:39:58 +08:00
huangdongrun ee2039fbba add support for value sequence of primitve 2020-07-15 09:24:39 +08:00
mindspore-ci-bot bc0a53cfb1 !3030 minddata support ps-lite feature 
Merge pull request !3030 from xiefangqi/md_support-pslite
 2020-07-15 09:11:37 +08:00
mindspore-ci-bot ba0143402c !3067 Cleanup dataset UT: Remove unneeded tf data files and tests 
Merge pull request !3067 from cathwong/ckw_dataset_ut_cleanup6
 2020-07-15 04:44:52 +08:00
mindspore-ci-bot 219a716eae !3066 fix some batch's get_dataset_size and some text validator inconsistency 
Merge pull request !3066 from ZiruiWu/fix_validator
 2020-07-15 03:11:31 +08:00
mindspore-ci-bot bed93a9ead !3039 [Dataset Python UT] adding coverage to Cifar Op and update test dataset 
Merge pull request !3039 from TinaMengtingZhang/dataset-op-ut-cifar
 2020-07-15 02:10:52 +08:00
Zirui Wu 63185cb20f fix some validators errors 
address review cmts

addr review cmts
 2020-07-14 14:04:40 -04:00
Cathy Wong ae1ed327ba Cleanup dataset UT: Remove unneeded data files and tests 2020-07-14 12:24:54 -04:00
nhussain 05b2a57d2a fix validation errors, and fix try catch error tests 2020-07-14 11:50:00 -04:00
tinazhang 340d98a4d1 added test case to cifar_op 
update cifar10 dataset
fixing missing error handling code in validator
 2020-07-14 11:22:38 -04:00
peixu_ren ac561f2956 Refactor random normal op 2020-07-14 11:35:19 -03:00
peixu_ren 20ca96c62b Add random normal MindSpore interface 2020-07-14 11:19:12 -03:00
xiefangqi add19a591c md support ps-lite 2020-07-14 21:46:11 +08:00
liuxiao93 c772b9e291 Add TBE ops Tan/TruncateDiv/TruncateMod for VM. 2020-07-14 16:27:01 +08:00
mindspore-ci-bot 8871f06f42 !2963 Add UT for python pass 
Merge pull request !2963 from BowenK/python_pass_clean
 2020-07-14 11:48:03 +08:00
BowenK f267a105b8 Add Python Pass UT 2020-07-14 10:18:22 +08:00
mindspore-ci-bot bfc3065fc7 !3025 [AutoParallel]Add embedding look up op 
Merge pull request !3025 from lichen/add_embedding_look_up_op
 2020-07-14 09:59:01 +08:00
mindspore-ci-bot 48654be14d !3040 BoundingBoxAugment op fix ratio 
Merge pull request !3040 from islam_amin/bounding_box_augment_bugs
 2020-07-14 09:36:34 +08:00
mindspore-ci-bot 69ce4bf2b2 !2970 Del mindspore/model_zoo 
Merge pull request !2970 from panbingao/master
 2020-07-14 08:57:31 +08:00
islam_amin 56da3b0ae1 Fixing ratio bug with BoundingBoxAugment 2020-07-13 18:11:19 -04:00
mindspore-ci-bot eadcb341e1 !2891 CacheOp phase 1 
Merge pull request !2891 from Jamie/CacheOp_dev
 2020-07-13 23:56:57 +08:00
Jesse Lee 7c1bc5192b Initial Drop of CacheOp Phase I 2020-07-13 10:18:53 -04:00
lichenever cde5cc2bd2 add_embedding_look_up 2020-07-13 22:00:55 +08:00
mindspore-ci-bot c465ea3269 !3031 fix context mode and device target dependency issue 
Merge pull request !3031 from wangqiuliang/fix-tensor-bool-operation
 2020-07-13 19:52:32 +08:00
mindspore-ci-bot 2f27c4e3e8 !2807 Apply indexed_slices 
Merge pull request !2807 from riemann_penn/apply_indexed_slices
 2020-07-13 17:08:25 +08:00
kingfo 8863dfd677 fix context mode and device_target dependency issue 2020-07-13 16:06:00 +08:00
panyifeng 44e74ad5aa Apply indexed_slices 2020-07-13 15:36:25 +08:00
mindspore-ci-bot 8f15d1f608 !2791 convert subgraph 
Merge pull request !2791 from changzherui/subgraph
 2020-07-13 15:06:15 +08:00
changzherui a27ce973ad convert subgraph 2020-07-13 12:31:22 +08:00
mindspore-ci-bot d3ec05d716 !2943 [quant]export bug fix 
Merge pull request !2943 from vlne-v1/quant_export_bugfix
 2020-07-13 10:02:18 +08:00
mindspore-ci-bot d925c52bb1 !2875 add grad all in pynative 
Merge pull request !2875 from wangqiuliang/add-grad-all-in-pynative
 2020-07-13 09:30:52 +08:00
mindspore-ci-bot 7cdd5581f9 !2914 make AbstractRef can join with AbstractTensor 
Merge pull request !2914 from xychow/fix-abstractref-join
 2020-07-13 09:26:19 +08:00
mindspore-ci-bot 6284c42a76 !2941 MD tokenizer support output offsets 
Merge pull request !2941 from xiefangqi/md_add_offsets_feature
 2020-07-11 14:36:00 +08:00
mindspore-ci-bot ebc6b92c27 !3002 add arg check for enumerate 
Merge pull request !3002 from zhangbuxue/add_arg_check_for_enumerate
 2020-07-11 12:31:30 +08:00
xiefangqi 47060631e5 add offsets feature to tokenizer 2020-07-11 11:20:02 +08:00
mindspore-ci-bot 541456044d !2934 GraphData support random_walk and get_edge_feature 
Merge pull request !2934 from heleiwang/gnn_july
 2020-07-11 10:26:17 +08:00
mindspore-ci-bot 2f565f4c20 !2776 Update API of dataset.text.lookup 
Merge pull request !2776 from ZiruiWu/master
 2020-07-10 22:18:48 +08:00
kingfo add3778a61 add grad all in pynative mode 2020-07-10 17:49:54 +08:00
panbingao 45dbc8bf04 Move model_zoo.resnet.py 2020-07-10 17:36:34 +08:00
heleiwang 7a046a1d70 support get_edge_feature 2020-07-10 17:05:23 +08:00
buxue cf797d3bf2 add arg check for enumerate 2020-07-10 16:58:38 +08:00
mindspore-ci-bot 87722b9e09 !2912 Update ssim and add msssim 
Merge pull request !2912 from fanglei/msssim
 2020-07-10 15:30:11 +08:00
Wei Luning b522368161 fix bug of quant export without input fakequant. 2020-07-10 14:11:45 +08:00
mindspore-ci-bot bccfa48509 !2980 Prevent empty column names 
Merge pull request !2980 from nhussain/empty_column_b
 2020-07-10 11:19:37 +08:00
leilei_snow 9b21420b3e update SSIM loss, add MSSSIM loss feature; add their ut testcases. 2020-07-10 11:11:48 +08:00
mindspore-ci-bot 00368b3683 !2972 Improving implicit type conversion 
Merge pull request !2972 from zhangbuxue/Improving_implicit_type_conversion
 2020-07-10 09:36:49 +08:00
Zirui Wu 7b15e5a742 rework on lookup 
add test caser

fix ci

address review cmts

ci

addr review cmt

fix typo

address review cmts

add 2 more test cases

cpplint fix

addr cpplint

addr ci

fix tst case err

fix doc str
 2020-07-09 17:10:18 -04:00
nhussain 2c7fd248f8 fixes for PR-2908: avoid empty strings for column names 2020-07-09 11:44:33 -04:00
buxue 4df1edf5b3 Improving implicit type conversion 2020-07-09 21:38:00 +08:00
wuyongkang e12255ad84 Add MixedPrecisionCast for KeywordArg 2020-07-09 19:10:57 +08:00
buxue 4e832b2309 support implicit type conversion for pynative mode 2020-07-09 15:41:41 +08:00
mindspore-ci-bot 323a80c620 !2765 fix large for loop segment fault 
Merge pull request !2765 from fary86/fix_large_for_loop
 2020-07-09 09:43:03 +08:00
mindspore-ci-bot 5fc6dcfb65 !2915 [Auto parallel] Rewrite EmbeddingLookup 
Merge pull request !2915 from Xiaoda/8-move-embeddinglookup-external
 2020-07-09 09:40:34 +08:00
nhussain 6c37ea3be0 fix validators 
fixed random_apply tests

fix validators

fixed random_apply tests

fix engine validation
 2020-07-08 16:40:33 -04:00
mindspore-ci-bot 915ddd25dd !2892 gnn random walk pr 1977 comment follow up 
Merge pull request !2892 from tony_liu2/master
 2020-07-09 03:35:55 +08:00
mindspore-ci-bot e2f51ccec8 !2922 updating the python ut tests based on floating point bounding boxes 
Merge pull request !2922 from ava/float_change
 2020-07-08 22:39:42 +08:00
Xiaoda Zhang fc906f7f58 move embeddinglookup to external 2020-07-08 16:27:40 +08:00
mindspore-ci-bot dffb76a0a9 !2605 High level abstraction of mathematical distributions 
Merge pull request !2605 from XunDeng/pp_poc_v3
 2020-07-08 12:44:52 +08:00
mindspore-ci-bot 403c1db8ce !2869 fix print bug 
Merge pull request !2869 from jinyaohui/master
 2020-07-08 09:40:29 +08:00
zhousiyi 9ad7c652a2 make abstractref can join with abstracttensor 2020-07-08 01:28:15 +00:00
peixu_ren bef1fc7f19 add sample functions in normal and bermoulli distributions 2020-07-07 18:13:58 -04:00
avakh 421b80bf8f updating python unit tests based on floating point bounding boxes + adding coco dataset in unit tests 2020-07-07 18:05:49 -04:00
tony_liu2 14899a1410 fix gnn random walk pr 1977 comments 
add fix to random resize decode crop test case

fix pylint issues
 2020-07-07 17:32:08 -04:00
Xun Deng 0aa26c1815 add high level abstract class Distribution and two example class: 
Bernoulli and Normal
 2020-07-07 17:29:42 -04:00
mindspore-ci-bot 9ba937b1af !2920 Updating 3 BBox AugOps for Float + Common Files for BBox Float Support - (VertFlip/RandomCrop/RandomResizeCrop) 
Merge pull request !2920 from danishnxt/AugOps-M1-Python
 2020-07-08 05:18:58 +08:00
mindspore-ci-bot c9929fd8a1 !2900 Update BoundingBoxAugment and RandomHorizontalFlipWithBBox to use float 
Merge pull request !2900 from islam_amin/object_ops_cc_float
 2020-07-08 03:53:39 +08:00
mindspore-ci-bot 92d2011b8b !2924 [Dataset Python UT] Disable md5 random perspective test 
Merge pull request !2924 from TinaMengtingZhang/redo-skip-md5-random-perspective-test
 2020-07-08 03:52:21 +08:00
Danish Farid 78c370f72a First Commit - New Infrastructure - Python UT tests + Common Aug Files 
fix accidental change overwrite

fix 2

updated inits from 0 to 0.0 for float

improvd python ut comments

updated macro
 2020-07-07 14:50:34 -04:00
tinazhang 8455f957ac disable md5 random perspective test case 2020-07-07 14:21:06 -04:00
jinyaohui c7f6527e92 fix print file bug 2020-07-07 21:05:17 +08:00
mindspore-ci-bot faa1084bd8 !2865 asymmetric param row split support for GatherV2 
Merge pull request !2865 from yihuaijie/dev
 2020-07-07 20:04:32 +08:00
mindspore-ci-bot 5baae2ebd0 !2884 Add TBE op UnsortedSegmentProd for VM. 
Merge pull request !2884 from liuxiao93/UnsortedSegmentProd
 2020-07-07 17:12:43 +08:00
mindspore-ci-bot bd60db5c11 !2811 support vm for ParallelConcat 
Merge pull request !2811 from jiangjinsheng/vm_parallel_concat
 2020-07-07 16:23:46 +08:00
liuxiao93 2b0ecfd2b1 Add TBE op UnsortedSegmentProd for VM. 2020-07-07 15:35:00 +08:00
Yi Huaijie cae254f4df asymmetric row split support for GatherV2 2020-07-07 14:36:07 +08:00
islam_amin dfc3409f67 Update RandomHorizontalFlipWithBBox and BoundingBouxAugment C++ Ops to use floats 2020-07-06 23:49:21 -04:00
mindspore-ci-bot 751b5e6fac !2897 Modify VOCDataset output float dtype bbox 
Merge pull request !2897 from xiefangqi/md_voc_support_float
 2020-07-07 11:11:19 +08:00
xiefangqi 62d55fdbce vocdataset support float bbox 2020-07-07 10:07:42 +08:00
jiangjinsheng a3565a75d1 vm for ParallelConcat 2020-07-06 18:35:12 +08:00
changzherui 17da929b82 syn code 0706 2020-07-06 17:51:17 +08:00
mindspore-ci-bot 3d377c51b9 !2839 support vm for PopulationCount 
Merge pull request !2839 from jiangjinsheng/vm_population_count
 2020-07-06 17:32:08 +08:00
mindspore-ci-bot aef002ad6c !2809 support Python built-in function 'enumerate' 
Merge pull request !2809 from zhangbuxue/support_Python_built-in_functions_enumerate
 2020-07-06 09:38:47 +08:00
leilei_snow 5cccfbc61b Add TransShape Operator. 2020-07-05 03:34:35 +00:00
mindspore-ci-bot b5066e81ee !2308 Unskip md5 python UT case for RandomPerspective 
Merge pull request !2308 from TinaMengtingZhang/unskip-case-random-perspective
 2020-07-04 03:37:58 +08:00
tinazhang dc03019200 unskip md5 testcase for RandomPerspective 2020-07-03 13:10:13 -04:00
Danish Farid 5a9673ee6f fix_annotate bug fix 2020-07-03 11:17:13 -04:00
jiangjinsheng ee7aef98df vm for PopulationCount 2020-07-03 17:47:11 +08:00
mindspore-ci-bot 860a32632e !2671 vm for MaxPoolGradGrad, MaxPoolGradGradWithArgmax 
Merge pull request !2671 from jiangjinsheng/vm_max_pool_ext2
 2020-07-03 17:40:54 +08:00
buxue cfa41733d6 support Python built-in function 'enumerate' 2020-07-03 14:42:10 +08:00
fary86 e17469bf42 Fix bug of large for loop 2020-07-03 11:15:41 +08:00
mindspore-ci-bot 2cd9649b9e !2810 Add operator adapting in ME for Softsign 
Merge pull request !2810 from zhangzheng/softsign
 2020-07-03 09:31:59 +08:00
mindspore-ci-bot 391f5e44e4 !2832 check types for optional boolean parameters 
Merge pull request !2832 from Peilin/invalid-type-bucket-check
 2020-07-03 09:20:28 +08:00
Hoai Linh Tran 6bd66e7953 Fix memcpy calls. Add ut tests for arithmetic_simplify. Split long arithmetic_simplify.h to arithmetic_simplify.cc 
Code checking
 2020-07-02 17:51:08 -04:00
peilin-wang 29aa589972 added check for invalid type for boolean args 2020-07-02 16:49:09 -04:00
mindspore-ci-bot c1a53d3f68 !2822 Fix bool tensor problem 
Merge pull request !2822 from hewei/fix_bool_tensor
 2020-07-02 20:41:27 +08:00
He Wei a0623e1528 Fix bool type tensor problem 
Problem: Create 'uint8' type tensor from float data raise RuntimeError;
Fix:  Use same internal data type for 'uint8' and 'bool' tensor and allows
convert float data to bool tensor.
 2020-07-02 19:22:35 +08:00
panbingao 1e51414f1b Adapting operator Softsign in ME 2020-07-02 03:31:25 -04:00
liuxiao ddedc41613 Add TBE operators SparseApplyFtrlV2\SparseApplyAdagradV2 for VM. 2020-07-02 12:00:58 +08:00
mindspore-ci-bot f1a9a7ceb1 !2718 fix quantization aware training auto create graph bug 
Merge pull request !2718 from chenzhongming/master
 2020-07-02 09:57:30 +08:00
mindspore-ci-bot 622b97f3b6 !2787 Add op ScatterMul ScatterDiv vm 
Merge pull request !2787 from zhaozhenlong/op/scatter-div-mul-vm
 2020-07-01 20:41:03 +08:00
jiangjinsheng ce4e15b0b3 vm for MaxPoolExt2,MaxPoolGradGrad,MaxPoolGradGradWithArgmax 2020-07-01 17:05:11 +08:00
yangzhenzhang 2351845ede delete shape validation in initializer 2020-07-01 16:01:31 +08:00
zhaozhenlong 8d9939eaa4 ScatterMull and ScatterDiv vm 2020-07-01 15:49:24 +08:00
mindspore-ci-bot 4eafb21ea8 !2638 support vm for mod 
Merge pull request !2638 from jiangjinsheng/vm_mod
 2020-07-01 14:26:07 +08:00
mindspore-ci-bot 30fc1bd0c3 !2747 refactor StridedSlice op 
Merge pull request !2747 from zhangbuxue/refactor_the_StridedSlice_op
 2020-07-01 12:04:11 +08:00
buxue be771aa9e4 refactor StridedSlice op 2020-07-01 11:08:36 +08:00
jiangjinsheng ffd0352162 vm for mod 2020-07-01 10:16:47 +08:00
mindspore-ci-bot d1fa90a3d9 !2769 fix get loss error and NoneType error cause by _proceesor_specified_data 
Merge pull request !2769 from ougongchang/fix_nonetype
 2020-07-01 10:01:05 +08:00
mindspore-ci-bot ea475637a1 !2720 fix assign used in while loop 
Merge pull request !2720 from xychow/fix-assign-in-while
 2020-07-01 09:16:13 +08:00
mindspore-ci-bot 9377e432d2 !2766 get default value if num_parallel_workers is None 
Merge pull request !2766 from yanghaitao/yht_serialize_num_parallel_worker
 2020-06-30 23:11:44 +08:00
ougongchang cd868aea52 fix get loss error and NoneType error cause by _proceesor_specified_data 
fix get loss error when it not a scalar and fix process specified data
failed when the action is False, and collect_specified_data parameter is
not None
 2020-06-30 21:11:06 +08:00
yanghaitao 365c901ee0 get default value if num_parallel_worker is None 2020-06-30 21:10:37 +08:00
mindspore-ci-bot 3a89f93cc5 !2699 add ScatterMax ScatterMin ScatterSub vm 
Merge pull request !2699 from zhaozhenlong/op/scatter-max-vm
 2020-06-30 20:10:17 +08:00
mindspore-ci-bot fe82d82155 !1904 Add IndexedSlices 
Merge pull request !1904 from riemann_penn/add_indexed_slices
 2020-06-30 19:03:12 +08:00
mindspore-ci-bot 2fadbb1d04 !2743 add more ut and st for SummaryCollector 
Merge pull request !2743 from ougongchang/summary_collector_ut
 2020-06-30 18:58:03 +08:00
panyifeng d6635bbbe2 Add IndexedSlices 2020-06-30 17:38:24 +08:00
chenzomi 1089c908a9 cherry-pick r0.5 to master for quantizaiton aware training 2020-06-30 17:23:08 +08:00
ougongchang 3dc6f6f2d9 add more ut and st for SummaryCollector 
Has fixed collecting optimizer error when mode is eval
 2020-06-30 17:02:03 +08:00
zhousiyi d5255fe311 fix assign used in while 2020-06-30 08:22:27 +00:00
guohongzilong 652093642e change order param same as group params 2020-06-30 14:56:55 +08:00
mindspore-ci-bot d08a89ab87 !2737 makes 0 an invaild bucket size 
Merge pull request !2737 from Peilin/zero-input-bucket-check
 2020-06-30 05:33:41 +08:00
mindspore-ci-bot 1227719cdd !2603 [Dataset Python UT] Cleanup mse and md5 validation 
Merge pull request !2603 from TinaMengtingZhang/I1LTCA-mse-check-cleanup
 2020-06-30 04:46:49 +08:00
peilin-wang 9468b49e28 bucket_batch_sizes must be strictly positive, 0 is not a valid batch size 2020-06-29 16:34:39 -04:00
mindspore-ci-bot c70e6987ba !2624 Fix config test 
Merge pull request !2624 from EricZ/fix_config_test
 2020-06-30 01:11:12 +08:00
mindspore-ci-bot 9b4399480a !2321 Connector throughput performance metric 
Merge pull request !2321 from Alexey_Shevlyakov/connector_throughput_dev
 2020-06-29 23:54:42 +08:00
tinazhang66 5cd3136355 remove local defined mse and add missing mse/md5 validation 2020-06-29 11:51:07 -04:00
mindspore-ci-bot 51c4f4a499 !2683 Add TBE operaters ApplyAddSign\ApplyPowerSign\ApplyGradientDescent\ApplyProximalGradientDescent for VM. 
Merge pull request !2683 from liuxiao/ops-for-VM
 2020-06-29 21:30:17 +08:00
mindspore-ci-bot 5b8957a884 !2717 dataset: some parameter check for NumpySlices and num_sharads 
Merge pull request !2717 from ms_yan/check_param
 2020-06-29 20:02:36 +08:00
ms_yan 7fa0d9e7e4 add paramter check for numpyslices and num_shards 2020-06-29 19:12:52 +08:00
jinyaohui dd5fba1db9 add notice 2020-06-29 17:39:25 +08:00
zhaozhenlong a8654ac3b5 add ScatterMax ScatterMin ScatterSub for vm 2020-06-29 17:21:08 +08:00
jin-xiulang 8dff818a18 Add Laplace random operator. 2020-06-29 15:51:59 +08:00
mindspore-ci-bot 6fb5538117 !2661 add support dtype for scatter_add vm 
Merge pull request !2661 from zhaozhenlong/op/scatter-add
 2020-06-29 11:46:49 +08:00
liuxiao 2097a0e90a Add optimizer operators for VM. 2020-06-29 11:35:45 +08:00
mindspore-ci-bot 99d4289251 !248 Add 5 random ops 
Merge pull request !248 from peixu_ren/custom_aicpu
 2020-06-29 09:15:22 +08:00
peixu_ren c5f72582dc Added 5 random ops 2020-06-28 12:34:02 -03:00
mindspore-ci-bot 9be17e2a59 !2668 support weight decay for sparse optimizer 
Merge pull request !2668 from wangnan39/support_weight_decay_for_sparse_optimizer
 2020-06-28 22:24:45 +08:00
mindspore-ci-bot 0ab7fd98ea !2654 fix: tfrecord to mindrecord para check 
Merge pull request !2654 from guozhijian/fix_tfrecord_to_mr_para_check
 2020-06-28 22:06:50 +08:00
mindspore-ci-bot 32a2d5d21c !2629 get monitor sampling interval from json file 
Merge pull request !2629 from yanghaitao/yht_sampling_interval
 2020-06-28 20:05:05 +08:00
mindspore-ci-bot 363489d00f !2580 BasicTokenizer do not case fold on preserved words 
Merge pull request !2580 from qianlong21st/fix_basic_tokenizer
 2020-06-28 19:36:28 +08:00
mindspore-ci-bot db6c4bf784 !2640 [MD] fix minddata error message 
Merge pull request !2640 from liyong126/minddataset_fix_errmsg
 2020-06-28 19:36:23 +08:00
wangnan39@huawei.com 172728a6a6 support weight decay for sparse optimizer 2020-06-28 17:49:03 +08:00
jonyguo 3450c35d9b fix: tfrecord to mindrecord parameter check 2020-06-28 17:48:52 +08:00
mindspore-ci-bot bc30576ac9 !2631 Add ExpandDims to whitelist 
Merge pull request !2631 from amongo/FixExpandDimsOps
 2020-06-28 17:40:20 +08:00
zhaozhenlong d55c0f6679 complement scatter add support dtype 2020-06-28 16:51:53 +08:00
qianlong cae77c0c22 BasicTokenizer not case fold on preserverd words 2020-06-28 16:28:00 +08:00
liyong 68e2097897 fix split erroer message 2020-06-28 15:47:10 +08:00
zhaozhenlong 15580f8f6e limit ssim input img type to fp32 and fp16 2020-06-28 15:36:30 +08:00
zhaozhenlong 71d33b087e limit ssim input img type to fp32 and fp16 2020-06-28 15:35:07 +08:00
yanghaitao fd701b8504 set monitor sampling interval through json file 2020-06-28 15:18:21 +08:00
huangdongrun 96b38f72b2 add ExpandDims whitelist 
add comment for control_depend
 2020-06-28 11:29:16 +08:00
Eric a4f5802924 Added Fix for test config 2020-06-27 15:20:48 -04:00
mindspore-ci-bot 87213648bc !2612 delete pynative lenet test 
Merge pull request !2612 from changzherui/del_test
 2020-06-27 18:38:36 +08:00
changzherui 9e83337e2f delete pynative lenet_model test 2020-06-27 15:33:27 +08:00
Ziyan 0925e35252 enable optimizer parallel with broadcast 2020-06-27 14:36:17 +08:00
mindspore-ci-bot df795daf75 !2562 [bug]when multi times print same thing, do not merge in cse 
Merge pull request !2562 from vlne-v1/I1LHCF-print-multi-times-and-same-str
 2020-06-27 07:26:52 +08:00
Alexey Shevlyakov 698abf75fc Connector throughput + PerfData + CyclicArray 2020-06-26 14:45:01 -04:00
mindspore-ci-bot a1b17bd2e2 !2593 python unit tests for randomResizeWithBBox and ResizeWithBBox 
Merge pull request !2593 from ava/python_ut_tests
 2020-06-27 02:31:31 +08:00
avakh 1e869146e9 applying comments removing VOC 2020-06-26 12:39:48 -04:00
Cathy Wong 277aba5326 dataset: Fixup docs; remove pylint disabled messages in UT 2020-06-26 12:26:41 -04:00
mindspore-ci-bot e11c953225 !2587 Implementing Python UTs for BoundingBoxAugment and RandomHorizontalFlipWithBBox 
Merge pull request !2587 from imaaamin/object_ops_ut
 2020-06-26 00:43:31 +08:00
mindspore-ci-bot 067592ccf9 !2590 Updated Python UTs for RandomVerticalFlipWithBBox, RandomCropWithBBox and RandomResizedCropWithBBox 
Merge pull request !2590 from danishnxt/AugOps2
 2020-06-25 23:40:34 +08:00
islam_amin 0f58f0338e updating ut for RandomHorizontalFlipWithBBox and BBoxAugment 2020-06-25 11:35:22 -04:00
mindspore-ci-bot b0a10c26a4 !2532 adding random-resize-with-bbox-op and resize-with-bbox-op 
Merge pull request !2532 from ava/NNNewMaster
 2020-06-25 20:42:00 +08:00
Danish Farid 3d1ecaaeb5 updated UT test for Python (3) AugOps with BBox - MD5 checks + imrpv comments 2020-06-25 03:19:14 -04:00
avakh 587e260236 addressing comments 2020-06-24 18:54:47 -04:00
Jamie Nisbet c22eac743d subtree creation in python apis 
updates

fix

fix cpplint

fix
 2020-06-24 17:17:05 -04:00
mindspore-ci-bot a12f9614d4 !2533 Fixing testVOC2012 dataset by merging with testVOC2012_2 + moving BBoxOp testing functions to util + new check in Bounding_Box_check 
Merge pull request !2533 from danishnxt/AugOpsD2
 2020-06-25 01:39:08 +08:00
Wei Luning ef13a4b6fb adjust cse code when op has side effect. 2020-06-25 00:46:01 +08:00
Danish Farid a8f392ca42 updated test util file + new BoundingBoxCheck + fixed VOCDataset annotations 
Style Error fix

fixed PyLint problem

reverting testVOC2012 due to CI break for existing test

reverting testVOC2012 due to CI break for existing test-2

updated old error messages to confirm with global standard

addressing PR 2355 Comments - 1

addressing PR 2355 Comments - 2

addressing PR 2355 Comments - 3
 2020-06-24 12:41:41 -04:00
mindspore-ci-bot 67d664d7dd !2511 add mod and floordiv opration for tensor 
Merge pull request !2511 from wangqiuliang/add-tensor-mod-operation
 2020-06-24 18:09:59 +08:00
kingfo 078738adc5 add tensor mod & floordiv operation 2020-06-24 16:47:23 +08:00
huangdongrun 9d3c9c69fe modify map to C.Map() 2020-06-24 15:07:33 +08:00
mindspore-ci-bot a9dac909d9 !2535 Fix pynative indexing 
Merge pull request !2535 from amongo/FixPynativeTensorIndexing
 2020-06-24 14:41:11 +08:00
mindspore-ci-bot 087779b7d4 !2517 checkpoint add model_type 
Merge pull request !2517 from chenzhongming/quant
 2020-06-24 14:32:33 +08:00
mindspore-ci-bot 0a368494db !2499 HostAllGather and HostReduceScatter change to internal interface 
Merge pull request !2499 from yihuaijie/master
 2020-06-24 14:32:31 +08:00
chenzomi d3f9b80066 checkpoint add model_type 2020-06-24 12:31:08 +08:00
huangdongrun bc0455eaff * fix bool index 
* change slice setitem to mixed procedure
* add testcase for slice assignment
 2020-06-24 11:18:20 +08:00
mindspore-ci-bot 363a232cbc !2512 [quant]The top level add op prefix_name check error 
Merge pull request !2512 from vlne-v1/I1LJMR-quant-the-top-level-add-op-prefix_name-check-error
 2020-06-24 09:42:29 +08:00
mindspore-ci-bot c22c865c4a !1950 [front]add `has_effect` direct to target construct method not cell object 
Merge pull request !1950 from vlne-v1/move-flags-to-construct
 2020-06-24 09:35:24 +08:00
yanghaoran 21c381b366 sync from mindspore to incubator 2020-06-23 21:05:50 +08:00
Wei Luning dcd5773f64 fix bug in quant deploy export 2020-06-23 20:34:44 +08:00
Wei Luning 8f56528f8c add flags on function 2020-06-23 20:22:07 +08:00
mindspore-ci-bot 0478b7d191 !2303 optimize LARS interface 
Merge pull request !2303 from gziyan/modify_lars_interface
 2020-06-23 20:05:47 +08:00
Yi Huaijie 2eb739de6e change HostAllGather and HostReduceScatter to internal interface 2020-06-23 16:56:04 +08:00
jiangjinsheng a1e148cb4d vm for LRN and LRNGrad 2020-06-23 15:47:15 +08:00
mindspore-ci-bot 367e5765f4 !237 fix issue ssim ksize check 
Merge pull request !237 from zhaozhenlong/fix-issue-ssim-ksize-check-incu
 2020-06-23 14:18:54 +08:00
Ziyan 41ddc153a6 modify lars interface 2020-06-23 11:23:28 +08:00
mindspore-ci-bot ac78ac9700 !2297 add vm support for operators include MatrixDiag, MatrixDiagPart etc 
Merge pull request !2297 from jiangjinsheng/vm_matrixdiag
 2020-06-23 11:03:02 +08:00
mindspore-ci-bot 8e5d8a1cf7 !2305 Enhance callback module and strongly check if callbacks is list or not 
Merge pull request !2305 from 李鸿章/callback
 2020-06-23 10:49:45 +08:00
mindspore-ci-bot 73f440a54d !2418 add pretrain for lstm & vgg16 and remove lstm/vgg16/googlenet from directory 'mindspore/model_zoo' 
Merge pull request !2418 from caojian05/ms_master_dev
 2020-06-22 22:51:19 +08:00
wuxuejian 92880788f3 add aicpu embeddinglookup 
move embeddinglookup to the internal
 2020-06-22 21:33:16 +08:00
jiangjinsheng 017ff492af vm for MatrixDiag,MatrixDiagPart.MatrixSetDiag 2020-06-22 20:24:51 +08:00
Li Hongzhang 4c0d12fd63 enhance callback module and strongly check callbacks is list or not 2020-06-22 18:54:40 +08:00
mindspore-ci-bot 932b7649e7 !2241 Adapting operator named AccumulateNV2 
Merge pull request !2241 from zhangzheng/accumulate
 2020-06-22 17:17:47 +08:00
caojian05 deb9694f63 add pretrain for lstm & vgg16 and remove lstm/vgg16/googlenet from directory 'mindspore/model_zoo' 2020-06-22 17:17:10 +08:00
mindspore-ci-bot 55d5ded228 !2306 [Dataset] Code review & improve quality 
Merge pull request !2306 from luoyang/pylint
 2020-06-22 16:01:02 +08:00
mindspore-ci-bot e9e4442dcb !2413 [Auto parallel] Check 'CAST' from optimizers 
Merge pull request !2413 from Xiaoda/7-auto-parallel-check-optimizer-ops
 2020-06-22 14:20:32 +08:00
YangLuo 4e3bfcf4c9 !2306 [Dataset] Code review & improve quality 2020-06-22 14:01:22 +08:00
zhaozhenlong 5888d745bf fix ssim filter size check 2020-06-22 11:02:29 +08:00
zhangz0911gm 4ac1876237 Adapting AccumulateNV2 2020-06-21 22:49:09 -04:00
jiangjinsheng e71599b5ca vm for lin_space 2020-06-22 10:32:03 +08:00
xutianchun 2bfc86f5b7 Add aicpu op: ReverseSequence, CropAndResize, CTCLoss 2020-06-22 09:31:30 +08:00
mindspore-ci-bot beb436f457 !2398 Bug in Slice when multiple rows are used 
Merge pull request !2398 from h.farahat/slice_bug
 2020-06-22 09:23:44 +08:00
mindspore-ci-bot a9c309da4c !2404 [Dataset]rename input variable name to children and output variable to parent 
Merge pull request !2404 from xulei/input_output
 2020-06-22 09:22:33 +08:00
mindspore-ci-bot 1ea38eb60c !2375 Add Python Tokenizer 
Merge pull request !2375 from h.farahat/python_tokenizer
 2020-06-22 09:20:33 +08:00
Xiaoda Zhang 3ff6e336c6 check cast from optimizer in auto-parallel 2020-06-22 09:10:22 +08:00
liyong 2412ee09ce fix distributedSampler reshuffle and fix random_device failed 2020-06-21 18:23:47 +08:00
mindspore-ci-bot 78a8bc302d !2380 Fix CocoDataset issue 
Merge pull request !2380 from xiefangqi/xfq_fix_coco_issue_01
 2020-06-20 18:41:07 +08:00
xulei2020 3b71bd0d5d rename input to children, output to parent 2020-06-20 16:40:10 +08:00
hesham 68030e6a4b Slice Bug 2020-06-20 00:47:13 -04:00
qianlong 980ddd32a2 change output of WordpieceTokenizer and BertTokenizer to 1-D string tensors 2020-06-20 12:08:43 +08:00
mindspore-ci-bot e8639ad91e !2347 support multi param for tuple grad 
Merge pull request !2347 from riemann_penn/support_multi_param_for_tuple_grad
 2020-06-20 10:30:37 +08:00
xiefangqi 5703a10b8b fix CocoDataset issue 2020-06-20 09:51:10 +08:00
mindspore-ci-bot bbf69912be !2363 fix TextFildDataset and CLUEDataset does not support to_device 
Merge pull request !2363 from yanghaitao/yht_fix_textfiledataset
 2020-06-20 09:47:01 +08:00
mindspore-ci-bot 634bfd3508 !2259 add Normal op 
Merge pull request !2259 from pkuliuliu/master
 2020-06-20 09:33:38 +08:00
mindspore-ci-bot d137cefa79 !2372 Cleanup work for BERT special ops 
Merge pull request !2372 from h.farahat/cleanup_0619
 2020-06-20 09:25:56 +08:00
mindspore-ci-bot 2f9c6ec8bc !2337 aware quantization training auto create graph 
Merge pull request !2337 from chenzhongming/master
 2020-06-20 09:23:14 +08:00
pkuliuliu acf46bafbb add Normal op 2020-06-20 09:23:13 +08:00
mindspore-ci-bot 9514b52a23 !2147 Add a callback named SummaryCollector and delete SummaryStep callback 
Merge pull request !2147 from ougongchang/master
 2020-06-20 09:19:10 +08:00
panyifeng 3c2057297e support multi param for tuple grad 2020-06-20 08:39:42 +08:00
hesham e981c67acd Python Tokenizer 
!38 Synchronize with latest Ascend software suite 17 Jun 2020
Merge pull request !38 from yanghaoran/master
 2020-06-19 19:57:11 -04:00
hesham 674415f7be Cleanup work for Concate, Mask, Slice, PadEnd and TruncatePair 2020-06-19 19:11:50 -04:00
mindspore-ci-bot bc4b1c2460 !2373 Comments + improved casting/parameters + UT tests for 3 AugOps (Augmentation Ops RandomCropWithBBox, Random Vertical FlipWithWithBBox and Random CropAndResizeWithWithBBox) 
Merge pull request !2373 from danishnxt/AugOpsD1
 2020-06-20 05:19:03 +08:00
mindspore-ci-bot 7bdcc319b2 !2325 Addressing comments from PR2314 
Merge pull request !2325 from imaaamin/object_ops_pr2
 2020-06-20 04:50:56 +08:00
Danish Farid 6442a85b75 comments added, ptrs to consts, UT tests for BBOps 
updated comments for 3 BB AugOps

addressing comments, void -> status, macros added, fixed test cmt

changed types -> value, fixed ut test funcs, grammar

bug type fix

fixed condition in tests for viz
 2020-06-19 16:09:16 -04:00
islam_amin edc42c5b85 addressed comments from reviews 2020-06-19 14:53:46 -04:00
nhussain d89101b95f add missing test 2020-06-19 11:44:41 -04:00
chenzomi c268c88220 aware quantization training auto create graph 2020-06-19 22:01:16 +08:00
ougongchang 939cd29d7e Add a callback named SummaryCollector and delete SummaryStep callback 
I added a SummaryCollector to help users automatically collect information
such as the network, loss, learning rate and so on, making it easier to collect this information.

It also can collect train lineage and eval lineage information which is
collected by TrainLineage Callback and EvalLineage Callback in
MindInsight.

I also add some UT for SummaryCollect to keep the code correct.
 2020-06-19 21:07:55 +08:00
mindspore-ci-bot 21c67eddd5 !1897 save print data to file 
Merge pull request !1897 from jinyaohui/print
 2020-06-19 17:50:34 +08:00
yanghaitao 9f336bb735 fix TextFileDataset and CLUEDataset failed with to_device 2020-06-19 17:28:05 +08:00
jinyaohui ac23a179bf save print data to file 2020-06-19 17:25:22 +08:00
mindspore-ci-bot 2d6d3cc86b !2339 support catch IndexError in C++ 
Merge pull request !2339 from zhangbuxue/support_catch_index_error_in_c++
 2020-06-19 15:28:18 +08:00
mindspore-ci-bot 8867c67d61 !1935 Summary callback as collector for summary and lineage 
Merge pull request !1935 from 李鸿章/policy_writer
 2020-06-19 14:53:14 +08:00
mindspore-ci-bot 9958bc479a !2161 [qat]Export network from quantization aware network to deploy 
Merge pull request !2161 from vlne-v1/I1IZV3-quant-infer
 2020-06-19 14:16:00 +08:00
mindspore-ci-bot 06b511ca94 !2301 add sparse proximal ada grad optimizer 
Merge pull request !2301 from lilei/sparse_proximal_ada_grad
 2020-06-19 14:07:50 +08:00
Li Hongzhang 0921c1e538 enhance the SummaryRecord with set_mode and add_value 2020-06-19 13:03:00 +08:00
buxue 2c9ca199ad support catch IndexError in C++ 2020-06-19 12:13:18 +08:00
Wei Luning 1d77bf86a9 Exports MindSpore quant predict model to deploy with GEIR 2020-06-19 10:21:35 +08:00
lilei 497067d7b2 add sparse proximal ada grad optimizer 2020-06-19 09:56:28 +08:00
peilinwang 1e36b0649f remove graphengine changes 
remove graphengine changes

concat op

Truncate Pair

concat_op

remove graph engine changes

ToNumberOp implementation almost done

ToNumberOp complete

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

merge conflicts
 2020-06-18 20:07:35 -04:00
hesham 11826fb256 DuplicateOp 2020-06-18 19:47:27 -04:00
mindspore-ci-bot 90bb9320aa !2314 Implemented RandomHorizontalFlipWithBBox and BoundingBoxAugment C++ Ops 
Merge pull request !2314 from imaaamin/object_ops_pr
 2020-06-19 07:08:42 +08:00
mindspore-ci-bot a83baafbf6 !2253 Add ConcatOp to Dataset 
Merge pull request !2253 from nhussain/concat_op
 2020-06-19 06:32:15 +08:00
mindspore-ci-bot 3784220056 !2317 rework on dataset.text.vocab to support any user special_tokens 
Merge pull request !2317 from ZiruiWu/vocab_rework
 2020-06-19 05:25:31 +08:00
nhussain 5515016dba remove graphengine changes 
remove graphengine changes

concat op

Truncate Pair

concat_op

remove graph engine changes
 2020-06-18 17:17:50 -04:00
mindspore-ci-bot ffc8a3c362 !2274 add PadEndOp 
Merge pull request !2274 from xunxue/padend
 2020-06-19 05:05:14 +08:00
mindspore-ci-bot e4322baece !2316 [Dataset] Move python tree transformation into cpp pass 
Merge pull request !2316 from JunhanHu/alter_node_cpp
 2020-06-19 05:02:03 +08:00
islam_amin 0af156d169 added two ops for object detection, random horizontal flip with bbox and bouding box augment. along with their unit tests 2020-06-18 16:55:31 -04:00
xunxue 87aa9c8f7a PadEndOp 2020-06-18 16:07:34 -04:00
Junhan Hu 57f3732ac3 Move python tree transformation into cpp pass. 2020-06-18 15:52:38 -04:00
Zirui Wu b6e9504b31 phase I of Vocab rework 
phase II vocab rework

added more test cases

fix api doc string

address review cmts and fix CI

address ci complains

fix review cmts

ci
 2020-06-18 15:36:28 -04:00
Zirui Wu 8f2674850b address API doc style and content 
addr review cmts

revert

ci

private class

ci

fix ci

address ci

address review cmts

fix style err
 2020-06-18 12:23:42 -04:00
mindspore-ci-bot c0fe8c0322 !2273 [AutoParallel]update EmbeddingLookUp op 
Merge pull request !2273 from lichen/fix_embeding_look_up
 2020-06-18 21:07:52 +08:00
mindspore-ci-bot 5850b99161 !2211 Add TruncatePair Op to dataset 
Merge pull request !2211 from h.farahat/pair_truncate
 2020-06-18 20:58:40 +08:00
mindspore-ci-bot 0958a695a4 !205 add ReverseSequenceGrad 
Merge pull request !205 from xutianchun/reverse_sequence_grad
 2020-06-18 20:53:48 +08:00
lichenever 563622874a update 2020-06-18 19:45:40 +08:00
mindspore-ci-bot d0c5071cab !1993 [Dataset] Fix codedex. 
Merge pull request !1993 from luoyang/pylint
 2020-06-18 18:59:31 +08:00
mindspore-ci-bot 2ecd5bdf25 !2239 [MD] convert csv to mindrecord 
Merge pull request !2239 from liyong126/csv_to_mindrecord
 2020-06-18 18:56:33 +08:00
mindspore-ci-bot d9b8da14e2 !2275 [Auto parallel] Changing bprob of EmbeddingLookup 
Merge pull request !2275 from Xiaoda/4-fix-the-embeddinglookup-errors
 2020-06-18 18:08:19 +08:00
mindspore-ci-bot 9b90d89f6b !2276 fix eliminate get ref parameter 
Merge pull request !2276 from fary86/fix_eliminate_get_ref
 2020-06-18 17:14:26 +08:00
fary86 15b3fba0ef Fix eliminate get ref parameter 2020-06-18 16:10:53 +08:00
Xiaoda Zhang 69574f3823 fix the bprob error of embeddinglookup 2020-06-18 16:06:56 +08:00
mindspore-ci-bot 3559cb5ccd !2252 dataset: repair bug in config load 
Merge pull request !2252 from ms_yan/config_load
 2020-06-18 15:03:44 +08:00
mindspore-ci-bot 60f4795f40 !2220 fix binary dump and add test case 
Merge pull request !2220 from leopz/fix_dump
 2020-06-18 14:30:52 +08:00
ms_yan 8d1dae46ac Throw error when load config failed 2020-06-18 13:47:32 +08:00
liyong 7369950a93 convert csv to mindrecord 2020-06-18 12:55:22 +08:00
mindspore-ci-bot 0c3d96a98b !2236 Refactor the callback module in an encapsulated way 
Merge pull request !2236 from 李鸿章/callback
 2020-06-18 12:09:19 +08:00
hesham b9495a9ccc Truncate Pair 2020-06-17 23:11:27 -04:00
mindspore-ci-bot 9ba6f61d01 !2148 fix hook and bprop debug issue in pynative 
Merge pull request !2148 from wangqiuliang/fix-hook-bprop-issue
 2020-06-18 10:44:45 +08:00
mindspore-ci-bot 4e3b3711be !2199 Fix the condition when activation name is 0 
Merge pull request !2199 from Simson/push-to-opensource
 2020-06-18 10:42:18 +08:00
leopz a67132f6b7 fix shape and add testcase 2020-06-18 10:36:32 +08:00
mindspore-ci-bot f513bb8f83 !2163 [Auto parallel] Move 'EmbeddingLookup' to internal 
Merge pull request !2163 from Xiaoda/3-changing-embeddinglookup-internal
 2020-06-18 10:05:55 +08:00
kingfo 358982a98f fix hook and bprop debug issue 2020-06-18 09:50:30 +08:00
simson ca988e9e69 fix the condition when activation name is 0 2020-06-18 09:14:45 +08:00
mindspore-ci-bot ea829e89c3 !2198 Add MaskOp to dataset 
Merge pull request !2198 from h.farahat/mask_op
 2020-06-18 02:50:16 +08:00
mindspore-ci-bot 808380a9f9 !2142 Cleanup dataset UT: refactor visualize() 
Merge pull request !2142 from Tinazhang/reorg-visualize
 2020-06-18 01:30:36 +08:00
ms_yan fdafc690f8 repair problem in NumpySlicesDataset 2020-06-17 21:49:02 +08:00
mindspore-ci-bot 2865436fee !2092 Tokenizers 
Merge pull request !2092 from qianlong21st/june_third
 2020-06-17 21:40:32 +08:00
Tinazhang 169eaf73c7 reorganize util function visualize() 2020-06-17 09:30:05 -04:00
panfengfeng c745b6bd9d 回退 'Pull Request !2189 : dataset: repair some bug in NumpySlicesDataset' 2020-06-17 19:26:36 +08:00
mindspore-ci-bot 11a256536d !2189 dataset: repair some bug in NumpySlicesDataset 
Merge pull request !2189 from ms_yan/numpy_slice_repair
 2020-06-17 19:17:08 +08:00
Li Hongzhang ecc459158e callback module in encapsulated 2020-06-17 17:01:44 +08:00
mindspore-ci-bot b9ad407dc2 !2204 add check for tensor slice before convert to ops 
Merge pull request !2204 from zhangbuxue/add_check_for_tensor_slice_before_convert_to_ops
 2020-06-17 16:39:11 +08:00
mindspore-ci-bot cef901fe0d !2069 Fix input value check for Momentum, SparseApplyFtrl and SparseApplyAdagrad. 
Merge pull request !2069 from liuxiao/fix-input-value-check-for-SparseApplyFtrl-and-SparseApplyAdaGrad
 2020-06-17 16:37:18 +08:00
Yang dee8471d23 !1993 [Dataset] Fix codedex. 2020-06-17 16:25:38 +08:00
qianlong 4f16f036be Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 
add CaseFold, NormalizeUTF8

add RegexReplace

add RegexTokenizer

add BasicTokenizer

add WordpieceTokenizer

add BertTokenizer
 2020-06-17 15:47:04 +08:00
buxue 61857b69ed add check for tensor slice before convert to ops 2020-06-17 15:32:41 +08:00
Xiaoda Zhang 55e7d9d2b8 move embeddinglookup to the internal 2020-06-17 14:11:28 +08:00
李鸿章 ee438aaf4a callback as context manager 2020-06-17 14:07:52 +08:00
ms_yan d162a7a5ab repair problem in NumpySlicesDataset 2020-06-17 13:21:17 +08:00
liuxiao df63a3195d fix input value check for SparseApplyFtrl and SparseApplyAdagrad 2020-06-17 13:05:09 +08:00
hesham f2462bb00d Mask Op 2020-06-16 23:51:46 -04:00
mindspore-ci-bot bb622877e8 !2167 Add a callback module to avoid the size of the callback.py file too large 
Merge pull request !2167 from ougongchang/adjust_callback
 2020-06-17 11:25:19 +08:00
mindspore-ci-bot ca94916ef9 !2184 CocoDataset add category_id check 
Merge pull request !2184 from xiefangqi/xfq_fix_coco_issue
 2020-06-17 10:06:41 +08:00
ougongchang 1ffa37ffbc Add a callback module to avoid the size of the callback.py file to large 2020-06-17 09:54:58 +08:00
mindspore-ci-bot 4291ea82cf !2024 Add MixedPrecisionCast for Dict 
Merge pull request !2024 from Kang/master
 2020-06-17 09:41:52 +08:00
mindspore-ci-bot 625f2421b5 !1977 random walk in gnn node2vec 
Merge pull request !1977 from JonathanY/randomwalk
 2020-06-17 03:22:21 +08:00
mindspore-ci-bot 3adbde56b2 !2162 SliceOp 
Merge pull request !2162 from h.farahat/slice_op
 2020-06-17 01:22:47 +08:00
mindspore-ci-bot 898b2fdecd !2187 Fix comment display issues in BuildVocabDataset 
Merge pull request !2187 from ZiruiWu/vocab_rework
 2020-06-17 00:51:37 +08:00
Zirui Wu 2794883644 fix selected minor issues 
fix review comments
 2020-06-16 11:07:49 -04:00
mindspore-ci-bot 3ccbafe71d !2062 [MD] add splitOP in minddataset 
Merge pull request !2062 from liyong126/minddataset_split
 2020-06-16 22:40:05 +08:00
mindspore-ci-bot 0b7d4855dd !2168 Chage combined quant to nn.quant 
Merge pull request !2168 from chenzhongming/combined
 2020-06-16 21:59:53 +08:00
xiefangqi aab190fcdb CocoDataset add category_id validation 2020-06-16 21:37:22 +08:00
chenzomi 4878616e43 change combined to nn 2020-06-16 21:07:01 +08:00
liyong d4f8f57c7e add split in minddataset 2020-06-16 19:50:41 +08:00
mindspore-ci-bot 6089d58d8d !2171 ssim input shape h and w should be greater than or equal to filter_size 
Merge pull request !2171 from zhaozhenlong/fix-issues-quant-not-exposed-ssim-ksize-check
 2020-06-16 18:53:45 +08:00
mindspore-ci-bot 6ff3a6dcff !2175 move AscendQuant and AscendDequant to inner_ops.py 
Merge pull request !2175 from zhaozhenlong/fix-issues-ascend-quant-move-to-inner-ops
 2020-06-16 18:53:02 +08:00
zhaozhenlong ea681bfb0f fix ssim filter size check 2020-06-16 17:32:35 +08:00
zhaozhenlong dbfb4f057c move AscendQuant AscendDequant to inner_ops.py 2020-06-16 17:25:26 +08:00
liuxiao aa73abc2f7 Add image.CentralCrop 2020-06-16 16:10:17 +08:00
mindspore-ci-bot 2d84011504 !2071 optimizer support loss scale for sparse situation 
Merge pull request !2071 from wangnan39/support_loss_scale_for_sparse_optimizer
 2020-06-16 15:01:49 +08:00
mindspore-ci-bot 2fa2f86619 !2135 add tfrecord to mindrecord tool 
Merge pull request !2135 from guozhijian/add_tools_tfrecord_to_mindrecord
 2020-06-16 14:40:38 +08:00
hesham e2012a1de9 Slice Op 2020-06-16 02:32:40 -04:00
jonyguo 3353a20d8b add tool: tfrecord to mindrecord 2020-06-16 12:09:21 +08:00
mindspore-ci-bot 71d27c6854 !2068 Add InplaceAddD and InplaceSubD vm ops 
Merge pull request !2068 from liuwenhao/master
 2020-06-16 11:00:32 +08:00
mindspore-ci-bot 105dcb1c1e !2128 hidden range 
Merge pull request !2128 from jiangjinsheng/issue_fix3
 2020-06-16 10:37:27 +08:00
mindspore-ci-bot ea96cbcef2 !1979 fix partial primitive poly node 
Merge pull request !1979 from fary86/fix_patial_primitive_poly_code
 2020-06-16 09:35:57 +08:00
liuwenhao4 be40a90ec6 add InplaceAddD and InplaceSubD vm ops 2020-06-16 09:29:11 +08:00
jiangjinsheng 032e921298 hidden range 2020-06-16 09:18:25 +08:00
mindspore-ci-bot dceb3c2be4 !2026 Change C++ behavior in RandomCropAndResize 
Merge pull request !2026 from MahdiRahmaniHanzaki/I1K3FL-random-resized-crop
 2020-06-16 05:27:36 +08:00
Mahdi add29f95f5 resolved issues in the comments 2020-06-15 16:45:18 -04:00
mindspore-ci-bot 2cab44a637 !2028 FillOp for BERT 
Merge pull request !2028 from nhussain/fillOp_learning
 2020-06-16 02:45:45 +08:00
nhussain dd9bf09f0a added FillOp for #119 - special Ops 2020-06-15 11:30:43 -04:00
Peilin Wang 848e07d022 initial commit, start of BucketBatchByLengthOp 
c implementation done, just need to call batch/pad

added python api and validator

added pybind/de_pipeline stuff, fixed some compile errors, figure out how null py::function works

added tiny bit of doc

integrated with static batch methods

fixed some bugs

some more bug fixes and cleanup

ci fix

fix ci

ci fix

fix ci

added test_cases and debugged

addressed code review comments

addressed code review comments

ci fix

ci fix

addressed code review comments

addressed code review comments
 2020-06-15 10:20:01 -04:00
wangnan39@huawei.com d4e3d69f37 support loss scale for sparse situation 2020-06-15 22:17:53 +08:00
mindspore-ci-bot 7b6f13886f !1962 add vm support for operators include ApproximateEqual, InplaceUpdateD and InTopKD 
Merge pull request !1962 from zhouneng/add_vm_support_for_ApproximateEqual_InplaceUpdateD_InTopKD
 2020-06-15 21:00:35 +08:00
Jonathan Yan 87d2c27c7f random walk v1 2020-06-15 08:54:10 -04:00
mindspore-ci-bot 842f8231ba !2100 add op quant and dequant 
Merge pull request !2100 from zhaozhenlong/op/quant-dequant-ge-open
 2020-06-15 17:32:13 +08:00
zhaozhenlong ccda0f7b36 add op AscendQuant AscendDequant 2020-06-15 16:42:53 +08:00
mindspore-ci-bot 11f5f88021 !2010 fix operator issues for tuple_to_array and cast 
Merge pull request !2010 from wangqiuliang/fix-tuple-to-array-issue
 2020-06-15 15:38:47 +08:00
kingfo 9708e58259 fix TupleToArray & Cast operator issue 2020-06-15 14:39:10 +08:00
mindspore-ci-bot 5cd41905c0 !1820 [Auto parallel] Implementing the backward of 'EmbeddingLookup' primitive 
Merge pull request !1820 from Xiaoda/the-backward-of-embeddinglookup
 2020-06-15 11:53:11 +08:00
mindspore-ci-bot a8cf83acf2 !1932 Add CLUE dataset 
Merge pull request !1932 from jiangzhiwen/dataset/clue
 2020-06-15 11:48:35 +08:00
fary86 ffa3352088 Fix partial primitive poly node 2020-06-15 10:56:55 +08:00
jiangzhiwen e0e167a000 add CLUE dataset 2020-06-15 10:40:46 +08:00
zhouneng 51fe3501a4 add vm support for ApproximateEqual, InplaceUpdateD and InTopKD. 2020-06-15 10:18:31 +08:00
hesham a22763b612 Bug in CIFAR after removing GetMutabble buffer 
Fixes # I1KIPC
 2020-06-14 13:27:17 -04:00
jonyguo bb2082daec fix: MindDataset padded log error 2020-06-13 19:46:24 +08:00
Xiaoda Zhang 20d2012a0e implementing the backward of embeddinglookup 2020-06-13 16:57:56 +08:00
mindspore-ci-bot 403c30c7da !1919 change tensor dtype and shape from function to attr 
Merge pull request !1919 from zhangbuxue/change_tensor_dtype_and_shape_from_function_to_attr
 2020-06-13 10:28:55 +08:00
buxue 66bbdb4a31 change tensor dtype and shape from function to attr 2020-06-12 19:03:23 +08:00
mindspore-ci-bot b285c8fa9d !1973 develop TensorScatterUpdate op and access ge and vm 
Merge pull request !1973 from zhangbuxue/develop_TensorScatterUpdate_op_and_access_ge_and_vm
 2020-06-12 18:40:06 +08:00
buxue 8aee6b07d6 develop TensorScatterUpdate op and access ge and vm 2020-06-12 17:43:40 +08:00
mindspore-ci-bot 3536185f5b !2007 add lazy adam optimizer and support sparse adam&ftrl for cpu backend 
Merge pull request !2007 from wangnan39/add_lazy_adam_optim_and_support_sparse_admm_for_cpu_backend
 2020-06-12 17:22:03 +08:00
mindspore-ci-bot a8378a3357 !1924 Add TBE ops ApplyAdaMax\ ApplyAdadelta\ ApplyAdagrad\ ApplyAdagradV2 for VM. 
Merge pull request !1924 from liuxiao/ops-for-VM
 2020-06-12 17:16:36 +08:00
wangnan39@huawei.com 4042f16ce4 add lazy adam optim and support sparse adam & ftrl for cpu backend 2020-06-12 16:06:11 +08:00
mindspore-ci-bot 11875d8495 !2044 Add_Sparse_GatherV2_distributed_op 
Merge pull request !2044 from lichen/add_sparse_gatherv2
 2020-06-12 14:19:30 +08:00
mindspore-ci-bot ac5878b4b7 !1939 Complete vm ops for DataFormatDimMap and HistogramFixedWidthD 
Merge pull request !1939 from lihongkang/lhk_master
 2020-06-12 11:53:21 +08:00
mindspore-ci-bot 5c7cb7bd71 !2023 add op CosineEmbeddingLoss 
Merge pull request !2023 from zhaozhenlong/op/cosine-embedding-loss-open
 2020-06-12 11:09:55 +08:00
lichenever e0e055a0b8 add sparse gatherv2 2020-06-12 11:09:28 +08:00
mindspore-ci-bot 3085e51e45 !1922 check parameter num_samples of sampler 
Merge pull request !1922 from yanghaitao/yht_check_num_samples_sampler
 2020-06-12 10:22:14 +08:00
mindspore-ci-bot 5b0472683c !1737 sparse feature backpropagation 
Merge pull request !1737 from lirongzhen1/sparse
 2020-06-12 09:51:41 +08:00
lihongkang bbbd980728 add vm for histogramfixedwidth and dataformatdimmap 2020-06-12 09:34:58 +08:00
mindspore-ci-bot 4df861cb62 !1672 support load full dataset on each device 
Merge pull request !1672 from yihuaijie/dev
 2020-06-12 09:24:04 +08:00
mindspore-ci-bot 1b5d9a1194 !1981 Implemented from_dataset, a way to build a vocab from existing dataset 
Merge pull request !1981 from ZiruiWu/from_dataset_dev
 2020-06-12 08:08:19 +08:00
Zirui Wu 880ce5ea26 implemented from_dataset 
fix complie error

more tests

address CI complains

fix ci

adress review comments

address review cmts
 2020-06-11 16:20:19 -04:00
Alexey Shevlyakov 4e333a2f22 MindData profiler infrastructure 2020-06-11 14:52:36 -04:00
mindspore-ci-bot 0a95223f25 !1910 RandomColorAdjust error for grayscale images 
Merge pull request !1910 from MahdiRahmaniHanzaki/I1J9SQ-random-color-adjust-bug
 2020-06-11 23:15:19 +08:00
yanghaitao 8f16cff12e add para check for sampler 2020-06-11 22:26:06 +08:00
mindspore-ci-bot bf172da4c3 !2015 add test case for floatxx / floatxx numpy 
Merge pull request !2015 from guozhijian/add_test_case_for_floatxx
 2020-06-11 21:59:03 +08:00
Kang 3ba2074213 Add MixedPrecisionCast for Dict 2020-06-11 21:32:08 +08:00
zhaozhenlong 19c5921c06 composed op CosineEmbeddingLoss 2020-06-11 21:28:35 +08:00
mindspore-ci-bot f859dfecc8 !1920 SupportPynativeIndexing 
Merge pull request !1920 from amongo/SupportPynativeIndexing
 2020-06-11 21:11:36 +08:00
mindspore-ci-bot 961af9fed1 !2014 adapt op SparseGatherV2 
Merge pull request !2014 from zhaozhenlong/op/sparse-gather-v2-vm
 2020-06-11 20:35:37 +08:00
Yi Huaijie e5c351690b support load full dataset on each device 2020-06-11 19:48:06 +08:00
jonyguo 1de7271afc add floatxx test case 2020-06-11 19:26:54 +08:00
huangdongrun 9522f59b87 support for tensor indexing in pynative 
support tensor slice using constexpr

remove tensorslice metagraph

add pynative testcases
 2020-06-11 19:14:22 +08:00
zhaozhenlong 562c2b8d3d sparse gather v2 2020-06-11 19:11:56 +08:00
mindspore-ci-bot 9dfb1011fe !1854 add SparseApplyAdam and SparseApplyLazyAdam ops 
Merge pull request !1854 from wangnan39/add_ops_sparse_adam_and_sparse_lazy_adam
 2020-06-11 16:35:03 +08:00
lirongzhen1 516b56cb64 sparse feature bp 2020-06-11 16:32:24 +08:00
wangnan39@huawei.com de21dbdaef add ops SparseApplyAdam and SparseApplyLazyAdam 2020-06-11 15:50:28 +08:00
ms_yan bc22c172b8 add TensorDataset and its ut 2020-06-11 15:24:12 +08:00
mindspore-ci-bot 251a6667a5 !1989 fix MindDataset distribute shuffle error 
Merge pull request !1989 from guozhijian/fix_distribute_shuffle
 2020-06-11 14:51:17 +08:00
mindspore-ci-bot b3da41bd7a !1913 CocoDataset implementation 
Merge pull request !1913 from xiefangqi/xfq_support_coco
 2020-06-11 14:37:44 +08:00
mindspore-ci-bot 3b8edd5a5b !1918 sparse grad for gatherv2 
Merge pull request !1918 from riemann_penn/sparse_grad_for_gatherv2
 2020-06-11 14:11:49 +08:00
liuxiao cda547e92f add tbe some ops about optimizer for vm 2020-06-11 12:35:00 +08:00
panyifeng acaa66a738 sparse grad for gatherv2 2020-06-11 12:00:53 +08:00
xiefangqi 097cbcc0cb CocoDataset implementation 2020-06-11 11:52:17 +08:00
jonyguo 96859f44b6 fix: MindDataset distribute shuffle bug 2020-06-11 11:06:34 +08:00
mindspore-ci-bot 7b7932ced9 !1944 move hook function to PrimitivePy class 
Merge pull request !1944 from wangqiuliang/move-hook-function-to-primitivepy
 2020-06-11 09:29:00 +08:00
Mahdi ba2e2dced4 fixed some warnings and typos 2020-06-10 17:18:56 -04:00
Tinazhang 2812cd57db fix pylint error 2020-06-10 15:55:11 -04:00
mindspore-ci-bot fe0c3e9a8f !1908 Add UT to six data vision transforms ops 
Merge pull request !1908 from Tinazhang/ut-normalize
 2020-06-11 00:43:57 +08:00
mindspore-ci-bot eecf0a9ab8 !1968 support vm for range 
Merge pull request !1968 from jiangjinsheng/vm_FusedMulApplyMomentumExtern
 2020-06-10 17:51:15 +08:00
heleiwang 3ece8dd090 1. support get_all_edges, get_nodes_from_edge, get_sampled_neighbors, get_neg_sampled_neighbors and graph_info API 
2. mod cora and citeseer conversion script
 2020-06-10 15:52:26 +08:00
jiangjinsheng a1efe4d14d support vm for range 2020-06-10 15:51:35 +08:00
kingfo 38436f929f move hook function to primtivePy class 2020-06-10 15:33:46 +08:00
mindspore-ci-bot 444d9484d7 !1916 add ProximalAdagrad Optimizer 
Merge pull request !1916 from lilei/add_proximal_ada_grad_optimizer
 2020-06-10 14:40:20 +08:00
xutianchun 9baf1ba99c add ReverseSequenceGrad 2020-06-10 11:37:30 +08:00
lilei 36d9e353a5 add proximal_ada_grad optimizer 2020-06-10 09:21:36 +08:00
mindspore-ci-bot bfc18f3adc !1873 synchronize latest ascend software 04 Jun 2020 
Merge pull request !1873 from yanghaoran/master
 2020-06-10 01:27:43 +08:00
mindspore-ci-bot 5eb95599f6 !1874 Updates to string tensor 
Merge pull request !1874 from h.farahat/string_tensor_updates
 2020-06-10 00:59:17 +08:00
yanghaoran 8da4c1a763 synchronize latest ascend software 04 Jun 2020 2020-06-09 23:34:13 +08:00
mindspore-ci-bot 0e7839826e !1945 [bug]fix bug in '=', use signature to support auto cast in assign. 
Merge pull request !1945 from vlne-v1/I1JXUP-resnet50-thor-assign-fail
 2020-06-09 22:57:01 +08:00
Tinazhang c3de5c7a54 adding new TCs to six ops and skip md5 case in RandomPerspective 2020-06-09 10:51:45 -04:00
hesham f837ddc956 - Bug when empty strings sent to Python 
- Support accepting Numpy of str as input
- Support batching strings
- Core logic of batch&pad is static
- Make Pad a utility function
 2020-06-09 10:34:38 -04:00
zhaozhenlong 9ce86e8832 composed op CosineEmbeddingLoss 2020-06-09 21:34:01 +08:00
Wei Luning ee8420aefa Make assign operator to use the signature. 2020-06-09 21:12:56 +08:00
zhaoting b16a552d41 Revert "Revert "add pattern AdjustAllReduceMulAdduse the old opadd test case for bugtemp fix try"" 
This reverts commit 705c71a257.
 2020-06-09 20:56:36 +08:00
liuxiao 6856c2ac7a Adapt ops ApplyProximalAdagrad for GE 2020-06-09 14:20:21 +08:00
wenkai ab6b6add0b cpu support summary 2020-06-09 09:51:28 +08:00
mindspore-ci-bot 10fd781b15 !1831 Add order parameter function in group params 
Merge pull request !1831 from ghzl/add-oder-parameters-in-group-functions
 2020-06-08 17:38:43 +08:00
mindspore-ci-bot c82a8bf483 !1678 modify print 
Merge pull request !1678 from jinyaohui/print
 2020-06-08 11:20:53 +08:00
guohongzilong 85a06b00c6 add order function in group params 2020-06-08 11:09:18 +08:00
mindspore-ci-bot 0a897b0ce7 !1865 add inv,invgrad&invert for vm 
Merge pull request !1865 from JichenZhao/bnops_for_vm
 2020-06-08 10:42:20 +08:00
zhaojichen cdb7ec937b add inv,invgrad&invert for vm 2020-06-05 08:23:51 -04:00
zhaozhenlong 1f342fb926 add op BroadcastTo 2020-06-05 17:45:53 +08:00
huangdongrun 1642be4a67 fix initiliazer 2020-06-05 15:58:02 +08:00
mindspore-ci-bot 1c640face9 !1826 fix bug when check learning_rate in AdamWeightDecayDynamicLR 
Merge pull request !1826 from wangnan39/fix_lr_check_bug_in_adamweightdecay_dynamic_lr
 2020-06-05 14:35:20 +08:00
mindspore-ci-bot bd34c6ec8b !1853 Fix initializer 
Merge pull request !1853 from amongo/FixInitializer
 2020-06-05 11:46:20 +08:00
mindspore-ci-bot 1973594bd1 !1774 [MD] minddataset support padding samples 
Merge pull request !1774 from liyong126/mindrecord_padded_sample
 2020-06-05 11:27:25 +08:00
mindspore-ci-bot b236beae28 !1615 convert constant bool tensor to bool 
Merge pull request !1615 from amongo/GetBoolValueFromConstantTensor
 2020-06-05 09:46:44 +08:00
liyong feff8899ac support padding samples 2020-06-05 09:14:42 +08:00
mindspore-ci-bot 5c21616293 !1807 Implemented Ngram TensorOp for dataset 
Merge pull request !1807 from ZiruiWu/ngram_dev
 2020-06-05 01:04:27 +08:00
huangdongrun 9081041199 fix initiliazer 2020-06-04 22:22:41 +08:00
mindspore-ci-bot 769ae609b4 !1808 consistent design for num_samples 
Merge pull request !1808 from Jamie/numsamples
 2020-06-04 22:12:55 +08:00
Zirui Wu dbf9936ec4 Implemented n-gram for dataset TensorOp 2020-06-04 09:57:44 -04:00
huangdongrun beacc26077 * add isconstant primitive 
* add infer_value for common math ops
* convert constant bool tensor to bool value

* do not infer value when encounter 0 as division

for while condition, do not unrool if condition is a tensor
 2020-06-04 21:51:44 +08:00
jinyaohui 5e43edc474 clean pylint 2020-06-04 21:03:30 +08:00
mindspore-ci-bot 97524b9ddd !1823 support vm for ConfusionMatrix 
Merge pull request !1823 from jiangjinsheng/vm_ConfusionMatrix
 2020-06-04 20:04:19 +08:00
jiangjinsheng fc4cf5a470 add vm support for ConfusionMatrix 2020-06-04 14:12:13 +08:00
mindspore-ci-bot 0c1674496f !1819 Restricting modify non_Parameter class members 
Merge pull request !1819 from zhangbuxue/restricting_modify_non-Parameter_class_members
 2020-06-04 09:53:30 +08:00
Jamie Nisbet 51bc0c0460 consistent design for num_samples 
updates

more update

more work

more fixin

post rebase updates

clang formatting

code review recovery

ci fixes

updates

update

update

update
 2020-06-03 15:01:18 -04:00
mindspore-ci-bot bc7a3a1bef !1806 Add crop size check to python RandomCrop op 
Merge pull request !1806 from Tinazhang/random-crop-error-msg
 2020-06-03 23:28:22 +08:00
wangnan39@huawei.com c9b7d95c2c fix lr check bug in AdamWeightDecayDynamicLR 2020-06-03 19:20:36 +08:00
buxue 94c9019d8e restricting modify non_Parameter class members 2020-06-03 17:17:46 +08:00
mindspore-ci-bot 5d397d8404 !1804 add tensor compare & len & constexpr feature 
Merge pull request !1804 from wangqiuliang/add-tensor-compare-len-consexpr-feature
 2020-06-03 15:41:00 +08:00
Xiaoda Zhang 1cfb52bc0e add the reshape part of the embeddinglookup backward operator 2020-06-03 10:39:45 +08:00
kingfo 9785178b88 add tensor compare & len & constexpr operation 2020-06-03 10:27:41 +08:00
Tinazhang 33fe66fd1e fix error handling for bigger crop size case 2020-06-02 11:06:41 -04:00
liuwenhao4 ad4996d528 Register forward and backward operations of Ceil 2020-06-02 20:48:37 +08:00
mindspore-ci-bot 80f581fc02 !1713 [Dataset] Clean pylint. 
Merge pull request !1713 from luoyang/pylint
 2020-06-02 16:54:29 +08:00
mindspore-ci-bot d5f55f0820 !1769 [AutoParallel]GatherV2_support_host_device 
Merge pull request !1769 from lichen/gatherv2_support_host_and_device
 2020-06-02 16:52:54 +08:00
Wei Luning 021c87700f fix bug in do signature 2020-06-02 16:12:47 +08:00
mindspore-ci-bot da06310ae0 !1766 [bug][auto cast]fix bug when do auto cast 
Merge pull request !1766 from vlne-v1/I1J0M0-amp-do-auto-cast-failed
 2020-06-02 15:44:10 +08:00
Wei Luning 7e4d972f6f fix bug in do signature 2020-06-02 11:59:19 +08:00
mindspore-ci-bot e79df7c169 !1697 optimize clip_norm 
Merge pull request !1697 from chenhaozhe/bert-optimization
 2020-06-02 11:28:53 +08:00
chenhaozhe 435fc12e28 optimize clip_norm 2020-06-02 09:48:29 +08:00
Yang 5522edc4b5 !1713 [Dataset] Clean pylint. 2020-06-02 09:02:19 +08:00
zhaozhenlong 7716f7618c add op BasicLSTMCell 2020-06-01 21:11:35 +08:00
lichenever 1437966c98 gatherv2_support_host_and_device 2020-06-01 21:06:35 +08:00