Commit Graph

1686 Commits

Author SHA1 Message Date
yangzhenzhang f4bb43bbaf add concat op 2020-08-07 15:47:17 +08:00
panyifeng 34e50e5d6e fix cell bprop 2020-08-07 10:57:01 +08:00
Lixia Chen ac85b77b76 Maintain epoch/repeat count for ops 2020-08-06 09:47:31 -04:00
mindspore-ci-bot 470328eeaf !4060 fix do concat in while loop specialize error
Merge pull request !4060 from fary86/fix_while_concat_specialize_error
2020-08-06 21:12:13 +08:00
Wei Luning d4d6457ea7 init parameter data by defaultOnly keep no data as MetaTensor in auto parallel mode 2020-08-06 19:52:31 +08:00
fary86 7602054acd Fix do concat in while loop specialize error 2020-08-06 19:41:11 +08:00
kingfo 28dabf0332 fix grad flag update issue in pynative 2020-08-06 15:12:31 +08:00
mindspore-ci-bot 0b407dfe78 !4005 unsortedsegsum grad
Merge pull request !4005 from fangzehua/unsortedsegsum
2020-08-06 14:19:20 +08:00
mindspore-ci-bot c493859978 !4004 add squreasumall grad
Merge pull request !4004 from fangzehua/squaresumall
2020-08-06 14:18:23 +08:00
mindspore-ci-bot 235378d5d7 !3789 eager mode sparse
Merge pull request !3789 from riemann_penn/eager_mode_sparse
2020-08-06 09:33:50 +08:00
mindspore-ci-bot 7ec0b5857a !3977 [MD] Refactor Concatenate Op
Merge pull request !3977 from nhussain/multi_dim_concat_2
2020-08-06 02:53:06 +08:00
nhussain 61769b2dd9 fix concat 2020-08-05 11:28:56 -04:00
fangzehua 99f2be7064 unsortedsegsum grad 2020-08-05 20:34:06 +08:00
fangzehua 7011508379 add squreasumall grad 2020-08-05 20:28:02 +08:00
panyifeng 9927e6eb5c eager mode sparse 2020-08-05 18:21:30 +08:00
mindspore-ci-bot 8dec74908a !4000 improve interface '__bool__' for tensor
Merge pull request !4000 from zhangbuxue/improve_bool_for_tensor
2020-08-05 17:21:41 +08:00
mindspore-ci-bot 617b98f104 !3966 [AutoParallel]Add dropout distributed op
Merge pull request !3966 from lichen/add_dropout_distributed_op
2020-08-05 16:38:32 +08:00
buxue ace34525cd improve interface '__bool__' for tensor 2020-08-05 16:14:14 +08:00
lichenever bfc96de1b9 add dropout distributed op 2020-08-05 14:07:24 +08:00
peixu_ren b9c8c0b439 Added Bijector TransformDistribution base classes and two instances: power and exp bijectors 2020-08-05 00:03:50 -04:00
mindspore-ci-bot a301fc1757 !3916 remove loss_scale range check which is a temp fix.
Merge pull request !3916 from xychow/remove-loss-scale-range-check
2020-08-05 10:16:15 +08:00
mindspore-ci-bot 5827ba9a8a !3940 View code support interface 'all' and 'any' of tensor
Merge pull request !3940 from zhangbuxue/support_interface_all_and_any_of_tensor
2020-08-04 20:08:44 +08:00
buxue 2c4cb49a11 support interface 'all' and 'any' of tensor 2020-08-04 18:24:56 +08:00
zhousiyi 7d31deb6fa remove loss_scale range check to make FP32Imm(inf) comparison equal 2020-08-04 08:08:29 +00:00
mindspore-ci-bot 8b396cea98 !3915 Revert modification of opt
Merge pull request !3915 from Simson/push-to-opensource
2020-08-04 15:59:20 +08:00
mindspore-ci-bot bac1781539 !3648 Add some testing cases for mindspore.profiler
Merge pull request !3648 from 张毅辉/zyh_profiler_test
2020-08-04 14:23:15 +08:00
mindspore-ci-bot c3edfe12bc !3715 Update python pattern expression
Merge pull request !3715 from BowenK/new_pattern
2020-08-04 12:58:32 +08:00
mindspore-ci-bot af9398b39a !3756 Change distribution api
Merge pull request !3756 from XunDeng/pp_poc_v3
2020-08-04 11:34:46 +08:00
mindspore-ci-bot 2da29bce66 !3370 same graph used in different context should be treat differently.
Merge pull request !3370 from xychow/fix-context-dup
2020-08-04 10:56:04 +08:00
simson 3617121ccf revert modification of opt 2020-08-04 10:09:21 +08:00
mindspore-ci-bot aa65cbf733 !3846 Add TBE op SquaredDifference\Xdivy\Xlogy for VM.
Merge pull request !3846 from liuxiao93/Add-ops-SeluSquaredDifference
2020-08-03 21:20:24 +08:00
mindspore-ci-bot 27a0a2e333 !3880 fix auto mix precision issue in pynative
Merge pull request !3880 from wangqiuliang/fix-gradients-issue-in-pynative
2020-08-03 19:23:03 +08:00
mindspore-ci-bot a182a87a6d !3820 support tensor attr shape and dtype in graph mode
Merge pull request !3820 from zhangbuxue/support_dtype_and_shape_as_attr_in_graph_mode
2020-08-03 18:57:46 +08:00
liuxiao93 374b7b8583 Add TBE op SquaredDifference for VM. 2020-08-03 18:52:18 +08:00
kingfo 577535b387 fix gradients issue in pynative 2020-08-03 17:35:21 +08:00
buxue b075674cf2 support tensor attr shape and dtype in graph mode 2020-08-03 17:09:31 +08:00
mindspore-ci-bot be507b96e0 !3473 [refine]change base class of parameter
Merge pull request !3473 from vlne-v1/change_base_class_of_parameter
2020-08-03 16:05:46 +08:00
zhousiyi f926650c64 if AbstractFunction comparison succeed in NewContext, then the evaluator should use the same one, otherwise one of the evaluator will not be evaluated.
if funcgraph or metafuncgraph call it recursively, then anf_node should be used as tracking_id to discriminate the first occurcance and the
recursive occurance.
add anf_node to PrimitiveAbstractClosure hash() to reduce cost of GetEvaluatorFor().

ignore the tracking_id to make cse work.
2020-08-03 07:57:07 +00:00
BowenK 6d4c07c886 Update python pattern expression 2020-08-03 15:29:22 +08:00
mindspore-ci-bot 25fdb67e3d !3744 [Auto parallel] Add a new graph operation in the DP algorithm
Merge pull request !3744 from Xiaoda/14-add-new-graph-operations-in-auto-parallel
2020-08-03 11:18:14 +08:00
Wei Luning a05c38bb63 make python Parameter inherit from Tensor 2020-08-03 09:12:24 +08:00
mindspore-ci-bot d1b3096418 !3837 add_test_for_mindrecord 3
Merge pull request !3837 from liucunwei/add_test_for_mindrecord3
2020-08-01 16:09:50 +08:00
z00505269 87668d6ea2 remove predict 2020-08-01 11:45:19 +08:00
liucunwei 8b99114f6d add mindrecord test case 2020-08-01 11:41:58 +08:00
Xun Deng e87e1fc6bc changed distribution api 2020-07-31 12:41:06 -04:00
mindspore-ci-bot 27e51c5a63 !3553 Unify np array comparisons
Merge pull request !3553 from tony_liu2/staging
2020-07-31 21:39:31 +08:00
dengyutao 388e43f7cb delete parameter block_reader for MindDataset 2020-07-31 11:30:05 +08:00
Xiaoda Zhang d24a902afe add a new graph operation in autoparallel 2020-07-31 10:57:19 +08:00
mindspore-ci-bot f1e717554c !3537 add sparse operators
Merge pull request !3537 from riemann_penn/add_sparse_operator
2020-07-31 10:25:55 +08:00
peixu_ren 374772035a Refactor random uniform ops and complete gamma and poisson 2020-07-30 09:46:52 -04:00
mindspore-ci-bot 8943d5de34 !3727 Fix fuzz issue and split problem
Merge pull request !3727 from xiefangqi/fuzz_issue_pad_01
2020-07-30 21:24:47 +08:00
panyifeng 598bfa0205 add sparse operators 2020-07-30 17:18:23 +08:00
mindspore-ci-bot 61867c7386 !3645 add mindspore hub for download ckpt file
Merge pull request !3645 from chenzhongming/master
2020-07-30 16:25:10 +08:00
mindspore-ci-bot ce08065c23 !3671 vgg: optimize the script and Readme
Merge pull request !3671 from ms_yan/vgg_optimize
2020-07-30 16:00:50 +08:00
xiefangqi 6017b050ac add generatordataset support split 2020-07-30 15:51:28 +08:00
chenzomi 8918c90b66 add mindspore hub for download ckpt file
add mindspore.hub and change model_zoo
2020-07-30 15:02:55 +08:00
mindspore-ci-bot ab4c43007f !3657 Add parallel operator for StridedSlice
Merge pull request !3657 from yangzhenzhang/add-stridedslice-op
2020-07-30 15:02:35 +08:00
mindspore-ci-bot 80dd2cfe00 !3405 fix optimizer parallel problems
Merge pull request !3405 from gziyan/fix_optimizer_parallel
2020-07-30 14:09:16 +08:00
zhangyihui 54f2cf4ef0 add some test case for profiler 2020-07-30 10:43:13 +08:00
ms_yan abbd7b50db optimize the vgg script 2020-07-30 07:48:35 +08:00
Xun Deng e94d91ba95 remove import probability from nn/__init__.py 2020-07-29 15:08:58 -04:00
tony_liu2 269b477684 use np.testing.assert instead of asserting
fix line lengths

fix spacing

reverse a few changes
2020-07-29 14:53:01 -04:00
Ziyan 98e2ee90de fix optimizer parallel problems 2020-07-29 20:55:31 +08:00
yangzhenzhang 9aa84b3d14 add strided slice op 2020-07-29 17:18:50 +08:00
mindspore-ci-bot d06da1d270 !3603 Check that the number columns of names and default matches
Merge pull request !3603 from jiangzhiwen/fix_column_names_exceeded
2020-07-29 11:40:06 +08:00
jiangzhiwen 2cc6b5cb52 fix number of columns not match 2020-07-29 09:19:33 +08:00
changzherui 758853ff52 modify case 2020-07-29 00:15:48 +08:00
mindspore-ci-bot 46ae7879d4 !3394 Three distribution class instances: Exponential, Geometric Uniform distribution
Merge pull request !3394 from XunDeng/pp_poc_v3
2020-07-28 22:21:29 +08:00
guansongsong 1906ed1be8 fix cache description again 2020-07-28 13:26:29 +08:00
guansongsong b6529b9096 fix cache description 2020-07-28 13:03:06 +08:00
guansongsong 620d951e5e Merge branch 'ql/fix_cache_core' of https://gitee.com/qianlong21st/mindspore into ql/fix_cache_core 2020-07-28 11:37:06 +08:00
mindspore-ci-bot 16079e6356 !3472 [Auto parallel] Cost model for GPU
Merge pull request !3472 from Xiaoda/13-add-gpu-costmodel
2020-07-28 09:27:26 +08:00
mindspore-ci-bot 72e45841a2 !3528 Fix the difference of Error type between graph&pynative mode
Merge pull request !3528 from Simson/push-to-opensource
2020-07-28 09:26:49 +08:00
mindspore-ci-bot d4165671d9 !3435 Add parallel operator for Tile
Merge pull request !3435 from yangzhenzhang/add-tile-op
2020-07-28 09:16:30 +08:00
peixu_ren 292f2de0cf Add sampling functions in exponential, geometric and uniform distributions 2020-07-27 17:07:14 -04:00
Xun Deng 7bb83067d0 added exponential uniform geometric distribution
added cdf, logcdf, survival, logsurvival, entropy, mode, cross_entropy wrapper
2020-07-27 17:03:37 -04:00
ms_yan cf3fff8996 init add vgg16 gpu version
merge the script

optimize the script
2020-07-27 22:26:17 +08:00
mindspore-ci-bot 6e7c673c90 !3519 remove diary file
Merge pull request !3519 from anzhengqi/remove-log
2020-07-27 20:53:41 +08:00
mindspore-ci-bot e9316b1389 !3500 fix sparse feature bug for auto parallel
Merge pull request !3500 from lirongzhen1/master
2020-07-27 19:27:39 +08:00
simson b2cdd5d848 Fix the difference of Error type between graph&pynative mode 2020-07-27 17:28:13 +08:00
mindspore-ci-bot 5f7d2ba396 !3525 Fix a bug for Parameter
Merge pull request !3525 from hewei/fix_parameter_bug
2020-07-27 17:17:16 +08:00
He Wei a6db29b11b Fix a bug for Parameter
1. Parameter's init_data() should have no effect if default_input already set;
2. This bug is introduced by 'decouple ParamValue from python';
3. An unit test case is added to ensure the right init_data() behavior.
2020-07-27 15:32:08 +08:00
Xiaoda Zhang 9097b36950 add resnet50 testcases for gpu 2020-07-27 15:22:30 +08:00
mindspore-ci-bot 568da0d510 !3425 fix avgpoolgrad
Merge pull request !3425 from fangzehua/avgpool
2020-07-27 14:15:29 +08:00
anzhengqi 081d876438 remove-log 2020-07-27 11:14:38 +08:00
fangzehua 86dd0c583a fix avgpool grad 2020-07-27 11:06:32 +08:00
lirongzhen1 51796aa624 fix sparse feature bug for auto parallel 2020-07-27 10:44:49 +08:00
mindspore-ci-bot 295038d346 !3324 add reduce_any op for vm
Merge pull request !3324 from fangzehua/reduce_any
2020-07-27 10:38:57 +08:00
mindspore-ci-bot 9c06a564d1 !2983 Dataset Tensor class cleanup
Merge pull request !2983 from h.farahat/tensor_class
2020-07-25 20:59:13 +08:00
qianlong bf87b1d1fb fix cache op core dump 2020-07-25 18:37:02 +08:00
yangzhenzhang 6a6e2bd271 add tile op 2020-07-25 11:42:06 +08:00
kingfo 73ea9b7855 fix mix precesion operator issue 2020-07-25 09:40:50 +08:00
mindspore-ci-bot 0a2980ca74 !3440 [MD]Fix Segementation Falut when SentencepieceTokenizer Op before zipOp and ConcatOp
Merge pull request !3440 from xulei/sentence_piece0715
2020-07-25 09:19:34 +08:00
hesham adfbc891d3 - Add checks and testing for empty tensors
- cleanup work on createTensor and Tensor's constructors
2020-07-24 17:23:18 -04:00
mindspore-ci-bot 06ed9ffd6a !3183 Remove files on test fail for test_minddataset*.py
Merge pull request !3183 from tony_liu2/master
2020-07-24 23:47:29 +08:00
xulei2020 0af6d75761 add code 2020-07-24 19:51:27 +08:00
mindspore-ci-bot b1fae868ba !3404 add sparse api docs
Merge pull request !3404 from riemann_penn/add_sparse_api_docs
2020-07-24 17:54:23 +08:00
panyifeng 963bd67a60 add sparse api docs 2020-07-24 15:40:46 +08:00
qianlong d28c63b6c0 fix diff workers disallow cache 2020-07-24 15:30:00 +08:00
buxue e9ca893431 remove ut test_expand_dims_grad 2020-07-24 15:15:41 +08:00
mindspore-ci-bot 2d973c9597 !3161 Set output value for dynamic graph.
Merge pull request !3161 from flywind/output
2020-07-23 21:14:08 +08:00
mindspore-ci-bot 366dd44ca8 !3371 support call super when class define in test_case
Merge pull request !3371 from zhangbuxue/support_call_super_when_class_define_in_test_case
2020-07-23 20:11:25 +08:00
panyifeng 8a89f003eb fix sparse related issues 2020-07-23 19:05:53 +08:00
buxue b812c1a17a support call super when class define in test_case. 2020-07-23 18:30:30 +08:00
kpy 570da089a8 set output value for dynamic graph 2020-07-23 17:05:47 +08:00
mindspore-ci-bot 684ff4f46b !3160 Rewrite tensor's __bool__ for pynative mode
Merge pull request !3160 from Simson/push-to-opensource
2020-07-23 16:55:49 +08:00
simson 5f77fbdd75 Rewrite tensor's __bool__ for pynative mode 2020-07-23 16:51:46 +08:00
mindspore-ci-bot 0a84b63fc3 !3305 modify the vgg16/lstm path to offical/{cv/npl}
Merge pull request !3305 from caojian05/ms_master_dev
2020-07-23 16:01:42 +08:00
fangzehua 228a959cc7 add reduce any op for vm 2020-07-23 14:43:53 +08:00
mindspore-ci-bot 48711414fc !3356 [common]Refine code & Add ToAbstruct for `FuncGraph`, `MetaFuncGraph` `Primitive`
Merge pull request !3356 from vlne-v1/add_to_abstract_for_function
2020-07-23 14:33:58 +08:00
Wei Luning 484d7f10c8 refine code* refine code in bert model* add ToAbstruct for `FuncGraph`, `MetaFuncGraph` `Primitive`* remove partial hard code in spec for poly* remove any in data convert cache 2020-07-23 12:43:37 +08:00
mindspore-ci-bot 7f1ccc5f3b !3311 add sparse feature test cases for auto parallel
Merge pull request !3311 from lirongzhen1/master
2020-07-23 11:35:49 +08:00
mindspore-ci-bot 21a5f06e93 !3328 Add testcases
Merge pull request !3328 from shenwei41/sw_master
2020-07-23 09:57:22 +08:00
tony_liu2 1f4251a440 add try to minddataset python tests to remove files on fail
delete unrelated file

change finally to except else

fix spacing alignment

fix indentation

fix indentation

fix indentation

add fix to new test case

add if main for pytest

fix spacing
2020-07-22 16:34:10 -04:00
mindspore-ci-bot 859fe6bc41 !3342 C++ API Support for Skip Dataset Op plus UTs
Merge pull request !3342 from cathwong/ckw_c_api_skip
2020-07-23 04:28:38 +08:00
mindspore-ci-bot df1300d9cb !3294 Refactor opt/pre passes
Merge pull request !3294 from nsyca/removal_pass
2020-07-23 02:51:31 +08:00
Cathy Wong 8921a6099c C++ API Support for Skip Dataset Op and UTs 2020-07-22 13:21:35 -04:00
mindspore-ci-bot c24122bb55 !3303 fix validator that checks the vocab_size is positive in vocab.from_file
Merge pull request !3303 from ZiruiWu/fix_vocab_validator
2020-07-23 00:49:29 +08:00
Nat Sutyanyong 9fb1904ed8 Refactoring opt/pre 2020-07-22 11:13:42 -04:00
buxue f84b055244 add check for implicit conversion when scalar is not number and bool. 2020-07-22 20:55:19 +08:00
shenwei41 4eaa396ca7 Add testcases 2020-07-22 20:21:19 +08:00
CaoJian f9fdb52373 modify the vgg16/lstm path to offical/{cv/npl} 2020-07-22 19:25:27 +08:00
mindspore-ci-bot bc20de741a !3315 restore reshape ut
Merge pull request !3315 from yao_yf/restore_auto_parallel_reshape_ut
2020-07-22 16:23:29 +08:00
yao_yf 1d3a06a3b0 recover reshape ut 2020-07-22 14:30:12 +08:00
lirongzhen1 5d63c60135 add sparse feature test cases for auto parallel 2020-07-22 14:27:12 +08:00
Amir Lashkari 6f186aafa0 Update Python UA op, AutoContrast Op and UT
Updated Validators.py

Fixed UA UT

Fixed UA UT

Fixed PyLint Errors

Added aditional changes

remove old golden AutoContrast UT file

updated Autocontrast python UT

Added golden files

Fixed issue

fixed UT
2020-07-22 14:16:16 +08:00
Zirui Wu 40ea84ae81 fix from_file validator minor error, 1 line change
add test case
2020-07-21 23:17:26 -04:00
mindspore-ci-bot 8da91ca3cf !3237 support call the parent class function
Merge pull request !3237 from zhangbuxue/support_call_the_parent_class_construct_function
2020-07-21 22:13:04 +08:00
mindspore-ci-bot c451146b14 !3255 Added cpp Equalize op to vision api
Merge pull request !3255 from alashkari/cpp_ops
2020-07-21 21:56:41 +08:00
mindspore-ci-bot 925172664b !3230 add bprop for sparse_tensor
Merge pull request !3230 from riemann_penn/add_bprop_for_sparse_tensor
2020-07-21 21:47:53 +08:00
mindspore-ci-bot cf4353f728 !3220 Add random normal op at MindSpore front-end
Merge pull request !3220 from peixu_ren/custom_gpu
2020-07-21 20:33:52 +08:00
mindspore-ci-bot 37cc6e2628 !3175 add ScatterNdAdd ScatterNdSub ScatterNonAliasingAdd ops
Merge pull request !3175 from fangzehua/scatter_add_vm
2020-07-21 20:26:07 +08:00
panyifeng 4d4e23fd9e Add bprop for sparse_tensor 2020-07-21 19:40:35 +08:00
buxue 073507a5e0 support call the parent class function 2020-07-21 16:38:11 +08:00
panfengfeng 5aad4bdfbf change size 2020-07-21 14:56:55 +08:00
xiefangqi 64a6ed56de fix annotation 2020-07-21 12:04:56 +08:00
mindspore-ci-bot ad651f38bf !3124 [MD] error occur when using numpy types
Merge pull request !3124 from liyong126/fix_numpy_generic
2020-07-21 11:44:34 +08:00
fangzehua dde74b227c add 5 vm op 2020-07-21 11:34:10 +08:00
peixu_ren 9b45018dfd Add random normal op at MindSpore front-end 2020-07-20 23:31:30 -04:00
mindspore-ci-bot bfc18704d5 !3254 [MD]Add more strict upper bounds to CenterCropOp and RandomCropWithBboxOp
Merge pull request !3254 from nhussain/padding_upperbound
2020-07-21 10:18:56 +08:00
mindspore-ci-bot 2e4bb93a1e !3250 [quant]bug fixes when export geir
Merge pull request !3250 from vlne-v1/quant_export_geir_biasadd_after_depth_wise
2020-07-21 09:35:28 +08:00
mindspore-ci-bot 718431429c !2755 unform learning rate behavior in optimizers
Merge pull request !2755 from wangnan39/uniform_lr_behavior_in_optimizers
2020-07-21 09:13:14 +08:00
mindspore-ci-bot 0e27dccbcf !3093 VOCDataset output change to multi-columns
Merge pull request !3093 from xiefangqi/md_voc_multi_columns
2020-07-21 09:12:01 +08:00
liyong 28ebd73096 fix bug when int or float is numpy type 2020-07-21 09:07:29 +08:00
Amir Lashkari 572750cd40 Added cpp Equalize op
adding missed files

Fixed Errors

fixed bugs

fixed bugs

fixed bugs

fixed bugs

fixed bugs

Updated Python UT for Equalize op

Added cpp Equalize op

adding missed files

Fixed Errors

fixed bugs

fixed bugs

fixed bugs

fixed bugs

fixed bugs

Updated Python UT for Equalize op

Fixed comment style

update files

deleted files

added files

added image_utils.h

Fixed PyLint and CPPLint Errors

updated tensor_op.h
2020-07-20 21:03:26 -04:00
nhussain b064cbab5d fix upper bound 2020-07-20 15:26:49 -04:00
mindspore-ci-bot b091f74c23 !3016 Add CSV dataset loader
Merge pull request !3016 from jiangzhiwen/dataset/csv
2020-07-20 22:14:52 +08:00
Wei Luning 7d5c9d52bc fix geir export bugs 2020-07-20 21:32:57 +08:00
wangnan39@huawei.com 082433183d uniform learning_rate behavior of optimizers 2020-07-20 21:09:20 +08:00
jiangzhiwen 2f506b7985 CSV dataset loader 2020-07-20 20:22:08 +08:00
mindspore-ci-bot fa7fa8a162 !3234 [MD] fix bug when save tfrecord data
Merge pull request !3234 from liyong126/fix_save_tfrecod
2020-07-20 20:18:12 +08:00
liyong f521532a06 fix field_name probelem from tfrecord to mindrecord 2020-07-20 17:12:21 +08:00
xulei2020 18b519ae0f add sentence piece 2020-07-20 15:50:35 +08:00
xiefangqi fbd9e3d402 vocdataset output multi-columns 2020-07-20 14:40:30 +08:00
anzhengqi 008b91b2a1 inject epoch ctrl op in the execution tree and send eos at the end of epoch 2020-07-20 13:02:47 +08:00
mindspore-ci-bot 6f8863b65d !3198 synchronize latest Ascend software suite 18 Jul 2020, and merging branches
Merge pull request !3198 from yanghaoran/code_sync_0718
2020-07-19 14:14:45 +08:00
yanghaoran 859acc6d2a synchronize latest Ascend software suite 18 Jul 2020, and merging branches 2020-07-18 21:09:55 +08:00
mindspore-ci-bot 05de773775 !3209 Fix bug about output of AddNGrad.
Merge pull request !3209 from liuxiao93/AddN
2020-07-18 19:56:31 +08:00
mindspore-ci-bot ffb7040c3c !3200 [clean]remove loop_can_unroll flag, clean some other python code
Merge pull request !3200 from vlne-v1/remove_loop_can_unroll
2020-07-18 19:44:29 +08:00
liuxiao93 8705545bcd Fix bug about output of AddNGrad. 2020-07-18 18:47:52 +08:00
Wei Luning f362503d57 support throw attribute error from c++ 2020-07-18 17:54:26 +08:00
Wei Luning 88e864a4a3 remove loop can unroll flag, clean some python usage 2020-07-18 17:41:34 +08:00
mindspore-ci-bot e8b26dbdaa !3151 Fix verification of BatchNorm2d input is 4D.
Merge pull request !3151 from liuxiao93/fix-BatchNorm2d
2020-07-18 16:22:04 +08:00
mindspore-ci-bot 4945d34a41 !3133 [MD] fix num_sample in distributed sampler
Merge pull request !3133 from liyong126/md_num_of_samples
2020-07-18 15:36:33 +08:00
liuxiao93 75881e5f2f check input of BatchNorm is 4D. 2020-07-18 14:53:11 +08:00
mindspore-ci-bot 4a19e6b8cb !3114 add coo_tensor
Merge pull request !3114 from riemann_penn/coo_tensor
2020-07-18 10:24:58 +08:00
mindspore-ci-bot a84092e89d !3102 [MD] Add additional parameter checks in RandomCropWithBBoxOp and RandomResizeWithBbox
Merge pull request !3102 from nhussain/random_crop_fixes
2020-07-17 22:33:50 +08:00
panyifeng 5a10383cc3 add coo_tensor 2020-07-17 18:53:03 +08:00
liyong e2ea1fa0df activate num_samples in distributed samplers 2020-07-17 16:55:57 +08:00
wangnan39@huawei.com 86889c59cb optimizer adapt IndexedSlices 2020-07-17 15:57:50 +08:00
mindspore-ci-bot 56f70e910c !3080 [parser]remove redundant phi
Merge pull request !3080 from vlne-v1/remove-redundant-phi
2020-07-17 15:19:41 +08:00
mindspore-ci-bot 6dd99ee35d !3130 [dump]support dump quant in binary format file
Merge pull request !3130 from vlne-v1/quant_op_depthwise
2020-07-17 14:25:57 +08:00
mindspore-ci-bot a10001cb58 !3152 remove 4 auto parallel reshape ut
Merge pull request !3152 from yao_yf/reshape_ut_remove
2020-07-17 14:12:24 +08:00
Wei Luning 28d1d37085 End at validate when export. 2020-07-17 12:44:12 +08:00
Wei Luning acbccea644 remove redundant phi 2020-07-17 11:46:09 +08:00
mindspore-ci-bot 1bcbbb08d6 !2973 [MD] Add implementation of SlidingWindow TensorOp, c++ & python
Merge pull request !2973 from luoyang/update
2020-07-17 11:06:35 +08:00
yao_yf abebb2004b remove 4 reshape ut 2020-07-17 10:56:24 +08:00
mindspore-ci-bot edec821c50 !2876 set reshape operator no redistribution for auto parallel
Merge pull request !2876 from lirongzhen1/master
2020-07-17 10:01:06 +08:00
mindspore-ci-bot 1a518e1cff !3144 [MD] Fix ResizeOp behaviour
Merge pull request !3144 from nhussain/dataset_check
2020-07-17 06:04:14 +08:00
nhussain c984b0fc88 fix size tuple 2020-07-16 17:02:34 -04:00
mindspore-ci-bot 35c0f1d2e6 !3143 Add python UT to MnistDataset op
Merge pull request !3143 from TinaMengtingZhang/dataset-op-ut-mnist
2020-07-17 04:40:26 +08:00
tinazhang ab37e87d7a adding Mnist python ut coverage 2020-07-16 14:14:20 -04:00
islam_amin 5647889c0d Added AutoContrast Op 2020-07-16 13:09:52 -04:00
mindspore-ci-bot 37e8439c0a !3077 supporting cpp invert operation
Merge pull request !3077 from ava/invert
2020-07-17 01:04:43 +08:00
mindspore-ci-bot c07a8d2033 !3137 Cleanup dataset UT: Remove deprecated save_and_check
Merge pull request !3137 from cathwong/ckw_dataset_ut_cleanup7
2020-07-17 00:45:56 +08:00
nhussain 5871ba8a05 more validator fixes 2020-07-16 10:10:36 -04:00
mindspore-ci-bot 74bbfa3cf6 !3095 modify the limit of loss scale
Merge pull request !3095 from Simson/push-to-opensource
2020-07-16 21:30:54 +08:00
lirongzhen1 c1eba79b83 set reshape redistribution strategy attribute to no redistribution 2020-07-16 21:20:46 +08:00
mindspore-ci-bot eeba046115 !3050 Add TBE ops Tan/TruncateDiv/TruncateMod for VM.
Merge pull request !3050 from liuxiao93/Tan/TruncateDiv/TruncateMOd
2020-07-16 20:36:50 +08:00
changzherui f4cb445ea8 syn code for 0715 2020-07-16 17:18:21 +08:00
mindspore-ci-bot 526770e09e !3049 [dataset] add save operator in dataset
Merge pull request !3049 from liyong126/dataset_save_op
2020-07-16 16:59:38 +08:00
simson 177e18f3f4 modify the limit of loss scale 2020-07-16 16:44:02 +08:00
mindspore-ci-bot 6335598fff !3111 Rollback to Normal that operates on D
Merge pull request !3111 from peixu_ren/custom_gpu
2020-07-16 16:09:24 +08:00
liyong bc676fe250 save op in minddataset 2020-07-16 15:10:48 +08:00
peixu_ren 1feca960aa Rollback to Normal on D 2020-07-16 00:49:23 -03:00
Ziyan 39f08eb7dd enable optimizer parallel 2020-07-16 11:47:41 +08:00
avakh 35c3a63701 support cpp invert operation 2020-07-15 23:45:45 -04:00
mindspore-ci-bot 7976d77593 !3104 fix mindspore dtype equal
Merge pull request !3104 from fary86/fix_mstype_eq
2020-07-16 10:26:34 +08:00
fary86 595767b4b5 Fix bug of mindspore dtype equal 2020-07-16 09:06:55 +08:00
Cathy Wong 04eb4f89c7 Cleanup dataset UT: Replace save_and_check 2020-07-15 20:47:31 -04:00
Zirui Wu d233c54139 implemented cpp random choice, apply and compos
python part of random ops

added random select sub policy

validators added

comments added, remaining issues addressed

add more python test cases

fix ci

fix CI

fix order of include files

addr review cmts

addr review cmts

reorg file

fix compile err

address review cmts

address review cmts
2020-07-15 13:39:10 -04:00
YangLuo 4136892a3e add SlidingWindow Op 2020-07-15 19:55:33 +08:00
mindspore-ci-bot 3e691e54f5 !3071 change ValueError to TypeError for enumerate start
Merge pull request !3071 from zhangbuxue/change_ValueError_to_TypeError_for_enumerate_start
2020-07-15 15:42:22 +08:00
mindspore-ci-bot bacbb26e3b !3062 fix valuenode simplify
Merge pull request !3062 from riemann_penn/fix_value_node_simplify
2020-07-15 14:42:49 +08:00
mindspore-ci-bot 45ad430af2 !3048 support use valuelist or valuetuple of primitives
Merge pull request !3048 from amongo/SupportPrimitiveList
2020-07-15 10:45:36 +08:00
buxue 60b0ded440 change ValueError to TypeError for enumerate start 2020-07-15 10:39:03 +08:00
panyifeng 394178569e fix valuenode simplify 2020-07-15 10:09:30 +08:00
mindspore-ci-bot 683920d1c8 !2987 Add random normal op at MindSpore front-end
Merge pull request !2987 from peixu_ren/custom_gpu2
2020-07-15 09:39:58 +08:00
huangdongrun ee2039fbba add support for value sequence of primitve 2020-07-15 09:24:39 +08:00
mindspore-ci-bot bc0a53cfb1 !3030 minddata support ps-lite feature
Merge pull request !3030 from xiefangqi/md_support-pslite
2020-07-15 09:11:37 +08:00
mindspore-ci-bot ba0143402c !3067 Cleanup dataset UT: Remove unneeded tf data files and tests
Merge pull request !3067 from cathwong/ckw_dataset_ut_cleanup6
2020-07-15 04:44:52 +08:00
mindspore-ci-bot 219a716eae !3066 fix some batch's get_dataset_size and some text validator inconsistency
Merge pull request !3066 from ZiruiWu/fix_validator
2020-07-15 03:11:31 +08:00
mindspore-ci-bot bed93a9ead !3039 [Dataset Python UT] adding coverage to Cifar Op and update test dataset
Merge pull request !3039 from TinaMengtingZhang/dataset-op-ut-cifar
2020-07-15 02:10:52 +08:00
Zirui Wu 63185cb20f fix some validators errors
address review cmts

addr review cmts
2020-07-14 14:04:40 -04:00
Cathy Wong ae1ed327ba Cleanup dataset UT: Remove unneeded data files and tests 2020-07-14 12:24:54 -04:00
nhussain 05b2a57d2a fix validation errors, and fix try catch error tests 2020-07-14 11:50:00 -04:00
tinazhang 340d98a4d1 added test case to cifar_op
update cifar10 dataset
fixing missing error handling code in validator
2020-07-14 11:22:38 -04:00
peixu_ren ac561f2956 Refactor random normal op 2020-07-14 11:35:19 -03:00
peixu_ren 20ca96c62b Add random normal MindSpore interface 2020-07-14 11:19:12 -03:00
xiefangqi add19a591c md support ps-lite 2020-07-14 21:46:11 +08:00
liuxiao93 c772b9e291 Add TBE ops Tan/TruncateDiv/TruncateMod for VM. 2020-07-14 16:27:01 +08:00
mindspore-ci-bot 8871f06f42 !2963 Add UT for python pass
Merge pull request !2963 from BowenK/python_pass_clean
2020-07-14 11:48:03 +08:00
BowenK f267a105b8 Add Python Pass UT 2020-07-14 10:18:22 +08:00
mindspore-ci-bot bfc3065fc7 !3025 [AutoParallel]Add embedding look up op
Merge pull request !3025 from lichen/add_embedding_look_up_op
2020-07-14 09:59:01 +08:00
mindspore-ci-bot 48654be14d !3040 BoundingBoxAugment op fix ratio
Merge pull request !3040 from islam_amin/bounding_box_augment_bugs
2020-07-14 09:36:34 +08:00
mindspore-ci-bot 69ce4bf2b2 !2970 Del mindspore/model_zoo
Merge pull request !2970 from panbingao/master
2020-07-14 08:57:31 +08:00
islam_amin 56da3b0ae1 Fixing ratio bug with BoundingBoxAugment 2020-07-13 18:11:19 -04:00
mindspore-ci-bot eadcb341e1 !2891 CacheOp phase 1
Merge pull request !2891 from Jamie/CacheOp_dev
2020-07-13 23:56:57 +08:00
Jesse Lee 7c1bc5192b Initial Drop of CacheOp Phase I 2020-07-13 10:18:53 -04:00
lichenever cde5cc2bd2 add_embedding_look_up 2020-07-13 22:00:55 +08:00
mindspore-ci-bot c465ea3269 !3031 fix context mode and device target dependency issue
Merge pull request !3031 from wangqiuliang/fix-tensor-bool-operation
2020-07-13 19:52:32 +08:00
mindspore-ci-bot 2f27c4e3e8 !2807 Apply indexed_slices
Merge pull request !2807 from riemann_penn/apply_indexed_slices
2020-07-13 17:08:25 +08:00
kingfo 8863dfd677 fix context mode and device_target dependency issue 2020-07-13 16:06:00 +08:00
panyifeng 44e74ad5aa Apply indexed_slices 2020-07-13 15:36:25 +08:00
mindspore-ci-bot 8f15d1f608 !2791 convert subgraph
Merge pull request !2791 from changzherui/subgraph
2020-07-13 15:06:15 +08:00
changzherui a27ce973ad convert subgraph 2020-07-13 12:31:22 +08:00
mindspore-ci-bot d3ec05d716 !2943 [quant]export bug fix
Merge pull request !2943 from vlne-v1/quant_export_bugfix
2020-07-13 10:02:18 +08:00
mindspore-ci-bot d925c52bb1 !2875 add grad all in pynative
Merge pull request !2875 from wangqiuliang/add-grad-all-in-pynative
2020-07-13 09:30:52 +08:00
mindspore-ci-bot 7cdd5581f9 !2914 make AbstractRef can join with AbstractTensor
Merge pull request !2914 from xychow/fix-abstractref-join
2020-07-13 09:26:19 +08:00
mindspore-ci-bot 6284c42a76 !2941 MD tokenizer support output offsets
Merge pull request !2941 from xiefangqi/md_add_offsets_feature
2020-07-11 14:36:00 +08:00
mindspore-ci-bot ebc6b92c27 !3002 add arg check for enumerate
Merge pull request !3002 from zhangbuxue/add_arg_check_for_enumerate
2020-07-11 12:31:30 +08:00
xiefangqi 47060631e5 add offsets feature to tokenizer 2020-07-11 11:20:02 +08:00
mindspore-ci-bot 541456044d !2934 GraphData support random_walk and get_edge_feature
Merge pull request !2934 from heleiwang/gnn_july
2020-07-11 10:26:17 +08:00
mindspore-ci-bot 2f565f4c20 !2776 Update API of dataset.text.lookup
Merge pull request !2776 from ZiruiWu/master
2020-07-10 22:18:48 +08:00
kingfo add3778a61 add grad all in pynative mode 2020-07-10 17:49:54 +08:00
panbingao 45dbc8bf04 Move model_zoo.resnet.py 2020-07-10 17:36:34 +08:00
heleiwang 7a046a1d70 support get_edge_feature 2020-07-10 17:05:23 +08:00
buxue cf797d3bf2 add arg check for enumerate 2020-07-10 16:58:38 +08:00
mindspore-ci-bot 87722b9e09 !2912 Update ssim and add msssim
Merge pull request !2912 from fanglei/msssim
2020-07-10 15:30:11 +08:00
Wei Luning b522368161 fix bug of quant export without input fakequant. 2020-07-10 14:11:45 +08:00
mindspore-ci-bot bccfa48509 !2980 Prevent empty column names
Merge pull request !2980 from nhussain/empty_column_b
2020-07-10 11:19:37 +08:00
leilei_snow 9b21420b3e update SSIM loss, add MSSSIM loss feature; add their ut testcases. 2020-07-10 11:11:48 +08:00
mindspore-ci-bot 00368b3683 !2972 Improving implicit type conversion
Merge pull request !2972 from zhangbuxue/Improving_implicit_type_conversion
2020-07-10 09:36:49 +08:00
Zirui Wu 7b15e5a742 rework on lookup
add test caser

fix ci

address review cmts

ci

addr review cmt

fix typo

address review cmts

add 2 more test cases

cpplint fix

addr cpplint

addr ci

fix tst case err

fix doc str
2020-07-09 17:10:18 -04:00
nhussain 2c7fd248f8 fixes for PR-2908: avoid empty strings for column names 2020-07-09 11:44:33 -04:00
buxue 4df1edf5b3 Improving implicit type conversion 2020-07-09 21:38:00 +08:00
wuyongkang e12255ad84 Add MixedPrecisionCast for KeywordArg 2020-07-09 19:10:57 +08:00
buxue 4e832b2309 support implicit type conversion for pynative mode 2020-07-09 15:41:41 +08:00
mindspore-ci-bot 323a80c620 !2765 fix large for loop segment fault
Merge pull request !2765 from fary86/fix_large_for_loop
2020-07-09 09:43:03 +08:00
mindspore-ci-bot 5fc6dcfb65 !2915 [Auto parallel] Rewrite EmbeddingLookup
Merge pull request !2915 from Xiaoda/8-move-embeddinglookup-external
2020-07-09 09:40:34 +08:00
nhussain 6c37ea3be0 fix validators
fixed random_apply tests

fix validators

fixed random_apply tests

fix engine validation
2020-07-08 16:40:33 -04:00
mindspore-ci-bot 915ddd25dd !2892 gnn random walk pr 1977 comment follow up
Merge pull request !2892 from tony_liu2/master
2020-07-09 03:35:55 +08:00
mindspore-ci-bot e2f51ccec8 !2922 updating the python ut tests based on floating point bounding boxes
Merge pull request !2922 from ava/float_change
2020-07-08 22:39:42 +08:00
Xiaoda Zhang fc906f7f58 move embeddinglookup to external 2020-07-08 16:27:40 +08:00
mindspore-ci-bot dffb76a0a9 !2605 High level abstraction of mathematical distributions
Merge pull request !2605 from XunDeng/pp_poc_v3
2020-07-08 12:44:52 +08:00
mindspore-ci-bot 403c1db8ce !2869 fix print bug
Merge pull request !2869 from jinyaohui/master
2020-07-08 09:40:29 +08:00
zhousiyi 9ad7c652a2 make abstractref can join with abstracttensor 2020-07-08 01:28:15 +00:00
peixu_ren bef1fc7f19 add sample functions in normal and bermoulli distributions 2020-07-07 18:13:58 -04:00
avakh 421b80bf8f updating python unit tests based on floating point bounding boxes + adding coco dataset in unit tests 2020-07-07 18:05:49 -04:00
tony_liu2 14899a1410 fix gnn random walk pr 1977 comments
add fix to random resize decode crop test case

fix pylint issues
2020-07-07 17:32:08 -04:00
Xun Deng 0aa26c1815 add high level abstract class Distribution and two example class:
Bernoulli and Normal
2020-07-07 17:29:42 -04:00
mindspore-ci-bot 9ba937b1af !2920 Updating 3 BBox AugOps for Float + Common Files for BBox Float Support - (VertFlip/RandomCrop/RandomResizeCrop)
Merge pull request !2920 from danishnxt/AugOps-M1-Python
2020-07-08 05:18:58 +08:00
mindspore-ci-bot c9929fd8a1 !2900 Update BoundingBoxAugment and RandomHorizontalFlipWithBBox to use float
Merge pull request !2900 from islam_amin/object_ops_cc_float
2020-07-08 03:53:39 +08:00
mindspore-ci-bot 92d2011b8b !2924 [Dataset Python UT] Disable md5 random perspective test
Merge pull request !2924 from TinaMengtingZhang/redo-skip-md5-random-perspective-test
2020-07-08 03:52:21 +08:00
Danish Farid 78c370f72a First Commit - New Infrastructure - Python UT tests + Common Aug Files
fix accidental change overwrite

fix 2

updated inits from 0 to 0.0 for float

improvd python ut comments

updated macro
2020-07-07 14:50:34 -04:00
tinazhang 8455f957ac disable md5 random perspective test case 2020-07-07 14:21:06 -04:00
jinyaohui c7f6527e92 fix print file bug 2020-07-07 21:05:17 +08:00
mindspore-ci-bot faa1084bd8 !2865 asymmetric param row split support for GatherV2
Merge pull request !2865 from yihuaijie/dev
2020-07-07 20:04:32 +08:00
mindspore-ci-bot 5baae2ebd0 !2884 Add TBE op UnsortedSegmentProd for VM.
Merge pull request !2884 from liuxiao93/UnsortedSegmentProd
2020-07-07 17:12:43 +08:00
mindspore-ci-bot bd60db5c11 !2811 support vm for ParallelConcat
Merge pull request !2811 from jiangjinsheng/vm_parallel_concat
2020-07-07 16:23:46 +08:00
liuxiao93 2b0ecfd2b1 Add TBE op UnsortedSegmentProd for VM. 2020-07-07 15:35:00 +08:00
Yi Huaijie cae254f4df asymmetric row split support for GatherV2 2020-07-07 14:36:07 +08:00
islam_amin dfc3409f67 Update RandomHorizontalFlipWithBBox and BoundingBouxAugment C++ Ops to use floats 2020-07-06 23:49:21 -04:00
mindspore-ci-bot 751b5e6fac !2897 Modify VOCDataset output float dtype bbox
Merge pull request !2897 from xiefangqi/md_voc_support_float
2020-07-07 11:11:19 +08:00
xiefangqi 62d55fdbce vocdataset support float bbox 2020-07-07 10:07:42 +08:00
jiangjinsheng a3565a75d1 vm for ParallelConcat 2020-07-06 18:35:12 +08:00
changzherui 17da929b82 syn code 0706 2020-07-06 17:51:17 +08:00
mindspore-ci-bot 3d377c51b9 !2839 support vm for PopulationCount
Merge pull request !2839 from jiangjinsheng/vm_population_count
2020-07-06 17:32:08 +08:00
mindspore-ci-bot aef002ad6c !2809 support Python built-in function 'enumerate'
Merge pull request !2809 from zhangbuxue/support_Python_built-in_functions_enumerate
2020-07-06 09:38:47 +08:00
leilei_snow 5cccfbc61b Add TransShape Operator. 2020-07-05 03:34:35 +00:00
mindspore-ci-bot b5066e81ee !2308 Unskip md5 python UT case for RandomPerspective
Merge pull request !2308 from TinaMengtingZhang/unskip-case-random-perspective
2020-07-04 03:37:58 +08:00
tinazhang dc03019200 unskip md5 testcase for RandomPerspective 2020-07-03 13:10:13 -04:00
Danish Farid 5a9673ee6f fix_annotate bug fix 2020-07-03 11:17:13 -04:00
jiangjinsheng ee7aef98df vm for PopulationCount 2020-07-03 17:47:11 +08:00
mindspore-ci-bot 860a32632e !2671 vm for MaxPoolGradGrad, MaxPoolGradGradWithArgmax
Merge pull request !2671 from jiangjinsheng/vm_max_pool_ext2
2020-07-03 17:40:54 +08:00
buxue cfa41733d6 support Python built-in function 'enumerate' 2020-07-03 14:42:10 +08:00
fary86 e17469bf42 Fix bug of large for loop 2020-07-03 11:15:41 +08:00
mindspore-ci-bot 2cd9649b9e !2810 Add operator adapting in ME for Softsign
Merge pull request !2810 from zhangzheng/softsign
2020-07-03 09:31:59 +08:00
mindspore-ci-bot 391f5e44e4 !2832 check types for optional boolean parameters
Merge pull request !2832 from Peilin/invalid-type-bucket-check
2020-07-03 09:20:28 +08:00
Hoai Linh Tran 6bd66e7953 Fix memcpy calls. Add ut tests for arithmetic_simplify. Split long arithmetic_simplify.h to arithmetic_simplify.cc
Code checking
2020-07-02 17:51:08 -04:00
peilin-wang 29aa589972 added check for invalid type for boolean args 2020-07-02 16:49:09 -04:00
mindspore-ci-bot c1a53d3f68 !2822 Fix bool tensor problem
Merge pull request !2822 from hewei/fix_bool_tensor
2020-07-02 20:41:27 +08:00
He Wei a0623e1528 Fix bool type tensor problem
Problem: Create 'uint8' type tensor from float data raise RuntimeError;
Fix:  Use same internal data type for 'uint8' and 'bool' tensor and allows
convert float data to bool tensor.
2020-07-02 19:22:35 +08:00
panbingao 1e51414f1b Adapting operator Softsign in ME 2020-07-02 03:31:25 -04:00
liuxiao ddedc41613 Add TBE operators SparseApplyFtrlV2\SparseApplyAdagradV2 for VM. 2020-07-02 12:00:58 +08:00
mindspore-ci-bot f1a9a7ceb1 !2718 fix quantization aware training auto create graph bug
Merge pull request !2718 from chenzhongming/master
2020-07-02 09:57:30 +08:00
mindspore-ci-bot 622b97f3b6 !2787 Add op ScatterMul ScatterDiv vm
Merge pull request !2787 from zhaozhenlong/op/scatter-div-mul-vm
2020-07-01 20:41:03 +08:00
jiangjinsheng ce4e15b0b3 vm for MaxPoolExt2,MaxPoolGradGrad,MaxPoolGradGradWithArgmax 2020-07-01 17:05:11 +08:00
yangzhenzhang 2351845ede delete shape validation in initializer 2020-07-01 16:01:31 +08:00
zhaozhenlong 8d9939eaa4 ScatterMull and ScatterDiv vm 2020-07-01 15:49:24 +08:00
mindspore-ci-bot 4eafb21ea8 !2638 support vm for mod
Merge pull request !2638 from jiangjinsheng/vm_mod
2020-07-01 14:26:07 +08:00
mindspore-ci-bot 30fc1bd0c3 !2747 refactor StridedSlice op
Merge pull request !2747 from zhangbuxue/refactor_the_StridedSlice_op
2020-07-01 12:04:11 +08:00
buxue be771aa9e4 refactor StridedSlice op 2020-07-01 11:08:36 +08:00
jiangjinsheng ffd0352162 vm for mod 2020-07-01 10:16:47 +08:00
mindspore-ci-bot d1fa90a3d9 !2769 fix get loss error and NoneType error cause by _proceesor_specified_data
Merge pull request !2769 from ougongchang/fix_nonetype
2020-07-01 10:01:05 +08:00
mindspore-ci-bot ea475637a1 !2720 fix assign used in while loop
Merge pull request !2720 from xychow/fix-assign-in-while
2020-07-01 09:16:13 +08:00
mindspore-ci-bot 9377e432d2 !2766 get default value if num_parallel_workers is None
Merge pull request !2766 from yanghaitao/yht_serialize_num_parallel_worker
2020-06-30 23:11:44 +08:00
ougongchang cd868aea52 fix get loss error and NoneType error cause by _proceesor_specified_data
fix get loss error when it not a scalar and fix process specified data
failed when the action is False, and collect_specified_data parameter is
not None
2020-06-30 21:11:06 +08:00
yanghaitao 365c901ee0 get default value if num_parallel_worker is None 2020-06-30 21:10:37 +08:00
mindspore-ci-bot 3a89f93cc5 !2699 add ScatterMax ScatterMin ScatterSub vm
Merge pull request !2699 from zhaozhenlong/op/scatter-max-vm
2020-06-30 20:10:17 +08:00
mindspore-ci-bot fe82d82155 !1904 Add IndexedSlices
Merge pull request !1904 from riemann_penn/add_indexed_slices
2020-06-30 19:03:12 +08:00
mindspore-ci-bot 2fadbb1d04 !2743 add more ut and st for SummaryCollector
Merge pull request !2743 from ougongchang/summary_collector_ut
2020-06-30 18:58:03 +08:00
panyifeng d6635bbbe2 Add IndexedSlices 2020-06-30 17:38:24 +08:00
chenzomi 1089c908a9 cherry-pick r0.5 to master for quantizaiton aware training 2020-06-30 17:23:08 +08:00
ougongchang 3dc6f6f2d9 add more ut and st for SummaryCollector
Has fixed collecting optimizer error when mode is eval
2020-06-30 17:02:03 +08:00
zhousiyi d5255fe311 fix assign used in while 2020-06-30 08:22:27 +00:00
guohongzilong 652093642e change order param same as group params 2020-06-30 14:56:55 +08:00
mindspore-ci-bot d08a89ab87 !2737 makes 0 an invaild bucket size
Merge pull request !2737 from Peilin/zero-input-bucket-check
2020-06-30 05:33:41 +08:00
mindspore-ci-bot 1227719cdd !2603 [Dataset Python UT] Cleanup mse and md5 validation
Merge pull request !2603 from TinaMengtingZhang/I1LTCA-mse-check-cleanup
2020-06-30 04:46:49 +08:00
peilin-wang 9468b49e28 bucket_batch_sizes must be strictly positive, 0 is not a valid batch size 2020-06-29 16:34:39 -04:00
mindspore-ci-bot c70e6987ba !2624 Fix config test
Merge pull request !2624 from EricZ/fix_config_test
2020-06-30 01:11:12 +08:00
mindspore-ci-bot 9b4399480a !2321 Connector throughput performance metric
Merge pull request !2321 from Alexey_Shevlyakov/connector_throughput_dev
2020-06-29 23:54:42 +08:00
tinazhang66 5cd3136355 remove local defined mse and add missing mse/md5 validation 2020-06-29 11:51:07 -04:00
mindspore-ci-bot 51c4f4a499 !2683 Add TBE operaters ApplyAddSign\ApplyPowerSign\ApplyGradientDescent\ApplyProximalGradientDescent for VM.
Merge pull request !2683 from liuxiao/ops-for-VM
2020-06-29 21:30:17 +08:00
mindspore-ci-bot 5b8957a884 !2717 dataset: some parameter check for NumpySlices and num_sharads
Merge pull request !2717 from ms_yan/check_param
2020-06-29 20:02:36 +08:00
ms_yan 7fa0d9e7e4 add paramter check for numpyslices and num_shards 2020-06-29 19:12:52 +08:00
jinyaohui dd5fba1db9 add notice 2020-06-29 17:39:25 +08:00
zhaozhenlong a8654ac3b5 add ScatterMax ScatterMin ScatterSub for vm 2020-06-29 17:21:08 +08:00
jin-xiulang 8dff818a18 Add Laplace random operator. 2020-06-29 15:51:59 +08:00
mindspore-ci-bot 6fb5538117 !2661 add support dtype for scatter_add vm
Merge pull request !2661 from zhaozhenlong/op/scatter-add
2020-06-29 11:46:49 +08:00
liuxiao 2097a0e90a Add optimizer operators for VM. 2020-06-29 11:35:45 +08:00
mindspore-ci-bot 99d4289251 !248 Add 5 random ops
Merge pull request !248 from peixu_ren/custom_aicpu
2020-06-29 09:15:22 +08:00
peixu_ren c5f72582dc Added 5 random ops 2020-06-28 12:34:02 -03:00
mindspore-ci-bot 9be17e2a59 !2668 support weight decay for sparse optimizer
Merge pull request !2668 from wangnan39/support_weight_decay_for_sparse_optimizer
2020-06-28 22:24:45 +08:00
mindspore-ci-bot 0ab7fd98ea !2654 fix: tfrecord to mindrecord para check
Merge pull request !2654 from guozhijian/fix_tfrecord_to_mr_para_check
2020-06-28 22:06:50 +08:00
mindspore-ci-bot 32a2d5d21c !2629 get monitor sampling interval from json file
Merge pull request !2629 from yanghaitao/yht_sampling_interval
2020-06-28 20:05:05 +08:00
mindspore-ci-bot 363489d00f !2580 BasicTokenizer do not case fold on preserved words
Merge pull request !2580 from qianlong21st/fix_basic_tokenizer
2020-06-28 19:36:28 +08:00
mindspore-ci-bot db6c4bf784 !2640 [MD] fix minddata error message
Merge pull request !2640 from liyong126/minddataset_fix_errmsg
2020-06-28 19:36:23 +08:00
wangnan39@huawei.com 172728a6a6 support weight decay for sparse optimizer 2020-06-28 17:49:03 +08:00
jonyguo 3450c35d9b fix: tfrecord to mindrecord parameter check 2020-06-28 17:48:52 +08:00
mindspore-ci-bot bc30576ac9 !2631 Add ExpandDims to whitelist
Merge pull request !2631 from amongo/FixExpandDimsOps
2020-06-28 17:40:20 +08:00
zhaozhenlong d55c0f6679 complement scatter add support dtype 2020-06-28 16:51:53 +08:00
qianlong cae77c0c22 BasicTokenizer not case fold on preserverd words 2020-06-28 16:28:00 +08:00
liyong 68e2097897 fix split erroer message 2020-06-28 15:47:10 +08:00
zhaozhenlong 15580f8f6e limit ssim input img type to fp32 and fp16 2020-06-28 15:36:30 +08:00
zhaozhenlong 71d33b087e limit ssim input img type to fp32 and fp16 2020-06-28 15:35:07 +08:00
yanghaitao fd701b8504 set monitor sampling interval through json file 2020-06-28 15:18:21 +08:00
huangdongrun 96b38f72b2 add ExpandDims whitelist
add comment for control_depend
2020-06-28 11:29:16 +08:00
Eric a4f5802924 Added Fix for test config 2020-06-27 15:20:48 -04:00
mindspore-ci-bot 87213648bc !2612 delete pynative lenet test
Merge pull request !2612 from changzherui/del_test
2020-06-27 18:38:36 +08:00
changzherui 9e83337e2f delete pynative lenet_model test 2020-06-27 15:33:27 +08:00
Ziyan 0925e35252 enable optimizer parallel with broadcast 2020-06-27 14:36:17 +08:00
mindspore-ci-bot df795daf75 !2562 [bug]when multi times print same thing, do not merge in cse
Merge pull request !2562 from vlne-v1/I1LHCF-print-multi-times-and-same-str
2020-06-27 07:26:52 +08:00
Alexey Shevlyakov 698abf75fc Connector throughput + PerfData + CyclicArray 2020-06-26 14:45:01 -04:00
mindspore-ci-bot a1b17bd2e2 !2593 python unit tests for randomResizeWithBBox and ResizeWithBBox
Merge pull request !2593 from ava/python_ut_tests
2020-06-27 02:31:31 +08:00
avakh 1e869146e9 applying comments removing VOC 2020-06-26 12:39:48 -04:00
Cathy Wong 277aba5326 dataset: Fixup docs; remove pylint disabled messages in UT 2020-06-26 12:26:41 -04:00
mindspore-ci-bot e11c953225 !2587 Implementing Python UTs for BoundingBoxAugment and RandomHorizontalFlipWithBBox
Merge pull request !2587 from imaaamin/object_ops_ut
2020-06-26 00:43:31 +08:00
mindspore-ci-bot 067592ccf9 !2590 Updated Python UTs for RandomVerticalFlipWithBBox, RandomCropWithBBox and RandomResizedCropWithBBox
Merge pull request !2590 from danishnxt/AugOps2
2020-06-25 23:40:34 +08:00
islam_amin 0f58f0338e updating ut for RandomHorizontalFlipWithBBox and BBoxAugment 2020-06-25 11:35:22 -04:00
mindspore-ci-bot b0a10c26a4 !2532 adding random-resize-with-bbox-op and resize-with-bbox-op
Merge pull request !2532 from ava/NNNewMaster
2020-06-25 20:42:00 +08:00
Danish Farid 3d1ecaaeb5 updated UT test for Python (3) AugOps with BBox - MD5 checks + imrpv comments 2020-06-25 03:19:14 -04:00
avakh 587e260236 addressing comments 2020-06-24 18:54:47 -04:00
Jamie Nisbet c22eac743d subtree creation in python apis
updates

fix

fix cpplint

fix
2020-06-24 17:17:05 -04:00
mindspore-ci-bot a12f9614d4 !2533 Fixing testVOC2012 dataset by merging with testVOC2012_2 + moving BBoxOp testing functions to util + new check in Bounding_Box_check
Merge pull request !2533 from danishnxt/AugOpsD2
2020-06-25 01:39:08 +08:00
Wei Luning ef13a4b6fb adjust cse code when op has side effect. 2020-06-25 00:46:01 +08:00
Danish Farid a8f392ca42 updated test util file + new BoundingBoxCheck + fixed VOCDataset annotations
Style Error fix

fixed PyLint problem

reverting testVOC2012 due to CI break for existing test

reverting testVOC2012 due to CI break for existing test-2

updated old error messages to confirm with global standard

addressing PR 2355 Comments - 1

addressing PR 2355 Comments - 2

addressing PR 2355 Comments - 3
2020-06-24 12:41:41 -04:00
mindspore-ci-bot 67d664d7dd !2511 add mod and floordiv opration for tensor
Merge pull request !2511 from wangqiuliang/add-tensor-mod-operation
2020-06-24 18:09:59 +08:00
kingfo 078738adc5 add tensor mod & floordiv operation 2020-06-24 16:47:23 +08:00
huangdongrun 9d3c9c69fe modify map to C.Map() 2020-06-24 15:07:33 +08:00
mindspore-ci-bot a9dac909d9 !2535 Fix pynative indexing
Merge pull request !2535 from amongo/FixPynativeTensorIndexing
2020-06-24 14:41:11 +08:00
mindspore-ci-bot 087779b7d4 !2517 checkpoint add model_type
Merge pull request !2517 from chenzhongming/quant
2020-06-24 14:32:33 +08:00
mindspore-ci-bot 0a368494db !2499 HostAllGather and HostReduceScatter change to internal interface
Merge pull request !2499 from yihuaijie/master
2020-06-24 14:32:31 +08:00
chenzomi d3f9b80066 checkpoint add model_type 2020-06-24 12:31:08 +08:00
huangdongrun bc0455eaff * fix bool index
* change slice setitem to mixed procedure
* add testcase for slice assignment
2020-06-24 11:18:20 +08:00
mindspore-ci-bot 363a232cbc !2512 [quant]The top level add op prefix_name check error
Merge pull request !2512 from vlne-v1/I1LJMR-quant-the-top-level-add-op-prefix_name-check-error
2020-06-24 09:42:29 +08:00
mindspore-ci-bot c22c865c4a !1950 [front]add `has_effect` direct to target construct method not cell object
Merge pull request !1950 from vlne-v1/move-flags-to-construct
2020-06-24 09:35:24 +08:00
yanghaoran 21c381b366 sync from mindspore to incubator 2020-06-23 21:05:50 +08:00
Wei Luning dcd5773f64 fix bug in quant deploy export 2020-06-23 20:34:44 +08:00
Wei Luning 8f56528f8c add flags on function 2020-06-23 20:22:07 +08:00
mindspore-ci-bot 0478b7d191 !2303 optimize LARS interface
Merge pull request !2303 from gziyan/modify_lars_interface
2020-06-23 20:05:47 +08:00
Yi Huaijie 2eb739de6e change HostAllGather and HostReduceScatter to internal interface 2020-06-23 16:56:04 +08:00
jiangjinsheng a1e148cb4d vm for LRN and LRNGrad 2020-06-23 15:47:15 +08:00
mindspore-ci-bot 367e5765f4 !237 fix issue ssim ksize check
Merge pull request !237 from zhaozhenlong/fix-issue-ssim-ksize-check-incu
2020-06-23 14:18:54 +08:00
Ziyan 41ddc153a6 modify lars interface 2020-06-23 11:23:28 +08:00
mindspore-ci-bot ac78ac9700 !2297 add vm support for operators include MatrixDiag, MatrixDiagPart etc
Merge pull request !2297 from jiangjinsheng/vm_matrixdiag
2020-06-23 11:03:02 +08:00
mindspore-ci-bot 8e5d8a1cf7 !2305 Enhance callback module and strongly check if callbacks is list or not
Merge pull request !2305 from 李鸿章/callback
2020-06-23 10:49:45 +08:00
mindspore-ci-bot 73f440a54d !2418 add pretrain for lstm & vgg16 and remove lstm/vgg16/googlenet from directory 'mindspore/model_zoo'
Merge pull request !2418 from caojian05/ms_master_dev
2020-06-22 22:51:19 +08:00
wuxuejian 92880788f3 add aicpu embeddinglookup
move embeddinglookup to the internal
2020-06-22 21:33:16 +08:00
jiangjinsheng 017ff492af vm for MatrixDiag,MatrixDiagPart.MatrixSetDiag 2020-06-22 20:24:51 +08:00
Li Hongzhang 4c0d12fd63 enhance callback module and strongly check callbacks is list or not 2020-06-22 18:54:40 +08:00
mindspore-ci-bot 932b7649e7 !2241 Adapting operator named AccumulateNV2
Merge pull request !2241 from zhangzheng/accumulate
2020-06-22 17:17:47 +08:00
caojian05 deb9694f63 add pretrain for lstm & vgg16 and remove lstm/vgg16/googlenet from directory 'mindspore/model_zoo' 2020-06-22 17:17:10 +08:00
mindspore-ci-bot 55d5ded228 !2306 [Dataset] Code review & improve quality
Merge pull request !2306 from luoyang/pylint
2020-06-22 16:01:02 +08:00
mindspore-ci-bot e9e4442dcb !2413 [Auto parallel] Check 'CAST' from optimizers
Merge pull request !2413 from Xiaoda/7-auto-parallel-check-optimizer-ops
2020-06-22 14:20:32 +08:00
YangLuo 4e3bfcf4c9 !2306 [Dataset] Code review & improve quality 2020-06-22 14:01:22 +08:00
zhaozhenlong 5888d745bf fix ssim filter size check 2020-06-22 11:02:29 +08:00
zhangz0911gm 4ac1876237 Adapting AccumulateNV2 2020-06-21 22:49:09 -04:00
jiangjinsheng e71599b5ca vm for lin_space 2020-06-22 10:32:03 +08:00
xutianchun 2bfc86f5b7 Add aicpu op: ReverseSequence, CropAndResize, CTCLoss 2020-06-22 09:31:30 +08:00
mindspore-ci-bot beb436f457 !2398 Bug in Slice when multiple rows are used
Merge pull request !2398 from h.farahat/slice_bug
2020-06-22 09:23:44 +08:00
mindspore-ci-bot a9c309da4c !2404 [Dataset]rename input variable name to children and output variable to parent
Merge pull request !2404 from xulei/input_output
2020-06-22 09:22:33 +08:00
mindspore-ci-bot 1ea38eb60c !2375 Add Python Tokenizer
Merge pull request !2375 from h.farahat/python_tokenizer
2020-06-22 09:20:33 +08:00
Xiaoda Zhang 3ff6e336c6 check cast from optimizer in auto-parallel 2020-06-22 09:10:22 +08:00
liyong 2412ee09ce fix distributedSampler reshuffle and fix random_device failed 2020-06-21 18:23:47 +08:00
mindspore-ci-bot 78a8bc302d !2380 Fix CocoDataset issue
Merge pull request !2380 from xiefangqi/xfq_fix_coco_issue_01
2020-06-20 18:41:07 +08:00
xulei2020 3b71bd0d5d rename input to children, output to parent 2020-06-20 16:40:10 +08:00
hesham 68030e6a4b Slice Bug 2020-06-20 00:47:13 -04:00
qianlong 980ddd32a2 change output of WordpieceTokenizer and BertTokenizer to 1-D string tensors 2020-06-20 12:08:43 +08:00
mindspore-ci-bot e8639ad91e !2347 support multi param for tuple grad
Merge pull request !2347 from riemann_penn/support_multi_param_for_tuple_grad
2020-06-20 10:30:37 +08:00
xiefangqi 5703a10b8b fix CocoDataset issue 2020-06-20 09:51:10 +08:00
mindspore-ci-bot bbf69912be !2363 fix TextFildDataset and CLUEDataset does not support to_device
Merge pull request !2363 from yanghaitao/yht_fix_textfiledataset
2020-06-20 09:47:01 +08:00
mindspore-ci-bot 634bfd3508 !2259 add Normal op
Merge pull request !2259 from pkuliuliu/master
2020-06-20 09:33:38 +08:00
mindspore-ci-bot d137cefa79 !2372 Cleanup work for BERT special ops
Merge pull request !2372 from h.farahat/cleanup_0619
2020-06-20 09:25:56 +08:00
mindspore-ci-bot 2f9c6ec8bc !2337 aware quantization training auto create graph
Merge pull request !2337 from chenzhongming/master
2020-06-20 09:23:14 +08:00
pkuliuliu acf46bafbb add Normal op 2020-06-20 09:23:13 +08:00
mindspore-ci-bot 9514b52a23 !2147 Add a callback named SummaryCollector and delete SummaryStep callback
Merge pull request !2147 from ougongchang/master
2020-06-20 09:19:10 +08:00
panyifeng 3c2057297e support multi param for tuple grad 2020-06-20 08:39:42 +08:00
hesham e981c67acd Python Tokenizer
!38 Synchronize with latest Ascend software suite 17 Jun 2020
Merge pull request !38 from yanghaoran/master
2020-06-19 19:57:11 -04:00
hesham 674415f7be Cleanup work for Concate, Mask, Slice, PadEnd and TruncatePair 2020-06-19 19:11:50 -04:00
mindspore-ci-bot bc4b1c2460 !2373 Comments + improved casting/parameters + UT tests for 3 AugOps (Augmentation Ops RandomCropWithBBox, Random Vertical FlipWithWithBBox and Random CropAndResizeWithWithBBox)
Merge pull request !2373 from danishnxt/AugOpsD1
2020-06-20 05:19:03 +08:00
mindspore-ci-bot 7bdcc319b2 !2325 Addressing comments from PR2314
Merge pull request !2325 from imaaamin/object_ops_pr2
2020-06-20 04:50:56 +08:00
Danish Farid 6442a85b75 comments added, ptrs to consts, UT tests for BBOps
updated comments for 3 BB AugOps

addressing comments, void -> status, macros added, fixed test cmt

changed types -> value, fixed ut test funcs, grammar

bug type fix

fixed condition in tests for viz
2020-06-19 16:09:16 -04:00
islam_amin edc42c5b85 addressed comments from reviews 2020-06-19 14:53:46 -04:00
nhussain d89101b95f add missing test 2020-06-19 11:44:41 -04:00
chenzomi c268c88220 aware quantization training auto create graph 2020-06-19 22:01:16 +08:00
ougongchang 939cd29d7e Add a callback named SummaryCollector and delete SummaryStep callback
I added a SummaryCollector to help users automatically collect information
such as the network, loss, learning rate and so on, making it easier to collect this information.

It also can collect train lineage and eval lineage information which is
collected by TrainLineage Callback and EvalLineage Callback in
MindInsight.

I also add some UT for SummaryCollect to keep the code correct.
2020-06-19 21:07:55 +08:00
mindspore-ci-bot 21c67eddd5 !1897 save print data to file
Merge pull request !1897 from jinyaohui/print
2020-06-19 17:50:34 +08:00
yanghaitao 9f336bb735 fix TextFileDataset and CLUEDataset failed with to_device 2020-06-19 17:28:05 +08:00
jinyaohui ac23a179bf save print data to file 2020-06-19 17:25:22 +08:00
mindspore-ci-bot 2d6d3cc86b !2339 support catch IndexError in C++
Merge pull request !2339 from zhangbuxue/support_catch_index_error_in_c++
2020-06-19 15:28:18 +08:00
mindspore-ci-bot 8867c67d61 !1935 Summary callback as collector for summary and lineage
Merge pull request !1935 from 李鸿章/policy_writer
2020-06-19 14:53:14 +08:00
mindspore-ci-bot 9958bc479a !2161 [qat]Export network from quantization aware network to deploy
Merge pull request !2161 from vlne-v1/I1IZV3-quant-infer
2020-06-19 14:16:00 +08:00
mindspore-ci-bot 06b511ca94 !2301 add sparse proximal ada grad optimizer
Merge pull request !2301 from lilei/sparse_proximal_ada_grad
2020-06-19 14:07:50 +08:00
Li Hongzhang 0921c1e538 enhance the SummaryRecord with set_mode and add_value 2020-06-19 13:03:00 +08:00
buxue 2c9ca199ad support catch IndexError in C++ 2020-06-19 12:13:18 +08:00
Wei Luning 1d77bf86a9 Exports MindSpore quant predict model to deploy with GEIR 2020-06-19 10:21:35 +08:00
lilei 497067d7b2 add sparse proximal ada grad optimizer 2020-06-19 09:56:28 +08:00
peilinwang 1e36b0649f remove graphengine changes
remove graphengine changes

concat op

Truncate Pair

concat_op

remove graph engine changes

ToNumberOp implementation almost done

ToNumberOp complete

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

merge conflicts
2020-06-18 20:07:35 -04:00
hesham 11826fb256 DuplicateOp 2020-06-18 19:47:27 -04:00