Commit Graph

345 Commits

Author SHA1 Message Date
mindspore-ci-bot 27e51c5a63 !3553 Unify np array comparisons
Merge pull request !3553 from tony_liu2/staging
2020-07-31 21:39:31 +08:00
dengyutao 388e43f7cb delete parameter block_reader for MindDataset 2020-07-31 11:30:05 +08:00
xiefangqi 6017b050ac add generatordataset support split 2020-07-30 15:51:28 +08:00
tony_liu2 269b477684 use np.testing.assert instead of asserting
fix line lengths

fix spacing

reverse a few changes
2020-07-29 14:53:01 -04:00
mindspore-ci-bot d06da1d270 !3603 Check that the number columns of names and default matches
Merge pull request !3603 from jiangzhiwen/fix_column_names_exceeded
2020-07-29 11:40:06 +08:00
jiangzhiwen 2cc6b5cb52 fix number of columns not match 2020-07-29 09:19:33 +08:00
guansongsong 1906ed1be8 fix cache description again 2020-07-28 13:26:29 +08:00
guansongsong b6529b9096 fix cache description 2020-07-28 13:03:06 +08:00
guansongsong 620d951e5e Merge branch 'ql/fix_cache_core' of https://gitee.com/qianlong21st/mindspore into ql/fix_cache_core 2020-07-28 11:37:06 +08:00
mindspore-ci-bot 9c06a564d1 !2983 Dataset Tensor class cleanup
Merge pull request !2983 from h.farahat/tensor_class
2020-07-25 20:59:13 +08:00
qianlong bf87b1d1fb fix cache op core dump 2020-07-25 18:37:02 +08:00
mindspore-ci-bot 0a2980ca74 !3440 [MD]Fix Segementation Falut when SentencepieceTokenizer Op before zipOp and ConcatOp
Merge pull request !3440 from xulei/sentence_piece0715
2020-07-25 09:19:34 +08:00
hesham adfbc891d3 - Add checks and testing for empty tensors
- cleanup work on createTensor and Tensor's constructors
2020-07-24 17:23:18 -04:00
mindspore-ci-bot 06ed9ffd6a !3183 Remove files on test fail for test_minddataset*.py
Merge pull request !3183 from tony_liu2/master
2020-07-24 23:47:29 +08:00
xulei2020 0af6d75761 add code 2020-07-24 19:51:27 +08:00
qianlong d28c63b6c0 fix diff workers disallow cache 2020-07-24 15:30:00 +08:00
mindspore-ci-bot 21a5f06e93 !3328 Add testcases
Merge pull request !3328 from shenwei41/sw_master
2020-07-23 09:57:22 +08:00
tony_liu2 1f4251a440 add try to minddataset python tests to remove files on fail
delete unrelated file

change finally to except else

fix spacing alignment

fix indentation

fix indentation

fix indentation

add fix to new test case

add if main for pytest

fix spacing
2020-07-22 16:34:10 -04:00
mindspore-ci-bot 859fe6bc41 !3342 C++ API Support for Skip Dataset Op plus UTs
Merge pull request !3342 from cathwong/ckw_c_api_skip
2020-07-23 04:28:38 +08:00
mindspore-ci-bot df1300d9cb !3294 Refactor opt/pre passes
Merge pull request !3294 from nsyca/removal_pass
2020-07-23 02:51:31 +08:00
Cathy Wong 8921a6099c C++ API Support for Skip Dataset Op and UTs 2020-07-22 13:21:35 -04:00
mindspore-ci-bot c24122bb55 !3303 fix validator that checks the vocab_size is positive in vocab.from_file
Merge pull request !3303 from ZiruiWu/fix_vocab_validator
2020-07-23 00:49:29 +08:00
Nat Sutyanyong 9fb1904ed8 Refactoring opt/pre 2020-07-22 11:13:42 -04:00
shenwei41 4eaa396ca7 Add testcases 2020-07-22 20:21:19 +08:00
Amir Lashkari 6f186aafa0 Update Python UA op, AutoContrast Op and UT
Updated Validators.py

Fixed UA UT

Fixed UA UT

Fixed PyLint Errors

Added aditional changes

remove old golden AutoContrast UT file

updated Autocontrast python UT

Added golden files

Fixed issue

fixed UT
2020-07-22 14:16:16 +08:00
Zirui Wu 40ea84ae81 fix from_file validator minor error, 1 line change
add test case
2020-07-21 23:17:26 -04:00
mindspore-ci-bot c451146b14 !3255 Added cpp Equalize op to vision api
Merge pull request !3255 from alashkari/cpp_ops
2020-07-21 21:56:41 +08:00
panfengfeng 5aad4bdfbf change size 2020-07-21 14:56:55 +08:00
xiefangqi 64a6ed56de fix annotation 2020-07-21 12:04:56 +08:00
mindspore-ci-bot ad651f38bf !3124 [MD] error occur when using numpy types
Merge pull request !3124 from liyong126/fix_numpy_generic
2020-07-21 11:44:34 +08:00
mindspore-ci-bot bfc18704d5 !3254 [MD]Add more strict upper bounds to CenterCropOp and RandomCropWithBboxOp
Merge pull request !3254 from nhussain/padding_upperbound
2020-07-21 10:18:56 +08:00
mindspore-ci-bot 0e27dccbcf !3093 VOCDataset output change to multi-columns
Merge pull request !3093 from xiefangqi/md_voc_multi_columns
2020-07-21 09:12:01 +08:00
liyong 28ebd73096 fix bug when int or float is numpy type 2020-07-21 09:07:29 +08:00
Amir Lashkari 572750cd40 Added cpp Equalize op
adding missed files

Fixed Errors

fixed bugs

fixed bugs

fixed bugs

fixed bugs

fixed bugs

Updated Python UT for Equalize op

Added cpp Equalize op

adding missed files

Fixed Errors

fixed bugs

fixed bugs

fixed bugs

fixed bugs

fixed bugs

Updated Python UT for Equalize op

Fixed comment style

update files

deleted files

added files

added image_utils.h

Fixed PyLint and CPPLint Errors

updated tensor_op.h
2020-07-20 21:03:26 -04:00
nhussain b064cbab5d fix upper bound 2020-07-20 15:26:49 -04:00
mindspore-ci-bot b091f74c23 !3016 Add CSV dataset loader
Merge pull request !3016 from jiangzhiwen/dataset/csv
2020-07-20 22:14:52 +08:00
jiangzhiwen 2f506b7985 CSV dataset loader 2020-07-20 20:22:08 +08:00
mindspore-ci-bot fa7fa8a162 !3234 [MD] fix bug when save tfrecord data
Merge pull request !3234 from liyong126/fix_save_tfrecod
2020-07-20 20:18:12 +08:00
liyong f521532a06 fix field_name probelem from tfrecord to mindrecord 2020-07-20 17:12:21 +08:00
xulei2020 18b519ae0f add sentence piece 2020-07-20 15:50:35 +08:00
xiefangqi fbd9e3d402 vocdataset output multi-columns 2020-07-20 14:40:30 +08:00
anzhengqi 008b91b2a1 inject epoch ctrl op in the execution tree and send eos at the end of epoch 2020-07-20 13:02:47 +08:00
mindspore-ci-bot 4945d34a41 !3133 [MD] fix num_sample in distributed sampler
Merge pull request !3133 from liyong126/md_num_of_samples
2020-07-18 15:36:33 +08:00
mindspore-ci-bot a84092e89d !3102 [MD] Add additional parameter checks in RandomCropWithBBoxOp and RandomResizeWithBbox
Merge pull request !3102 from nhussain/random_crop_fixes
2020-07-17 22:33:50 +08:00
liyong e2ea1fa0df activate num_samples in distributed samplers 2020-07-17 16:55:57 +08:00
mindspore-ci-bot 1bcbbb08d6 !2973 [MD] Add implementation of SlidingWindow TensorOp, c++ & python
Merge pull request !2973 from luoyang/update
2020-07-17 11:06:35 +08:00
mindspore-ci-bot 1a518e1cff !3144 [MD] Fix ResizeOp behaviour
Merge pull request !3144 from nhussain/dataset_check
2020-07-17 06:04:14 +08:00
nhussain c984b0fc88 fix size tuple 2020-07-16 17:02:34 -04:00
mindspore-ci-bot 35c0f1d2e6 !3143 Add python UT to MnistDataset op
Merge pull request !3143 from TinaMengtingZhang/dataset-op-ut-mnist
2020-07-17 04:40:26 +08:00
tinazhang ab37e87d7a adding Mnist python ut coverage 2020-07-16 14:14:20 -04:00