Commit Graph

323 Commits

Author SHA1 Message Date
guansongsong 5b15f40598 Fix a DatasetCache sharing scenario 2020-07-29 17:42:05 +08:00
guansongsong 543b75f366 fix the description of cache 2020-07-28 18:13:51 +08:00
xulei2020 c43bc92d7c add code 2020-07-25 09:39:23 +08:00
Amir Lashkari 6f186aafa0 Update Python UA op, AutoContrast Op and UT
Updated Validators.py

Fixed UA UT

Fixed UA UT

Fixed PyLint Errors

Added aditional changes

remove old golden AutoContrast UT file

updated Autocontrast python UT

Added golden files

Fixed issue

fixed UT
2020-07-22 14:16:16 +08:00
mindspore-ci-bot c451146b14 !3255 Added cpp Equalize op to vision api
Merge pull request !3255 from alashkari/cpp_ops
2020-07-21 21:56:41 +08:00
panfengfeng 5aad4bdfbf change size 2020-07-21 14:56:55 +08:00
xiefangqi 64a6ed56de fix annotation 2020-07-21 12:04:56 +08:00
mindspore-ci-bot ad651f38bf !3124 [MD] error occur when using numpy types
Merge pull request !3124 from liyong126/fix_numpy_generic
2020-07-21 11:44:34 +08:00
mindspore-ci-bot bfc18704d5 !3254 [MD]Add more strict upper bounds to CenterCropOp and RandomCropWithBboxOp
Merge pull request !3254 from nhussain/padding_upperbound
2020-07-21 10:18:56 +08:00
mindspore-ci-bot 0e27dccbcf !3093 VOCDataset output change to multi-columns
Merge pull request !3093 from xiefangqi/md_voc_multi_columns
2020-07-21 09:12:01 +08:00
liyong 28ebd73096 fix bug when int or float is numpy type 2020-07-21 09:07:29 +08:00
Amir Lashkari 572750cd40 Added cpp Equalize op
adding missed files

Fixed Errors

fixed bugs

fixed bugs

fixed bugs

fixed bugs

fixed bugs

Updated Python UT for Equalize op

Added cpp Equalize op

adding missed files

Fixed Errors

fixed bugs

fixed bugs

fixed bugs

fixed bugs

fixed bugs

Updated Python UT for Equalize op

Fixed comment style

update files

deleted files

added files

added image_utils.h

Fixed PyLint and CPPLint Errors

updated tensor_op.h
2020-07-20 21:03:26 -04:00
nhussain b064cbab5d fix upper bound 2020-07-20 15:26:49 -04:00
mindspore-ci-bot b091f74c23 !3016 Add CSV dataset loader
Merge pull request !3016 from jiangzhiwen/dataset/csv
2020-07-20 22:14:52 +08:00
jiangzhiwen 2f506b7985 CSV dataset loader 2020-07-20 20:22:08 +08:00
mindspore-ci-bot fa7fa8a162 !3234 [MD] fix bug when save tfrecord data
Merge pull request !3234 from liyong126/fix_save_tfrecod
2020-07-20 20:18:12 +08:00
liyong f521532a06 fix field_name probelem from tfrecord to mindrecord 2020-07-20 17:12:21 +08:00
xulei2020 18b519ae0f add sentence piece 2020-07-20 15:50:35 +08:00
xiefangqi fbd9e3d402 vocdataset output multi-columns 2020-07-20 14:40:30 +08:00
anzhengqi 008b91b2a1 inject epoch ctrl op in the execution tree and send eos at the end of epoch 2020-07-20 13:02:47 +08:00
mindspore-ci-bot 4945d34a41 !3133 [MD] fix num_sample in distributed sampler
Merge pull request !3133 from liyong126/md_num_of_samples
2020-07-18 15:36:33 +08:00
mindspore-ci-bot a84092e89d !3102 [MD] Add additional parameter checks in RandomCropWithBBoxOp and RandomResizeWithBbox
Merge pull request !3102 from nhussain/random_crop_fixes
2020-07-17 22:33:50 +08:00
liyong e2ea1fa0df activate num_samples in distributed samplers 2020-07-17 16:55:57 +08:00
mindspore-ci-bot 1bcbbb08d6 !2973 [MD] Add implementation of SlidingWindow TensorOp, c++ & python
Merge pull request !2973 from luoyang/update
2020-07-17 11:06:35 +08:00
mindspore-ci-bot 1a518e1cff !3144 [MD] Fix ResizeOp behaviour
Merge pull request !3144 from nhussain/dataset_check
2020-07-17 06:04:14 +08:00
nhussain c984b0fc88 fix size tuple 2020-07-16 17:02:34 -04:00
mindspore-ci-bot 35c0f1d2e6 !3143 Add python UT to MnistDataset op
Merge pull request !3143 from TinaMengtingZhang/dataset-op-ut-mnist
2020-07-17 04:40:26 +08:00
tinazhang ab37e87d7a adding Mnist python ut coverage 2020-07-16 14:14:20 -04:00
islam_amin 5647889c0d Added AutoContrast Op 2020-07-16 13:09:52 -04:00
mindspore-ci-bot 37e8439c0a !3077 supporting cpp invert operation
Merge pull request !3077 from ava/invert
2020-07-17 01:04:43 +08:00
mindspore-ci-bot c07a8d2033 !3137 Cleanup dataset UT: Remove deprecated save_and_check
Merge pull request !3137 from cathwong/ckw_dataset_ut_cleanup7
2020-07-17 00:45:56 +08:00
nhussain 5871ba8a05 more validator fixes 2020-07-16 10:10:36 -04:00
liyong bc676fe250 save op in minddataset 2020-07-16 15:10:48 +08:00
avakh 35c3a63701 support cpp invert operation 2020-07-15 23:45:45 -04:00
Cathy Wong 04eb4f89c7 Cleanup dataset UT: Replace save_and_check 2020-07-15 20:47:31 -04:00
Zirui Wu d233c54139 implemented cpp random choice, apply and compos
python part of random ops

added random select sub policy

validators added

comments added, remaining issues addressed

add more python test cases

fix ci

fix CI

fix order of include files

addr review cmts

addr review cmts

reorg file

fix compile err

address review cmts

address review cmts
2020-07-15 13:39:10 -04:00
YangLuo 4136892a3e add SlidingWindow Op 2020-07-15 19:55:33 +08:00
mindspore-ci-bot bc0a53cfb1 !3030 minddata support ps-lite feature
Merge pull request !3030 from xiefangqi/md_support-pslite
2020-07-15 09:11:37 +08:00
mindspore-ci-bot ba0143402c !3067 Cleanup dataset UT: Remove unneeded tf data files and tests
Merge pull request !3067 from cathwong/ckw_dataset_ut_cleanup6
2020-07-15 04:44:52 +08:00
mindspore-ci-bot 219a716eae !3066 fix some batch's get_dataset_size and some text validator inconsistency
Merge pull request !3066 from ZiruiWu/fix_validator
2020-07-15 03:11:31 +08:00
mindspore-ci-bot bed93a9ead !3039 [Dataset Python UT] adding coverage to Cifar Op and update test dataset
Merge pull request !3039 from TinaMengtingZhang/dataset-op-ut-cifar
2020-07-15 02:10:52 +08:00
Zirui Wu 63185cb20f fix some validators errors
address review cmts

addr review cmts
2020-07-14 14:04:40 -04:00
Cathy Wong ae1ed327ba Cleanup dataset UT: Remove unneeded data files and tests 2020-07-14 12:24:54 -04:00
nhussain 05b2a57d2a fix validation errors, and fix try catch error tests 2020-07-14 11:50:00 -04:00
tinazhang 340d98a4d1 added test case to cifar_op
update cifar10 dataset
fixing missing error handling code in validator
2020-07-14 11:22:38 -04:00
xiefangqi add19a591c md support ps-lite 2020-07-14 21:46:11 +08:00
mindspore-ci-bot 48654be14d !3040 BoundingBoxAugment op fix ratio
Merge pull request !3040 from islam_amin/bounding_box_augment_bugs
2020-07-14 09:36:34 +08:00
islam_amin 56da3b0ae1 Fixing ratio bug with BoundingBoxAugment 2020-07-13 18:11:19 -04:00
Jesse Lee 7c1bc5192b Initial Drop of CacheOp Phase I 2020-07-13 10:18:53 -04:00
mindspore-ci-bot 6284c42a76 !2941 MD tokenizer support output offsets
Merge pull request !2941 from xiefangqi/md_add_offsets_feature
2020-07-11 14:36:00 +08:00