like20
/
mindspore2022
forked from huawei/mindspore2022
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
19,824 Commits 18 Branches 0 Tags 564 MiB
Commit Graph

123 Commits

Author SHA1 Message Date
RobinGrosman a0e75b845a Increase default level of parallelism in mindddata pipeline to 8. 
Adjust memory usage to not increase as parallelism increases.  it will
stay at same level it would be with 4 parallelism
 2021-03-10 18:38:11 -08:00
alex-yuyue b54e01bfb4 Tensor op decoupling stage 2 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2021-01-14 11:51:16 -05:00
Xiao Tianci 0659473535 add TruncateSequencePair, ToNumber C++ API and enable three test cases 2020-12-08 11:12:16 +08:00
Cathy Wong e5f62013f4 dataset Python UT: Add Sampler Chain Tests, with get_dataset_size 2020-11-17 15:24:44 -05:00
alex-yuyue 913a49f3af Add support for C++ API: GetNumClasses 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2020-10-27 16:26:51 -04:00
Eric 7e21648e16 Added Album empty string tensor support 2020-10-20 16:37:37 -04:00
mindspore-ci-bot 7707bb8540 !7439 [MD] Add YUV to BGR , Split, extractChannel ops 
Merge pull request !7439 from xulei/lite_test0905
 2020-10-20 19:36:19 +08:00
xulei2020 442cee15ad add yuv420sp to bgr, split and extractchannel 2020-10-20 15:05:25 +08:00
Eric 359ad19884 Added float_array support 
Added fix, tests to come
 2020-10-15 00:18:30 -04:00
mindspore-ci-bot 2f3add4acd !6301 [MD] Combine c++ and python ops in map 
Merge pull request !6301 from nhussain/c_py_compose
 2020-09-24 23:10:47 +08:00
nhussain fda9462682 embed python compose op 
Leaf ops do self-reset.

embed python compose op

add implicit compose op

more tests
 2020-09-21 11:24:55 -04:00
yanghaitao1 4ff4c17632 fix get_dataset_size in CelebADataset when usage is not all 2020-09-19 02:16:29 -04:00
Lixia Chen b5b333726f Leaf ops do self-reset. 2020-09-14 09:48:14 -04:00
liyong 16147669a6 fix num_samples in concatDataset 2020-09-12 15:06:18 +08:00
mindspore-ci-bot 2dfb2f3578 !6009 Add Affine transformation ut for Lite Dataset 
Merge pull request !6009 from jiangzhiwen/lite/affine_ut
 2020-09-11 09:57:56 +08:00
nhussain 92e99ff224 change map calls 2020-09-10 10:25:05 -04:00
jiangzhiwen d4ce668b9b add Affine ut 2020-09-10 21:50:56 +08:00
mindspore-ci-bot dff02cc282 !5188 rename image files in imagefolder 
Merge pull request !5188 from tony_liu2/alt
 2020-09-01 11:16:30 +08:00
Cathy Wong 7f6782be2a dataset fixes: Update OneHot API docs; fixup Python UTs 2020-08-31 15:04:26 -04:00
tony_liu2 5e4c314130 rename dataset dir and image files 
change references to use path original

revert folder name

revert graphengine
 2020-08-27 16:49:23 -04:00
islam_amin 94a4a3f20b changing affine and posterize apis 2020-08-26 10:51:54 -04:00
Eric c79db93c48 Initial commit for album 
Added linter fix for album dataset

Added testDataset

Adding signature

Added JsonDataset example API

Example dataset

Resolving format

More fixing

Refactor

Small fix

Added compiling album dataset

Running tests

Added linter fix #1

Passing UT

Added dataset API

Addressing clang

Clang part 2

Fixing pass

Fixed tree check

lint fix

Added lint fix part 2
 2020-08-22 11:07:10 -04:00
jiangzhiwen 39df25f803 c++ api for CSV Dataset 2020-08-19 16:02:11 +08:00
nhussain 738ae2c78d change api to use std_vector 
try to display image
 2020-08-18 15:41:21 -04:00
islam_amin 979111d0ef Added Posterize Op 2020-08-18 13:55:47 -04:00
mindspore-ci-bot 113ff6ca24 !4367 CutMixBatch Augmentation Op 
Merge pull request !4367 from MahdiRahmaniHanzaki/cutmix
 2020-08-18 03:27:33 +08:00
mahdi 3ecc53fb4e Added CutMix 2020-08-17 13:01:47 -04:00
Alexey Shevlyakov 8526d5414d RandomColor 2020-08-13 16:10:21 -04:00
avakh 477528de7f random sharpness cpp op support 2020-08-11 15:30:40 -04:00
nhussain 7766efd58e add files 2020-08-11 11:54:14 -04:00
islam_amin e52d85ba9d Added RandomAffine Op 2020-08-10 17:52:50 -04:00
Mahdi 1896950ae5 Added Mixup 2020-08-07 17:47:16 -04:00
islam_amin 48ec178e77 Fixing AutoContrast/Equalize Bug 2020-07-23 14:32:37 -04:00
Amir Lashkari 6f186aafa0 Update Python UA op, AutoContrast Op and UT 
Updated Validators.py

Fixed UA UT

Fixed UA UT

Fixed PyLint Errors

Added aditional changes

remove old golden AutoContrast UT file

updated Autocontrast python UT

Added golden files

Fixed issue

fixed UT
 2020-07-22 14:16:16 +08:00
mindspore-ci-bot c451146b14 !3255 Added cpp Equalize op to vision api 
Merge pull request !3255 from alashkari/cpp_ops
 2020-07-21 21:56:41 +08:00
mindspore-ci-bot 0e27dccbcf !3093 VOCDataset output change to multi-columns 
Merge pull request !3093 from xiefangqi/md_voc_multi_columns
 2020-07-21 09:12:01 +08:00
Amir Lashkari 572750cd40 Added cpp Equalize op 
adding missed files

Fixed Errors

fixed bugs

fixed bugs

fixed bugs

fixed bugs

fixed bugs

Updated Python UT for Equalize op

Added cpp Equalize op

adding missed files

Fixed Errors

fixed bugs

fixed bugs

fixed bugs

fixed bugs

fixed bugs

Updated Python UT for Equalize op

Fixed comment style

update files

deleted files

added files

added image_utils.h

Fixed PyLint and CPPLint Errors

updated tensor_op.h
 2020-07-20 21:03:26 -04:00
jiangzhiwen 2f506b7985 CSV dataset loader 2020-07-20 20:22:08 +08:00
xulei2020 18b519ae0f add sentence piece 2020-07-20 15:50:35 +08:00
xiefangqi fbd9e3d402 vocdataset output multi-columns 2020-07-20 14:40:30 +08:00
mindspore-ci-bot 1a518e1cff !3144 [MD] Fix ResizeOp behaviour 
Merge pull request !3144 from nhussain/dataset_check
 2020-07-17 06:04:14 +08:00
nhussain c984b0fc88 fix size tuple 2020-07-16 17:02:34 -04:00
islam_amin 5647889c0d Added AutoContrast Op 2020-07-16 13:09:52 -04:00
mindspore-ci-bot 37e8439c0a !3077 supporting cpp invert operation 
Merge pull request !3077 from ava/invert
 2020-07-17 01:04:43 +08:00
avakh 35c3a63701 support cpp invert operation 2020-07-15 23:45:45 -04:00
Cathy Wong 04eb4f89c7 Cleanup dataset UT: Replace save_and_check 2020-07-15 20:47:31 -04:00
mindspore-ci-bot ba0143402c !3067 Cleanup dataset UT: Remove unneeded tf data files and tests 
Merge pull request !3067 from cathwong/ckw_dataset_ut_cleanup6
 2020-07-15 04:44:52 +08:00
Cathy Wong ae1ed327ba Cleanup dataset UT: Remove unneeded data files and tests 2020-07-14 12:24:54 -04:00
tinazhang 340d98a4d1 added test case to cifar_op 
update cifar10 dataset
fixing missing error handling code in validator
 2020-07-14 11:22:38 -04:00
mindspore-ci-bot 48654be14d !3040 BoundingBoxAugment op fix ratio 
Merge pull request !3040 from islam_amin/bounding_box_augment_bugs
 2020-07-14 09:36:34 +08:00