Commit Graph

253 Commits

Author SHA1 Message Date
shenwei41 87b108f4e0 C++ api add Rescale 2020-10-14 10:32:48 +08:00
mindspore-ci-bot 4a077f6341 !7035 Add validation for input image size of affine transformation
Merge pull request !7035 from jiangzhiwen/fix/check_affine_size
2020-10-13 15:03:46 +08:00
jiangzhiwen 197f0cabe0 check affine input size 2020-10-12 17:06:31 +08:00
YangLuo 9e033bbe19 C++ api add TypeCaseOp & RandomCropDecodeResizeOp 2020-10-12 15:13:17 +08:00
Cathy Wong 2aa26d245c C++ API: Move vision ops to new vision files; create transforms namespace 2020-10-08 11:59:58 -04:00
Mahdi e92d4edceb Updated TensorRow conversion 2020-09-29 14:50:44 -04:00
mindspore-ci-bot 0d8015b043 !5300 [MD] Add nD Slice Support
Merge pull request !5300 from nhussain/slice_op
2020-09-25 20:38:19 +08:00
mindspore-ci-bot 70221f5261 !6307 Conversion to and from TensorRow in C++
Merge pull request !6307 from MahdiRahmaniHanzaki/c_func
2020-09-25 04:14:05 +08:00
nhussain 77d507279c first working implementation
add string implementation, can handle partial string slices

finish core implementation, added Index object

fix up the logic

add in new SliceOption object, cleaning up tests
2020-09-24 15:39:28 -04:00
Lixia Chen 983827ec5c Rebase up to 88ded11f59 2020-09-24 14:09:08 -04:00
Mahdi 890598d112 Added TensorRow conversion 2020-09-24 11:12:22 -04:00
yanghaitao1 4ff4c17632 fix get_dataset_size in CelebADataset when usage is not all 2020-09-19 02:16:29 -04:00
luoyang 9064a5f731 add num_row check & fix api distributed sampler, lookup, default value
of usage
2020-09-17 20:31:26 +08:00
xulei2020 85962adffd add code 2020-09-16 17:01:30 +08:00
luoyang 581335453e Change return val of GetNextRow 2020-09-12 14:19:46 +08:00
mindspore-ci-bot a084196300 !6094 Adding input checks to C API
Merge pull request !6094 from EricZ/add_input_check_capi
2020-09-12 09:47:50 +08:00
eric cd5af9472e Added input check 2020-09-11 20:36:12 -04:00
xulei2020 72861a68f3 add code 2020-09-11 19:28:35 +08:00
jiangzhiwen d4ce668b9b add Affine ut 2020-09-10 21:50:56 +08:00
mindspore-ci-bot c882e4863c !5961 [Data]Add lite_cv lib for mindspore lite data preprocessing
Merge pull request !5961 from xulei/lite_test0905
2020-09-10 18:51:07 +08:00
xulei2020 b356211413 add init code 2020-09-10 15:35:08 +08:00
Zirui Wu 1bb93580dd Add usage flag to MNIST/CIFAR
ci fix 1

fix ci 2

fix ci 3

fix ci 4

fix ci 5

fix ci 6

fix ci 7

change var name in CelebA from dataset_type to usage

address review cmts

fix cpp ut fail

change mode to usage in VOCDataset

fix cmts

fix ci test case fail
2020-09-09 09:59:55 -04:00
Zirui Wu bde9f18f5a update lookup api to take in a type
ci

add test case

address some of the review cmts

address review cmts
2020-09-08 11:59:28 -04:00
mindspore-ci-bot d0c7b1ba24 !5731 Manifest Dataset check invalid filename string
Merge pull request !5731 from jiangzhiwen/fix/invalid_filename_string
2020-09-04 16:36:29 +08:00
mindspore-ci-bot 2f3684d4fa !4872 Add C++ API support for TFRecordDataset
Merge pull request !4872 from TinaMengtingZhang/cpp-api-tfrecord-dataset
2020-09-04 11:53:08 +08:00
jiangzhiwen 294f7b620a check invalid filename string 2020-09-03 22:09:26 +08:00
jiangzhiwen 1a1a8893a4 Align num_samples of CSV with other dataset 2020-09-03 17:30:39 +08:00
tinazhang e430b4056a add tfrecord dataset to cpp api
fix to support schema=nullptr
2020-09-02 08:55:47 -04:00
luoyang 8aba39a71b Modify VOCDataset doc & Fix BuildVocab bug 2020-09-02 16:54:50 +08:00
luoyang ce419404ce Add check for duplicate column for a-cpi 2020-09-02 10:41:52 +08:00
mindspore-ci-bot 0cb6d29f0c !4998 Shared memory pool clean up
Merge pull request !4998 from JesseKLee/mem_pool
2020-09-02 02:01:19 +08:00
mindspore-ci-bot dff02cc282 !5188 rename image files in imagefolder
Merge pull request !5188 from tony_liu2/alt
2020-09-01 11:16:30 +08:00
mindspore-ci-bot b99149dc37 !4901 Adding data_helper for minddata
Merge pull request !4901 from EricZ/md_helper
2020-09-01 11:14:11 +08:00
mindspore-ci-bot 3be136f6f0 !5354 Fix randomdata issue
Merge pull request !5354 from xiefangqi/fix_randomdata_columnlist
2020-09-01 11:03:54 +08:00
mahdi 84efa0b96b Added BucketBatchByLength for C API 2020-08-31 17:06:16 -04:00
Eric 65bf3ecc3e Adding data_helper class 2020-08-31 16:29:14 -04:00
Jesse Lee e89b4648f6 Memory pool clean up 2020-08-30 11:28:24 -04:00
xiefangqi e2085a9505 fix randomdata issue 2020-08-28 11:55:49 +08:00
tony_liu2 5e4c314130 rename dataset dir and image files
change references to use path original

revert folder name

revert graphengine
2020-08-27 16:49:23 -04:00
mindspore-ci-bot 716329df6c !5278 Change default value of sampler in c-api
Merge pull request !5278 from luoyang/c-api
2020-08-27 21:33:18 +08:00
YangLuo 419478b410 Change default value of sampler to seperate behaviour of default sampler
& null sampler, add check for duplicate column name
2020-08-27 21:24:37 +08:00
islam_amin 94a4a3f20b changing affine and posterize apis 2020-08-26 10:51:54 -04:00
Cathy Wong 46e9d79a50 C++ API: Lexicographical order support for CLUE, CSV & TextFile Datasets 2020-08-25 14:11:19 -04:00
luoyang b26f6b3d5e fix bug in c-api: rename, concat, take 2020-08-25 16:25:00 +08:00
mindspore-ci-bot 0bbce9367e !4772 Adding AlbumDataset for device training
Merge pull request !4772 from EricZ/ms-album
2020-08-24 08:27:14 +08:00
Eric c79db93c48 Initial commit for album
Added linter fix for album dataset

Added testDataset

Adding signature

Added JsonDataset example API

Example dataset

Resolving format

More fixing

Refactor

Small fix

Added compiling album dataset

Running tests

Added linter fix #1

Passing UT

Added dataset API

Addressing clang

Clang part 2

Fixing pass

Fixed tree check

lint fix

Added lint fix part 2
2020-08-22 11:07:10 -04:00
mindspore-ci-bot 9b503e4f38 !4955 Fixes for Dynamic Augmentation Ops
Merge pull request !4955 from MahdiRahmaniHanzaki/dynamic-ops-fix
2020-08-22 10:27:50 +08:00
Mahdi a5f9b8f92e Added fix for MixUpBatch and CutMixBatch and for RandomAffine
updated c color op descriptions
2020-08-21 17:40:08 -04:00
Zirui Wu 74c1e6da60 introducing pause and quit flags to DataBuffer
fix review cmts

fix ci

fix Ci

fixci

address ci

ci

- add timeout
- add more test cases

fix CI

address review cmts
2020-08-21 14:33:26 -04:00
mindspore-ci-bot 9a3baf4f6c !4314 [MD] remove defaults used in binding code, and remove bilinear resize op
Merge pull request !4314 from nhussain/clean_up_bindings
2020-08-20 22:16:56 +08:00