OSSInnovation
/
mindspore
0
0
Fork 26
Code Issues Pull Requests 7 Releases Wiki Activity
8,373 Commits 12 Branches 6 Tags 451 MiB
Commit Graph

211 Commits

Author SHA1 Message Date
Cathy Wong 46e9d79a50 C++ API: Lexicographical order support for CLUE, CSV & TextFile Datasets 2020-08-25 14:11:19 -04:00
luoyang b26f6b3d5e fix bug in c-api: rename, concat, take 2020-08-25 16:25:00 +08:00
mindspore-ci-bot 0bbce9367e !4772 Adding AlbumDataset for device training 
Merge pull request !4772 from EricZ/ms-album
 2020-08-24 08:27:14 +08:00
Eric c79db93c48 Initial commit for album 
Added linter fix for album dataset

Added testDataset

Adding signature

Added JsonDataset example API

Example dataset

Resolving format

More fixing

Refactor

Small fix

Added compiling album dataset

Running tests

Added linter fix #1

Passing UT

Added dataset API

Addressing clang

Clang part 2

Fixing pass

Fixed tree check

lint fix

Added lint fix part 2
 2020-08-22 11:07:10 -04:00
mindspore-ci-bot 9b503e4f38 !4955 Fixes for Dynamic Augmentation Ops 
Merge pull request !4955 from MahdiRahmaniHanzaki/dynamic-ops-fix
 2020-08-22 10:27:50 +08:00
Mahdi a5f9b8f92e Added fix for MixUpBatch and CutMixBatch and for RandomAffine 
updated c color op descriptions
 2020-08-21 17:40:08 -04:00
Zirui Wu 74c1e6da60 introducing pause and quit flags to DataBuffer 
fix review cmts

fix ci

fix Ci

fixci

address ci

ci

- add timeout
- add more test cases

fix CI

address review cmts
 2020-08-21 14:33:26 -04:00
mindspore-ci-bot 9a3baf4f6c !4314 [MD] remove defaults used in binding code, and remove bilinear resize op 
Merge pull request !4314 from nhussain/clean_up_bindings
 2020-08-20 22:16:56 +08:00
xiefangqi 7dc7990d75 add NumWorkers validate 2020-08-20 17:25:30 +08:00
mindspore-ci-bot 7b0a4e5929 !4796 Fix randomdata ut core dump problem 
Merge pull request !4796 from xiefangqi/fix_randomdata_ut
 2020-08-20 14:11:55 +08:00
xiefangqi c0d18d2517 fix randomdata ut problem 2020-08-20 11:13:02 +08:00
Jesse Lee 8a08d0c37b Phase 2 of CacheOp 2020-08-19 13:45:55 -04:00
Zirui Wu 78c1aa1d96 Implemented Callback for Dataset 
implment pause in MapOp, added more to callback

add ds_callback

- Initial drop of Python DSCallback

- Pybind DSCallback

- Pybind DSCallback

added callback to mapOp

- de_pipeline DSCallback

- de_pipeline DSCallback

add test case, segfault for now

fix seg fault

- de_pipeline DSCallback

remove 1 line

update callback test case, now works

use builder class for mapOp callback

- de_pipeline DSCallback

- de_pipeline DSCallback

- de_pipeline DSCallback

better test case

minor fix

add comments and minor clean ups

get rid of nullptr in MapOp, use other flag instead

fix a bug ParseMapOp only takes 1 callback

- Added WaitedDSCalabck

refactor callback param

fix text case incorrect number

- added testing

fix cpp test case

- added testing

- revert back lenet changes

- cleanup test_callbacks.py

- cleanup test_callbacks.py

fix CI stage I

fix CI stage II

fix CI and update epoch counter

- add validation
- add more testing  test_callbacks.py

use random data op to do tests

adjust when to call EpochBegin/End

- add repeat with callback

- addressing reviewers' comments

- docstring and CI fixes

- docstring and CI fixes

- docstring and CI fixes

- rebase with upstream/master

fix cpp test case

fix review comments

addr review cmts, add test case
 2020-08-19 12:31:04 -04:00
YangLuo b50ae27c72 !4597 [Dataset] C++ API Support for build_vocab 2020-08-19 22:47:47 +08:00
nhussain eb9a611041 remove old defaults 2020-08-19 10:11:19 -04:00
mindspore-ci-bot d541e261a0 !4696 C++ API Support for CSV Dataset 
Merge pull request !4696 from jiangzhiwen/jzw/c_api_csv
 2020-08-19 17:08:33 +08:00
mindspore-ci-bot 256dccc651 !4498 Gnn data processing supports distributed scenarios 
Merge pull request !4498 from heleiwang/gnn_distributed
 2020-08-19 16:09:05 +08:00
jiangzhiwen 39df25f803 c++ api for CSV Dataset 2020-08-19 16:02:11 +08:00
heleiwang 8ee4d8e92d Gnn data processing supports distributed scenarios 2020-08-19 11:09:01 +08:00
mindspore-ci-bot 6868b9b6fa !4422 Minddata new dataset api ==> RandomData 
Merge pull request !4422 from xiefangqi/xfq_c++api_randomdata
 2020-08-19 10:48:53 +08:00
xiefangqi b91e56375e add randomdataset and schema 2020-08-19 09:13:43 +08:00
nhussain 738ae2c78d change api to use std_vector 
try to display image
 2020-08-18 15:41:21 -04:00
islam_amin 979111d0ef Added Posterize Op 2020-08-18 13:55:47 -04:00
jiangzhiwen a88273bd3f c++ api support for Manifest Dataset 2020-08-18 09:48:55 +08:00
mindspore-ci-bot 113ff6ca24 !4367 CutMixBatch Augmentation Op 
Merge pull request !4367 from MahdiRahmaniHanzaki/cutmix
 2020-08-18 03:27:33 +08:00
mahdi 3ecc53fb4e Added CutMix 2020-08-17 13:01:47 -04:00
Cathy Wong 9c8af0d1cf C++ API: Provide validate param functions 2020-08-14 17:54:38 -04:00
mindspore-ci-bot 7d70fb4dc4 !3769 add RandomColorOp 
Merge pull request !3769 from Alexey_Shevlyakov/ColorOp
 2020-08-14 23:43:08 +08:00
mindspore-ci-bot ebdea65f70 !4402 [Dataset] Fix c_api bugs 
Merge pull request !4402 from luoyang/c-api-pyfunc
 2020-08-14 17:40:32 +08:00
Alexey Shevlyakov 8526d5414d RandomColor 2020-08-13 16:10:21 -04:00
mindspore-ci-bot 2953720169 !4322 Adding RGBA color conversion 
Merge pull request !4322 from EricZ/bitmap_support
 2020-08-14 01:58:33 +08:00
mindspore-ci-bot 7a10e07fc6 !4383 Add distributedSampler to concatOP 
Merge pull request !4383 from genglishuai/genglshOK
 2020-08-14 00:06:06 +08:00
eric 6a41b44724 Added wrapper around color change function 2020-08-13 11:39:56 -04:00
genglishuai 4d4df68d1e add DistributedSampler for Concat op 2020-08-13 22:52:02 +08:00
luoyang 373adaa553 !4402 [Dataset] Fix c_api bugs 2020-08-13 22:38:55 +08:00
tinazhang 0868720eb7 fix parameter type for repeat op in c++ api and added c++/python ut. 2020-08-12 17:23:42 -04:00
tony_liu2 deb1146474 reorganize headers and tests 
remove headers

fix iterator file

fix pr comments

fix new file
 2020-08-12 14:36:01 -04:00
mindspore-ci-bot 5adba834d0 !3819 C++ API Support for CLUE Dataset 
Merge pull request !3819 from jiangzhiwen/jzw/c_api_clue
 2020-08-12 14:21:19 +08:00
jiangzhiwen 5842a0212f c++ api support for CLUE Dataset 2020-08-12 09:55:43 +08:00
mindspore-ci-bot 9276a9d2fb !3771 C++ API Support for TextFile Dataset 
Merge pull request !3771 from cathwong/ckw_c_api_textfile_nosampler
 2020-08-12 04:32:05 +08:00
avakh 477528de7f random sharpness cpp op support 2020-08-11 15:30:40 -04:00
nhussain 7766efd58e add files 2020-08-11 11:54:14 -04:00
Cathy Wong 7f39b5cfd7 C++ API Support for TextFile Dataset and Unit Tests 2020-08-11 11:53:53 -04:00
mindspore-ci-bot f21ee64fd0 !4247 Add ChannelSwap operation 
Merge pull request !4247 from 章一智/channel_swap_op
 2020-08-11 09:59:55 +08:00
mindspore-ci-bot 2cab58fdbc !3850 Implementing RandomAffine C Op and a CPP UT for AutoContrast & Equalize 
Merge pull request !3850 from islam_amin/randomaffine_op
 2020-08-11 09:29:09 +08:00
mindspore-ci-bot 0bb39830ae !4250 fix cpp api iterator build function 
Merge pull request !4250 from anthonyaje/fix_cpp_api_iterator
 2020-08-11 07:21:27 +08:00
anthonyaje 9774505ecd Fixed dataset cpp api iterator build function 2020-08-10 18:35:59 -04:00
islam_amin e52d85ba9d Added RandomAffine Op 2020-08-10 17:52:50 -04:00
mindspore-ci-bot 612f533d15 !3917 Add c++ ops CreateTupleIterator & Code changes in VOC DatasetOp 
Merge pull request !3917 from luoyang/c-api
 2020-08-11 05:50:21 +08:00
ervinzhang 3a1d8b5f39 added channel swap operation in transforms.h 2020-08-10 17:32:50 -04:00