Commit Graph

22 Commits

Author SHA1 Message Date
luoyang 992da13168 Fix minddata python doc 2021-06-25 18:30:55 +08:00
YangLuo 74d7bb41a6 fix minddata transform issue 2021-03-12 11:37:14 +08:00
Xiao Tianci 08df0ee4fd combine __all__ in dataset/__init__.py and dataset/engine/__init__.py to be one 2020-12-17 19:22:33 +08:00
Lixia Chen 23e90216d9 Minor modification for DatasetCache docstring 2020-12-15 13:56:35 -05:00
Xiao Tianci ca1b692640 add note for ops not supported on windows 2020-11-25 16:39:23 +08:00
nhussain 3bac9d3713 switch input columns and operation
change ImagefolderDV2 name

change ds.transforms.vision to ds.vision

change batch api to match map api more closely

compose op changes

test_pylint

remove compose op from vision, move to transform module, refactor map and batch to use column_order
2020-09-08 10:26:20 -04:00
genglishuai 4d4df68d1e add DistributedSampler for Concat op 2020-08-13 22:52:02 +08:00
jiangzhiwen 2f506b7985 CSV dataset loader 2020-07-20 20:22:08 +08:00
Jesse Lee 7c1bc5192b Initial Drop of CacheOp Phase I 2020-07-13 10:18:53 -04:00
ms_yan edd7e184d8 modify config api 2020-07-10 18:55:09 +08:00
jiangzhiwen e0e167a000 add CLUE dataset 2020-06-15 10:40:46 +08:00
ms_yan bc22c172b8 add TensorDataset and its ut 2020-06-11 15:24:12 +08:00
xiefangqi 097cbcc0cb CocoDataset implementation 2020-06-11 11:52:17 +08:00
Jamie Nisbet 51bc0c0460 consistent design for num_samples
updates

more update

more work

more fixin

post rebase updates

clang formatting

code review recovery

ci fixes

updates

update

update

update
2020-06-03 15:01:18 -04:00
Peilin Wang d4c93575e7 fixed bug for split, RandomSampler and some other cleanup
add another test case

typo

merge conflict

another PR changed testing behavior, updated test cases in this commit

added input check for use_sampler

addressed code review comments

fixed pylint, not related to my changes
2020-05-26 16:29:52 -04:00
ms_yan d5e896b51c delete storageDataset Op API and its test case 2020-05-22 21:23:24 +08:00
heleiwang 599a449e0b Support processing GNN data 2020-05-22 14:15:25 +08:00
Jesse Lee 270bf831a9 Random Data Op 2020-04-29 10:26:00 -04:00
mindspore-ci-bot 822a3160e4 !404 [Dataset] Add Python Sampler support for CPP dataset
Merge pull request !404 from JunhanHu/python_sampler_for_cpp_dataset
2020-04-20 22:45:51 +08:00
yanghaitao 2795e492ff TextFileDataset 2020-04-20 11:18:55 +08:00
Junhan Hu 43a2e99833 Add python sampler support for CPP dataset 2020-04-19 20:36:37 -04:00
zhunaipan 930a1fb0a8 initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
2020-03-27 22:54:54 +08:00