Commit Graph

25 Commits

Author SHA1 Message Date
YangLuo bf48400c10 unify include file of minddata 2021-04-22 10:59:36 +08:00
Cathy Wong a2ee0cb3e5 dataset UT: Update UTs to check for return Status 2021-04-14 17:52:31 -04:00
Cathy Wong 1775c4e83d dataset: Reinstate INFO logging and data verification - part 3
Updates: GetItemAt, CreateFromVector, CreateScalar.
Add TEST_MS_LOG_MSTENSOR.
Wrap ASSERT_OK around Tensor function calls.
2021-03-17 13:48:04 -04:00
Cathy Wong 95bbaaf9f6 dataset: Reinstate INFO logging and data verification - part 2
for image/vision datasets
2021-03-12 10:07:45 -05:00
Cathy Wong 521c313a3b dataset: Reinstate INFO logging and data verification - part1 2021-03-05 10:13:09 -05:00
mohammad f73def5933 make C++ API classes for samplers 2021-02-25 17:29:43 -05:00
Eric 9953757ff4 Fixed tenor compile error for MD 2021-02-09 14:56:31 +08:00
Zirui Wu 3555d19b07 fix get num_class in imagefolder
address cmt

review cmts
2020-11-12 14:26:54 -05:00
Zirui Wu 5d1ada682c remove uncessary headers
staging II

clean up

further clean up

fix merge conflict with 8139

fix complie err
2020-11-03 11:59:55 -05:00
hesham 5169fb4c42 Remove api namespace 2020-11-02 20:09:37 -05:00
Cathy Wong 18ecd65f93 C++ API: Delete ValidateParams in dataset APIs; update error input UTs 2020-10-29 16:29:16 -04:00
alex-yuyue 913a49f3af Add support for C++ API: GetNumClasses
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2020-10-27 16:26:51 -04:00
hesham f3880f8355 Add GetBatchSizer and GetRepeatCount to c++ API 2020-10-24 22:45:19 -04:00
Mahdi 0e03f5b0dd Added GetDatasetSize 2020-10-23 16:29:11 -04:00
Zirui Wu cfc50e231a Added IR breakdown for remaining ops after PR7596
fix android build failure

fix include in datasets.cc

attempting fix android build

fix complie err x86
2020-10-22 23:07:41 -04:00
Zirui Wu d471552fc5 shuffle take repeat bucketbatch buildvocab repeat shuffle take project concat rename node IR added
concat, bucketbatch project rename

fix ci round 1

fix ci round 2

fix up

fix ci
2020-10-21 18:41:34 -04:00
Zirui Wu 52eec881ec Refactor ImageFolderNode and BatchNode into its separate files
fix ci

fix ci

address review cmmts, fix ci

remove dup code in datasets.cc
2020-10-20 23:07:51 -04:00
Cathy Wong 9f7c1a32e7 C++ API: vision ops - reorder and add gap UTs; correct parm desc style 2020-10-14 19:10:13 -04:00
yanghaitao1 4ff4c17632 fix get_dataset_size in CelebADataset when usage is not all 2020-09-19 02:16:29 -04:00
luoyang 9064a5f731 add num_row check & fix api distributed sampler, lookup, default value
of usage
2020-09-17 20:31:26 +08:00
Zirui Wu 1bb93580dd Add usage flag to MNIST/CIFAR
ci fix 1

fix ci 2

fix ci 3

fix ci 4

fix ci 5

fix ci 6

fix ci 7

change var name in CelebA from dataset_type to usage

address review cmts

fix cpp ut fail

change mode to usage in VOCDataset

fix cmts

fix ci test case fail
2020-09-09 09:59:55 -04:00
YangLuo 419478b410 Change default value of sampler to seperate behaviour of default sampler
& null sampler, add check for duplicate column name
2020-08-27 21:24:37 +08:00
luoyang 373adaa553 !4402 [Dataset] Fix c_api bugs 2020-08-13 22:38:55 +08:00
tony_liu2 deb1146474 reorganize headers and tests
remove headers

fix iterator file

fix pr comments

fix new file
2020-08-12 14:36:01 -04:00
tony_liu2 3a020fe877 split c_api_test
split into datasets

review fix

fix merge issues

fixed minddata lite build issues
2020-08-07 11:57:49 -04:00