Commit Graph

437 Commits

Author SHA1 Message Date
xiefangqi 653c79b4af md fix per_batch_map issue 2020-09-14 09:55:51 +08:00
liyong 16147669a6 fix num_samples in concatDataset 2020-09-12 15:06:18 +08:00
mindspore-ci-bot eb049b0e93 !5842 [Dataset] dataset op log changes
Merge pull request !5842 from luoyang/pylint
2020-09-12 09:42:42 +08:00
mindspore-ci-bot 28e2b0253e !6086 Order dict by column_id in create_dict_iterator()
Merge pull request !6086 from ZiruiWu/order_dict_in_create_dict_iterator
2020-09-12 08:41:46 +08:00
Zirui Wu d54ba374b9 order dict by column_id in create_dict_iterator()
fix CI
2020-09-11 15:33:47 -04:00
YangLuo f5a85510f2 [MD] dataset op log changes 2020-09-12 00:43:36 +08:00
nhussain 96de2ffdb6 fix errors from old compose call in Python 2020-09-11 10:30:23 -04:00
mindspore-ci-bot d8c09067ce !5801 [MD][Feature] minddata iterator output ms_tensor
Merge pull request !5801 from xiefangqi/md_modify_output_tensor
2020-09-11 20:19:06 +08:00
mindspore-ci-bot 5b4642d10a !4950 Fixing Minddata profiling monitor
Merge pull request !4950 from anthonyaje/monitor_fix
2020-09-11 14:34:27 +08:00
xiefangqi 9b3c33e157 minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
mindspore-ci-bot cf7d6eddc4 !6019 [MD] Move Random(Choice/Apply/Order) from vision to transforms module
Merge pull request !6019 from nhussain/move_random_choice_apply
2020-09-11 10:37:21 +08:00
mindspore-ci-bot a778868a5a !5929 BucketBatchByLength column issue
Merge pull request !5929 from MahdiRahmaniHanzaki/bucket_batch_by_length_fix
2020-09-11 05:53:48 +08:00
nhussain f42f9ef9d7 move random apply order and choice ops 2020-09-10 15:39:56 -04:00
nhussain 92e99ff224 change map calls 2020-09-10 10:25:05 -04:00
anthonyaje 2d08d83247 Fixed connector_size and monitor. 2020-09-09 17:54:59 -04:00
Zirui Wu 1bb93580dd Add usage flag to MNIST/CIFAR
ci fix 1

fix ci 2

fix ci 3

fix ci 4

fix ci 5

fix ci 6

fix ci 7

change var name in CelebA from dataset_type to usage

address review cmts

fix cpp ut fail

change mode to usage in VOCDataset

fix cmts

fix ci test case fail
2020-09-09 09:59:55 -04:00
xiefangqi d0410d6191 md delete set_dataset_size interface 2020-09-09 09:56:03 +08:00
mindspore-ci-bot c45f79d36b !5384 [MD]-Api changes
Merge pull request !5384 from nhussain/api_changes
2020-09-09 09:49:05 +08:00
mahdi a152a65227 Fixed the column problem in BucketBatchByLength 2020-09-08 17:48:42 -04:00
Zirui Wu bde9f18f5a update lookup api to take in a type
ci

add test case

address some of the review cmts

address review cmts
2020-09-08 11:59:28 -04:00
nhussain 3bac9d3713 switch input columns and operation
change ImagefolderDV2 name

change ds.transforms.vision to ds.vision

change batch api to match map api more closely

compose op changes

test_pylint

remove compose op from vision, move to transform module, refactor map and batch to use column_order
2020-09-08 10:26:20 -04:00
mindspore-ci-bot d76ac7c6e8 !5648 GetColumnNames for Python
Merge pull request !5648 from MahdiRahmaniHanzaki/get-col-name
2020-09-03 22:37:42 +08:00
Mahdi 6e7aab8c4f Added GetColumnNames for Datasets 2020-09-02 17:12:48 -04:00
Cathy Wong 4d4c11b133 dataset API docstring cleanup: Standard product terms NumPy, Python 2020-09-02 10:42:12 -04:00
mindspore-ci-bot bb84f50407 !5473 optim pylint
Merge pull request !5473 from jinyaohui/master
2020-09-02 15:25:30 +08:00
Lixia Chen 27d5281641 Change epoch count to 1 for python testcases 2020-09-01 11:24:26 -04:00
mindspore-ci-bot 8f3ebfd469 !5624 Optimize the performance of GraphData.get_neg_sampled_neighbors
Merge pull request !5624 from heleiwang/gnn_perf
2020-09-01 19:22:53 +08:00
heleiwang 857cf2f77f Optimize the negative sampling process 2020-09-01 16:29:59 +08:00
mindspore-ci-bot 5453b40311 !4477 add dataset compare function to utils
Merge pull request !4477 from tony_liu2/staging
2020-09-01 11:15:18 +08:00
Cathy Wong 7f6782be2a dataset fixes: Update OneHot API docs; fixup Python UTs 2020-08-31 15:04:26 -04:00
jinyaohui a9972a7def optim pylint 2020-08-31 14:49:57 +08:00
tony_liu2 70bfd506a1 add function
pr comment fix

revert graphengine
2020-08-27 16:50:19 -04:00
mindspore-ci-bot 7aaf4118bf !5297 CutMixBatch and MixUpBatch fix for 2D one-hot labels
Merge pull request !5297 from MahdiRahmaniHanzaki/cutmix-fix
2020-08-27 21:32:09 +08:00
mahdi 7ad7024c45 Fixed 2D one-hot label problems in CutMix and MixUp 2020-08-26 16:17:21 -04:00
islam_amin 94a4a3f20b changing affine and posterize apis 2020-08-26 10:51:54 -04:00
mindspore-ci-bot e4d2f2fd3b !5030 Adding a BBox class and fixing Posterize C Op testing.
Merge pull request !5030 from islam_amin/bbox_class
2020-08-26 11:40:57 +08:00
mindspore-ci-bot 20b3134785 !5184 fix: padded dataset when no div and with repeat op
Merge pull request !5184 from guozhijian/fix_padded_with_no_div_repeat
2020-08-26 10:47:22 +08:00
mindspore-ci-bot f3fd7a5578 !5073 Add checks and exception handling DS callback
Merge pull request !5073 from h.farahat/map_callback_end
2020-08-26 10:40:40 +08:00
jonyguo 6df1a43ec2 fix: padded dataset with non div & repeat 2020-08-26 08:56:37 +08:00
mindspore-ci-bot 346b97acb8 !5156 fix softdvpp coredump
Merge pull request !5156 from qianlong21st/master_fix_softdvpp_core
2020-08-25 22:20:00 +08:00
qianlong 12dfca71f1 fix softdvpp coredump 2020-08-25 18:56:40 +08:00
YangLuo 67f5c89cd6 Check input image type for random posterize 2020-08-25 16:26:17 +08:00
islam_amin 641e751d5e adding bbox class 2020-08-24 18:22:58 -04:00
Mahdi a2c38d89f9 Added float32 support for CutMixBatch 2020-08-24 17:15:25 -04:00
hesham 8eeceb267b - release the wait if training is ended 2020-08-24 13:11:07 -04:00
mindspore-ci-bot ac81886328 !4916 fix generator_dataset hangs and test_graphdata_distributed.py failing randomly
Merge pull request !4916 from heleiwang/gnn_fix_bug
2020-08-22 10:51:01 +08:00
mindspore-ci-bot 9b503e4f38 !4955 Fixes for Dynamic Augmentation Ops
Merge pull request !4955 from MahdiRahmaniHanzaki/dynamic-ops-fix
2020-08-22 10:27:50 +08:00
Mahdi a5f9b8f92e Added fix for MixUpBatch and CutMixBatch and for RandomAffine
updated c color op descriptions
2020-08-21 17:40:08 -04:00
mindspore-ci-bot 9d7250c483 !4776 Introduce 2 extra ctrl flags to DataBuffer in dataset, address remaining cmts to PR4632
Merge pull request !4776 from ZiruiWu/map_callback_follow_up
2020-08-22 03:31:31 +08:00
Zirui Wu 74c1e6da60 introducing pause and quit flags to DataBuffer
fix review cmts

fix ci

fix Ci

fixci

address ci

ci

- add timeout
- add more test cases

fix CI

address review cmts
2020-08-21 14:33:26 -04:00