mindspore2022/tests/ut/python/dataset
Zirui Wu d233c54139 implemented cpp random choice, apply and compos
python part of random ops

added random select sub policy

validators added

comments added, remaining issues addressed

add more python test cases

fix ci

fix CI

fix order of include files

addr review cmts

addr review cmts

reorg file

fix compile err

address review cmts

address review cmts
2020-07-15 13:39:10 -04:00
..
README.md initial version 2020-03-27 22:54:54 +08:00
test_2ops.py made shuffle determinisitc for subsequent epochs 2020-05-22 17:03:19 -04:00
test_HWC2CHW.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_Tensor.py 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
test_apply.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_autocontrast.py remove local defined mse and add missing mse/md5 validation 2020-06-29 11:51:07 -04:00
test_batch.py dataset: Fixup docs; remove pylint disabled messages in UT 2020-06-26 12:26:41 -04:00
test_bounding_box_augment.py Fixing ratio bug with BoundingBoxAugment 2020-07-13 18:11:19 -04:00
test_bucket_batch_by_length.py fix validation errors, and fix try catch error tests 2020-07-14 11:50:00 -04:00
test_c_compose.py implemented cpp random choice, apply and compos 2020-07-15 13:39:10 -04:00
test_c_random_apply.py implemented cpp random choice, apply and compos 2020-07-15 13:39:10 -04:00
test_c_random_choice.py implemented cpp random choice, apply and compos 2020-07-15 13:39:10 -04:00
test_cache_map.py Initial Drop of CacheOp Phase I 2020-07-13 10:18:53 -04:00
test_cache_nomap.py Initial Drop of CacheOp Phase I 2020-07-13 10:18:53 -04:00
test_center_crop.py dataset: Fixup docs; remove pylint disabled messages in UT 2020-06-26 12:26:41 -04:00
test_concat.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_concatenate_op.py fix validation errors, and fix try catch error tests 2020-07-14 11:50:00 -04:00
test_config.py added test case to cifar_op 2020-07-14 11:22:38 -04:00
test_cut_out.py remove local defined mse and add missing mse/md5 validation 2020-06-29 11:51:07 -04:00
test_dataset_numpy_slices.py fix validation errors, and fix try catch error tests 2020-07-14 11:50:00 -04:00
test_datasets_celeba.py add get_dataset_size to celebadataset 2020-05-28 17:00:14 +08:00
test_datasets_cifarop.py added test case to cifar_op 2020-07-14 11:22:38 -04:00
test_datasets_clue.py fix TextFileDataset and CLUEDataset failed with to_device 2020-06-19 17:28:05 +08:00
test_datasets_coco.py fix CocoDataset issue 2020-06-20 09:51:10 +08:00
test_datasets_get_dataset_size.py initial version 2020-03-27 22:54:54 +08:00
test_datasets_imagefolder.py consistent design for num_samples 2020-06-03 15:01:18 -04:00
test_datasets_manifestop.py 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
test_datasets_sharding.py consistent design for num_samples 2020-06-03 15:01:18 -04:00
test_datasets_textfileop.py fix TextFileDataset and CLUEDataset failed with to_device 2020-06-19 17:28:05 +08:00
test_datasets_voc.py vocdataset support float bbox 2020-07-07 10:07:42 +08:00
test_decode.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_deviceop_cpu.py clean pylint 2020-05-18 16:42:35 +08:00
test_duplicate_op.py DuplicateOp 2020-06-18 19:47:27 -04:00
test_equalize.py remove local defined mse and add missing mse/md5 validation 2020-06-29 11:51:07 -04:00
test_exceptions.py fix validators 2020-07-08 16:40:33 -04:00
test_fill_op.py fix validation errors, and fix try catch error tests 2020-07-14 11:50:00 -04:00
test_filterop.py dataset: Fixup docs; remove pylint disabled messages in UT 2020-06-26 12:26:41 -04:00
test_five_crop.py remove local defined mse and add missing mse/md5 validation 2020-06-29 11:51:07 -04:00
test_flat_map.py Clean up work for text python package 2020-05-22 04:35:58 -04:00
test_from_dataset.py fix some validators errors 2020-07-14 14:04:40 -04:00
test_generator.py consistent design for num_samples 2020-06-03 15:01:18 -04:00
test_get_size.py initial version 2020-03-27 22:54:54 +08:00
test_graphdata.py support get_edge_feature 2020-07-10 17:05:23 +08:00
test_invert.py remove local defined mse and add missing mse/md5 validation 2020-06-29 11:51:07 -04:00
test_iterator.py rename input to children, output to parent 2020-06-20 16:40:10 +08:00
test_linear_transformation.py fix validators 2020-07-08 16:40:33 -04:00
test_mask_op.py Cleanup work for Concate, Mask, Slice, PadEnd and TruncatePair 2020-06-19 19:11:50 -04:00
test_minddataset.py fix distributedSampler reshuffle and fix random_device failed 2020-06-21 18:23:47 +08:00
test_minddataset_exception.py fix validation errors, and fix try catch error tests 2020-07-14 11:50:00 -04:00
test_minddataset_multi_images.py clean pylint 2020-05-18 10:31:46 +08:00
test_minddataset_multi_images_and_ndarray.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_minddataset_padded.py fix distributedSampler reshuffle and fix random_device failed 2020-06-21 18:23:47 +08:00
test_minddataset_sampler.py fix distributedSampler reshuffle and fix random_device failed 2020-06-21 18:23:47 +08:00
test_mixup_label_smoothing.py 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
test_ngram_op.py fix some validators errors 2020-07-14 14:04:40 -04:00
test_nlp.py fix validation errors, and fix try catch error tests 2020-07-14 11:50:00 -04:00
test_noop_mode.py md support ps-lite 2020-07-14 21:46:11 +08:00
test_normalizeOp.py fix validators 2020-07-08 16:40:33 -04:00
test_onehot_op.py Cleanup dataset UT: Remove unneeded data files and tests 2020-07-14 12:24:54 -04:00
test_opt.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_opt_pass.py subtree creation in python apis 2020-06-24 17:17:05 -04:00
test_pad.py remove local defined mse and add missing mse/md5 validation 2020-06-29 11:51:07 -04:00
test_pad_batch.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_pad_end_op.py fix validators 2020-07-08 16:40:33 -04:00
test_pair_truncate.py Truncate Pair 2020-06-17 23:11:27 -04:00
test_profiling.py Connector throughput + PerfData + CyclicArray 2020-06-26 14:45:01 -04:00
test_project.py clean pylint 2020-05-18 16:42:35 +08:00
test_pyfunc.py clean pylint 2020-05-18 10:31:46 +08:00
test_python_tokenizer.py Python Tokenizer 2020-06-19 19:57:11 -04:00
test_random_affine.py fix validators 2020-07-08 16:40:33 -04:00
test_random_apply.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_random_choice.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_random_color.py fix validators 2020-07-08 16:40:33 -04:00
test_random_color_adjust.py remove local defined mse and add missing mse/md5 validation 2020-06-29 11:51:07 -04:00
test_random_crop.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_random_crop_and_resize.py fix validators 2020-07-08 16:40:33 -04:00
test_random_crop_and_resize_with_bbox.py fix validators 2020-07-08 16:40:33 -04:00
test_random_crop_decode_resize.py remove local defined mse and add missing mse/md5 validation 2020-06-29 11:51:07 -04:00
test_random_crop_with_bbox.py First Commit - New Infrastructure - Python UT tests + Common Aug Files 2020-07-07 14:50:34 -04:00
test_random_dataset.py Initial Drop of CacheOp Phase I 2020-07-13 10:18:53 -04:00
test_random_erasing.py remove local defined mse and add missing mse/md5 validation 2020-06-29 11:51:07 -04:00
test_random_grayscale.py fix validators 2020-07-08 16:40:33 -04:00
test_random_horizontal_flip.py fix validators 2020-07-08 16:40:33 -04:00
test_random_horizontal_flip_with_bbox.py fix validators 2020-07-08 16:40:33 -04:00
test_random_order.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_random_perspective.py fix validators 2020-07-08 16:40:33 -04:00
test_random_resize.py remove local defined mse and add missing mse/md5 validation 2020-06-29 11:51:07 -04:00
test_random_resize_with_bbox.py fix validators 2020-07-08 16:40:33 -04:00
test_random_rotation.py remove local defined mse and add missing mse/md5 validation 2020-06-29 11:51:07 -04:00
test_random_select_subpolicy.py implemented cpp random choice, apply and compos 2020-07-15 13:39:10 -04:00
test_random_sharpness.py fix validators 2020-07-08 16:40:33 -04:00
test_random_vertical_flip.py fix validators 2020-07-08 16:40:33 -04:00
test_random_vertical_flip_with_bbox.py fix validators 2020-07-08 16:40:33 -04:00
test_rename.py 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
test_repeat.py Cleanup dataset UT: Remove unneeded data files and tests 2020-07-14 12:24:54 -04:00
test_rescale_op.py remove local defined mse and add missing mse/md5 validation 2020-06-29 11:51:07 -04:00
test_resize_with_bbox.py fix validators 2020-07-08 16:40:33 -04:00
test_rgb_hsv.py 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
test_sampler.py add para check for sampler 2020-06-11 22:26:06 +08:00
test_schema.py initial version 2020-03-27 22:54:54 +08:00
test_serdes_dataset.py Adding new UT cases and missing TCs in PY Ops. 2020-05-29 12:12:17 -04:00
test_shuffle.py fix validators 2020-07-08 16:40:33 -04:00
test_skip.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_slice_op.py Slice Bug 2020-06-20 00:47:13 -04:00
test_split.py fix split erroer message 2020-06-28 15:47:10 +08:00
test_sync_wait.py fix validation errors, and fix try catch error tests 2020-07-14 11:50:00 -04:00
test_take.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_ten_crop.py fix validators 2020-07-08 16:40:33 -04:00
test_tensor_string.py - Bug when empty strings sent to Python 2020-06-09 10:34:38 -04:00
test_text_basic_tokenizer.py add offsets feature to tokenizer 2020-07-11 11:20:02 +08:00
test_text_bert_tokenizer.py add offsets feature to tokenizer 2020-07-11 11:20:02 +08:00
test_text_jieba_tokenizer.py add offsets feature to tokenizer 2020-07-11 11:20:02 +08:00
test_text_tokenizer.py add offsets feature to tokenizer 2020-07-11 11:20:02 +08:00
test_text_wordpiece_tokenizer.py add offsets feature to tokenizer 2020-07-11 11:20:02 +08:00
test_tfreader_op.py Cleanup dataset UT: Remove unneeded data files and tests 2020-07-14 12:24:54 -04:00
test_to_number_op.py remove graphengine changes 2020-06-18 20:07:35 -04:00
test_to_pil.py add UTs for LinearTransformation, ToPIL, ToType 2020-05-22 18:04:09 -04:00
test_to_type.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_type_cast.py clean pylint 2020-05-18 16:42:35 +08:00
test_uniform_augment.py fix validation errors, and fix try catch error tests 2020-07-14 11:50:00 -04:00
test_var_batch_map.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_vocab.py fix some validators errors 2020-07-14 14:04:40 -04:00
test_zip.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
util.py fix validators 2020-07-08 16:40:33 -04:00

README.md

DE Dataset Ops Test (Python)

Environment

Python3.7 (PyCharm IDE is recommended)

Introduce of data

All of data used in this folder created by Huawei Technologies Co.