mindspore2022/tests/ut/python/dataset
peilinwang 1e36b0649f remove graphengine changes
remove graphengine changes

concat op

Truncate Pair

concat_op

remove graph engine changes

ToNumberOp implementation almost done

ToNumberOp complete

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

merge conflicts
2020-06-18 20:07:35 -04:00
..
README.md initial version 2020-03-27 22:54:54 +08:00
test_2ops.py made shuffle determinisitc for subsequent epochs 2020-05-22 17:03:19 -04:00
test_HWC2CHW.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_Tensor.py 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
test_apply.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_autocontrast.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_basic_tokenizer.py Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 2020-06-17 15:47:04 +08:00
test_batch.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_bert_tokenizer.py Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 2020-06-17 15:47:04 +08:00
test_bounding_box_augment.py added two ops for object detection, random horizontal flip with bbox and bouding box augment. along with their unit tests 2020-06-18 16:55:31 -04:00
test_bucket_batch_by_length.py initial commit, start of BucketBatchByLengthOp 2020-06-15 10:20:01 -04:00
test_center_crop.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_cifarop.py Bug in CIFAR after removing GetMutabble buffer 2020-06-14 13:27:17 -04:00
test_concat.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_concatenate_op.py remove graphengine changes 2020-06-18 17:17:50 -04:00
test_config.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_cut_out.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_dataset_numpy_slices.py repair problem in NumpySlicesDataset 2020-06-17 21:49:02 +08:00
test_datasets_celeba.py add get_dataset_size to celebadataset 2020-05-28 17:00:14 +08:00
test_datasets_clue.py add CLUE dataset 2020-06-15 10:40:46 +08:00
test_datasets_coco.py CocoDataset add category_id validation 2020-06-16 21:37:22 +08:00
test_datasets_get_dataset_size.py initial version 2020-03-27 22:54:54 +08:00
test_datasets_imagefolder.py consistent design for num_samples 2020-06-03 15:01:18 -04:00
test_datasets_imagenet.py 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
test_datasets_imagenet_distribution.py 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
test_datasets_manifestop.py 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
test_datasets_sharding.py consistent design for num_samples 2020-06-03 15:01:18 -04:00
test_datasets_textfileop.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_datasets_voc.py !1713 [Dataset] Clean pylint. 2020-06-02 09:02:19 +08:00
test_decode.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_deviceop_cpu.py clean pylint 2020-05-18 16:42:35 +08:00
test_duplicate_op.py DuplicateOp 2020-06-18 19:47:27 -04:00
test_equalize.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_exceptions.py consistent design for num_samples 2020-06-03 15:01:18 -04:00
test_fill_op.py added FillOp for #119 - special Ops 2020-06-15 11:30:43 -04:00
test_filterop.py Throw error when load config failed 2020-06-18 13:47:32 +08:00
test_five_crop.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_flat_map.py Clean up work for text python package 2020-05-22 04:35:58 -04:00
test_from_dataset.py phase I of Vocab rework 2020-06-18 15:36:28 -04:00
test_generator.py consistent design for num_samples 2020-06-03 15:01:18 -04:00
test_get_size.py initial version 2020-03-27 22:54:54 +08:00
test_graphdata.py random walk v1 2020-06-15 08:54:10 -04:00
test_invert.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_iterator.py 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
test_linear_transformation.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_mask_op.py Mask Op 2020-06-16 23:51:46 -04:00
test_minddataset.py add floatxx test case 2020-06-11 19:26:54 +08:00
test_minddataset_exception.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_minddataset_multi_images.py clean pylint 2020-05-18 10:31:46 +08:00
test_minddataset_multi_images_and_ndarray.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_minddataset_padded.py fix: MindDataset padded log error 2020-06-13 19:46:24 +08:00
test_minddataset_sampler.py add split in minddataset 2020-06-16 19:50:41 +08:00
test_mixup_label_smoothing.py 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
test_ngram_op.py address API doc style and content 2020-06-18 12:23:42 -04:00
test_nlp.py phase I of Vocab rework 2020-06-18 15:36:28 -04:00
test_nlp_jieop.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_normalizeOp.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_onehot_op.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_opt.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_opt_pass.py Move python tree transformation into cpp pass. 2020-06-18 15:52:38 -04:00
test_pad.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_padEnd_op.py PadEndOp 2020-06-18 16:07:34 -04:00
test_pad_batch.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_pair_truncate.py Truncate Pair 2020-06-17 23:11:27 -04:00
test_profiling.py MindData profiler infrastructure 2020-06-11 14:52:36 -04:00
test_project.py clean pylint 2020-05-18 16:42:35 +08:00
test_pyfunc.py clean pylint 2020-05-18 10:31:46 +08:00
test_random_affine.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_random_apply.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_random_choice.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_random_color.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_random_color_adjust.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_random_crop.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_random_crop_and_resize.py !2142 Cleanup dataset UT: refactor visualize() 2020-06-18 01:30:36 +08:00
test_random_crop_decode_resize.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_random_dataset.py 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
test_random_erasing.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_random_grayscale.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_random_horizontal_flip.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_random_horizontal_flip_bbox.py added two ops for object detection, random horizontal flip with bbox and bouding box augment. along with their unit tests 2020-06-18 16:55:31 -04:00
test_random_order.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_random_perspective.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_random_resize.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_random_rotation.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_random_sharpness.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_random_vertical_flip.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_rename.py 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
test_repeat.py clean pylint 2020-05-18 16:42:35 +08:00
test_rescale_op.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_rgb_hsv.py 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
test_sampler.py add para check for sampler 2020-06-11 22:26:06 +08:00
test_schema.py initial version 2020-03-27 22:54:54 +08:00
test_serdes_dataset.py Adding new UT cases and missing TCs in PY Ops. 2020-05-29 12:12:17 -04:00
test_shuffle.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_skip.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_slice_op.py Mask Op 2020-06-16 23:51:46 -04:00
test_split.py fixed bug for split, RandomSampler and some other cleanup 2020-05-29 11:27:32 -04:00
test_sync_wait.py !1713 [Dataset] Clean pylint. 2020-06-02 09:02:19 +08:00
test_take.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_ten_crop.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_tensor_string.py - Bug when empty strings sent to Python 2020-06-09 10:34:38 -04:00
test_tfreader_op.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_to_number_op.py remove graphengine changes 2020-06-18 20:07:35 -04:00
test_to_pil.py add UTs for LinearTransformation, ToPIL, ToType 2020-05-22 18:04:09 -04:00
test_to_type.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_tokenizer.py Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 2020-06-17 15:47:04 +08:00
test_type_cast.py clean pylint 2020-05-18 16:42:35 +08:00
test_uniform_augment.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00
test_var_batch_map.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
test_vocab.py DuplicateOp 2020-06-18 19:47:27 -04:00
test_wordpiece_tokenizer.py Add WhitespaceTokenizer and UnicodeScriptTokenizer for nlp 2020-06-17 15:47:04 +08:00
test_zip.py !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
util.py reorganize util function visualize() 2020-06-17 09:30:05 -04:00

README.md

DE Dataset Ops Test (Python)

Environment

Python3.7 (PyCharm IDE is recommended)

Introduce of data

All of data used in this folder created by Huawei Technologies Co.