mindspore2022/tests/ut/python/dataset
Peilin Wang 9bc2134cb7 added checking of first row crc to find invalid tfrecord files
addressed code review comments. added check in python layer to exclude directories and to raise an error if a pattern does not match any file

fixed clang format

fixed cppcheck

fixed cppcheck (used std::accumulate and std::copy_if). regenerated tfrecord file to contain correct header, it was a dummy header before

fixed cppcheck: added const reference for string parameter for lambdas, fixed clang format: whitespace adjustments

more clang whitespace fixes...

changed print to logger.info
2020-04-20 10:25:26 -04:00
..
README.md initial version 2020-03-27 22:54:54 +08:00
prep_data.py initial version 2020-03-27 22:54:54 +08:00
test_2ops.py initial version 2020-03-27 22:54:54 +08:00
test_Tensor.py initial version 2020-03-27 22:54:54 +08:00
test_apply.py implemention of new api: apply 2020-04-14 21:43:53 +08:00
test_batch.py initial version 2020-03-27 22:54:54 +08:00
test_center_crop.py initial version 2020-03-27 22:54:54 +08:00
test_cifarop.py initial version 2020-03-27 22:54:54 +08:00
test_config.py initial version 2020-03-27 22:54:54 +08:00
test_cut_out.py initial version 2020-03-27 22:54:54 +08:00
test_datasets_celeba.py initial version 2020-03-27 22:54:54 +08:00
test_datasets_get_dataset_size.py initial version 2020-03-27 22:54:54 +08:00
test_datasets_imagefolder.py initial version 2020-03-27 22:54:54 +08:00
test_datasets_imagenet.py initial version 2020-03-27 22:54:54 +08:00
test_datasets_imagenet_distribution.py initial version 2020-03-27 22:54:54 +08:00
test_datasets_manifestop.py initial version 2020-03-27 22:54:54 +08:00
test_datasets_sharding.py check num_samples 2020-04-01 14:39:23 +08:00
test_datasets_textfileop.py TextFileDataset 2020-04-20 11:18:55 +08:00
test_datasets_voc.py initial version 2020-03-27 22:54:54 +08:00
test_decode.py initial version 2020-03-27 22:54:54 +08:00
test_deviceop_cpu.py initial version 2020-03-27 22:54:54 +08:00
test_exceptions.py check num_samples 2020-04-01 14:39:23 +08:00
test_five_crop.py initial version 2020-03-27 22:54:54 +08:00
test_general.py initial version 2020-03-27 22:54:54 +08:00
test_generator.py Add CPP sampler support for GeneratorDataset 2020-04-14 12:09:03 -04:00
test_get_size.py initial version 2020-03-27 22:54:54 +08:00
test_iterator.py Bug in weak reference. 2020-04-17 11:36:32 -04:00
test_minddataset.py fix: when use MindDataset block_reade=True hung 2020-04-07 17:53:23 +08:00
test_minddataset_exception.py initial version 2020-03-27 22:54:54 +08:00
test_minddataset_multi_images.py initial version 2020-03-27 22:54:54 +08:00
test_minddataset_multi_images_and_ndarray.py initial version 2020-03-27 22:54:54 +08:00
test_minddataset_sampler.py fix TestShardSampleWrongNumber 2020-04-13 21:31:45 +08:00
test_mixup_label_smoothing.py initial version 2020-03-27 22:54:54 +08:00
test_normalizeOp.py initial version 2020-03-27 22:54:54 +08:00
test_onehot_op.py initial version 2020-03-27 22:54:54 +08:00
test_pad.py initial version 2020-03-27 22:54:54 +08:00
test_project.py fix and remove useless import of example, st, ut 2020-04-02 22:13:36 +08:00
test_pyfunc.py initial version 2020-03-27 22:54:54 +08:00
test_random_color_adjust.py initial version 2020-03-27 22:54:54 +08:00
test_random_crop.py initial version 2020-03-27 22:54:54 +08:00
test_random_crop_and_resize.py initial version 2020-03-27 22:54:54 +08:00
test_random_crop_decode_resize.py initial version 2020-03-27 22:54:54 +08:00
test_random_erasing.py initial version 2020-03-27 22:54:54 +08:00
test_random_horizontal_flip.py initial version 2020-03-27 22:54:54 +08:00
test_random_resize.py initial version 2020-03-27 22:54:54 +08:00
test_random_rotation.py initial version 2020-03-27 22:54:54 +08:00
test_random_vertical_flip.py initial version 2020-03-27 22:54:54 +08:00
test_readdir.py initial version 2020-03-27 22:54:54 +08:00
test_rename.py initial version 2020-03-27 22:54:54 +08:00
test_repeat.py Support nested repeat 2020-04-14 10:13:18 -04:00
test_rescale_op.py initial version 2020-03-27 22:54:54 +08:00
test_rgb_hsv.py Optimize the execution time of test case test_rgb_hsv.py 2020-03-31 09:23:20 +08:00
test_sampler.py Add CPP sampler support for GeneratorDataset 2020-04-14 12:09:03 -04:00
test_schema.py initial version 2020-03-27 22:54:54 +08:00
test_serdes_dataset.py Fix dataset serdes for MindDataset 2020-04-17 13:24:02 -04:00
test_shuffle.py Correct shuffle UT buffer_size > #dataset-row as valid 2020-04-09 15:22:33 -04:00
test_skip.py add skip dataset op 2020-04-17 19:48:25 +08:00
test_storage.py initial version 2020-03-27 22:54:54 +08:00
test_take.py Realize take op and add ut 2020-04-18 18:33:57 +08:00
test_tfreader_op.py added checking of first row crc to find invalid tfrecord files 2020-04-20 10:25:26 -04:00
test_type_cast.py initial version 2020-03-27 22:54:54 +08:00
test_var_batch_map.py initial version 2020-03-27 22:54:54 +08:00
test_zip.py Enable skipped dataset zip python unit tests 2020-03-31 16:47:13 -04:00
util.py initial version 2020-03-27 22:54:54 +08:00

README.md

DE Dataset Ops Test (Python)

Environment

Python3.7 (PyCharm IDE is recommended)

Introduce of data

All of data used in this folder created by Huawei Technologies Co.