qsdy
/
mindspore2022
forked from huawei/mindspore2022
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
mindspore2022/tests/ut/python/dataset
History
RobinGrosman eec6289007 add check for shm available when num_devices=1 to avoid bus errors 
Required modifying tests to reduce memory usage to check doesn't fail during CI
    Also required fixing max_rowsize to be externalized from map+batch() function
 		2021-09-24 00:53:02 -07:00
..
README.md fix code format bug 2021-03-25 09:18:36 +08:00
test_2ops.py Cleanup dataset UT: Replace save_and_check 2020-07-15 20:47:31 -04:00
test_HWC2CHW.py Add more callable test and clean the input check 2021-03-03 17:30:36 -05:00
test_Tensor.py use np.testing.assert instead of asserting 2020-07-29 14:53:01 -04:00
test_adjustgamma.py Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset" 2021-08-23 01:46:38 +08:00
test_allpass_biquad.py Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset" 2021-08-23 01:46:38 +08:00
test_amplitude_to_db.py Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset" 2021-08-23 01:46:38 +08:00
test_angle.py Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset" 2021-08-23 01:46:38 +08:00
test_apply.py MD Profiling UT: Check CPU util file. Add sequential pipeline UTs 2021-06-16 15:30:59 -04:00
test_autocontrast.py Fix unused return value in main code 2021-04-16 11:33:35 -04:00
test_band_biquad.py Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset" 2021-08-23 01:46:38 +08:00
test_bandpass_biquad.py Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset" 2021-08-23 01:46:38 +08:00
test_bandreject_biquad.py Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset" 2021-08-23 01:46:38 +08:00
test_bass_biquad.py Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset" 2021-08-23 01:46:38 +08:00
test_batch.py Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset" 2021-08-23 01:46:38 +08:00
test_biquad.py [feat][assistant][I3T96A] Add new audio operator Biquad 2021-09-13 19:18:50 +08:00
test_bounding_box_augment.py fix RandomAffine degree error and some examples in docs 2021-03-12 17:39:38 +08:00
test_browse_dataset.py add util: browse dataset 2021-09-01 16:13:32 +08:00
test_bucket_batch_by_length.py minddata modify dir validation 2021-05-06 21:35:31 +08:00
test_c_compose.py fix: may max openfiles in mindrecord and onehot error in py_transform 2021-09-12 00:25:07 +08:00
test_c_random_apply.py Fix validation of RGB2HSV/HSV2RGB/RandomResizedCrop in py_transform 2021-04-01 19:09:07 +08:00
test_c_random_choice.py first working implementation 2020-09-24 15:39:28 -04:00
test_cache_map.py Fix cache_admin server start stderr output 2021-06-23 18:32:54 -04:00
test_cache_nomap.py Fix cache_admin server start stderr output 2021-06-23 18:32:54 -04:00
test_callbacks.py port over getter pass 2021-01-07 10:52:49 -05:00
test_center_crop.py modify log in kernel part 2021-09-16 22:09:21 +08:00
test_complex_norm.py [fix][assistant][I47V0O] fix bug about the wrong output in the operator ComplexNorm 2021-09-01 17:55:38 +08:00
test_compose.py fix: may max openfiles in mindrecord and onehot error in py_transform 2021-09-12 00:25:07 +08:00
test_concat.py add GetDatasetSize to concat node 2021-01-21 16:25:48 -05:00
test_concatenate_op.py minddata err msg add file path 2021-01-22 16:38:46 +08:00
test_config.py add check for shm available when num_devices=1 to avoid bus errors 2021-09-24 00:53:02 -07:00
test_contrast.py [feat][assistant][I3J6U0] add new data operator Contrast 2021-08-30 19:34:37 -07:00
test_convertcolor.py Add ConvertColor Operation 2021-08-26 21:14:28 +08:00
test_crop.py add Crop Python API 2021-06-10 09:46:57 +08:00
test_cut_out.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_cutmix_batch_op.py modify log in kernel part 2021-09-16 22:09:21 +08:00
test_dataset_numpy_slices.py fix NumpySlicesDataset not accept numpy 2021-07-22 15:46:37 +08:00
test_datasets_celeba.py Fix sampler error messages 2021-02-23 23:58:19 -05:00
test_datasets_cifarop.py add virtual DatasetName method 2021-09-13 15:17:32 +08:00
test_datasets_cityscapes.py [feat] [assistant] [I3CKEM] add new dataset operator Cityscapes 2021-08-31 20:03:37 +08:00
test_datasets_clue.py minddata err msg add file path 2021-01-22 16:38:46 +08:00
test_datasets_coco.py complete dataset log 2021-06-08 16:45:47 +08:00
test_datasets_csv.py minddata err msg add file path 2021-01-22 16:38:46 +08:00
test_datasets_div2k.py [feat] [assistant] [I3CKEK] add new dataset operator DIV2K 2021-09-10 17:55:34 +08:00
test_datasets_flickr.py [feat] [assistant] [I3CKEN] add new dataset operator Flickr 2021-08-04 10:20:43 +08:00
test_datasets_flowers102.py [feat][assistant][I3J6VN] add new data operator flowers102 2021-08-06 10:55:12 +08:00
test_datasets_generator.py add check for shm available when num_devices=1 to avoid bus errors 2021-09-24 00:53:02 -07:00
test_datasets_get_dataset_size.py fix get dataset size in distributed scenario 2020-12-15 20:41:45 +08:00
test_datasets_get_dynamic_shape.py update cpp api & doc 2021-06-23 11:14:52 +08:00
test_datasets_imagefolder.py fix minddata directory path problem 2021-05-10 22:16:37 +08:00
test_datasets_manifestop.py complete dataset log 2021-06-08 16:45:47 +08:00
test_datasets_mnist.py add virtual DatasetName method 2021-09-13 15:17:32 +08:00
test_datasets_sbd.py Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset" 2021-08-23 01:46:38 +08:00
test_datasets_sbu.py [feat][assistant][I3J6VH] add new data operator SBU 2021-09-11 09:58:17 +08:00
test_datasets_sharding.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_datasets_textfileop.py fix minddata issues 2021-02-19 10:53:49 +08:00
test_datasets_tfrecord.py fix white list error msg 2021-09-11 17:36:23 +08:00
test_datasets_usps.py [feat][assistant][I3J6VL] add new data operator USPS 2021-09-09 21:46:57 +08:00
test_datasets_voc.py voc add image_id column 2021-05-17 16:09:04 +08:00
test_dc_shift.py [feat][assistant][I3J6U3] add new audio operator DCShift 2021-09-11 23:58:18 -07:00
test_decode.py add np.frombuffer to support return bytes 2021-08-23 17:31:38 +08:00
test_deemph_biquad.py [feat][assistant][I3J6U6]add new data operator DeemphBiquad 2021-09-09 14:34:24 +08:00
test_deviceop_cpu.py change map calls 2020-09-10 10:25:05 -04:00
test_duplicate_op.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_eager_text.py fix python tokenizer 2021-03-18 15:47:09 +08:00
test_eager_transforms.py Add eager tests for transform ops 2021-04-29 13:19:24 -04:00
test_eager_vision.py Fix bugs of minddata transforms 2021-03-06 16:41:51 +08:00
test_epoch_ctrl.py Replace Databuffers with TensorRows 2021-03-31 17:00:36 -04:00
test_equalize.py change code to import APIs from mindspore.dataset rather than mindspore.dataset.engine 2020-12-24 17:30:02 +08:00
test_equalizer_biquad.py [feat][assistant][I3ALd1] add new operator EqualizerBiquad 2021-09-11 10:36:20 +08:00
test_exceptions.py Fix validation of RGB2HSV/HSV2RGB/RandomResizedCrop in py_transform 2021-04-01 19:09:07 +08:00
test_fade.py [feat][assistant][I3CEGF] add op fade 2021-09-14 19:08:37 +08:00
test_fill_op.py modify log in kernel part 2021-09-16 22:09:21 +08:00
test_filterop.py add filter c api and ut 2020-11-06 15:49:23 +08:00
test_five_crop.py embed python compose op 2020-09-21 11:24:55 -04:00
test_flat_map.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_frequency_masking.py [fix] [assistant] [I465ZG] revise error message and change input param datatype 2021-08-25 10:47:27 +08:00
test_from_dataset.py fix waring to master 2021-07-30 16:37:27 +08:00
test_gaussian_blur.py add Rotate Python API 2021-06-08 22:19:15 +08:00
test_generator_reset_pass.py MindData Codespell correction 2021-04-07 10:20:29 +08:00
test_get_col_names.py voc add image_id column 2021-05-17 16:09:04 +08:00
test_get_size.py added python api based on cpp api 2020-11-25 15:46:59 -05:00
test_graphdata.py add check for shm available when num_devices=1 to avoid bus errors 2021-09-24 00:53:02 -07:00
test_graphdata_distributed.py Implement new gnn feature 2021-06-07 10:20:06 +08:00
test_highpass_biquad.py [feat] [assistant] [I3ALCL] add new operator HighpassBiquad 2021-09-08 15:12:40 +08:00
test_horizontal_flip.py add Rotate Python API 2021-06-08 22:19:15 +08:00
test_input_indexes.py added python api based on cpp api 2020-11-25 15:46:59 -05:00
test_invert.py revert 'Pull Request !21685 : add function to invert_op' 2021-08-19 22:49:51 +08:00
test_iterator.py fix: for loop dataset iterator will cause memory leak 2021-08-30 16:08:26 +08:00
test_lfilter.py [feat][assistant][I3T96B]add new data operator LFilter 2021-09-11 02:05:43 -07:00
test_linear_transformation.py Fix validation of RGB2HSV/HSV2RGB/RandomResizedCrop in py_transform 2021-04-01 19:09:07 +08:00
test_lowpass_biquad.py [feat] [assistant] [I3ALCA] add new LowpassBiquad operator 2021-08-26 18:49:21 +08:00
test_magphase.py [feat][assistant][I3ALC5] add new method Magphase 2021-09-17 16:02:46 +08:00
test_mask_op.py modify log in kernel part 2021-09-16 22:09:21 +08:00
test_minddataset.py fix: for loop dataset iterator will cause memory leak 2021-08-30 16:08:26 +08:00
test_minddataset_exception.py fix mindrecord log 2021-09-15 16:18:40 +08:00
test_minddataset_multi_images.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_minddataset_multi_images_and_ndarray.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_minddataset_padded.py fix md padding bug 2020-10-30 12:00:44 +08:00
test_minddataset_sampler.py Add SubsetSampler 2021-01-27 15:00:18 -05:00
test_mixup_label_smoothing.py MD Profiling UT: Check CPU util file. Add sequential pipeline UTs 2021-06-16 15:30:59 -04:00
test_mixup_op.py modify log in kernel part 2021-09-16 22:09:21 +08:00
test_mu_law_decoding_op.py [feat][assistant][I3CEG5] add new data OP MuLawDecoding 2021-09-10 15:49:46 +08:00
test_ngram_op.py Fix validation of RGB2HSV/HSV2RGB/RandomResizedCrop in py_transform 2021-04-01 19:09:07 +08:00
test_nlp.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_noop_mode.py minddata use new ps api 2020-09-27 17:38:22 +08:00
test_normalizeOp.py Bug in Normalize when num_channels > 128 2021-05-18 12:23:11 -04:00
test_normalizepad_op.py fix RandomAffine degree error and some examples in docs 2021-03-12 17:39:38 +08:00
test_num_samples.py Fixing api leftover 2021-03-03 09:37:06 -05:00
test_onehot_op.py fix: may max openfiles in mindrecord and onehot error in py_transform 2021-09-12 00:25:07 +08:00
test_opt.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_opt_pass.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_pad.py fix bugs of execute & update doc description in minddata 2021-02-07 22:52:52 +08:00
test_pad_batch.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_pad_end_op.py modify log of dataset part 2021-05-06 23:33:17 +08:00
test_paddeddataset.py fix: wrong input order in test_paddeddataset.py 2021-04-09 17:22:31 +08:00
test_pair_truncate.py Add more callable test and clean the input check 2021-03-03 17:30:36 -05:00
test_profiling.py MD Profiling: Update Connector Init to Remove any existing file 2021-09-03 15:45:38 -04:00
test_project.py order dict by column_id in create_dict_iterator() 2020-09-11 15:33:47 -04:00
test_pyfunc.py add check for shm available when num_devices=1 to avoid bus errors 2021-09-24 00:53:02 -07:00
test_python_tokenizer.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_random_affine.py minddata modify dir validation 2021-05-06 21:35:31 +08:00
test_random_apply.py added python api based on cpp api 2020-11-25 15:46:59 -05:00
test_random_choice.py added python api based on cpp api 2020-11-25 15:46:59 -05:00
test_random_color.py minddata modify dir validation 2021-05-06 21:35:31 +08:00
test_random_color_adjust.py fix error msg issue 2021-01-30 11:03:53 +08:00
test_random_crop.py Add Random operation with MultiField 2021-09-08 19:29:23 +08:00
test_random_crop_and_resize.py Add Random operation with MultiField 2021-09-08 19:29:23 +08:00
test_random_crop_and_resize_with_bbox.py minddata err msg add file path 2021-01-22 16:38:46 +08:00
test_random_crop_decode_resize.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_random_crop_with_bbox.py fix RandomAffine degree error and some examples in docs 2021-03-12 17:39:38 +08:00
test_random_dataset.py Change epoch count to 1 for python testcases 2020-09-01 11:24:26 -04:00
test_random_erasing.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_random_grayscale.py fix RandomAffine degree error and some examples in docs 2021-03-12 17:39:38 +08:00
test_random_horizontal_flip.py Add Random operation with MultiField 2021-09-08 19:29:23 +08:00
test_random_horizontal_flip_with_bbox.py fix RandomAffine degree error and some examples in docs 2021-03-12 17:39:38 +08:00
test_random_order.py !5801 [MD][Feature] minddata iterator output ms_tensor 2020-09-11 20:19:06 +08:00
test_random_perspective.py fix RandomAffine degree error and some examples in docs 2021-03-12 17:39:38 +08:00
test_random_posterize.py modify log in kernel part 2021-09-16 22:09:21 +08:00
test_random_resize.py Add Random operation with MultiField 2021-09-08 19:29:23 +08:00
test_random_resize_with_bbox.py fix RandomAffine degree error and some examples in docs 2021-03-12 17:39:38 +08:00
test_random_rotation.py MindData Codespell correction 2021-04-07 10:20:29 +08:00
test_random_select_subpolicy.py fix RandomAffine degree error and some examples in docs 2021-03-12 17:39:38 +08:00
test_random_sharpness.py change code to import APIs from mindspore.dataset rather than mindspore.dataset.engine 2020-12-24 17:30:02 +08:00
test_random_solarize_op.py minddata modify dir validation 2021-05-06 21:35:31 +08:00
test_random_vertical_flip.py Add Random operation with MultiField 2021-09-08 19:29:23 +08:00
test_random_vertical_flip_with_bbox.py fix RandomAffine degree error and some examples in docs 2021-03-12 17:39:38 +08:00
test_rename.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_repeat.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_rescale_op.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_resize.py Fix validation of RGB2HSV/HSV2RGB/RandomResizedCrop in py_transform 2021-04-01 19:09:07 +08:00
test_resize_with_bbox.py minddata err msg add file path 2021-01-22 16:38:46 +08:00
test_rgb_bgr.py Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset" 2021-08-23 01:46:38 +08:00
test_rgb_hsv.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_rotate.py fix param check for Rotate and GaussianBlur 2021-07-01 20:31:33 +08:00
test_sampler.py Adding inheritance to user defined sampler 2021-03-09 18:14:49 -05:00
test_sampler_chain.py voc add image_id column 2021-05-17 16:09:04 +08:00
test_save_op.py fix waring to master 2021-07-30 16:37:27 +08:00
test_schema.py [feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset 2021-08-22 16:26:45 +08:00
test_sentencepiece_tokenizer.py Fix CI warning and test team issues 2021-03-11 13:34:51 -05:00
test_serdes_dataset.py minddata error message optimize 2021-09-15 18:05:02 +08:00
test_shuffle.py fix RandomAffine degree error and some examples in docs 2021-03-12 17:39:38 +08:00
test_skip.py [feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset 2021-08-22 16:26:45 +08:00
test_slice_op.py minddata modify dir validation 2021-05-06 21:35:31 +08:00
test_slice_patches.py [feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset 2021-08-22 16:26:45 +08:00
test_sliding_window.py Add more callable test and clean the input check 2021-03-03 17:30:36 -05:00
test_soft_dvpp.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_split.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_sync_wait.py Fix validation of RGB2HSV/HSV2RGB/RandomResizedCrop in py_transform 2021-04-01 19:09:07 +08:00
test_take.py [feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset 2021-08-22 16:26:45 +08:00
test_ten_crop.py fix RandomAffine degree error and some examples in docs 2021-03-12 17:39:38 +08:00
test_tensor_empty.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_tensor_string.py Clean up the view code 2020-09-19 19:02:04 +08:00
test_text_basic_tokenizer.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_text_bert_tokenizer.py Fix CI warning and test team issues 2021-03-11 13:34:51 -05:00
test_text_jieba_tokenizer.py files_need_cleanup fixes 2021-05-30 15:44:08 -04:00
test_text_tokenizer.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_text_wordpiece_tokenizer.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_time_masking.py [fix] [assistant] [I465ZG] revise error message and change input param datatype 2021-08-25 10:47:27 +08:00
test_time_stretch.py Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset" 2021-08-23 01:46:38 +08:00
test_to_number_op.py Fix CI warning and test team issues 2021-03-11 13:34:51 -05:00
test_to_pil.py change map calls 2020-09-10 10:25:05 -04:00
test_to_type.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_type_cast.py minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
test_uniform_augment.py Fix validation of RGB2HSV/HSV2RGB/RandomResizedCrop in py_transform 2021-04-01 19:09:07 +08:00
test_unique_op.py fix unorder_map hash 2020-10-24 11:03:06 +08:00
test_var_batch_map.py fix some syntax error 2021-09-14 21:29:02 +08:00
test_vertical_flip.py add Rotate Python API 2021-06-08 22:19:15 +08:00
test_vocab.py dataset: C++ API ToNumber & Lookup: change data_type parm from string to DataType 2021-04-19 12:35:37 -04:00
test_vol.py [feat][assistant][I3CEGI] add op vol 2021-09-17 09:34:20 +08:00
test_zip.py fix schema & zip validation 2020-12-01 14:23:56 +08:00
util.py dataset UT: check PIL version, delete test_callback_2maps 2020-09-24 17:01:06 -04:00

README.md

DE Dataset Ops Test (Python)

Environment

Python3.7 (PyCharm IDE is recommended)

Introduce of data

All of data used in this folder created by Huawei Technologies Co.