like20
/
mindspore2022
forked from huawei/mindspore2022
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
3,367 Commits 18 Branches 0 Tags 564 MiB
Commit Graph

157 Commits

Author SHA1 Message Date
ms_yan bc22c172b8 add TensorDataset and its ut 2020-06-11 15:24:12 +08:00
mindspore-ci-bot 251a6667a5 !1989 fix MindDataset distribute shuffle error 
Merge pull request !1989 from guozhijian/fix_distribute_shuffle
 2020-06-11 14:51:17 +08:00
mindspore-ci-bot b3da41bd7a !1913 CocoDataset implementation 
Merge pull request !1913 from xiefangqi/xfq_support_coco
 2020-06-11 14:37:44 +08:00
xiefangqi 097cbcc0cb CocoDataset implementation 2020-06-11 11:52:17 +08:00
jonyguo 96859f44b6 fix: MindDataset distribute shuffle bug 2020-06-11 11:06:34 +08:00
Tinazhang 2812cd57db fix pylint error 2020-06-10 15:55:11 -04:00
mindspore-ci-bot fe0c3e9a8f !1908 Add UT to six data vision transforms ops 
Merge pull request !1908 from Tinazhang/ut-normalize
 2020-06-11 00:43:57 +08:00
heleiwang 3ece8dd090 1. support get_all_edges, get_nodes_from_edge, get_sampled_neighbors, get_neg_sampled_neighbors and graph_info API 
2. mod cora and citeseer conversion script
 2020-06-10 15:52:26 +08:00
mindspore-ci-bot 5eb95599f6 !1874 Updates to string tensor 
Merge pull request !1874 from h.farahat/string_tensor_updates
 2020-06-10 00:59:17 +08:00
Tinazhang c3de5c7a54 adding new TCs to six ops and skip md5 case in RandomPerspective 2020-06-09 10:51:45 -04:00
hesham f837ddc956 - Bug when empty strings sent to Python 
- Support accepting Numpy of str as input
- Support batching strings
- Core logic of batch&pad is static
- Make Pad a utility function
 2020-06-09 10:34:38 -04:00
liyong feff8899ac support padding samples 2020-06-05 09:14:42 +08:00
mindspore-ci-bot 5c21616293 !1807 Implemented Ngram TensorOp for dataset 
Merge pull request !1807 from ZiruiWu/ngram_dev
 2020-06-05 01:04:27 +08:00
Zirui Wu dbf9936ec4 Implemented n-gram for dataset TensorOp 2020-06-04 09:57:44 -04:00
Jamie Nisbet 51bc0c0460 consistent design for num_samples 
updates

more update

more work

more fixin

post rebase updates

clang formatting

code review recovery

ci fixes

updates

update

update

update
 2020-06-03 15:01:18 -04:00
Tinazhang 33fe66fd1e fix error handling for bigger crop size case 2020-06-02 11:06:41 -04:00
Yang 5522edc4b5 !1713 [Dataset] Clean pylint. 2020-06-02 09:02:19 +08:00
liuwenhao4 7b911886ec Fixing some tiny faults about Pylint in my code(ops) 2020-05-30 16:55:37 +08:00
mindspore-ci-bot 7878743400 !1638 fixed rounding edge case in split 
Merge pull request !1638 from Peilin/splitOp-after-testing
 2020-05-30 05:31:33 +08:00
mindspore-ci-bot 0e3dd8149a !1703 Adding sync_wait input check 
Merge pull request !1703 from EricZ/master
 2020-05-30 05:29:38 +08:00
mindspore-ci-bot c366b3fb18 !1704 fix num rows bug in sampler 
Merge pull request !1704 from Peilin/fix-random-sampler-bug
 2020-05-30 05:27:20 +08:00
Eric 8e1b2107ce Added example for sync_wait bad batch_num 
Added broken test case for cv

Fixed error handling in sync_wait
 2020-05-29 16:30:12 -04:00
mindspore-ci-bot 976b4793d1 !1544 Python Unit Test for TenCrop 
Merge pull request !1544 from MahdiRahmaniHanzaki/I1IHNG-ten-crop
 2020-05-30 03:02:29 +08:00
Peilin Wang 3ef3d1433d fixed num_samples bug for RandomSampler 2020-05-29 13:09:26 -04:00
Tinazhang f4a61fdbb2 Adding new UT cases and missing TCs in PY Ops. 2020-05-29 12:12:17 -04:00
Peilin Wang 5469be2a97 fixed bug for split, RandomSampler and some other cleanup 
add another test case

typo

merge conflict

another PR changed testing behavior, updated test cases in this commit

added input check for use_sampler

addressed code review comments

fixed pylint, not related to my changes

fixed edge case of rounding in getting split sizes

fix pylint
 2020-05-29 11:27:32 -04:00
Mahdi dfc097019b Added TenCrop test 
Added unit tests for both testing the functinality of the TenCrop and
its error messages. Due to the similarity of this method to FiveCrop the
test cases are similar to FiveCrop test cases.
Signed-off-by: Mahdi <mahdi.rahmani.hanzaki@huawei.com>

added error_msg function call in the main method

refactored the test and added visual representation of the results

Separated the two error cases into two different functions and used the
visualize function in util.py to plot the result of TenCrop.
Signed-off-by: Mahdi <mahdi.rahmani.hanzaki@huawei.com>

Added new test cases

Added new test cases including test case for checking the error message
when the size variable is not a positive integer, test case for
rectangle crop, test case for vertical flip setting, and testing for
similarity of the result of TenCrop for the same input data in different runs.
Signed-off-by: Mahdi <mahdi.rahmani.hanzaki@huawei.com>

changed visualize in test_five_crop

Changed the visualize function in test_five_crop to use the already
existing function in util.py
Signed-off-by: Mahdi <mahdi.rahmani.hanzaki@huawei.com>

made generate_golden variable global
 2020-05-28 17:52:56 -04:00
mindspore-ci-bot 21da86b393 !1591 add get_dataset_size for CelebADataset 
Merge pull request !1591 from yanghaitao/yht_celeba_get_dataset_size
 2020-05-28 22:21:43 +08:00
yanghaitao cc6c7a3f60 add get_dataset_size to celebadataset 2020-05-28 17:00:14 +08:00
mindspore-ci-bot 0f4dc13e8e !1478 [Dataset] Fix CI warnings, clean pylint. 
Merge pull request !1478 from luoyang/pylint
 2020-05-28 15:54:52 +08:00
Yang 9b2a778d94 !1478 [Dataset] clean pylint. 2020-05-28 14:06:36 +08:00
xiefangqi 5e4728c50f add voc support split 2020-05-28 11:18:32 +08:00
Peilin Wang d4c93575e7 fixed bug for split, RandomSampler and some other cleanup 
add another test case

typo

merge conflict

another PR changed testing behavior, updated test cases in this commit

added input check for use_sampler

addressed code review comments

fixed pylint, not related to my changes
 2020-05-26 16:29:52 -04:00
Yang abca62f407 10:00 26/5 clean pylint 2020-05-26 10:05:12 +08:00
mindspore-ci-bot 0a8ef2fe72 !1455 Cleanup dataset UT: restore config support 
Merge pull request !1455 from cathwong/ckw_dataset_config_util
 2020-05-26 05:40:39 +08:00
Cathy Wong f891e1755c Cleanup dataset UT: restore config support 2020-05-25 15:10:03 -04:00
mindspore-ci-bot aeb4c52f2d !1379 Creating new UTs to three vision transformation ops 
Merge pull request !1379 from Tinazhang/linearTrans
 2020-05-25 23:10:30 +08:00
mindspore-ci-bot 718a96430f !1389 Security issues in recent string tensor PR 
Merge pull request !1389 from h.farahat/fix_security_issues
 2020-05-24 08:45:21 +08:00
mindspore-ci-bot a6b8451a33 !1380 make ShuffleOp have deterministic behavior for subsequent epochs 
Merge pull request !1380 from Peilin/shuffle-subsequent-epoch-deterministic
 2020-05-23 21:02:30 +08:00
heleiwang f28f883cac fix comments error and modify parameter check 2020-05-23 18:31:13 +08:00
hesham c0f0e154f5 Clean up work for text python package 2020-05-22 23:53:34 -04:00
mindspore-ci-bot 41456ac824 !1369 dataset: delete StorageDataset 
Merge pull request !1369 from ms_yan/del_storage
 2020-05-23 10:39:34 +08:00
Tinazhang 7322839b04 add UTs for LinearTransformation, ToPIL, ToType 2020-05-22 18:04:09 -04:00
Peilin Wang 0cbcc7200b made shuffle determinisitc for subsequent epochs 2020-05-22 17:03:19 -04:00
mindspore-ci-bot 61639be1e0 !1375 Cleanup dataset UT: remove num_parallel_workers=1 in test_exception 
Merge pull request !1375 from cathwong/ckw_dataset_ut_cleanup5
 2020-05-22 23:54:52 +08:00
mindspore-ci-bot a528797253 !1377 Code Fix for Uniform Augmentation 
Merge pull request !1377 from Tinazhang/cc
 2020-05-22 23:20:01 +08:00
mindspore-ci-bot 458436186c !1365 Clean up work for text python sub-package 
Merge pull request !1365 from h.farahat/text_namespace
 2020-05-22 23:16:31 +08:00
Tinazhang b390883c6a Bug fix 2020-05-22 10:56:56 -04:00
Cathy Wong 702005d403 Cleanup dataset UT: remove num_parallel_workers=1 in test_exception 2020-05-22 09:28:17 -04:00
ms_yan d5e896b51c delete storageDataset Op API and its test case 2020-05-22 21:23:24 +08:00