yankf21
/
mindspore2022
forked from huawei/mindspore2022
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,863 Commits 18 Branches 22 Tags 3.6 GiB
Commit Graph

383 Commits

Author SHA1 Message Date
mindspore-ci-bot ed954dc407 !4782 Python UT fails on RandomPosterize 
Merge pull request !4782 from islam_amin/bbox_class
 2020-08-20 10:18:59 +08:00
islam_amin 85357238fe Fixing posterize python ut 2020-08-19 21:35:07 -04:00
Jesse Lee 8a08d0c37b Phase 2 of CacheOp 2020-08-19 13:45:55 -04:00
Zirui Wu 78c1aa1d96 Implemented Callback for Dataset 
implment pause in MapOp, added more to callback

add ds_callback

- Initial drop of Python DSCallback

- Pybind DSCallback

- Pybind DSCallback

added callback to mapOp

- de_pipeline DSCallback

- de_pipeline DSCallback

add test case, segfault for now

fix seg fault

- de_pipeline DSCallback

remove 1 line

update callback test case, now works

use builder class for mapOp callback

- de_pipeline DSCallback

- de_pipeline DSCallback

- de_pipeline DSCallback

better test case

minor fix

add comments and minor clean ups

get rid of nullptr in MapOp, use other flag instead

fix a bug ParseMapOp only takes 1 callback

- Added WaitedDSCalabck

refactor callback param

fix text case incorrect number

- added testing

fix cpp test case

- added testing

- revert back lenet changes

- cleanup test_callbacks.py

- cleanup test_callbacks.py

fix CI stage I

fix CI stage II

fix CI and update epoch counter

- add validation
- add more testing  test_callbacks.py

use random data op to do tests

adjust when to call EpochBegin/End

- add repeat with callback

- addressing reviewers' comments

- docstring and CI fixes

- docstring and CI fixes

- docstring and CI fixes

- rebase with upstream/master

fix cpp test case

fix review comments

addr review cmts, add test case
 2020-08-19 12:31:04 -04:00
mindspore-ci-bot 256dccc651 !4498 Gnn data processing supports distributed scenarios 
Merge pull request !4498 from heleiwang/gnn_distributed
 2020-08-19 16:09:05 +08:00
heleiwang 8ee4d8e92d Gnn data processing supports distributed scenarios 2020-08-19 11:09:01 +08:00
mindspore-ci-bot 50b5c8035b !4701 fix concat get_dataset_size error 
Merge pull request !4701 from guozhijian/fix_concat_get_dataset_size_err
 2020-08-19 09:14:30 +08:00
nhussain 738ae2c78d change api to use std_vector 
try to display image
 2020-08-18 15:41:21 -04:00
islam_amin 979111d0ef Added Posterize Op 2020-08-18 13:55:47 -04:00
jonyguo b0b370336f fix: concat get_dataset_size error 2020-08-18 23:40:17 +08:00
jonyguo 5f294fb90d fix: random affine parameter check 2020-08-18 21:58:53 +08:00
mindspore-ci-bot 113ff6ca24 !4367 CutMixBatch Augmentation Op 
Merge pull request !4367 from MahdiRahmaniHanzaki/cutmix
 2020-08-18 03:27:33 +08:00
mahdi 3ecc53fb4e Added CutMix 2020-08-17 13:01:47 -04:00
jonyguo 8bb4449fa8 add testcase for padded dataset with decode op 2020-08-17 16:43:23 +08:00
mayang c410c6a6e2 soft_dvpp_decode_resize_jpeg_op issue resolved, input size can be an int, break the constraints of input size being sequence (height, width) 2020-08-17 14:57:04 +08:00
Alexey Shevlyakov 8526d5414d RandomColor 2020-08-13 16:10:21 -04:00
mindspore-ci-bot 7a10e07fc6 !4383 Add distributedSampler to concatOP 
Merge pull request !4383 from genglishuai/genglshOK
 2020-08-14 00:06:06 +08:00
genglishuai 4d4df68d1e add DistributedSampler for Concat op 2020-08-13 22:52:02 +08:00
mindspore-ci-bot ed1244558c !4366 Fixing param type in c++ api and fixing python validator for Repeat Op 
Merge pull request !4366 from TinaMengtingZhang/cpp-api-repeat-count
 2020-08-13 22:03:39 +08:00
tinazhang 0868720eb7 fix parameter type for repeat op in c++ api and added c++/python ut. 2020-08-12 17:23:42 -04:00
anzhengqi 3e31ac6d62 all Dataset support get_dataset_size 2020-08-12 15:35:47 +08:00
mindspore-ci-bot 9276a9d2fb !3771 C++ API Support for TextFile Dataset 
Merge pull request !3771 from cathwong/ckw_c_api_textfile_nosampler
 2020-08-12 04:32:05 +08:00
avakh 477528de7f random sharpness cpp op support 2020-08-11 15:30:40 -04:00
nhussain 7766efd58e add files 2020-08-11 11:54:14 -04:00
Cathy Wong 7f39b5cfd7 C++ API Support for TextFile Dataset and Unit Tests 2020-08-11 11:53:53 -04:00
mindspore-ci-bot c2997845c2 !4289 Fix pad op validate issue 
Merge pull request !4289 from xiefangqi/fix_pad_validate
 2020-08-11 20:20:35 +08:00
xiefangqi 7ee1e46455 fix pad op validate issue 2020-08-11 17:28:08 +08:00
qianlong e9c4378ed8 add support of soft dvpp op 2020-08-11 15:46:07 +08:00
mindspore-ci-bot 266df56570 !4220 [MD] add num_samples support in minddataset pk sampler 
Merge pull request !4220 from liyong126/minddataset_pk_num_samples
 2020-08-11 11:22:28 +08:00
islam_amin e52d85ba9d Added RandomAffine Op 2020-08-10 17:52:50 -04:00
mindspore-ci-bot 9ad82f79fd !3979 Adding MixUp operation 
Merge pull request !3979 from MahdiRahmaniHanzaki/mixup
 2020-08-10 23:01:26 +08:00
liyong 7341421d3b fix num samples in pk sampler 2020-08-10 19:05:47 +08:00
xiefangqi 3d7826b6df test five crop problem 2020-08-10 16:59:24 +08:00
Mahdi 1896950ae5 Added Mixup 2020-08-07 17:47:16 -04:00
mindspore-ci-bot e19d382473 !3346 Maintain epoch/repeat count for ops 
Merge pull request !3346 from lixiachen/repeat_rework
 2020-08-07 20:39:19 +08:00
Lixia Chen ac85b77b76 Maintain epoch/repeat count for ops 2020-08-06 09:47:31 -04:00
mindspore-ci-bot 7ec0b5857a !3977 [MD] Refactor Concatenate Op 
Merge pull request !3977 from nhussain/multi_dim_concat_2
 2020-08-06 02:53:06 +08:00
nhussain 61769b2dd9 fix concat 2020-08-05 11:28:56 -04:00
mindspore-ci-bot 27e51c5a63 !3553 Unify np array comparisons 
Merge pull request !3553 from tony_liu2/staging
 2020-07-31 21:39:31 +08:00
dengyutao 388e43f7cb delete parameter block_reader for MindDataset 2020-07-31 11:30:05 +08:00
xiefangqi 6017b050ac add generatordataset support split 2020-07-30 15:51:28 +08:00
tony_liu2 269b477684 use np.testing.assert instead of asserting 
fix line lengths

fix spacing

reverse a few changes
 2020-07-29 14:53:01 -04:00
mindspore-ci-bot d06da1d270 !3603 Check that the number columns of names and default matches 
Merge pull request !3603 from jiangzhiwen/fix_column_names_exceeded
 2020-07-29 11:40:06 +08:00
jiangzhiwen 2cc6b5cb52 fix number of columns not match 2020-07-29 09:19:33 +08:00
guansongsong 1906ed1be8 fix cache description again 2020-07-28 13:26:29 +08:00
guansongsong b6529b9096 fix cache description 2020-07-28 13:03:06 +08:00
guansongsong 620d951e5e Merge branch 'ql/fix_cache_core' of https://gitee.com/qianlong21st/mindspore into ql/fix_cache_core 2020-07-28 11:37:06 +08:00
mindspore-ci-bot 9c06a564d1 !2983 Dataset Tensor class cleanup 
Merge pull request !2983 from h.farahat/tensor_class
 2020-07-25 20:59:13 +08:00
qianlong bf87b1d1fb fix cache op core dump 2020-07-25 18:37:02 +08:00
mindspore-ci-bot 0a2980ca74 !3440 [MD]Fix Segementation Falut when SentencepieceTokenizer Op before zipOp and ConcatOp 
Merge pull request !3440 from xulei/sentence_piece0715
 2020-07-25 09:19:34 +08:00