yankf21
/
mindspore2022
forked from huawei/mindspore2022
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,217 Commits 18 Branches 22 Tags 3.6 GiB
Commit Graph

23 Commits

Author SHA1 Message Date
yanghaitao c87e174661 checkout python_multiprocess type for map 2020-04-27 15:47:45 +08:00
yanghaitao 60f2663326 Check TfFileDataset num_shards and shard_id 2020-04-26 15:45:50 +08:00
ms_yan 763aa1067e Add Error catch for giving too many input parameters 2020-04-22 20:02:55 +08:00
mindspore-ci-bot eda63a559a !477 Fix VOC dataset test cases 
Merge pull request !477 from xiefangqi/xfq_fix_voc
 2020-04-22 10:15:25 +08:00
eric cd94518769 X# This is a combination of 2 commits. 
Initial commit for dataset op python

Added signature to barrier

Adde compiling barrier code

Rebasing, fixed new compile errors

Final fix for make_unique

Added pybind API for barrier

Fixed pyfunc invocation

python interface - sync_wait

!1 sync_wait python interface
* python interface - sync_wait

fix test

update test

update test

Added new test case

add test case

test for shuffle + batch

Added two-sync test case

Restrited that no shuffle after sync

Added sync to pipeline info

block first databuffer as well

Intelligently get batch size

Fix default case

Lock Pair shares among all iterators

Added fix for empty character

Fixed up test case formatting

Fix end of epoch in sync_wait

Fixing CI
 2020-04-21 17:42:13 -04:00
xiefangqi 108eeb8e3d fix voc test cases 2020-04-21 21:22:46 +08:00
mindspore-ci-bot 98fbd30a5b !460 [Data]Add filter operation 
Merge pull request !460 from xulei/filter_master
 2020-04-20 23:33:44 +08:00
mindspore-ci-bot 822a3160e4 !404 [Dataset] Add Python Sampler support for CPP dataset 
Merge pull request !404 from JunhanHu/python_sampler_for_cpp_dataset
 2020-04-20 22:45:51 +08:00
xulei2020 c705ea5e5b add filterOp code 2020-04-20 22:32:19 +08:00
yanghaitao 2795e492ff TextFileDataset 2020-04-20 11:18:55 +08:00
Junhan Hu 43a2e99833 Add python sampler support for CPP dataset 2020-04-19 20:36:37 -04:00
ms_yan f0c07c3fa6 Realize take op and add ut 2020-04-18 18:33:57 +08:00
jzw 3f7054dccb add skip dataset op 2020-04-17 19:48:25 +08:00
Junhan Hu 9739d3b048 Add CPP sampler support for GeneratorDataset 2020-04-14 12:09:03 -04:00
mindspore-ci-bot 7f8c9ebf10 !194 Fix dataset parameter check 
Merge pull request !194 from pengyanjun/fix_dataset_para_validator_check
 2020-04-09 21:21:32 +08:00
Yanjun Peng 363632ca9d fix dataset para validator check 2020-04-09 20:15:22 +08:00
Cathy Wong 917aa02e2a Correct dataset error checking 2020-04-08 16:36:06 -04:00
ms_yan ff38eff9ae add parameter check for Class Schema 2020-04-07 21:35:39 +08:00
chang zherui 7696c21e65 fix runtest.sh for python ut 2020-04-07 13:10:33 +08:00
ms_yan fc9d088794 add parameter check for Class Schema 2020-04-05 13:43:15 +08:00
anzhengqi 6a1b865c91 check num_samples 2020-04-01 14:39:23 +08:00
ms_yan 7b5640da4e Repair parameter check problem in TFRecordDataset 2020-03-31 18:58:58 +08:00
zhunaipan 930a1fb0a8 initial version 
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
 2020-03-27 22:54:54 +08:00