yankf21
/
mindspore2022
forked from huawei/mindspore2022
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,217 Commits 18 Branches 22 Tags 3.6 GiB
Commit Graph

28 Commits

Author SHA1 Message Date
liyong bfba630aa2 update pK_sampler 2020-04-27 21:40:49 +08:00
Alexey Shevlyakov 6acae622dc fix random seed behaviour 2020-04-22 14:25:57 -04:00
mindspore-ci-bot dc0491caf9 !508 [Dataset] Adding sync_wait operator for dataset 
Merge pull request !508 from EricZ/master
 2020-04-22 06:15:24 +08:00
mindspore-ci-bot b0f4b36f48 !511 Uniform Augmentation C++ OP 
Merge pull request !511 from AdelShafiei/uniform_augmentation
 2020-04-22 06:06:04 +08:00
eric cd94518769 X# This is a combination of 2 commits. 
Initial commit for dataset op python

Added signature to barrier

Adde compiling barrier code

Rebasing, fixed new compile errors

Final fix for make_unique

Added pybind API for barrier

Fixed pyfunc invocation

python interface - sync_wait

!1 sync_wait python interface
* python interface - sync_wait

fix test

update test

update test

Added new test case

add test case

test for shuffle + batch

Added two-sync test case

Restrited that no shuffle after sync

Added sync to pipeline info

block first databuffer as well

Intelligently get batch size

Fix default case

Lock Pair shares among all iterators

Added fix for empty character

Fixed up test case formatting

Fix end of epoch in sync_wait

Fixing CI
 2020-04-21 17:42:13 -04:00
Adel Shafiei 5fcd3f01a6 Added C++ UniformAugOp support 2020-04-21 17:04:05 -04:00
liyong f1542a90a3 add pk sampler 2020-04-21 10:08:38 +08:00
mindspore-ci-bot 98fbd30a5b !460 [Data]Add filter operation 
Merge pull request !460 from xulei/filter_master
 2020-04-20 23:33:44 +08:00
mindspore-ci-bot 822a3160e4 !404 [Dataset] Add Python Sampler support for CPP dataset 
Merge pull request !404 from JunhanHu/python_sampler_for_cpp_dataset
 2020-04-20 22:45:51 +08:00
xulei2020 c705ea5e5b add filterOp code 2020-04-20 22:32:19 +08:00
yanghaitao 2795e492ff TextFileDataset 2020-04-20 11:18:55 +08:00
Junhan Hu 43a2e99833 Add python sampler support for CPP dataset 2020-04-19 20:36:37 -04:00
ms_yan f0c07c3fa6 Realize take op and add ut 2020-04-18 18:33:57 +08:00
jzw 3f7054dccb add skip dataset op 2020-04-17 19:48:25 +08:00
mindspore-ci-bot c0c0b0985e !378 Multiple Iterators can cause performance problem 
Merge pull request !378 from h.farahat/multi_itr
 2020-04-17 04:18:44 +08:00
hesham fb6c7ba2e1 Fix two problem when we create multiple instances of the same dataset (2 for-loops) 
-- Iterator list is keeping  all created iterators wihtout cleaning them up
-- alter tree modifies the original.
 2020-04-16 15:04:29 -04:00
mindspore-ci-bot cf026096a6 !183 Mindspore.dataset CPP sampler for GeneratorDataset 
Merge pull request !183 from JunhanHu/cpp_sampler
 2020-04-16 22:30:59 +08:00
chenjianping 1286767d0e support building on windows 2020-04-15 09:36:48 +00:00
Junhan Hu 9739d3b048 Add CPP sampler support for GeneratorDataset 2020-04-14 12:09:03 -04:00
mindspore-ci-bot f1fa2a9941 !273 [MD] update subset random sampler in minddataset 
Merge pull request !273 from liyong126/mindrecord_subset_sampler_python
 2020-04-14 11:18:36 +08:00
mindspore-ci-bot d9cd681c30 !207 Fix potential overflow in batch by changing int32 to int64 
Merge pull request !207 from ZiruiWu/batch_info_overflow
 2020-04-14 01:55:35 +08:00
liyong 0ce83e39e1 fix TestShardSampleWrongNumber 
adjust internal api
 2020-04-13 21:31:45 +08:00
liyong 11403492ae add mindrecord subset random sampler 2020-04-11 18:48:23 +08:00
Zirui Wu 19f2ea6d41 change int32 to int64 to avoid overflow in batch 
fix clang

pybind fix
 2020-04-09 11:23:43 -04:00
mindspore-ci-bot cc75cb357c !168 remove mindspore::make_unique and make_unique.h 
Merge pull request !168 from Alexey_Shevlyakov/remove_mindspore_make_unique
 2020-04-09 05:32:52 +08:00
Jonathan Yan 9d0fde29f4 remove ENABLE_MINDRECORD flag 2020-04-07 14:55:45 -04:00
Alexey Shevlyakov 84d780c1a4 remove make_unique.h 2020-04-07 14:00:09 -04:00
zhunaipan 930a1fb0a8 initial version 
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
 2020-03-27 22:54:54 +08:00