like20
/
mindspore2022
forked from huawei/mindspore2022
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
19,824 Commits 18 Branches 0 Tags 564 MiB
Commit Graph

477 Commits

Author SHA1 Message Date
mindspore-ci-bot 98a87ad969 !13220 Add data helper to C++ API 
From: @ezphlow
Reviewed-by: 
Signed-off-by:
 2021-03-13 09:52:54 +08:00
Eric 82f7c6f2c7 Moving data_helper 
exposing json

WIP fix for removing templates

Removing templates part 1

replacing core/constants.h

removed template part 2

Changed fake data to filler data

Fixing CI

Fix CI part 2

CI fix part 2

Fix CI 3

Fixed lizard for data_util

Fixed clang

Fixing CI part 4
 2021-03-12 15:30:34 -05:00
mindspore-ci-bot 483bb9de60 !13078 dataset UT: Reinstate INFO logging and data verification - part 2 
From: @cathwong
Reviewed-by: 
Signed-off-by:
 2021-03-13 03:55:34 +08:00
Cathy Wong 95bbaaf9f6 dataset: Reinstate INFO logging and data verification - part 2 
for image/vision datasets
 2021-03-12 10:07:45 -05:00
mindspore-ci-bot f7040ca134 !13198 Fix get_dataset_size error with PKSampler 
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
 2021-03-12 06:11:26 +08:00
Zirui Wu 2692e3cc3d fix pk sampler's get_dataset error due to num_class unavaiable at pre-runtime 2021-03-11 15:43:02 -05:00
mindspore-ci-bot 236c874e64 !12862 Increase default level of parallelism in minddata pipeline 
From: @robingrosman
Reviewed-by: 
Signed-off-by:
 2021-03-12 04:23:02 +08:00
RobinGrosman a0e75b845a Increase default level of parallelism in mindddata pipeline to 8. 
Adjust memory usage to not increase as parallelism increases.  it will
stay at same level it would be with 4 parallelism
 2021-03-10 18:38:11 -08:00
mindspore-ci-bot 0febd9c891 !13017 Add RGB2GRAY Operation 
From: @shenwei41
Reviewed-by: 
Signed-off-by:
 2021-03-11 10:08:25 +08:00
Cathy Wong 71ad3bb808 dataset: Specify Sampler and TensorTransform C++ API classes as final 2021-03-10 15:25:20 -05:00
shenwei41 7b56d1772e Add RGB2GRAY operation 2021-03-10 20:59:50 +08:00
jonyguo c426cd5434 fix: increace deviation_ratio for gnn test case 2021-03-10 15:58:46 +08:00
mindspore-ci-bot 62a6f783b3 !12809 Added pull-based prototype 
From: @mahdirahmanihanzaki
Reviewed-by: 
Signed-off-by:
 2021-03-09 22:31:38 +08:00
Mahdi 9c3c36217e Added pull based prototype 2021-03-08 15:00:14 -05:00
YangLuo 74431ad117 Fix bugs of minddata transforms 2021-03-06 16:41:51 +08:00
Zirui Wu 8022001450 Remove datasets.h dependency on tensor.h and other related dependencies 
Replace std::function<TensorRow(TensorRow)> with std::function<MSTensorVec(MSTensor)> by using std::bind

Replace pad_info with MSTensor

Switch TensorShape/dataset::DataType to vector<int64> /mindspore::DataType

Change TypeId to mindspore::DataType in SchemaObj

address review cmts, add CreateFromMSTensor() in tensor.h/.cc
 2021-03-05 16:26:58 -05:00
mindspore-ci-bot ea8db7baf4 !12936 dataset UT: Reinstate INFO logging and data verification - part 1 
From: @cathwong
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @robingrosman
 2021-03-06 04:36:14 +08:00
Cathy Wong 521c313a3b dataset: Reinstate INFO logging and data verification - part1 2021-03-05 10:13:09 -05:00
mindspore-ci-bot 9baec79337 !12881 add GaussianBlur and Canny for lite_cv 
From: @tiancixiao
Reviewed-by: 
Signed-off-by:
 2021-03-05 17:33:20 +08:00
TinaMengtingZhang 6280582315 fix testcases in c_api_random_test.cc 
fix testcases in c_api_transforms_test.cc
 2021-03-04 11:20:23 -05:00
Xiao Tianci 449452c7ef add gaussian blur and canny for lite cv process 2021-03-04 22:27:48 +08:00
Eric f9a2379a70 Fixing api leftover 
Fixed compile error

Fixed more testcases
 2021-03-03 09:37:06 -05:00
mindspore-ci-bot 4f504ad2a3 !12760 Fix include file(samplers.h) contains internal head file & Fix execute ut 
From: @luoyang42
Reviewed-by: @pandoublefeng,@heleiwang,@liucunwei
Signed-off-by: @pandoublefeng,@liucunwei
 2021-03-03 15:02:52 +08:00
mindspore-ci-bot 7f71525b0a !12810 dataset: Add IR vision error input tests, plus other UT updates 
From: @cathwong
Reviewed-by: 
Signed-off-by:
 2021-03-03 06:24:20 +08:00
Cathy Wong 253f389817 dataset: Add IR vision error input tests, plus other UT updates 2021-03-02 16:33:28 -05:00
YangLuo eecbc99b2e fix minddata include internal head file & fix execute ut 2021-03-02 14:12:33 +08:00
TinaMengtingZhang ccefa8b32e Make Parse() as protected 2021-03-01 15:07:36 -05:00
Cathy Wong 2f1f0c438d dataset: C++ API Vision support for Ops with TensorTransform op input 
plus UTs
 2021-02-26 16:25:30 -05:00
mindspore-ci-bot f1c7aeaa6b !12555 Create C++ API classes for Samplers 
From: @mhmotallebi
Reviewed-by: 
Signed-off-by:
 2021-02-27 02:54:19 +08:00
mindspore-ci-bot 5556b12da4 !12480 Adding Affine API 
From: @ezphlow
Reviewed-by: 
Signed-off-by:
 2021-02-26 21:35:05 +08:00
mohammad f73def5933 make C++ API classes for samplers 2021-02-25 17:29:43 -05:00
Eric d328d6eb54 Adding affine 
Need to move Affine to image_utilC

Refactored affine

Added affine API

Added API class impl

Removed default from vision ir

Compiling

removed extra file

Spell check
 2021-02-25 16:55:02 -05:00
TinaMengtingZhang 518828b639 Support 3 composed data ops and cleanup code 2021-02-24 11:05:44 -05:00
Zhenglong Li 581f1e82d4 API merge with new API class and new IR class 2021-02-24 10:55:18 +08:00
mindspore-ci-bot 182d928379 !12553 dataset: Split c_api_vision_test.cc 
From: @cathwong
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @robingrosman
 2021-02-24 02:01:30 +08:00
Cathy Wong 6112738fea dataset: Split c_api_vision_test.cc 2021-02-23 11:04:29 -05:00
shenwei41 d8d56b5374 GetAffineTransform 2021-02-22 15:22:34 +08:00
Cathy Wong 3fc204e3bc dataset: Create C++ API classes for vision transform ops 
Review rework

Add overloaded API Map function

Overload Execute, update st test_de.cc and enhance ut execute_test.cc;
More TensorTransform support for BoundingBoxAugment and UniformAug

Execute support for auto case; UT updates

Rebase updates, including fix CI Ascend compilations

test_de.cc - comment out dvpp tests

Rebase updates

Added back testcase and constructor

Added back constructor

added missing macro

Fixed Macro

removed decode
 2021-02-20 15:29:33 -05:00
mindspore-ci-bot 98f6d78778 !12361 Provide C++ API class for text and data transforms ops 
From: @tina_mengting_zhang
Reviewed-by: 
Signed-off-by:
 2021-02-20 04:38:26 +08:00
TinaMengtingZhang c5aa3eeef2 Add API class for data transform ops except Compose, RandomApply, RandomChoice 
Add API class for text transforms ops
 2021-02-18 15:58:44 -05:00
mohammad 9e6fcc7f23 return status from sampler IR functions 2021-02-17 12:01:34 -05:00
mindspore-ci-bot c8332c16f7 !11957 getRotationMatrix2D and getPerspectiveTransform 
From: @shenwei41
Reviewed-by: 
Signed-off-by:
 2021-02-11 00:08:56 +08:00
shenwei41 737e828f3d getRotationMatrix2D and getPerspectiveTransform 2021-02-10 12:35:56 +08:00
Zhenglong Li e2d3495925 Dvpp refactor and 6 Dvpp operators 2021-02-10 10:34:38 +08:00
Eric 9953757ff4 Fixed tenor compile error for MD 2021-02-09 14:56:31 +08:00
Cathy Wong 3e6e35d749 dataset: delete minddata/dataset/include/status.h 2021-02-04 10:19:08 -05:00
hesham 715d70f397 Remove setting num_parallel_worker in UT, since it would fail for machines with less than 16 cores. 2021-02-02 11:38:27 -05:00
lixian 7d2fd6e76c cxx api refactor: tensor/status/model 2021-02-02 09:15:56 +08:00
Nat Sutyanyong 5a7dc0accc Migrate repeat_pass.cc to IR optimizer and remove ExecTree optimizer 2021-02-01 12:30:16 -05:00
mindspore-ci-bot f980561fe1 !11598 [MD] add common validation functions for transform 
From: @luoyang42
Reviewed-by: 
Signed-off-by:
 2021-01-30 14:32:44 +08:00