Commit Graph

493 Commits

Author SHA1 Message Date
Xiao Tianci b88a68c9e8 fix canny when size is 7 2021-03-19 17:26:59 +08:00
mindspore-ci-bot 0451a800bc !13571 Added seed to prevent random failures in ut
From: @ezphlow
Reviewed-by: 
Signed-off-by:
2021-03-19 17:17:42 +08:00
Eric a3c98d9d59 Added fix for random core dump 2021-03-18 21:15:50 -04:00
mindspore-ci-bot b45f289801 !13504 Add check of GetPerspectiveTransform and GetAffineTransform
From: @shenwei41
Reviewed-by: @liucunwei,@pandoublefeng
Signed-off-by: @liucunwei
2021-03-18 09:57:52 +08:00
mindspore-ci-bot dd90f7f055 !13506 dataset UT: Reinstate INFO logging and data verification - part 3
From: @cathwong
Reviewed-by: @robingrosman,@liucunwei
Signed-off-by: @robingrosman
2021-03-18 09:35:22 +08:00
Cathy Wong 1775c4e83d dataset: Reinstate INFO logging and data verification - part 3
Updates: GetItemAt, CreateFromVector, CreateScalar.
Add TEST_MS_LOG_MSTENSOR.
Wrap ASSERT_OK around Tensor function calls.
2021-03-17 13:48:04 -04:00
shenwei41 89f109a3f3 add check of operation 2021-03-17 20:29:17 +08:00
Eric a7da38feeb Added example for ngram 2021-03-16 23:45:04 -04:00
mindspore-ci-bot c0aa5f8132 !13365 Fix random rotation input check
From: @ezphlow
Reviewed-by: 
Signed-off-by:
2021-03-17 09:42:37 +08:00
Eric c730df23e8 Added json fix 2 2021-03-16 18:32:42 -04:00
Eric 4be0ffb9ba removing type_id.h from header files 2021-03-16 16:51:10 -04:00
shenwei41 d1bb9d470e Add resizefiller 2021-03-16 20:35:27 +08:00
Eric 9b921953f9 misc issues 2021-03-15 22:30:04 -04:00
Lixia Chen 30017ea5a0 Fix codex issues 2021-03-15 11:15:15 -04:00
mindspore-ci-bot 0cf6fb5310 !13264 [MD] Fix input check bug in RandomSelectSubpolicyOperation and codex issues
From: @tina_mengting_zhang
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @robingrosman
2021-03-15 20:29:56 +08:00
mindspore-ci-bot 98a87ad969 !13220 Add data helper to C++ API
From: @ezphlow
Reviewed-by: 
Signed-off-by:
2021-03-13 09:52:54 +08:00
TinaMengtingZhang ac05546aeb fix input check bug in RandomSelectSubpolicy and codex issue 2021-03-12 16:04:38 -05:00
Eric 82f7c6f2c7 Moving data_helper
exposing json

WIP fix for removing templates

Removing templates part 1

replacing core/constants.h

removed template part 2

Changed fake data to filler data

Fixing CI

Fix CI part 2

CI fix part 2

Fix CI 3

Fixed lizard for data_util

Fixed clang

Fixing CI part 4
2021-03-12 15:30:34 -05:00
mindspore-ci-bot 483bb9de60 !13078 dataset UT: Reinstate INFO logging and data verification - part 2
From: @cathwong
Reviewed-by: 
Signed-off-by:
2021-03-13 03:55:34 +08:00
Cathy Wong 95bbaaf9f6 dataset: Reinstate INFO logging and data verification - part 2
for image/vision datasets
2021-03-12 10:07:45 -05:00
mindspore-ci-bot f7040ca134 !13198 Fix get_dataset_size error with PKSampler
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
2021-03-12 06:11:26 +08:00
Zirui Wu 2692e3cc3d fix pk sampler's get_dataset error due to num_class unavaiable at pre-runtime 2021-03-11 15:43:02 -05:00
mindspore-ci-bot 236c874e64 !12862 Increase default level of parallelism in minddata pipeline
From: @robingrosman
Reviewed-by: 
Signed-off-by:
2021-03-12 04:23:02 +08:00
RobinGrosman a0e75b845a Increase default level of parallelism in mindddata pipeline to 8.
Adjust memory usage to not increase as parallelism increases.  it will
stay at same level it would be with 4 parallelism
2021-03-10 18:38:11 -08:00
mindspore-ci-bot 0febd9c891 !13017 Add RGB2GRAY Operation
From: @shenwei41
Reviewed-by: 
Signed-off-by:
2021-03-11 10:08:25 +08:00
Cathy Wong 71ad3bb808 dataset: Specify Sampler and TensorTransform C++ API classes as final 2021-03-10 15:25:20 -05:00
shenwei41 7b56d1772e Add RGB2GRAY operation 2021-03-10 20:59:50 +08:00
jonyguo c426cd5434 fix: increace deviation_ratio for gnn test case 2021-03-10 15:58:46 +08:00
mindspore-ci-bot 62a6f783b3 !12809 Added pull-based prototype
From: @mahdirahmanihanzaki
Reviewed-by: 
Signed-off-by:
2021-03-09 22:31:38 +08:00
Mahdi 9c3c36217e Added pull based prototype 2021-03-08 15:00:14 -05:00
YangLuo 74431ad117 Fix bugs of minddata transforms 2021-03-06 16:41:51 +08:00
Zirui Wu 8022001450 Remove datasets.h dependency on tensor.h and other related dependencies
Replace std::function<TensorRow(TensorRow)> with std::function<MSTensorVec(MSTensor)> by using std::bind

Replace pad_info with MSTensor

Switch TensorShape/dataset::DataType to vector<int64> /mindspore::DataType

Change TypeId to mindspore::DataType in SchemaObj

address review cmts, add CreateFromMSTensor() in tensor.h/.cc
2021-03-05 16:26:58 -05:00
mindspore-ci-bot ea8db7baf4 !12936 dataset UT: Reinstate INFO logging and data verification - part 1
From: @cathwong
Reviewed-by: @robingrosman,@nsyca
Signed-off-by: @robingrosman
2021-03-06 04:36:14 +08:00
Cathy Wong 521c313a3b dataset: Reinstate INFO logging and data verification - part1 2021-03-05 10:13:09 -05:00
mindspore-ci-bot 9baec79337 !12881 add GaussianBlur and Canny for lite_cv
From: @tiancixiao
Reviewed-by: 
Signed-off-by:
2021-03-05 17:33:20 +08:00
TinaMengtingZhang 6280582315 fix testcases in c_api_random_test.cc
fix testcases in c_api_transforms_test.cc
2021-03-04 11:20:23 -05:00
Xiao Tianci 449452c7ef add gaussian blur and canny for lite cv process 2021-03-04 22:27:48 +08:00
Eric f9a2379a70 Fixing api leftover
Fixed compile error

Fixed more testcases
2021-03-03 09:37:06 -05:00
mindspore-ci-bot 4f504ad2a3 !12760 Fix include file(samplers.h) contains internal head file & Fix execute ut
From: @luoyang42
Reviewed-by: @pandoublefeng,@heleiwang,@liucunwei
Signed-off-by: @pandoublefeng,@liucunwei
2021-03-03 15:02:52 +08:00
mindspore-ci-bot 7f71525b0a !12810 dataset: Add IR vision error input tests, plus other UT updates
From: @cathwong
Reviewed-by: 
Signed-off-by:
2021-03-03 06:24:20 +08:00
Cathy Wong 253f389817 dataset: Add IR vision error input tests, plus other UT updates 2021-03-02 16:33:28 -05:00
YangLuo eecbc99b2e fix minddata include internal head file & fix execute ut 2021-03-02 14:12:33 +08:00
TinaMengtingZhang ccefa8b32e Make Parse() as protected 2021-03-01 15:07:36 -05:00
Cathy Wong 2f1f0c438d dataset: C++ API Vision support for Ops with TensorTransform op input
plus UTs
2021-02-26 16:25:30 -05:00
mindspore-ci-bot f1c7aeaa6b !12555 Create C++ API classes for Samplers
From: @mhmotallebi
Reviewed-by: 
Signed-off-by:
2021-02-27 02:54:19 +08:00
mindspore-ci-bot 5556b12da4 !12480 Adding Affine API
From: @ezphlow
Reviewed-by: 
Signed-off-by:
2021-02-26 21:35:05 +08:00
mohammad f73def5933 make C++ API classes for samplers 2021-02-25 17:29:43 -05:00
Eric d328d6eb54 Adding affine
Need to move Affine to image_utilC

Refactored affine

Added affine API

Added API class impl

Removed default from vision ir

Compiling

removed extra file

Spell check
2021-02-25 16:55:02 -05:00
TinaMengtingZhang 518828b639 Support 3 composed data ops and cleanup code 2021-02-24 11:05:44 -05:00
Zhenglong Li 581f1e82d4 API merge with new API class and new IR class 2021-02-24 10:55:18 +08:00