Commit Graph

590 Commits

Author SHA1 Message Date
mindspore-ci-bot 1c191a65fb !12765 Fix numpy input to samplers
From: @hfarahat
Reviewed-by: 
Signed-off-by:
2021-03-04 04:57:40 +08:00
mindspore-ci-bot c07371f5c9 !12763 Fix C++ API testcases
From: @ezphlow
Reviewed-by: 
Signed-off-by:
2021-03-04 04:57:28 +08:00
Eric f9a2379a70 Fixing api leftover
Fixed compile error

Fixed more testcases
2021-03-03 09:37:06 -05:00
alex-yuyue 66aff93940 Fix test team issue: ToNumber in eager mode.
And support multiple tensor as input in call method

Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-03-02 17:39:44 -05:00
hesham 616d1a1f3d Fix sampler supporting numpy input 2021-03-01 12:41:59 -05:00
hesham aa4298721a Fix sampler error messages 2021-02-23 23:58:19 -05:00
YangLuo d8ace8f041 fix minddata issues 2021-02-19 10:53:49 +08:00
mindspore-ci-bot c5df707b69 !12327 Block caching after random pyfunc cases
From: @lixiachen
Reviewed-by: 
Signed-off-by:
2021-02-17 08:56:10 +08:00
Lixia Chen 0667818d9a Block caching after random pyfunc 2021-02-12 14:10:00 -05:00
Mahdi 4b106f184c Fixed an issue with SequentialSampler 2021-02-10 12:55:10 -05:00
mindspore-ci-bot 260c77f4ad !12336 [MD] fix sampler log & transform log
From: @luoyang42
Reviewed-by: 
Signed-off-by:
2021-02-10 15:33:15 +08:00
luoyang 416ad23e9d fix resize & randomcoloradjust
fix sampler
2021-02-10 12:53:27 +08:00
mindspore-ci-bot 923dd47b0f !12331 Adding validators back to check method
From: @ezphlow
Reviewed-by: @robingrosman,@nsyca,@robingrosman
Signed-off-by: @robingrosman
2021-02-10 08:58:02 +08:00
Eric 5d91fa6d77 changed discription
Added validator checks

Added builtin sampler check

Added proper input check for samplers
2021-02-09 18:00:53 -05:00
hesham 58193bc469 User explicit deepcopy 2021-02-09 17:25:21 -05:00
luoyang cd86788cf3 fix bugs of execute & update doc description in minddata 2021-02-07 22:52:52 +08:00
TinaMengtingZhang ddab5ad417 Add support for vision op and py_transform op to serdes 2021-02-03 12:31:09 -05:00
mindspore-ci-bot e8f4cafd02 !11950 Overwrite default port/hostname from env variables for cache_admin
From: @lixiachen
Reviewed-by: 
Signed-off-by:
2021-02-03 23:38:48 +08:00
Lixia Chen 97cd142f8d Overwrite default port/hostname from env variables
update copyright

add examples to CacheClient docstring
2021-02-02 20:39:19 -05:00
hesham 1185218335 Support list of IDs as a sampler 2021-02-02 11:44:38 -05:00
luoyang fa4f67cbcd LookupOp: default value of unknown_token support NoneType 2021-02-02 16:17:02 +08:00
Nat Sutyanyong 5a7dc0accc Migrate repeat_pass.cc to IR optimizer and remove ExecTree optimizer 2021-02-01 12:30:16 -05:00
mindspore-ci-bot 320ea51308 !11853 Add call for decoupled image and text ops
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
2021-02-01 19:47:00 +08:00
mindspore-ci-bot 794af6d094 !11834 [MD] Fix error msg description of dataset
From: @xiefangqi
Reviewed-by: @liucunwei,@heleiwang
Signed-off-by: @liucunwei
2021-01-30 14:49:24 +08:00
xiefangqi 3d72282f26 fix error msg issue 2021-01-30 11:03:53 +08:00
alex-yuyue 6fd58dc580 Add call for decoupled image and text ops
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-01-29 21:36:31 -05:00
Mahdi 8f34faeb7a Changed bindings to SamplerObj 2021-01-29 14:20:05 -05:00
mindspore-ci-bot 20c1727b2c !11631 Add SubsetSampler
From: @hfarahat
Reviewed-by: 
Signed-off-by:
2021-01-29 03:48:45 +08:00
mindspore-ci-bot 8e4a6842ff !11681 gnn support edge weight sampling
From: @heleiwang
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
2021-01-28 19:15:37 +08:00
heleiwang 2dc9ba761c gnn support weight sampling neighbors. 2021-01-28 15:28:44 +08:00
hesham 7120c66998 Add SubsetSampler 2021-01-27 15:00:18 -05:00
mindspore-ci-bot 4cd6588af0 !11393 Migrating cache transform pass from execution tree to IR tree
From: @lixiachen
Reviewed-by: 
Signed-off-by:
2021-01-27 22:10:13 +08:00
mindspore-ci-bot f2fd357ffc !11623 fix issues of MD
From: @luoyang42
Reviewed-by: 
Signed-off-by:
2021-01-27 14:37:55 +08:00
luoyang 415c8b08a5 fix issues of MD:
1. description of num_shard in datasets.py
2. add param validation for sampler
3. add description for add_child in sampler.py
2021-01-27 09:30:42 +08:00
Lixia Chen 922e1f4f36 Migrate CacheTransformPass 2021-01-26 19:24:10 -05:00
mindspore-ci-bot 3708624a25 !11559 [MD] Change the default spill location of cache server
From: @lixiachen
Reviewed-by: 
Signed-off-by:
2021-01-27 03:12:24 +08:00
Lixia Chen be6d310946 Default to memory-only cache server 2021-01-25 18:38:24 -05:00
xiefangqi 3f76abcdee minddata err msg add file path 2021-01-22 16:38:46 +08:00
mindspore-ci-bot 2beb916bf5 !11427 TextOp decoupling
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
2021-01-22 09:09:41 +08:00
mohammad b5e91139e2 add GetDatasetSize to concat node 2021-01-21 16:25:48 -05:00
alex-yuyue a8675f8227 TextOp decoupling
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-01-20 21:52:45 -05:00
Lixia Chen 273865a72b Rename SamplerObj::Build() to SamplerBuild() 2021-01-18 15:42:34 -05:00
TinaMengtingZhang d3fdbceb61 [Part II] Push down json save logic to IR and add getter to each IR node 2021-01-15 18:03:37 -05:00
alex-yuyue b54e01bfb4 Tensor op decoupling stage 2
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-01-14 11:51:16 -05:00
TinaMengtingZhang 4812fece80 [Part I] Push down json save logic to IR and add getter to each IR node 2021-01-12 11:17:45 -05:00
Nat Sutyanyong 686772cce7 Migrate GeneratorOp resetting logic to IR optimizer (incl. debug code)
with comments from the peer view addressed
2021-01-11 12:20:40 -05:00
mindspore-ci-bot 7957a3b6f5 !10988 Tensor op decoupling stage 1
From: @ezphlow
Reviewed-by: 
Signed-off-by:
2021-01-09 05:12:10 +08:00
Eric be46ccf721 Started vision decoupling
map validate params

Changing bindings

Change behavior of vision.cc

Added signature and changed Cmake

Compiling

Need to fix compile

Added compiling random transforms

python changes for decoupling

two failed test case remaining

Compiling random choice

passes all ut

Changed assert

review comments

Added validate params

add back return value

Fix lint

py lint fix

pylint 2

Addressing comments
2021-01-08 09:42:20 -05:00
Zirui Wu 0e68575e77 port over getter pass
port over tensor_op_fusion pass

add fusion support for prebuildOpeartion (TensorOpeartion)
2021-01-07 10:52:49 -05:00
mindspore-ci-bot 03e655f14a !10070 Fixing GetDatasetSize issue with chained samplers
From: @mahdirahmanihanzaki
Reviewed-by: 
Signed-off-by:
2021-01-06 05:11:51 +08:00