Commit Graph

349 Commits

Author SHA1 Message Date
luoyang cd86788cf3 fix bugs of execute & update doc description in minddata 2021-02-07 22:52:52 +08:00
TinaMengtingZhang ddab5ad417 Add support for vision op and py_transform op to serdes 2021-02-03 12:31:09 -05:00
xulei2020 ee09b38f00 add code for MD lite C++ include and api 2021-02-03 10:45:31 +08:00
luoyang fa4f67cbcd LookupOp: default value of unknown_token support NoneType 2021-02-02 16:17:02 +08:00
mindspore-ci-bot df2da5679d !11901 fix cutout issue & pad doc
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
2021-02-02 15:44:32 +08:00
lixian 7d2fd6e76c cxx api refactor: tensor/status/model 2021-02-02 09:15:56 +08:00
luoyang 8846b50c7f fix cutout issue & pad doc 2021-02-01 20:14:03 +08:00
mindspore-ci-bot 320ea51308 !11853 Add call for decoupled image and text ops
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
2021-02-01 19:47:00 +08:00
yanghaitao1 83cb87bcd1 cpu profiling
add operator profiling part

add op_id param when create task

repair bugs in op cpu sampling

fix wrong order of write and parse cpu_info

add process cpu profiling part

add multiprocessing part(part 1)

adapter cpu_sampling c layer

fix little error in sampling

descrease cirle complex in voc

descrease cirle complex in device_que
2021-02-01 13:18:54 +08:00
mindspore-ci-bot f980561fe1 !11598 [MD] add common validation functions for transform
From: @luoyang42
Reviewed-by: 
Signed-off-by:
2021-01-30 14:32:44 +08:00
alex-yuyue 6fd58dc580 Add call for decoupled image and text ops
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-01-29 21:36:31 -05:00
Mahdi 8f34faeb7a Changed bindings to SamplerObj 2021-01-29 14:20:05 -05:00
YangLuo 1893ae8662 [MD] add common validation functions for transform 2021-01-29 16:29:47 +08:00
mindspore-ci-bot 20c1727b2c !11631 Add SubsetSampler
From: @hfarahat
Reviewed-by: 
Signed-off-by:
2021-01-29 03:48:45 +08:00
heleiwang 2dc9ba761c gnn support weight sampling neighbors. 2021-01-28 15:28:44 +08:00
hesham 7120c66998 Add SubsetSampler 2021-01-27 15:00:18 -05:00
mindspore-ci-bot 029ea5d1f3 !11301 Push sampler to GeneratorOp c++
From: @hfarahat
Reviewed-by: 
Signed-off-by:
2021-01-26 01:31:43 +08:00
hesham c3278c983d Move GeneratorOp sampler to c++ 2021-01-22 12:03:40 -05:00
mindspore-ci-bot 2beb916bf5 !11427 TextOp decoupling
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
2021-01-22 09:09:41 +08:00
mohammad b5e91139e2 add GetDatasetSize to concat node 2021-01-21 16:25:48 -05:00
alex-yuyue a8675f8227 TextOp decoupling
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-01-20 21:52:45 -05:00
Lixia Chen 273865a72b Rename SamplerObj::Build() to SamplerBuild() 2021-01-18 15:42:34 -05:00
mindspore-ci-bot 91842af2ad !11245 Pushing down pipeline json serializer logic to C++ IR - PART II
From: @tina_mengting_zhang
Reviewed-by: 
Signed-off-by:
2021-01-19 04:31:32 +08:00
TinaMengtingZhang d3fdbceb61 [Part II] Push down json save logic to IR and add getter to each IR node 2021-01-15 18:03:37 -05:00
mindspore-ci-bot 0e03630503 !11139 [MD][BugFix] MindData remove the compile link of _c_dataengine and numa
From: @xiefangqi
Reviewed-by: 
Signed-off-by:
2021-01-15 09:12:55 +08:00
mindspore-ci-bot 581789c252 !11246 add num_epochs to CPP API Dataset::CreateIterator()
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
2021-01-15 06:02:00 +08:00
mindspore-ci-bot a2d9c5914a !10944 Tensor op decoupling stage 2
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
2021-01-15 05:28:50 +08:00
mindspore-ci-bot ee3cc09b22 !11259 Fix CI issues
From: @ezphlow
Reviewed-by: @nsyca,@robingrosman
Signed-off-by: @robingrosman
2021-01-15 05:15:10 +08:00
alex-yuyue b54e01bfb4 Tensor op decoupling stage 2
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-01-14 11:51:16 -05:00
Eric f758bfa79f CI fix part 1
Added CI fix
2021-01-13 22:03:58 -05:00
Cathy Wong 4b1ccf9dd5 dataset: Use int32_t for text's vocab_size 2021-01-13 18:12:50 -05:00
Zirui Wu fa553956ef add num_epochs to CPP API Dataset::CreateIterator(columns,num_epochs) 2021-01-13 12:13:40 -05:00
TinaMengtingZhang 4812fece80 [Part I] Push down json save logic to IR and add getter to each IR node 2021-01-12 11:17:45 -05:00
xiefangqi f09fdb2679 change md numa link to dllload 2021-01-12 14:59:09 +08:00
mohammad f48ab2b5c9 make MD public headers standalone 2021-01-11 06:35:53 -05:00
mindspore-ci-bot 3945bdcabb !11094 【MD】fix bug for md pipleline build
From: @xulei2020
Reviewed-by: 
Signed-off-by:
2021-01-10 11:10:38 +08:00
mindspore-ci-bot 7957a3b6f5 !10988 Tensor op decoupling stage 1
From: @ezphlow
Reviewed-by: 
Signed-off-by:
2021-01-09 05:12:10 +08:00
Eric be46ccf721 Started vision decoupling
map validate params

Changing bindings

Change behavior of vision.cc

Added signature and changed Cmake

Compiling

Need to fix compile

Added compiling random transforms

python changes for decoupling

two failed test case remaining

Compiling random choice

passes all ut

Changed assert

review comments

Added validate params

add back return value

Fix lint

py lint fix

pylint 2

Addressing comments
2021-01-08 09:42:20 -05:00
xulei2020 026cdcd6fc fix build for md pipeline 2021-01-08 14:36:47 +08:00
Zirui Wu 0e68575e77 port over getter pass
port over tensor_op_fusion pass

add fusion support for prebuildOpeartion (TensorOpeartion)
2021-01-07 10:52:49 -05:00
mindspore-ci-bot 5fd77356c9 !9687 Adding AddChild functionality to SamplerObj
From: @mahdirahmanihanzaki
Reviewed-by: 
Signed-off-by:
2021-01-06 01:46:08 +08:00
Zhenglong Li 425c3c6abc Fix warning information. 2020-12-24 18:26:23 +08:00
Zhenglong Li d032b69c2d Update Error message for dvpp operator. 2020-12-24 10:37:56 +08:00
Zhenglong Li 17f23ddbf3 Fix compile error 2020-12-19 10:22:29 +08:00
mindspore-ci-bot ad1766492d !10182 fix to_number op
From: @luoyang42
Reviewed-by: @liucunwei,@pandoublefeng
Signed-off-by: @liucunwei
2020-12-18 20:48:11 +08:00
luoyang 7587db9eaa fix to_number 2020-12-18 17:34:29 +08:00
Zhenglong Li 04da5bae5d Fix dvpp parameter validation bug and make information clear, besides, modify Dvpp ut. 2020-12-18 17:06:06 +08:00
Zhenglong Li 13204cb8e3 Add YoloV3 with Dvpp test. 2020-12-17 16:51:40 +08:00
xiaoyisd 5b31b46c8c mac build plus 2020-12-16 09:36:57 +08:00
mindspore-ci-bot 280db3d651 !9844 New Dvpp operation for Ascend 310 chip
From: @lizhenglong1992
Reviewed-by: 
Signed-off-by:
2020-12-15 17:32:49 +08:00