Col_lin
/
mindspore2022
forked from huawei/mindspore2022
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
23,188 Commits 18 Branches 22 Tags 3.6 GiB
Commit Graph

1259 Commits

Author SHA1 Message Date
jonyguo 9452142b50 enhance: enable shuffle infile / files when mindrecord 2021-05-14 17:41:18 +08:00
mindspore-ci-bot eb483a276b !16313 Evaluate the func graph in simulative stack, not to call recursively. 
From: @zh_qh
Reviewed-by: @hwhewei,@ginfung
Signed-off-by: @hwhewei
 2021-05-13 08:56:18 +08:00
mindspore-ci-bot b5cddcb8cc !16036 Improve performance of multi-processing option for dataset 
From: @robingrosman
Reviewed-by: 
Signed-off-by:
 2021-05-13 01:41:16 +08:00
RobinGrosman 9a7d1fc034 Optimize multi-process in minddata by passing data via shared memory instead of multiprocessing.queue 2021-05-11 15:16:29 -07:00
zhoufeng a76d58b52d hccl decouple 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-05-11 22:25:00 +08:00
mindspore-ci-bot f356c51169 !16116 graph scheduler support multi graphs 
From: @limingqi107
Reviewed-by: @cristoval,@wilfchen
Signed-off-by: @wilfchen
 2021-05-11 19:33:57 +08:00
Zhang Qinghua 5ad27e7639 Evaluate the func graph in simulative stack, not to call recursively. 2021-05-11 15:36:22 +08:00
mindspore-ci-bot 6fcd6cab68 !16119 Fix minddata issues 
From: @luoyang42
Reviewed-by: @jonyguo,@liucunwei
Signed-off-by: @jonyguo,@liucunwei
 2021-05-11 14:33:29 +08:00
mindspore-ci-bot d3a175e30f !16078 Modify Normalize to accept images with more than 3 channels 
From: @hfarahat
Reviewed-by: @mikef,@robingrosman
Signed-off-by: @robingrosman
 2021-05-11 02:03:34 +08:00
limingqi107 d8399e61e7 graph scheduler support multi graphs 2021-05-10 20:57:04 +08:00
YangLuo 0a4da64e13 Fix minddata issues 2021-05-10 11:12:00 +08:00
mindspore-ci-bot c74e66e759 !15928 unify dump path and support npy format 
From: @zhangbuxue
Reviewed-by: @guoqi1024,@zhaizhiqiang
Signed-off-by: @zhaizhiqiang
 2021-05-08 11:32:24 +08:00
mindspore-ci-bot 7a271987d6 !15269 use avx to optimize cpu op 
From: @wangyanling10
Reviewed-by: 
Signed-off-by:
 2021-05-08 09:40:10 +08:00
buxue 0eab785cfa unify dump path and support npy format 2021-05-08 09:04:33 +08:00
mindspore-ci-bot b86747b9a6 !15813 Convert some pipeline Ops to be inlined 
From: @hfarahat
Reviewed-by: 
Signed-off-by:
 2021-05-08 05:30:39 +08:00
hesham fd943bbdc0 Modify normalize to support multiple of channels 2021-05-07 17:06:26 -04:00
wangyanling ee1b803416 optimize cpu adam op 2021-05-07 10:47:57 +08:00
Lixia Chen 5967cb2cd7 Unblock mindrecord under cache 2021-05-05 13:28:13 -04:00
hesham e4c0bd51a5 Modify concat to be an inlined Op 
Modify zip to be an inlined Op
Modify take to be an inlined Op
Modify skip to be an inlined Op
Modify rename to be an inlined Op
Modify filter to consume child's rows using one thread
 2021-05-04 12:45:18 -04:00
mindspore-ci-bot 9416502e90 !15916 Add federated learning server part1 
From: @zpac
Reviewed-by: 
Signed-off-by:
 2021-05-01 14:59:47 +08:00
mindspore-ci-bot 9c7cb65c3b !15801 Split sampler and vision IR files 
From: @mhmotallebi
Reviewed-by: 
Signed-off-by:
 2021-05-01 05:19:41 +08:00
ZPaC 232e525ff2 Add common.h, local_meta_storage.h, param_name_type.h 
Add class Message, AddrStorage

Add Kernel folder

Add consistent hash ring

Add updater for server.

Add iteration timer

Add executor for server
 2021-04-30 15:31:09 +08:00
mindspore-ci-bot cefcf6c2ae !15931 Add eager tests for transform ops, and add a shape comparison in the EXPECT_MSTENSOR_EQ Macro 
From: @alexyuyue
Reviewed-by: @nsyca,@robingrosman
Signed-off-by: @robingrosman
 2021-04-30 06:15:12 +08:00
mohammad 9ce28cd34c split sampler vision IR files 2021-04-29 16:30:18 -04:00
alex-yuyue 9ef4331f56 Add eager tests for transform ops 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2021-04-29 13:19:24 -04:00
mindspore-ci-bot 966f89198a !15107 use internal ge runtime 
From: @zhoufeng54
Reviewed-by: 
Signed-off-by:
 2021-04-29 10:05:54 +08:00
mindspore-ci-bot a1aeb7b8f1 !15616 remove unnecessary ops && modify static check 
From: @lyvette
Reviewed-by: @jpc_chenjianping,@hangangqiang
Signed-off-by: @jpc_chenjianping
 2021-04-28 11:31:29 +08:00
mindspore-ci-bot 1e2e554db3 !15380 Unify minddata include files(except for datasets.h) in scenario of cloud and lite 
From: @luoyang42
Reviewed-by: @tiancixiao
Signed-off-by:
 2021-04-28 09:57:46 +08:00
mindspore-ci-bot 6dd37c5857 !15777 [Auto parallel] Fix some codestyle warnings 
From: @xiaoda_zh
Reviewed-by: @yangzhenzhang,@stsuteng
Signed-off-by: @stsuteng
 2021-04-28 09:09:25 +08:00
Xiaoda Zhang 5fecfe92a6 code style warnings fixing 2021-04-27 19:54:56 +08:00
chendongsheng 05d3ae2219 add http communicator 2021-04-27 19:44:57 +08:00
liuyu d259c159ba remove unnecessary ops 
fix static check
 2021-04-27 19:23:32 +08:00
zhoufeng 3d38bcf791 use internal ge runtime 
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
 2021-04-26 18:56:33 +08:00
YangLuo bf48400c10 unify include file of minddata 2021-04-22 10:59:36 +08:00
lianliguang d2c696667b change process of infer value 2021-04-20 19:02:22 +08:00
mindspore-ci-bot 490d2e1efb !15385 remove the useless prim type 
From: @lianliguang
Reviewed-by: @ginfung,@zh_qh,@ginfung
Signed-off-by: @zh_qh
 2021-04-20 16:07:45 +08:00
mindspore-ci-bot 512130d171 !15363 cpu unique support fp16 
From: @kisnwang
Reviewed-by: @jjfeing,@zhoufeng54
Signed-off-by: @zhoufeng54
 2021-04-20 14:25:56 +08:00
kswang 9c8ada03fe cpu unique kernel support fp16 2021-04-20 11:40:13 +08:00
lianliguang 4d7b7649e9 remove the useless PrimType 2021-04-20 10:16:36 +08:00
Cathy Wong 636809c255 dataset: C++ API ToNumber & Lookup: change data_type parm from string to DataType 2021-04-19 12:35:37 -04:00
mindspore-ci-bot 5f2603ed93 !15216 Pybind11::object && PrimitivePy recycle optimize 
From: @zhangzhaoju
Reviewed-by: @zh_qh,@hwhewei,@zh_qh
Signed-off-by: @zh_qh,@zh_qh
 2021-04-17 09:38:16 +08:00
mindspore-ci-bot bd69a86931 !15124 Remove unused #include in cc files in MindData 
From: @hfarahat
Reviewed-by: @nsyca,@mikef,@robingrosman
Signed-off-by: @robingrosman
 2021-04-17 02:19:27 +08:00
mindspore-ci-bot 9c81c5d2a0 !15189 Add more ut for transform ops and subset sampler 
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
 2021-04-17 01:46:13 +08:00
hesham 98f0f36a20 Removed unused include 2021-04-16 11:40:56 -04:00
mindspore-ci-bot 5b7ed56d57 !12521 [WIP] MindData C++ Plugin infrastructure with GDAL decode 
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
 2021-04-16 20:37:18 +08:00
zhangzhaoju a1db9c4959 Pybind11::object && PrimitivePy recycle optimize 2021-04-16 18:32:55 +08:00
mindspore-ci-bot 053b04ae6e !15204 replace memcpy_async with tensor move 
From: @laiyongqiang
Reviewed-by: @kisnwang,@jjfeing
Signed-off-by: @jjfeing
 2021-04-16 10:19:40 +08:00
Zirui Wu 8ebc512d25 plugin infrastruture for mindddata 
add single element string tensor support for plugin tensor
 2021-04-15 21:11:16 -04:00
alex-yuyue 97e3232b6d Add more ut for transform ops and subset sampler 
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
 2021-04-15 16:51:41 -04:00
laiyongqiang 1533435015 replace memcpy_async with tensor move 2021-04-15 16:12:01 +08:00