Commit Graph

560 Commits

Author SHA1 Message Date
Xiao Tianci a54e65a7ad add Crop Python API 2021-06-10 09:46:57 +08:00
Xiao Tianci 9c4c1c6a77 add Rotate Python API 2021-06-08 22:19:15 +08:00
Zhenglong Li 2c7d1bf603 Implement new gnn feature 2021-06-07 10:20:06 +08:00
mindspore-ci-bot cf27d3c8dc !12972 Removing Builder from dataset ops phase 1
From: @ezphlow
Reviewed-by: 
Signed-off-by:
2021-06-05 03:51:49 +08:00
EricZ 16837a4639 Removing Builder from dataset ops phase 1 2021-06-03 09:09:29 +08:00
Xiao Tianci 9c74d55a49 add HorizontalFlip and VerticalFlip APIs 2021-05-31 15:55:21 +08:00
zetongzhao 728b180329 delete_extra files 2021-05-26 16:41:27 -04:00
mindspore-ci-bot 686225ad2a !16382 Unity Input Order
From: @zetongzhao
Reviewed-by: 
Signed-off-by:
2021-05-26 21:28:36 +08:00
zetongzhao 4cb53823fd all the updated input order
Fix FillOperation to_json function

Fix FillOperation to_json function

serialize tensor without testing

fix unity input order bug, next step is to test the tensor serialization

serialize tensor, testing code in tensor_test.cc

change for tensor serialization

changes after review

changes after review

clang-format the files

rename
2021-05-25 18:26:43 -04:00
Xiao Tianci 3f495bbae1 add GaussianBlur API 2021-05-24 16:27:05 +08:00
mindspore-ci-bot 601322356b !15638 VOCDataset need to add img_id for evaluation
From: @xiefangqi
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
2021-05-17 19:33:24 +08:00
xiefangqi 9b846c7873 voc add image_id column 2021-05-17 16:09:04 +08:00
jonyguo 9452142b50 enhance: enable shuffle infile / files when mindrecord 2021-05-14 17:41:18 +08:00
mindspore-ci-bot b5cddcb8cc !16036 Improve performance of multi-processing option for dataset
From: @robingrosman
Reviewed-by: 
Signed-off-by:
2021-05-13 01:41:16 +08:00
RobinGrosman 9a7d1fc034 Optimize multi-process in minddata by passing data via shared memory instead of multiprocessing.queue 2021-05-11 15:16:29 -07:00
mindspore-ci-bot 6fcd6cab68 !16119 Fix minddata issues
From: @luoyang42
Reviewed-by: @jonyguo,@liucunwei
Signed-off-by: @jonyguo,@liucunwei
2021-05-11 14:33:29 +08:00
mindspore-ci-bot d3a175e30f !16078 Modify Normalize to accept images with more than 3 channels
From: @hfarahat
Reviewed-by: @mikef,@robingrosman
Signed-off-by: @robingrosman
2021-05-11 02:03:34 +08:00
YangLuo 0a4da64e13 Fix minddata issues 2021-05-10 11:12:00 +08:00
mindspore-ci-bot b86747b9a6 !15813 Convert some pipeline Ops to be inlined
From: @hfarahat
Reviewed-by: 
Signed-off-by:
2021-05-08 05:30:39 +08:00
hesham fd943bbdc0 Modify normalize to support multiple of channels 2021-05-07 17:06:26 -04:00
Lixia Chen 5967cb2cd7 Unblock mindrecord under cache 2021-05-05 13:28:13 -04:00
hesham e4c0bd51a5 Modify concat to be an inlined Op
Modify zip to be an inlined Op
Modify take to be an inlined Op
Modify skip to be an inlined Op
Modify rename to be an inlined Op
Modify filter to consume child's rows using one thread
2021-05-04 12:45:18 -04:00
mindspore-ci-bot 9c7cb65c3b !15801 Split sampler and vision IR files
From: @mhmotallebi
Reviewed-by: 
Signed-off-by:
2021-05-01 05:19:41 +08:00
mindspore-ci-bot cefcf6c2ae !15931 Add eager tests for transform ops, and add a shape comparison in the EXPECT_MSTENSOR_EQ Macro
From: @alexyuyue
Reviewed-by: @nsyca,@robingrosman
Signed-off-by: @robingrosman
2021-04-30 06:15:12 +08:00
mohammad 9ce28cd34c split sampler vision IR files 2021-04-29 16:30:18 -04:00
alex-yuyue 9ef4331f56 Add eager tests for transform ops
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-04-29 13:19:24 -04:00
YangLuo bf48400c10 unify include file of minddata 2021-04-22 10:59:36 +08:00
Cathy Wong 636809c255 dataset: C++ API ToNumber & Lookup: change data_type parm from string to DataType 2021-04-19 12:35:37 -04:00
mindspore-ci-bot bd69a86931 !15124 Remove unused #include in cc files in MindData
From: @hfarahat
Reviewed-by: @nsyca,@mikef,@robingrosman
Signed-off-by: @robingrosman
2021-04-17 02:19:27 +08:00
mindspore-ci-bot 9c81c5d2a0 !15189 Add more ut for transform ops and subset sampler
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
2021-04-17 01:46:13 +08:00
hesham 98f0f36a20 Removed unused include 2021-04-16 11:40:56 -04:00
mindspore-ci-bot 5b7ed56d57 !12521 [WIP] MindData C++ Plugin infrastructure with GDAL decode
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
2021-04-16 20:37:18 +08:00
Zirui Wu 8ebc512d25 plugin infrastruture for mindddata
add single element string tensor support for plugin tensor
2021-04-15 21:11:16 -04:00
alex-yuyue 97e3232b6d Add more ut for transform ops and subset sampler
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-04-15 16:51:41 -04:00
Cathy Wong a2ee0cb3e5 dataset UT: Update UTs to check for return Status 2021-04-14 17:52:31 -04:00
mindspore-ci-bot 1d89109d19 !14929 Cleanup stale comments about DataBuffers
From: @hfarahat
Reviewed-by: @pandoublefeng,@robingrosman
Signed-off-by: @pandoublefeng
2021-04-14 05:33:40 +08:00
mindspore-ci-bot 727203a498 !14911 dataset: Fill op: C++ API support, UTs and Pybind decoupling
From: @cathwong
Reviewed-by: 
Signed-off-by:
2021-04-14 05:32:11 +08:00
Cathy Wong 7e6a03487e dataset: Fill op: C++ API support, UTs and Pybind decoupling 2021-04-13 10:02:39 -04:00
mindspore-ci-bot e07a69d8f8 !14874 GNN dataset new feature
From: @lizhenglong1992
Reviewed-by: 
Signed-off-by:
2021-04-13 10:44:27 +08:00
hesham 15354569f2 Cleanup stale comments about DataBuffers 2021-04-12 14:26:59 -04:00
ms_yan ecb8d6bc08 add pil version cubic resize 2021-04-12 21:56:14 +08:00
Zhenglong Li f3895f2b09 Add get edges from nodes function for gnn network 2021-04-10 18:31:13 +08:00
mindspore-ci-bot 74f4c85315 !14750 Address some code issues in MD
From: @hfarahat
Reviewed-by: @robingrosman,@mikef
Signed-off-by: @robingrosman
2021-04-10 03:55:16 +08:00
hesham 97cf4e516e Address 3 code issues:
1- access out of bound memory in toFlatIndex
2- CreateFromNPArray function is 50>
3- duplicate variable init
2021-04-08 21:50:19 -04:00
Cathy Wong 82f4b3f757 dataset: C++ API TypeCast: change data_type parm from string to DataType 2021-04-08 11:47:58 -04:00
mindspore-ci-bot bdc5a9c88b !14579 TensorOp decoupling stage 3 (transform ops)
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
2021-04-08 21:41:26 +08:00
mindspore-ci-bot b6cf16d8aa !14389 fix codex warning
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
2021-04-08 14:22:39 +08:00
alex-yuyue 83aaed09bb TensorOp decoupling stage 3 (transform ops)
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-04-07 18:46:23 -04:00
mindspore-ci-bot a9ba9b90f6 !14680 MindData Codespell correction
From: @luoyang42
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
2021-04-07 18:28:55 +08:00
luoyang 624511337c MindData Codespell correction 2021-04-07 10:20:29 +08:00