Commit Graph

430 Commits

Author SHA1 Message Date
lixian 7d2fd6e76c cxx api refactor: tensor/status/model 2021-02-02 09:15:56 +08:00
Nat Sutyanyong 5a7dc0accc Migrate repeat_pass.cc to IR optimizer and remove ExecTree optimizer 2021-02-01 12:30:16 -05:00
mindspore-ci-bot f980561fe1 !11598 [MD] add common validation functions for transform
From: @luoyang42
Reviewed-by: 
Signed-off-by:
2021-01-30 14:32:44 +08:00
YangLuo 1893ae8662 [MD] add common validation functions for transform 2021-01-29 16:29:47 +08:00
mindspore-ci-bot 20c1727b2c !11631 Add SubsetSampler
From: @hfarahat
Reviewed-by: 
Signed-off-by:
2021-01-29 03:48:45 +08:00
mindspore-ci-bot 8e4a6842ff !11681 gnn support edge weight sampling
From: @heleiwang
Reviewed-by: @liucunwei
Signed-off-by: @liucunwei
2021-01-28 19:15:37 +08:00
heleiwang 2dc9ba761c gnn support weight sampling neighbors. 2021-01-28 15:28:44 +08:00
hesham 7120c66998 Add SubsetSampler 2021-01-27 15:00:18 -05:00
mindspore-ci-bot 4cd6588af0 !11393 Migrating cache transform pass from execution tree to IR tree
From: @lixiachen
Reviewed-by: 
Signed-off-by:
2021-01-27 22:10:13 +08:00
xulei2020 de630f1cb1 Add parameter verification for getROI function
fix c++ ut compilation failed of Asan bug
2021-01-27 09:06:59 +08:00
Lixia Chen 922e1f4f36 Migrate CacheTransformPass 2021-01-26 19:24:10 -05:00
Cathy Wong a3b10213b7 dataset: Resolve protected parent_access from DeepCopyPass 2021-01-22 15:56:32 -05:00
xiefangqi 3f76abcdee minddata err msg add file path 2021-01-22 16:38:46 +08:00
mindspore-ci-bot 2beb916bf5 !11427 TextOp decoupling
From: @alexyuyue
Reviewed-by: 
Signed-off-by:
2021-01-22 09:09:41 +08:00
mindspore-ci-bot fcc4a4eaea !11397 add GetDatasetSize to concat_node
From: @mhmotallebi
Reviewed-by: 
Signed-off-by:
2021-01-22 08:08:41 +08:00
mohammad b5e91139e2 add GetDatasetSize to concat node 2021-01-21 16:25:48 -05:00
xulei2020 de6356ebfa add warp affine 2021-01-21 14:20:14 +08:00
alex-yuyue a8675f8227 TextOp decoupling
Signed-off-by: alex-yuyue <yue.yu1@huawei.com>
2021-01-20 21:52:45 -05:00
mindspore-ci-bot c155dfee7a !11329 [MD] Rename SamplerObj::Build() to SamplerBuild()
From: @lixiachen
Reviewed-by: 
Signed-off-by:
2021-01-19 06:33:49 +08:00
Lixia Chen 273865a72b Rename SamplerObj::Build() to SamplerBuild() 2021-01-18 15:42:34 -05:00
Lixia Chen 3c5917a03d Fix IR node Drop() 2021-01-18 13:06:07 -05:00
mindspore-ci-bot cb58b5baa5 !11211 Provide functions for modifying IR tree (Insert/Drop/Append nodes)
From: @lixiachen
Reviewed-by: 
Signed-off-by:
2021-01-16 01:20:01 +08:00
Nat Sutyanyong e28fb6ce4d Tested with new test cases and all dataset UTs passed 2021-01-15 09:59:21 -05:00
mindspore-ci-bot dfa6daaa57 !11249 【MD】fix bug for extractchannel when type is UINT16
From: @xulei2020
Reviewed-by: @heleiwang,@liucunwei
Signed-off-by: @liucunwei
2021-01-15 14:33:16 +08:00
mindspore-ci-bot 581789c252 !11246 add num_epochs to CPP API Dataset::CreateIterator()
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
2021-01-15 06:02:00 +08:00
xulei2020 5dd651f1a5 fix bug for extractchannel when type is UINT16 2021-01-14 09:26:18 +08:00
Cathy Wong 4b1ccf9dd5 dataset: Use int32_t for text's vocab_size 2021-01-13 18:12:50 -05:00
Zirui Wu fa553956ef add num_epochs to CPP API Dataset::CreateIterator(columns,num_epochs) 2021-01-13 12:13:40 -05:00
mohammad f48ab2b5c9 make MD public headers standalone 2021-01-11 06:35:53 -05:00
Zirui Wu 0e68575e77 port over getter pass
port over tensor_op_fusion pass

add fusion support for prebuildOpeartion (TensorOpeartion)
2021-01-07 10:52:49 -05:00
mindspore-ci-bot 5fd77356c9 !9687 Adding AddChild functionality to SamplerObj
From: @mahdirahmanihanzaki
Reviewed-by: 
Signed-off-by:
2021-01-06 01:46:08 +08:00
mindspore-ci-bot a5869f2984 !10142 dataset CPP UT: Updates for ExecTree to IRTree Support
From: @cathwong
Reviewed-by: 
Signed-off-by:
2021-01-05 06:53:14 +08:00
Nat Sutyanyong 7c5b2de1ec dataset CPP UT: Updates for ExecTree to IRTree Support 2021-01-04 16:00:30 -05:00
Zirui Wu 0a31f563a7 minor fixes 2020-12-23 10:06:01 -05:00
mindspore-ci-bot 20df37e428 !10287 Add ut for dataset to_number
From: @luoyang42
Reviewed-by: @heleiwang
Signed-off-by:
2020-12-23 21:14:42 +08:00
Zirui Wu 0e2f7a9e9e add validate param to base class DatasetNode 2020-12-21 11:14:37 -05:00
YangLuo da6de519ae Add ut for dataset to_number 2020-12-21 20:09:03 +08:00
Xiao Tianci 633f97bb48 fix get dataset size in distributed scenario 2020-12-15 20:41:45 +08:00
xiefangqi 3c6cc3c58c Add NormalizePadOp 2020-12-15 11:45:41 +08:00
Mahdi 0f2b5d8cac Changed SamplerObj validate params to return status and added AddChild to it 2020-12-10 15:39:59 -05:00
Zirui Wu 91a6b2b0ca Add checks to RandomData and LookUp 2020-12-09 17:09:34 -05:00
mindspore-ci-bot 317a97e6b9 !9336 auto num_parallel_workers setup
From: @ziruiwu
Reviewed-by: 
Signed-off-by:
2020-12-09 08:32:55 +08:00
mindspore-ci-bot a2c80435ce !9685 Fix a core dump in TreeConsumer::Terminate() plus minor cache fixes
From: @lixiachen
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
2020-12-09 08:21:22 +08:00
Zirui Wu d6df1b0832 Implemented AutoNumWorker Pass which sets num_workers of selected parallel ops automatically if enabled 2020-12-08 17:49:05 -05:00
Lixia Chen 32b82c2737 Fix a core dump in TreeConsumer::Terminate()
and other minor cache changes
2020-12-08 15:38:40 -05:00
Xiao Tianci 0659473535 add TruncateSequencePair, ToNumber C++ API and enable three test cases 2020-12-08 11:12:16 +08:00
mindspore-ci-bot 49fd5308a4 !9564 Tidy up code in dataset compilation phase
From: @nsyca
Reviewed-by: 
Signed-off-by:
2020-12-08 05:11:29 +08:00
mindspore-ci-bot 6b5626634c !9530 add BasicTokenizer and BertTokenizer C++ API
From: @tiancixiao
Reviewed-by: @mikef,@nsyca
Signed-off-by: @nsyca
2020-12-08 04:09:40 +08:00
Nat Sutyanyong 41ea1621c5 Tidy up TreeAdapter::Compile 2020-12-07 14:57:22 -05:00
shenwei41 206ae1a7c3 Add Three text C++ API 2020-12-05 10:32:15 +08:00