Commit Graph

22 Commits

Author SHA1 Message Date
djc b077aa1cab [feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset 2021-08-22 16:26:45 +08:00
djc 4e6f7dc97d [feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset 2021-08-22 13:39:37 +08:00
i-robot c84e09cf45 !21072 Deserialize - python binding
Merge pull request !21072 from zetongzhao/deserialize_1
2021-08-06 21:47:09 +00:00
zetongzhao 4f199b548c deserialize and tests 2021-08-06 13:35:27 -04:00
liyong 5fea72473c fix HW1 issue 2021-08-06 14:07:26 +08:00
zetongzhao 728b180329 delete_extra files 2021-05-26 16:41:27 -04:00
zetongzhao 4cb53823fd all the updated input order
Fix FillOperation to_json function

Fix FillOperation to_json function

serialize tensor without testing

fix unity input order bug, next step is to test the tensor serialization

serialize tensor, testing code in tensor_test.cc

change for tensor serialization

changes after review

changes after review

clang-format the files

rename
2021-05-25 18:26:43 -04:00
lixian 7d2fd6e76c cxx api refactor: tensor/status/model 2021-02-02 09:15:56 +08:00
nhussain 77d507279c first working implementation
add string implementation, can handle partial string slices

finish core implementation, added Index object

fix up the logic

add in new SliceOption object, cleaning up tests
2020-09-24 15:39:28 -04:00
nhussain 61769b2dd9 fix concat 2020-08-05 11:28:56 -04:00
hesham adfbc891d3 - Add checks and testing for empty tensors
- cleanup work on createTensor and Tensor's constructors
2020-07-24 17:23:18 -04:00
liubuyu 43c79eb853 mindspore path adjust 2020-07-14 18:07:28 +08:00
Eric 79445012bd Tensor ut works
new test case

Name change for empty check
2020-07-08 17:28:59 -04:00
jonyguo 41d16a3c77 enhance: 1. fix api comment, 2. del dead code 2020-06-29 17:15:44 +08:00
nhussain 5515016dba remove graphengine changes
remove graphengine changes

concat op

Truncate Pair

concat_op

remove graph engine changes
2020-06-18 17:17:50 -04:00
hesham e2012a1de9 Slice Op 2020-06-16 02:32:40 -04:00
hesham 0c5e47111b - Move MutableBuffer to be protected
- Add new CreateTensors
2020-06-11 17:32:03 -04:00
hesham df361d1d26 Change mem layout of string tensor
add support for MindRecord and TFRecord
----
optimize tensorshape

optimize tensorshape and FlatIndex

TFRecord and MindRecord support for string tensor

Modify mem layout
Add new constructor
Add method Allocate

Change some GetMutableBuffer usages to AllocateBuffer
2020-05-22 01:22:29 -04:00
hesham e8ca243364 -Add DE_STRING
-replace switch'case by indexing

- Add test case
- Add constructors
- Add getItem string

- Fix bugs
- Add more tests

- Tensor iterator
- asNumpy
- TextFileDataset

- Tensor(Numpy)

- Super > 2D
- Add more test cases for GeneratorDataset

- Change StartAddr to GetBuffer and GetMutableNuffer

- Raise an error if batch is used with strings

Clean-up work
2020-05-15 20:33:28 -04:00
xulei2020 c705ea5e5b add filterOp code 2020-04-20 22:32:19 +08:00
Jonathan Yan 080bcda021 Replace std::cout with MS_LOG in dataset unit test
Signed-off-by: Jonathan Yan <jonathan.yan1@huawei.com>
2020-03-30 11:02:32 -04:00
zhunaipan 930a1fb0a8 initial version
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
2020-03-27 22:54:54 +08:00