28ebd73096
fix bug when int or float is numpy type
2020-07-21 09:07:29 +08:00
e2ea1fa0df
activate num_samples in distributed samplers
2020-07-17 16:55:57 +08:00
2412ee09ce
fix distributedSampler reshuffle and fix random_device failed
2020-06-21 18:23:47 +08:00
jonyguo
1de7271afc
add floatxx test case
2020-06-11 19:26:54 +08:00
jonyguo
96859f44b6
fix: MindDataset distribute shuffle bug
2020-06-11 11:06:34 +08:00
feff8899ac
support padding samples
2020-06-05 09:14:42 +08:00
9b2a778d94
!1478 [Dataset] clean pylint.
2020-05-28 14:06:36 +08:00
abca62f407
10:00 26/5 clean pylint
2020-05-26 10:05:12 +08:00
hesham
df361d1d26
Change mem layout of string tensor
...
add support for MindRecord and TFRecord
----
optimize tensorshape
optimize tensorshape and FlatIndex
TFRecord and MindRecord support for string tensor
Modify mem layout
Add new constructor
Add method Allocate
Change some GetMutableBuffer usages to AllocateBuffer
2020-05-22 01:22:29 -04:00
jonwe
bb51bb88d7
add compress in mindrecord
2020-05-22 09:37:51 +08:00
5a914994ba
clean pylint
2020-05-18 16:42:35 +08:00
bcfaff97f9
clean pylint
2020-05-18 10:31:46 +08:00
aa3f89e74f
mindrecord support read file list
2020-05-13 14:11:59 +08:00
jonyguo
d4d236bcce
fix: use MindDataset by column_names get data error in some situation
2020-05-07 18:12:36 +08:00
jonyguo
c688265671
fix: when use MindDataset block_reade=True hung
2020-04-07 17:53:23 +08:00
bc4602b58e
fix and remove useless import of example, st, ut
2020-04-02 22:13:36 +08:00
jonyguo
34e42bd6f9
1. add more log info for dataset & mindrecord, 2. add two new testcase for MindDataset
2020-03-30 17:24:24 +08:00
930a1fb0a8
initial version
...
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
2020-03-27 22:54:54 +08:00
liyong
jonyguo
hesham
jonwe