dengyutao
388e43f7cb
delete parameter block_reader for MindDataset
2020-07-31 11:30:05 +08:00
tony_liu2
1f4251a440
add try to minddataset python tests to remove files on fail
...
delete unrelated file
change finally to except else
fix spacing alignment
fix indentation
fix indentation
fix indentation
add fix to new test case
add if main for pytest
fix spacing
2020-07-22 16:34:10 -04:00
28ebd73096
fix bug when int or float is numpy type
2020-07-21 09:07:29 +08:00
e2ea1fa0df
activate num_samples in distributed samplers
2020-07-17 16:55:57 +08:00
2412ee09ce
fix distributedSampler reshuffle and fix random_device failed
2020-06-21 18:23:47 +08:00
jonyguo
1de7271afc
add floatxx test case
2020-06-11 19:26:54 +08:00
jonyguo
96859f44b6
fix: MindDataset distribute shuffle bug
2020-06-11 11:06:34 +08:00
feff8899ac
support padding samples
2020-06-05 09:14:42 +08:00
9b2a778d94
!1478 [Dataset] clean pylint.
2020-05-28 14:06:36 +08:00
abca62f407
10:00 26/5 clean pylint
2020-05-26 10:05:12 +08:00
hesham
df361d1d26
Change mem layout of string tensor
...
add support for MindRecord and TFRecord
----
optimize tensorshape
optimize tensorshape and FlatIndex
TFRecord and MindRecord support for string tensor
Modify mem layout
Add new constructor
Add method Allocate
Change some GetMutableBuffer usages to AllocateBuffer
2020-05-22 01:22:29 -04:00
jonwe
bb51bb88d7
add compress in mindrecord
2020-05-22 09:37:51 +08:00
5a914994ba
clean pylint
2020-05-18 16:42:35 +08:00
bcfaff97f9
clean pylint
2020-05-18 10:31:46 +08:00
aa3f89e74f
mindrecord support read file list
2020-05-13 14:11:59 +08:00
jonyguo
d4d236bcce
fix: use MindDataset by column_names get data error in some situation
2020-05-07 18:12:36 +08:00
jonyguo
c688265671
fix: when use MindDataset block_reade=True hung
2020-04-07 17:53:23 +08:00
bc4602b58e
fix and remove useless import of example, st, ut
2020-04-02 22:13:36 +08:00
jonyguo
34e42bd6f9
1. add more log info for dataset & mindrecord, 2. add two new testcase for MindDataset
2020-03-30 17:24:24 +08:00
930a1fb0a8
initial version
...
Signed-off-by: leonwanghui <leon.wanghui@huawei.com>
2020-03-27 22:54:54 +08:00
dengyutao
tony_liu2
liyong
jonyguo
hesham
jonwe