like20
/
mindspore2022
forked from huawei/mindspore2022
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
42,203 Commits 18 Branches 0 Tags 564 MiB
Commit Graph

26 Commits

Author SHA1 Message Date
liyong 2172934177 fix doc issue2 2022-04-08 10:46:08 +08:00
jonyguo b8205ee995 add testcase 2022-04-07 09:49:23 +08:00
liyong 3191160eca fix some issue 2022-04-06 17:48:55 +08:00
yanghaoran c44de68591 takedown test_datasets_generator to ensure gate stability 2022-03-31 16:56:03 +08:00
jonyguo 4378014ffb fix: when return numpy in GeneratorDataset 2022-03-30 20:21:41 +08:00
ms_yan 192983b5da check operator mixed or not 2021-12-23 10:22:03 +08:00
xiefangqi f74b5cea0c optimize datasetops error msg 2021-12-01 09:11:22 +08:00
jonyguo 58c9112c2e fix: generator dataset with source zip 2021-11-25 11:32:28 +08:00
RobinGrosman c90efc0403 add check for shm available when num_devices=1 to avoid bus errors 
-Required modifying tests to reduce memory usage to check doesn't fail during CI
-Also required fixing max_rowsize to be externalized from map+batch() function
 2021-09-24 10:24:31 -07:00
hetshah 2c1666fd06 set num epochs for iterators that use the default value 
add explicit paramter for infinite iterators

set appropriate value for num_epoch param for iteratos

fix long lines

remove trailing whitespace

fixed typo

remove comment

fixed comments

fixed test
 2021-09-22 17:32:50 +00:00
jonyguo c408867085 fix: hung when user return Tensor in generator 2021-09-15 14:13:33 +08:00
xiefangqi 57f68d35bd fix generator 14 ut problem 2021-09-06 19:01:51 +08:00
YangLuo 17c121b087 Give concreted error when mappable dataset lack __len__ method 2021-06-29 11:13:12 +08:00
ms_yan be65ebcb28 complete dataset log 2021-06-08 16:45:47 +08:00
RobinGrosman ca88d7d76a fix edge case and docstring in minddata multiprocessing shared memory code 2021-05-16 06:46:44 -07:00
RobinGrosman 9a7d1fc034 Optimize multi-process in minddata by passing data via shared memory instead of multiprocessing.queue 2021-05-11 15:16:29 -07:00
hesham 58193bc469 User explicit deepcopy 2021-02-09 17:25:21 -05:00
ms_yan 0cb5c47856 add err modify 2020-11-18 16:30:24 +08:00
YangLuo f5a85510f2 [MD] dataset op log changes 2020-09-12 00:43:36 +08:00
xiefangqi 9b3c33e157 minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
nhussain 92e99ff224 change map calls 2020-09-10 10:25:05 -04:00
nhussain 3bac9d3713 switch input columns and operation 
change ImagefolderDV2 name

change ds.transforms.vision to ds.vision

change batch api to match map api more closely

compose op changes

test_pylint

remove compose op from vision, move to transform module, refactor map and batch to use column_order
 2020-09-08 10:26:20 -04:00
Lixia Chen 27d5281641 Change epoch count to 1 for python testcases 2020-09-01 11:24:26 -04:00
anzhengqi 3e31ac6d62 all Dataset support get_dataset_size 2020-08-12 15:35:47 +08:00
tony_liu2 269b477684 use np.testing.assert instead of asserting 
fix line lengths

fix spacing

reverse a few changes
 2020-07-29 14:53:01 -04:00
Cathy Wong 04eb4f89c7 Cleanup dataset UT: Replace save_and_check 2020-07-15 20:47:31 -04:00