Commit Graph

21 Commits

Author SHA1 Message Date
hetshah 098ca49dd3 remove instances of datasetiterator from old tests and move coverage to new method 2021-11-25 15:22:34 +00:00
jonyguo 9452142b50 enhance: enable shuffle infile / files when mindrecord 2021-05-14 17:41:18 +08:00
Lixia Chen 5967cb2cd7 Unblock mindrecord under cache 2021-05-05 13:28:13 -04:00
YangLuo bf48400c10 unify include file of minddata 2021-04-22 10:59:36 +08:00
Cathy Wong a2ee0cb3e5 dataset UT: Update UTs to check for return Status 2021-04-14 17:52:31 -04:00
Lixia Chen 30017ea5a0 Fix codex issues 2021-03-15 11:15:15 -04:00
Cathy Wong 95bbaaf9f6 dataset: Reinstate INFO logging and data verification - part 2
for image/vision datasets
2021-03-12 10:07:45 -05:00
Zirui Wu 8022001450 Remove datasets.h dependency on tensor.h and other related dependencies
Replace std::function<TensorRow(TensorRow)> with std::function<MSTensorVec(MSTensor)> by using std::bind

Replace pad_info with MSTensor

Switch TensorShape/dataset::DataType to vector<int64> /mindspore::DataType

Change TypeId to mindspore::DataType in SchemaObj

address review cmts, add CreateFromMSTensor() in tensor.h/.cc
2021-03-05 16:26:58 -05:00
mohammad f73def5933 make C++ API classes for samplers 2021-02-25 17:29:43 -05:00
Cathy Wong 3fc204e3bc dataset: Create C++ API classes for vision transform ops
Review rework

Add overloaded API Map function

Overload Execute, update st test_de.cc and enhance ut execute_test.cc;
More TensorTransform support for BoundingBoxAugment and UniformAug

Execute support for auto case; UT updates

Rebase updates, including fix CI Ascend compilations

test_de.cc - comment out dvpp tests

Rebase updates

Added back testcase and constructor

Added back constructor

added missing macro

Fixed Macro

removed decode
2021-02-20 15:29:33 -05:00
Eric 9953757ff4 Fixed tenor compile error for MD 2021-02-09 14:56:31 +08:00
mohammad f48ab2b5c9 make MD public headers standalone 2021-01-11 06:35:53 -05:00
Lixia Chen 32b82c2737 Fix a core dump in TreeConsumer::Terminate()
and other minor cache changes
2020-12-08 15:38:40 -05:00
Jesse Lee 0c8dfc68ec Fix hang on RequestFreeTag 2020-12-04 14:54:30 -05:00
Lixia Chen e8247eadef Same runtime CacheClient if c++ cache is shared 2020-11-27 18:52:15 -05:00
Eric a21eb2d527 Added random node fix 2020-11-11 17:24:48 -05:00
Lixia Chen f24a788eed Rebase up to 5792d50ca7 2020-11-06 18:39:05 -05:00
Zirui Wu 5d1ada682c remove uncessary headers
staging II

clean up

further clean up

fix merge conflict with 8139

fix complie err
2020-11-03 11:59:55 -05:00
hesham 5169fb4c42 Remove api namespace 2020-11-02 20:09:37 -05:00
Lixia Chen 02ddddfe7e Enable caching over non-mappable dataset c++ api
and caching over Album dataset
2020-10-27 23:02:13 -04:00
Lixia Chen bc396febae Add testcases for cache c api 2020-10-23 17:10:18 -04:00