Commit Graph

208 Commits

Author SHA1 Message Date
zhouyuanshen 6cc51e0c0c fix bug in infer_dtype function of hcom operations 2020-04-28 11:33:13 +08:00
buxue 42eb8b08c2 fix bugs of Acosh, TopK, ResizeNearestNeighbor, DepthwiseConv2dNative 2020-04-27 22:24:23 +08:00
buxue 4fa2d03c89 fix reviewboot and example of TruncatedNormal and add type mapping 2020-04-27 22:23:36 +08:00
buxue 71ccf74b88 fix the infer of TruncatedNormal and a bug of structure output and a bug of tensorslice ellipsis 2020-04-27 22:23:31 +08:00
mindspore-ci-bot ad75618ca6 !611 change error message type
Merge pull request !611 from JichenZhao/errormsg
2020-04-23 19:49:59 +08:00
zhaojichen 8963e39516 change error type 2020-04-23 05:29:26 -04:00
mindspore-ci-bot 5ac07bb695 !504 Support Tensor assign A[slice] = u
Merge pull request !504 from candanzg/tensor_assign_with_slice
2020-04-23 16:24:10 +08:00
candanzg 663d597330 tensor assign with slice index
Signed-off-by: candanzg <zhangshucheng@huawei.com>
2020-04-23 13:07:04 +08:00
mindspore-ci-bot 0bf6717e9a !454 Fix the check of bool type in auto cast
Merge pull request !454 from candanzg/bug_cast_op
2020-04-23 10:54:40 +08:00
mindspore-ci-bot 5cf09405e2 !532 [AutoParallel]support multiple subgraphs
Merge pull request !532 from lichen/support_multiple_subgraphs_in_auto_parallel
2020-04-23 09:04:09 +08:00
liuxiao b6e77e5178 Add ReluV2/ReluGradV2/ConfusionMulGrad for VM 2020-04-22 21:09:37 +08:00
mindspore-ci-bot 1a0d2666b7 !559 Add Fill/Erf op for VM.
Merge pull request !559 from liuxiao/fill-op
2020-04-22 19:22:04 +08:00
mindspore-ci-bot 818acd46d4 !569 fix bug in checkpoint when save scaler
Merge pull request !569 from wangnan39/master
2020-04-22 18:55:02 +08:00
lichenever c78630d737 support multiple subgraphs 2020-04-22 17:40:56 +08:00
wangnan39@huawei.com f38d18c665 fix bug in checkpoint when save scaler 2020-04-22 16:04:55 +08:00
mindspore-ci-bot 24a9f4974c !536 support ellipsis and bool for tensor slice
Merge pull request !536 from zhangbuxue/support_elipis_for_tensor_slice
2020-04-22 15:49:33 +08:00
liuxiao 5b6c8fade8 Add Erf\FillD operator for VM 2020-04-22 15:32:42 +08:00
buxue 437bb8c27c support ellipsis and bool for tensor slice 2020-04-22 15:00:04 +08:00
mindspore-ci-bot 67057d1309 !541 add average pooling 1D
Merge pull request !541 from JichenZhao/avgpooling
2020-04-22 14:13:04 +08:00
mindspore-ci-bot 4516b8feff !437 Add L2Loss op for VM.
Merge pull request !437 from liuxiao/add-l2-loss
2020-04-22 10:27:04 +08:00
mindspore-ci-bot 3b083d07bb !550 support one node communication group
Merge pull request !550 from yao_yf/support_one_node_communication_group
2020-04-22 10:17:01 +08:00
liuxiao c874e2d484 Add L2Loss op for VM 2020-04-22 09:31:14 +08:00
mindspore-ci-bot aad5771a62 !524 Added support for UA augmentation ops with tests
Merge pull request !524 from alashkari/ua-ops
2020-04-22 08:28:47 +08:00
Amir Lashkari 56e7a7deb5 Added UniformAugment + Python Augmentation Ops 2020-04-21 19:54:32 -04:00
mindspore-ci-bot dc0491caf9 !508 [Dataset] Adding sync_wait operator for dataset
Merge pull request !508 from EricZ/master
2020-04-22 06:15:24 +08:00
eric cd94518769 X# This is a combination of 2 commits.
Initial commit for dataset op python

Added signature to barrier

Adde compiling barrier code

Rebasing, fixed new compile errors

Final fix for make_unique

Added pybind API for barrier

Fixed pyfunc invocation

python interface - sync_wait

!1 sync_wait python interface
* python interface - sync_wait

fix test

update test

update test

Added new test case

add test case

test for shuffle + batch

Added two-sync test case

Restrited that no shuffle after sync

Added sync to pipeline info

block first databuffer as well

Intelligently get batch size

Fix default case

Lock Pair shares among all iterators

Added fix for empty character

Fixed up test case formatting

Fix end of epoch in sync_wait

Fixing CI
2020-04-21 17:42:13 -04:00
Junhan Hu 78001ac9e6 Add multiprocessing support for Mindspore.Dataset.GeneratorDataset 2020-04-21 16:03:43 -04:00
mindspore-ci-bot fb18671b28 !506 [Dataset] Multiprocessing support for Pyfunc
Merge pull request !506 from JunhanHu/multiprocess_pyfunc
2020-04-22 03:57:26 +08:00
Junhan Hu b13e7bc31a Add python multiprocessing support for Mindspore.dataset 2020-04-21 14:56:25 -04:00
yao_yf 371b3338b6 support one node communication group 2020-04-21 21:16:22 +08:00
mindspore-ci-bot 72f42fc37c !170 Add prim name to error message for operators in nn_ops.py
Merge pull request !170 from fary86/add_prim_name_to_error_message_for_nn_ops
2020-04-21 21:14:44 +08:00
wangnan39@huawei.com b812b18c02 support update parameter for vm 2020-04-21 20:19:46 +08:00
fary86 6dd72f654a Add prim name to error message for nn_ops.py 2020-04-21 19:25:30 +08:00
qianlong db80f4ff92 The num_samples and numRows in schema for TFRecordDataset are conflict 2020-04-21 17:08:59 +08:00
zhaojichen 94c99998ae add AvgPooling layer 2020-04-21 03:17:24 -04:00
mindspore-ci-bot d9e4dcc33b !483 Optimize skip dataset op
Merge pull request !483 from jiangzhiwen/dataset/skip_opt
2020-04-21 15:10:23 +08:00
mindspore-ci-bot 862d23fe90 !481 Move args_type_check function to _checkparam.py
Merge pull request !481 from leonwanghui/rm-code
2020-04-21 11:23:05 +08:00
mindspore-ci-bot 7aac50804a !514 [MD] add Pk Sampler in minddataset
Merge pull request !514 from liyong126/mindrecord_pk_sampler_lee
2020-04-21 11:10:19 +08:00
leonwanghui 24b26ee1a8 Move args_type_check function to _checkparam.py 2020-04-21 10:20:09 +08:00
liyong f1542a90a3 add pk sampler 2020-04-21 10:08:38 +08:00
candanzg 0de05b3949 [bug] fixed bool check for cast op
Signed-off-by: candanzg <zhangshucheng@huawei.com>
2020-04-21 09:48:34 +08:00
mindspore-ci-bot 27a88a6bc3 !456 Auto cast case for NotEqual op
Merge pull request !456 from candanzg/not_equal_auto_cast
2020-04-21 09:20:40 +08:00
jiangzhiwen e1b109e8b8 optimize skip dataset op 2020-04-21 09:16:37 +08:00
Cathy Wong 60df369100 Fixup py Normalize doc: takes input CHW 2020-04-20 15:17:30 -04:00
mindspore-ci-bot 6369cf27bd !406 added first row crc check for when reading tfrecord files
Merge pull request !406 from Peilin/first-row-crc-check
2020-04-21 00:10:18 +08:00
mindspore-ci-bot 98fbd30a5b !460 [Data]Add filter operation
Merge pull request !460 from xulei/filter_master
2020-04-20 23:33:44 +08:00
mindspore-ci-bot 822a3160e4 !404 [Dataset] Add Python Sampler support for CPP dataset
Merge pull request !404 from JunhanHu/python_sampler_for_cpp_dataset
2020-04-20 22:45:51 +08:00
xulei2020 c705ea5e5b add filterOp code 2020-04-20 22:32:19 +08:00
Peilin Wang 9bc2134cb7 added checking of first row crc to find invalid tfrecord files
addressed code review comments. added check in python layer to exclude directories and to raise an error if a pattern does not match any file

fixed clang format

fixed cppcheck

fixed cppcheck (used std::accumulate and std::copy_if). regenerated tfrecord file to contain correct header, it was a dummy header before

fixed cppcheck: added const reference for string parameter for lambdas, fixed clang format: whitespace adjustments

more clang whitespace fixes...

changed print to logger.info
2020-04-20 10:25:26 -04:00
mindspore-ci-bot d8176a77f4 !425 New api "TextFileDataset"
Merge pull request !425 from yanghaitao/yht_textfiledatasetv2
2020-04-20 22:14:26 +08:00