Commit Graph

87 Commits

Author SHA1 Message Date
mindspore-ci-bot d99dfbd83d !390 getnext parallel optimization part III & IV: Loop Control & Stream Dispatch adaptation
Merge pull request !390 from gukecai/master
2020-04-21 15:36:44 +08:00
gukecai f8208c7c52 Support GetNext Parallel 2020-04-21 11:39:07 +08:00
liyong f1542a90a3 add pk sampler 2020-04-21 10:08:38 +08:00
mindspore-ci-bot 6369cf27bd !406 added first row crc check for when reading tfrecord files
Merge pull request !406 from Peilin/first-row-crc-check
2020-04-21 00:10:18 +08:00
xulei2020 c705ea5e5b add filterOp code 2020-04-20 22:32:19 +08:00
Peilin Wang 9bc2134cb7 added checking of first row crc to find invalid tfrecord files
addressed code review comments. added check in python layer to exclude directories and to raise an error if a pattern does not match any file

fixed clang format

fixed cppcheck

fixed cppcheck (used std::accumulate and std::copy_if). regenerated tfrecord file to contain correct header, it was a dummy header before

fixed cppcheck: added const reference for string parameter for lambdas, fixed clang format: whitespace adjustments

more clang whitespace fixes...

changed print to logger.info
2020-04-20 10:25:26 -04:00
mindspore-ci-bot d8176a77f4 !425 New api "TextFileDataset"
Merge pull request !425 from yanghaitao/yht_textfiledatasetv2
2020-04-20 22:14:26 +08:00
mindspore-ci-bot 11a4b35caa !472 Fix inputs size and attr for AddN fission pass
Merge pull request !472 from YuJianfeng/master
2020-04-20 21:30:52 +08:00
ms_yan c5cfb09e66 Repair some MS_LOG problem 2020-04-20 19:45:46 +08:00
mindspore-ci-bot 679dbd27b3 !478 fix save_graphs_path and log file mode related issues
Merge pull request !478 from fary86/fix_log_and_ir_issues
2020-04-20 19:07:38 +08:00
fary86 7e23a1a475 Fix issues of save_graphs_path, Type/Value error message and log file mode 2020-04-20 16:23:40 +08:00
YuJianfeng bc2df2c913 Fix inputs size and attr for AddN fission pass 2020-04-20 15:48:27 +08:00
yanghaitao 2795e492ff TextFileDataset 2020-04-20 11:18:55 +08:00
mindspore-ci-bot 3822b4837f !340 Add a HistogramSummary ops to record tensor value
Merge pull request !340 from ougongchang/master
2020-04-20 10:54:04 +08:00
ms_yan f0c07c3fa6 Realize take op and add ut 2020-04-18 18:33:57 +08:00
mindspore-ci-bot 71b63c3fcf !246 [opt pass] AdjustAllReduceMulAdd
Merge pull request !246 from vlne-v1/I1E3PI-opt-pass-adjust-allreduce-apply-weight-decy-seq
2020-04-18 18:17:01 +08:00
Wei Luning ea6958c50a add pattern AdjustAllReduceMulAdd 2020-04-18 17:00:55 +08:00
YuJianfeng 5eb5379889 Add AdamApplyOne fusion pass 2020-04-18 10:54:09 +08:00
ougongchang 0ed6d9178e add Histogram summary operator
clean clang format errors and cpplint errors

add some test cases for histogram summary operator
2020-04-18 09:56:45 +08:00
jzw 3f7054dccb add skip dataset op 2020-04-17 19:48:25 +08:00
mindspore-ci-bot f69a668d98 !350 change tuple output to make tuple
Merge pull request !350 from lianliguang/chang-tuple-output-to-make-tuple
2020-04-17 19:22:41 +08:00
lianliguang 00e4306518 convert all tuple output to maketuple 2020-04-17 17:31:42 +08:00
mindspore-ci-bot f98efafa16 !317 [IRFusion] add derelu_fusion pass
Merge pull request !317 from huanghui/derelu_fusion_pass
2020-04-17 16:42:06 +08:00
mindspore-ci-bot cf026096a6 !183 Mindspore.dataset CPP sampler for GeneratorDataset
Merge pull request !183 from JunhanHu/cpp_sampler
2020-04-16 22:30:59 +08:00
wenchunjiang ee5f3fa240 add pass to insert memcpy_async for get_next outputs 2020-04-16 14:30:24 +08:00
mindspore-ci-bot 58a70b5f82 !346 getnext parallel optimization part II: Eliminate Memcpy in specify scenario
Merge pull request !346 from laiyongqiang/develop
2020-04-15 20:38:42 +08:00
laiyongqiang 3e05f50f5f getnext_memcpy_elimination 2020-04-15 19:38:10 +08:00
yangzhenzhang 6d522f0a4f add parallel op for layernorm 2020-04-15 19:30:07 +08:00
huanghui b02e871c1a [IRFusion] add derelu_fusion pass 2020-04-15 10:20:35 +08:00
Junhan Hu 9739d3b048 Add CPP sampler support for GeneratorDataset 2020-04-14 12:09:03 -04:00
mindspore-ci-bot 30de261c3c !243 Support nested repeat
Merge pull request !243 from h.farahat/nested_repeat
2020-04-14 23:07:32 +08:00
hesham 0fc23eee0f Support nested repeat 2020-04-14 10:13:18 -04:00
mindspore-ci-bot b571fabd77 !289 Add cnode mapping after graph match
Merge pull request !289 from YuJianfeng/find_op
2020-04-14 18:51:28 +08:00
YuJianfeng e5c67b9088 Add cnode to equal map when opt matching 2020-04-14 17:29:47 +08:00
mindspore-ci-bot 9bda080bb5 !260 refactor padding strategy
Merge pull request !260 from lianliguang/refactor-padding-strategy
2020-04-14 15:44:46 +08:00
mindspore-ci-bot 1ab430072e !232 [Auto parallel] Model the memory_cost in cost model
Merge pull request !232 from Xiaoda/model-memory-cost-in-auto-parallel
2020-04-14 15:29:04 +08:00
mindspore-ci-bot 94589ce611 !226 expend conv stride and dilation to 2d
Merge pull request !226 from wangnan39/expend_conv_stride_to_2d
2020-04-14 14:58:22 +08:00
wangnan39@huawei.com 2604acedcb extend conv stride and dilation to 2d 2020-04-14 13:16:27 +08:00
lianliguang 5d225f934f change the padding strategy & refactor insert transdata 2020-04-14 12:57:40 +08:00
Xiaoda Zhang 0ac50a19f5 Model the memory cost in auto-parallel. It is calculated by the output of operators, plus the parameters. Additionally, modify the graph-operations in auto_parallel to include memory_cost. 2020-04-14 11:39:31 +08:00
mindspore-ci-bot f1fa2a9941 !273 [MD] update subset random sampler in minddataset
Merge pull request !273 from liyong126/mindrecord_subset_sampler_python
2020-04-14 11:18:36 +08:00
mindspore-ci-bot 298a32f1e2 !132 Add confusion_mul_grad_fusion pass
Merge pull request !132 from huanghui/master
2020-04-13 21:49:06 +08:00
liyong 0ce83e39e1 fix TestShardSampleWrongNumber
adjust internal api
2020-04-13 21:31:45 +08:00
mindspore-ci-bot 57f953ca38 !216 Implement addn fusion pass
Merge pull request !216 from YuJianfeng/master
2020-04-13 20:49:32 +08:00
huanghui 19ee376cd3 add confusion_mul_grad fusion pass 2020-04-13 19:08:15 +08:00
c00425699 d62f560b50 add_bool_type_check_in_comm_op 2020-04-13 17:34:29 +08:00
YuJianfeng 7307c81f31 implement AddN fission pass 2020-04-13 16:05:45 +08:00
panfengfeng 6a79fc1735 skip mindrecord ut test case 2020-04-13 10:38:54 +08:00
buxue 5841fe010e Support pow's second input could be tensor and fix bug in bprop of pow 2020-04-11 16:16:58 +08:00
yangzhenzhang b34c0e7a17 add parallel op for dropoutdomask 2020-04-11 12:11:22 +08:00