Commit Graph

1686 Commits

Author SHA1 Message Date
buxue c3c06514d7 perfect annotation of ops and context and support bool equal 2020-09-15 14:32:02 +08:00
mindspore-ci-bot b83d921735 !3317 add check for stridedslice when choose aicpu or aicore
Merge pull request !3317 from zhangbuxue/add_check_for_stridedslice_when_choose_aicpu_or_aicore
2020-09-15 10:37:09 +08:00
mindspore-ci-bot 7a5ef7894d !6227 dataset API docstring: Update datasets and text desc and examples
Merge pull request !6227 from cathwong/ckw_api_engine
2020-09-15 10:29:11 +08:00
mindspore-ci-bot 2b05208a6f !6153 [AutoParallel]Check device target in init
Merge pull request !6153 from lichen/add_checks_for_init
2020-09-15 09:34:56 +08:00
Cathy Wong f7adf648e9 dataset API docstring: Update datasets, samplers, graphdata and text 2020-09-14 18:10:44 -04:00
Xun Deng c64f6a0a2a move pp related tests cases to probability folder 2020-09-14 13:29:43 -04:00
mindspore-ci-bot d0e49c5cf8 !6192 Improve the functions of class SequentialCell and add examples
Merge pull request !6192 from lijiaqi/sequentialcell
2020-09-14 23:24:04 +08:00
mindspore-ci-bot 1b956c77e0 !6155 modify path of ut and st of mdp
Merge pull request !6155 from byweng/master
2020-09-14 22:30:52 +08:00
Lixia Chen b5b333726f Leaf ops do self-reset. 2020-09-14 09:48:14 -04:00
Jiaqi 76cec24098 modify sequentialcell 2020-09-14 17:13:47 +08:00
mindspore-ci-bot 9824d0b20f !6142 MindData fix batch ops issue
Merge pull request !6142 from xiefangqi/md_fix_map_issue
2020-09-14 16:00:23 +08:00
lichenever aaf7045cdf add checks for init 2020-09-14 14:40:41 +08:00
bingyaweng 866a8a1178 modify path of ut and st of mdp 2020-09-14 11:23:55 +08:00
mindspore-ci-bot 37e3b6082f !6002 Reduce inline passes traversal by skipping inline action if no pre-ad python pass exists
Merge pull request !6002 from BowenK/pre_ad
2020-09-14 10:16:56 +08:00
xiefangqi 653c79b4af md fix per_batch_map issue 2020-09-14 09:55:51 +08:00
mindspore-ci-bot a9a3d5a1f5 !5753 remove sens parameter
Merge pull request !5753 from lijiaqi/loss_scale_sens
2020-09-13 17:27:27 +08:00
mindspore-ci-bot c10341dfb7 !6020 Add common check_param_type and set_param_type in distribution
Merge pull request !6020 from XunDeng/new_check_param
2020-09-13 13:54:39 +08:00
Jiaqi 94d63b90f4 remove sens parameter 2020-09-13 11:34:56 +08:00
mindspore-ci-bot 02c6852699 !6108 add model with loss test case
Merge pull request !6108 from hanyang/master
2020-09-12 16:58:23 +08:00
mindspore-ci-bot 8bf5ac1c15 !6032 [bug]add import for ops in ops.py in __init__
Merge pull request !6032 from vlne-v1/change_ops_import
2020-09-12 16:57:15 +08:00
Wei Luning 7b6899fdc0 add import of ops in in ops __init__ 2020-09-12 15:29:43 +08:00
liyong 16147669a6 fix num_samples in concatDataset 2020-09-12 15:06:18 +08:00
Wan Hanyang 0b7570eb53 add model with loss, without loso and o2 test case 2020-09-12 14:26:40 +08:00
mindspore-ci-bot 3c0aa0a6e4 !6069 support function as condition of if
Merge pull request !6069 from zhangbuxue/support_function_as_condition_of_if
2020-09-12 12:39:15 +08:00
mindspore-ci-bot eb049b0e93 !5842 [Dataset] dataset op log changes
Merge pull request !5842 from luoyang/pylint
2020-09-12 09:42:42 +08:00
mindspore-ci-bot 28e2b0253e !6086 Order dict by column_id in create_dict_iterator()
Merge pull request !6086 from ZiruiWu/order_dict_in_create_dict_iterator
2020-09-12 08:41:46 +08:00
Xun Deng 67325d63b0 edited common_dtype and check_param dtype logic 2020-09-11 16:51:19 -04:00
Zirui Wu d54ba374b9 order dict by column_id in create_dict_iterator()
fix CI
2020-09-11 15:33:47 -04:00
YangLuo f5a85510f2 [MD] dataset op log changes 2020-09-12 00:43:36 +08:00
nhussain 96de2ffdb6 fix errors from old compose call in Python 2020-09-11 10:30:23 -04:00
mindspore-ci-bot d8c09067ce !5801 [MD][Feature] minddata iterator output ms_tensor
Merge pull request !5801 from xiefangqi/md_modify_output_tensor
2020-09-11 20:19:06 +08:00
buxue b9c9046b93 support function as condition of if 2020-09-11 17:43:07 +08:00
Wan Hanyang 2ceea1e59d add a self attention test case 2020-09-11 16:30:28 +08:00
mindspore-ci-bot 5b4642d10a !4950 Fixing Minddata profiling monitor
Merge pull request !4950 from anthonyaje/monitor_fix
2020-09-11 14:34:27 +08:00
mindspore-ci-bot 48b337f206 !6026 fix some test case
Merge pull request !6026 from suteng/master
2020-09-11 14:09:11 +08:00
xiefangqi 9b3c33e157 minddata iterator output ms_tensor 2020-09-11 11:35:50 +08:00
mindspore-ci-bot cf7d6eddc4 !6019 [MD] Move Random(Choice/Apply/Order) from vision to transforms module
Merge pull request !6019 from nhussain/move_random_choice_apply
2020-09-11 10:37:21 +08:00
Su Teng 7b46f46a65 remove unuse test 2020-09-11 10:16:56 +08:00
buxue 08059f5c61 add check for stridedslice when choose aicpu or aicore 2020-09-11 10:11:14 +08:00
mindspore-ci-bot dd215f4080 !5735 delete seed0 and seed1
Merge pull request !5735 from caozhou/delete_seed
2020-09-11 09:58:56 +08:00
mindspore-ci-bot f1979f8fe5 !5998 change internal API _get_strategy() to _get_shard_strategy()
Merge pull request !5998 from yihuaijie/master
2020-09-11 09:15:18 +08:00
mindspore-ci-bot a778868a5a !5929 BucketBatchByLength column issue
Merge pull request !5929 from MahdiRahmaniHanzaki/bucket_batch_by_length_fix
2020-09-11 05:53:48 +08:00
nhussain f42f9ef9d7 move random apply order and choice ops 2020-09-10 15:39:56 -04:00
nhussain 92e99ff224 change map calls 2020-09-10 10:25:05 -04:00
mindspore-ci-bot eedbbb3649 !5958 Modify interface for function and remove duplicated def
Merge pull request !5958 from lilei/modify_bug
2020-09-10 21:22:32 +08:00
BowenK e482e4e8bf reduce pass traversals if no pre-ad python pass exists 2020-09-10 20:00:10 +08:00
mindspore-ci-bot 2f529c149a !5991 Change API set_strategy() to shard()
Merge pull request !5991 from yihuaijie/master
2020-09-10 19:17:32 +08:00
Yi Huaijie eb83ea9607 change internal API _get_strategy() to _get_shard_strategy() 2020-09-10 17:46:53 +08:00
Yi Huaijie a836d25c64 change API set_strategy() to shard() 2020-09-10 15:30:19 +08:00
anthonyaje 2d08d83247 Fixed connector_size and monitor. 2020-09-09 17:54:59 -04:00
Zirui Wu 1bb93580dd Add usage flag to MNIST/CIFAR
ci fix 1

fix ci 2

fix ci 3

fix ci 4

fix ci 5

fix ci 6

fix ci 7

change var name in CelebA from dataset_type to usage

address review cmts

fix cpp ut fail

change mode to usage in VOCDataset

fix cmts

fix ci test case fail
2020-09-09 09:59:55 -04:00
lilei 71adabd944 modify_bug 2020-09-09 18:20:32 +08:00
Wei Luning 249382899b fix bug in cell pickle and copy 2020-09-09 15:33:56 +08:00
mindspore-ci-bot 2350a5990b !5885 [doc]add some document for composite op
Merge pull request !5885 from vlne-v1/add-doc-for-composite-op
2020-09-09 14:13:23 +08:00
mindspore-ci-bot eff187d83d !5806 [MD] minddata delete set_dataset_size interface
Merge pull request !5806 from xiefangqi/md_delete_setdatasetsize
2020-09-09 11:50:52 +08:00
mindspore-ci-bot 0aa9f900dd !5749 Support multi grad
Merge pull request !5749 from amongo/SupportPyantiveMultiGrad
2020-09-09 10:31:35 +08:00
Wei Luning 8c6475fd0b add composite op doc 2020-09-09 10:18:49 +08:00
xiefangqi d0410d6191 md delete set_dataset_size interface 2020-09-09 09:56:03 +08:00
mindspore-ci-bot c45f79d36b !5384 [MD]-Api changes
Merge pull request !5384 from nhussain/api_changes
2020-09-09 09:49:05 +08:00
mindspore-ci-bot 88f5cbe5db !5692 Add requires_grad option for python pass
Merge pull request !5692 from BowenK/pre_ad
2020-09-09 09:28:52 +08:00
mahdi a152a65227 Fixed the column problem in BucketBatchByLength 2020-09-08 17:48:42 -04:00
Zirui Wu bde9f18f5a update lookup api to take in a type
ci

add test case

address some of the review cmts

address review cmts
2020-09-08 11:59:28 -04:00
nhussain 3bac9d3713 switch input columns and operation
change ImagefolderDV2 name

change ds.transforms.vision to ds.vision

change batch api to match map api more closely

compose op changes

test_pylint

remove compose op from vision, move to transform module, refactor map and batch to use column_order
2020-09-08 10:26:20 -04:00
huangdongrun 341b8468eb add support for pynative multicases
clear df builder

add testcases
2020-09-08 16:09:48 +08:00
mindspore-ci-bot f984518150 !5872 remove timeout exception test case
Merge pull request !5872 from zhangbuxue/remove_timeout_exception_test_case
2020-09-08 14:11:06 +08:00
mindspore-ci-bot b40677002f !5714 [refine]change top graph and add cell class
Merge pull request !5714 from vlne-v1/change-top-graph
2020-09-08 11:56:36 +08:00
caozhou 6509fa9023 delete seed0 and seed1 in Dropout 2020-09-08 10:51:12 +08:00
buxue 1ae9da85e0 remove timeout exception test case 2020-09-08 10:34:22 +08:00
mindspore-ci-bot ad186e79d8 !5599 Collect input data when `dataset_sink_mode` set on GPU
Merge pull request !5599 from LiHongzhang/dataset_sink_mode
2020-09-08 10:21:33 +08:00
Wei Luning e6f82af849 add cell class to c++ 2020-09-07 21:06:07 +08:00
Li Hongzhang 066950f69e GPU dataset_sink_mode collect inputs 2020-09-07 17:12:36 +08:00
lichenever f2d3fd34ce rectification_allreduce_fusion_api 2020-09-07 16:38:58 +08:00
mindspore-ci-bot 77dd91a646 !5669 Fix get_py_obj_dtype() for mindspore type
Merge pull request !5669 from hewei/fix_get_py_obj_dtype
2020-09-07 08:59:01 +08:00
mindspore-ci-bot 5c7fa52468 !5673 [performance]cell init opt performance
Merge pull request !5673 from kingxian/master
2020-09-05 17:10:08 +08:00
kingxian 92bebe65a9 cell init performance opt 2020-09-04 19:52:56 +08:00
yao_yf d4cfe55c04 rename mirror_mean to gradients_mean 2020-09-04 14:47:36 +08:00
BowenK 1bdb26f9e8 Warming up python pass by adding inline passes before it 2020-09-04 14:26:17 +08:00
mindspore-ci-bot 9018737e99 !5696 [Auto parallel] Move 'multi-subgraphs' interface to internal
Merge pull request !5696 from Xiaoda/20-moving-multi-graph-interface-internal
2020-09-04 11:17:28 +08:00
mindspore-ci-bot c064c01b6b !5729 [AutoParallel]Add FuseBatchNormEx op
Merge pull request !5729 from lichen/add_batchnormex_op
2020-09-04 11:17:22 +08:00
mindspore-ci-bot 7786adc3aa !5722 fix semi auto parallel parameter of reshape has another user
Merge pull request !5722 from yao_yf/semi_auto_parallel_reshape_parameter_has_another_user
2020-09-04 09:45:41 +08:00
mindspore-ci-bot d76ac7c6e8 !5648 GetColumnNames for Python
Merge pull request !5648 from MahdiRahmaniHanzaki/get-col-name
2020-09-03 22:37:42 +08:00
lichenever d22f506431 add BatchNormEx op 2020-09-03 22:22:19 +08:00
mindspore-ci-bot 527d7f0afb !5580 [MD] remove finish in FileReader
Merge pull request !5580 from liyong126/rmv_filereader_finish
2020-09-03 21:18:35 +08:00
yao_yf 05c003ae6b origin/semi_auto_parallel_reshape_parameter_has_another_user 2020-09-03 20:27:46 +08:00
mindspore-ci-bot fc79997de5 !5502 Mod SoftmaxCrossEntropyWithlogits
Merge pull request !5502 from wanyiming/mod_SoftmaxCrossEntropyWithlogits
2020-09-03 20:24:43 +08:00
liyong ac39c20f41 del finish in FileReader 2020-09-03 20:05:38 +08:00
Xiaoda Zhang 42f1241270 remove 'multi-subgraphs' to internal 2020-09-03 19:07:08 +08:00
wanyiming 0ec70068ae mod_SoftmaxCrossEntropyWithLogits 2020-09-03 17:33:20 +08:00
mindspore-ci-bot 290979853e !5663 add check for mod when y in (-1, 0)
Merge pull request !5663 from zhangbuxue/add_check_for_mod_for_y
2020-09-03 09:16:45 +08:00
mindspore-ci-bot 021ba724cf !5645 [bug][api]updata signature
Merge pull request !5645 from vlne-v1/ref_demo
2020-09-03 09:11:50 +08:00
Mahdi 6e7aab8c4f Added GetColumnNames for Datasets 2020-09-02 17:12:48 -04:00
Cathy Wong 4d4c11b133 dataset API docstring cleanup: Standard product terms NumPy, Python 2020-09-02 10:42:12 -04:00
mindspore-ci-bot 35e6cca1a3 !5634 wrap numpy random seed into an api
Merge pull request !5634 from yihuaijie/master
2020-09-02 19:28:33 +08:00
buxue 4d59fe9ee1 add check for mod when y in (-1, 0) 2020-09-02 18:10:00 +08:00
Wei Luning 879a519136 updata signature 2020-09-02 17:29:29 +08:00
Yi Huaijie 4a5d115a66 add get_seed() and set_seed() 2020-09-02 17:17:04 +08:00
He Wei c1469d61ce Fix get_py_obj_dtype() for mindspore type
Return mstype.type_type if input is mindspore type object,
for example:
```
get_py_obj_dtype(mstype.float32) ---> mstype.type_type
```
2020-09-02 16:14:25 +08:00
mindspore-ci-bot ccc0ea60ee !5661 fix auto parallel reshape strategy set when it is first operator
Merge pull request !5661 from yao_yf/auto_parallel_reshape_fix
2020-09-02 15:42:47 +08:00
mindspore-ci-bot 847fadc8b9 !5516 auto parallel context modify
Merge pull request !5516 from yao_yf/auto_parallel_context_collation
2020-09-02 15:41:05 +08:00
mindspore-ci-bot bb84f50407 !5473 optim pylint
Merge pull request !5473 from jinyaohui/master
2020-09-02 15:25:30 +08:00
mindspore-ci-bot 4ec343961e !5482 modify save_checkpoint
Merge pull request !5482 from liuyang/md_save_checkpoint
2020-09-02 14:20:48 +08:00
yao_yf 755f381406 fix auto parallel reshape strategy set when it is first operator 2020-09-02 14:15:54 +08:00
mindspore-ci-bot 03093778df !5387 Set num_epochs=1 for MindData python testcases
Merge pull request !5387 from lixiachen/testcase_epoch
2020-09-02 09:45:13 +08:00
mindspore-ci-bot be3d79cb6b !4204 add dynamic shape support for GatherV2 and others
Merge pull request !4204 from fary86/adapt_primitive_dynamic_shape
2020-09-02 09:31:14 +08:00
Lixia Chen 27d5281641 Change epoch count to 1 for python testcases 2020-09-01 11:24:26 -04:00
buxue 359e1f236e check user define bprop when there is parameter in nested network 2020-09-01 21:24:27 +08:00
fary86 144a35b17e Adapt GatherV2 for dynamic shape 2020-09-01 19:24:21 +08:00
mindspore-ci-bot 8f3ebfd469 !5624 Optimize the performance of GraphData.get_neg_sampled_neighbors
Merge pull request !5624 from heleiwang/gnn_perf
2020-09-01 19:22:53 +08:00
heleiwang 857cf2f77f Optimize the negative sampling process 2020-09-01 16:29:59 +08:00
mindspore-ci-bot c2fddb56c8 !4922 Transform tuple parameter to multiple parameters
Merge pull request !4922 from amongo/TupleTransform
2020-09-01 15:15:56 +08:00
huangdongrun 0099da2c99 add support for tuple parameter transform
add support for pynative pass

add testcases
2020-09-01 14:17:52 +08:00
mindspore-ci-bot 5453b40311 !4477 add dataset compare function to utils
Merge pull request !4477 from tony_liu2/staging
2020-09-01 11:15:18 +08:00
mindspore-ci-bot ab29dbf98b !5385 dataset fixes: Update OneHot API doc; fixup UTs
Merge pull request !5385 from cathwong/ckw_dataset_ut_cleanup8
2020-09-01 11:11:49 +08:00
mindspore-ci-bot 8ebc8ce9c6 !5438 support parameter tuple input in pynative mode
Merge pull request !5438 from wangqiuliang/support-parameter-tuple-input
2020-09-01 11:04:03 +08:00
mindspore-ci-bot 1a4d3e351e !5586 Boost python pass compile and train performance
Merge pull request !5586 from BowenK/performance
2020-09-01 09:19:02 +08:00
Cathy Wong 7f6782be2a dataset fixes: Update OneHot API docs; fixup Python UTs 2020-08-31 15:04:26 -04:00
mindspore-ci-bot 65819fb50c !5488 heck arg is tensor when graph output is a const or parameter
Merge pull request !5488 from zhangbuxue/add_check_tensor_before_compile_graph
2020-08-31 21:36:04 +08:00
yao_yf 8f7aa5bd5a auto parallel context modify 2020-08-31 21:19:49 +08:00
kingfo 7765d44b76 support parameter tuple input in pynative mode 2020-08-31 20:38:43 +08:00
BowenK d6fb7d2db1 Remove debug drawing and printing to boost compile performance; re-opt after python pass to boost training; fix NewParameter tensor clone 2020-08-31 17:42:00 +08:00
buxue 4168c51f0d add check tensor when graph output is a const or parameter 2020-08-31 17:17:24 +08:00
liuyang_655 4683de3443 modify save_checkpoint 2020-08-31 16:24:57 +08:00
jinyaohui a9972a7def optim pylint 2020-08-31 14:49:57 +08:00
mindspore-ci-bot 4d963d96f4 !5534 Fix Tensor.from_numpy() returns wrong type
Merge pull request !5534 from hewei/fix_tensor_from_numpy
2020-08-31 09:15:48 +08:00
He Wei 27721ff4ea Fix Tensor.from_numpy() returns wrong type
Tensor.from_numpy() should return mindspore.Tensor not _c_expression.Tensor.
2020-08-29 19:05:44 +08:00
mindspore-ci-bot e6a4d932b4 !5350 [AutoParallel]Rectification distributed init
Merge pull request !5350 from lichen/rectification_init
2020-08-29 14:55:18 +08:00
mindspore-ci-bot be606ba8f5 !5432 Mindspore parallel supports all elementary-wise operators
Merge pull request !5432 from yihuaijie/master
2020-08-29 14:16:48 +08:00
lichenever d3e55b543e rectification init 2020-08-29 09:34:58 +08:00
Yi Huaijie 84948ca730 parallel supports more elementary-wise operators 2020-08-28 18:19:06 +08:00
mindspore-ci-bot 414184c184 !5367 Check the parameter's split strategies if it has multiple users
Merge pull request !5367 from yangzhenzhang/check-parameter-split
2020-08-28 16:26:46 +08:00
mindspore-ci-bot 820f2cb4eb !5351 move ParalleMode to Context
Merge pull request !5351 from yao_yf/parallel_context_collation
2020-08-28 16:13:01 +08:00
yao_yf 07117e4dd4 mv ParallelMode to context 2020-08-28 19:13:55 +08:00
He Wei d7cdda1cb0 Provide Tensor.from_numpy() to avoid copy 2020-08-28 11:03:14 +08:00
yangzhenzhang fbda03bbcc check parameter split 2020-08-28 10:49:27 +08:00
tony_liu2 70bfd506a1 add function
pr comment fix

revert graphengine
2020-08-27 16:50:19 -04:00
mindspore-ci-bot 7aaf4118bf !5297 CutMixBatch and MixUpBatch fix for 2D one-hot labels
Merge pull request !5297 from MahdiRahmaniHanzaki/cutmix-fix
2020-08-27 21:32:09 +08:00
mindspore-ci-bot 9392623066 !5181 Python pass pattern renaming and interface tweaking
Merge pull request !5181 from BowenK/new_parameter
2020-08-27 19:45:36 +08:00
mindspore-ci-bot e94416be0c !5283 Support setting operator io format in the frontend
Merge pull request !5283 from liangchenghui/io_format
2020-08-27 15:48:13 +08:00
mindspore-ci-bot fabebb2678 !5264 [bug]fix bugs when parameters updata
Merge pull request !5264 from vlne-v1/I1SP3I-return-value-not-the-exact-value
2020-08-27 14:13:20 +08:00
mindspore-ci-bot b346f0b3ec !5026 Fix the problem of resource clear
Merge pull request !5026 from Simson/enhancement-API
2020-08-27 11:19:02 +08:00
simson d4babf190c fix risk of memory leak 2020-08-27 10:54:06 +08:00
BowenK 641d12d6d9 python pass pattern renaming and interface tweaking 2020-08-27 10:03:46 +08:00
mindspore-ci-bot 66d6320b21 !5224 Add test case about loss scale in parallel mode
Merge pull request !5224 from yangzhenzhang/add-split-sens-and-loss-scale-test-case
2020-08-27 09:06:01 +08:00
mahdi 7ad7024c45 Fixed 2D one-hot label problems in CutMix and MixUp 2020-08-26 16:17:21 -04:00
islam_amin 94a4a3f20b changing affine and posterize apis 2020-08-26 10:51:54 -04:00
Wei Luning 4cc8342b5b fix bug in Parameter init_data 2020-08-26 22:15:22 +08:00
梁成辉 34d433fd9a Set io format for old backend 2020-08-26 20:49:15 +08:00
kpy 44b738e8ac fix grad all ci bug 2020-08-26 18:28:35 +08:00
mindspore-ci-bot 314c5ad055 !5172 remove name arg from gradoperation
Merge pull request !5172 from riemann_penn/remove_name_args_from_gradoperation
2020-08-26 16:55:57 +08:00
mindspore-ci-bot 95212b55a0 !3271 make reftype a subtype of MetaTensor and try to mark ref in node input
Merge pull request !3271 from vlne-v1/ref_demo
2020-08-26 15:45:48 +08:00