Commit Graph

2645 Commits

Author SHA1 Message Date
chujinjin 551fa9ab8b modify ms function cache key 2021-08-25 14:40:45 +08:00
i-robot db44b88e1e !22094 MD Profiling: For mismatch op info btwn files, skip bottleneck analysis
Merge pull request !22094 from cathwong/ckw_mon_py_analyze_fixes3
2021-08-23 18:28:51 +00:00
ms_yan 36a8886ca2 Revert "[feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset"
This reverts commit b077aa1cab.

Revert "[feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset"

This reverts commit 4e6f7dc97d.

delete pass_registry_test.cc

comment  hiai_nlu_model_multi.pb related  line
2021-08-23 01:46:38 +08:00
djc b077aa1cab [feat] [assistant] [I3T96T] add new Dataset operator CMUARCTICDataset 2021-08-22 16:26:45 +08:00
djc 4e6f7dc97d [feat] [assistant] [I3T96X] add new Dataset operator LibriSpeechDataset 2021-08-22 13:39:37 +08:00
i-robot 0e7844daa9 !22093 revert merge request 21685
Merge pull request !22093 from guozhijian/revert-merge-21685-master
2021-08-21 09:25:32 +00:00
i-robot 4ba337e0f5 !16667 [assistant][ComplexNorm]
Merge pull request !16667 from QingfengLi/ComplexNorm
2021-08-21 02:44:18 +00:00
i-robot f34426095c !22084 Move Transformer Code from Mindspore.nn.parallel to mindspore.parallel.nn
Merge pull request !22084 from huangxinjing/transformer_doc_check
2021-08-20 10:40:01 +00:00
huangxinjing d777742904 1. Move the class to mindspore.parallel, support activation sharding 2021-08-20 14:34:10 +08:00
i-robot 954864bfba !22037 incoroporate getitem if indexed node is zeros_like
Merge pull request !22037 from xychow/always-incorporate-getitem-if-zeros-like
2021-08-20 02:14:35 +00:00
i-robot 5d1bb097e2 !22052 Fix probability core dump in MindData coverage test
Merge pull request !22052 from luoyang/issues2
2021-08-20 01:18:06 +00:00
robert_luo_yibo d837cbee0f [feat][assistant][I3CEG8] add new data operator ComplexNorm 2021-08-20 09:07:21 +08:00
Cathy Wong 85931175bc MD Profiling: For mismatch op info btwn files, skip bottleneck analysis.
Add to summary output: per_pipeline_time and per_push_queue_time.
Enhance UT
2021-08-19 12:19:59 -04:00
guozhijian e1df9a2152 revert 'Pull Request !21685 : add function to invert_op' 2021-08-19 22:49:51 +08:00
i-robot 4113aee7d6 !18668 [assistant][ops]New operator implementation, include Flowers102Dataset
Merge pull request !18668 from Wangsong95/flowers102_dataset
2021-08-19 08:41:44 +00:00
YangLuo 9352935ff6 Fix probability core dump in MindData coverage test 2021-08-19 14:34:57 +08:00
i-robot c93bb9936e !20011 [assistant][ops] Add nn operator Roll
Merge pull request !20011 from 孟权令/Roll
2021-08-19 06:28:28 +00:00
i-robot 3ad641cb65 !21685 add function to invert_op
Merge pull request !21685 from Killer/fake_killer
2021-08-19 05:13:39 +00:00
zhousiyi dcd374961e incoroporate getitem if indexed node is zeros_like so AddN(MakeTuple(x, zeros_like)) can be optimized 2021-08-19 03:28:24 +00:00
fake_killer b0bc4bf5da [feat] [assistant] [I44TRS] extend invert_op's function 2021-08-18 21:46:15 +08:00
i-robot dde05c36b8 !21551 auto_parallel_context interface dataset_strategy union
Merge pull request !21551 from yao_yf/auto_parallel_context_dataset_strategy_union
2021-08-18 09:03:18 +00:00
i-robot 415275ae17 !21805 support adafactor model parallel
Merge pull request !21805 from yangzhenzhang/auto-parallel-support-adafactor-opt
2021-08-18 07:20:39 +00:00
hedongdong d76ed25e96 [feat][assistant][I3T92I] add new nn operator Roll 2021-08-18 10:15:17 +08:00
i-robot 264cb4d2e8 !21920 MD Profiling Analyze: Search for device trace file, independent of device_target
Merge pull request !21920 from cathwong/ckw_mon_py_analyze_device_file
2021-08-18 00:57:50 +00:00
i-robot 0d839fa7c6 !21809 Improved Transformer Struture and Add Args Check
Merge pull request !21809 from huangxinjing/transformer_improved
2021-08-17 12:05:25 +00:00
i-robot a77a0b968d !21761 comm_recompute_interface.
Merge pull request !21761 from yao_yf/comm_recompute_interface
2021-08-17 09:14:29 +00:00
yangzhenzhang 7ca64d2235 auto parallel support adafactor opt 2021-08-17 10:36:42 +08:00
yao_yf 5277b229be add cell comm recompute interface 2021-08-17 09:23:21 +08:00
Cathy Wong a2cbd4b5fa MD Profiling Analyze: Search for device trace file
MinddataProfilingAnalyzer() - remove device_target input parm
2021-08-16 15:41:11 -04:00
huangxinjing 18044aff0f 1. Add docstring, elimitate attention mask, tuple append the deocoder return layer past
split attention inputs from two into three

Add input check and modify test case

Fix check error and add check to transformer inputs

add input check to the transformers
2021-08-16 21:08:48 +08:00
Xiao Tianci aae886bcd7 fix crowd contributing code 2021-08-16 19:33:10 +08:00
yao_yf a83bf73298 union auto_parallel_context interface dataset_strategy 2021-08-16 10:54:46 +08:00
i-robot 530da3e37e !21527 fix_reshape_reshape_in_auto_parallel
Merge pull request !21527 from yao_yf/fix_reshape_reshape_in_auto_parallel
2021-08-13 08:29:15 +00:00
i-robot f99effd430 !21755 Fix batch usability problem
Merge pull request !21755 from xiefangqi/md_fix_batch_usability
2021-08-13 07:21:49 +00:00
i-robot d1112f8e9c !17631 [assistant][FrequencyMasking]
Merge pull request !17631 from QingfengLi/FreqMask
2021-08-13 06:48:06 +00:00
xiefangqi e4894a1bf1 fix batch usability problem 2021-08-12 20:12:43 +08:00
i-robot 2650aae9ba !21351 complex support
Merge pull request !21351 from zhouyaqiang0/complex_support
2021-08-12 09:39:15 +00:00
chenx2ovo 53615010a3 [feat][assistant][I3CEGG] add new data OP FrequencyMasking 2021-08-12 15:28:30 +08:00
yao_yf e233880e41 fix reshape depend reshape in auto parallel 2021-08-12 11:45:28 +08:00
i-robot bff5cbda9c !21670 fix: null numpy field in mindrecord will cause read error
Merge pull request !21670 from guozhijian/fix_null_numpy_field_in_mr
2021-08-12 03:39:34 +00:00
zhouyaqiang b81ba100b7 add complex number support 2021-08-12 10:36:43 +08:00
i-robot 63445ff6fd !21627 alltoall exception handle
Merge pull request !21627 from zhoufeng/alltoall_exception
2021-08-12 01:40:22 +00:00
i-robot 6320bf6b7b !21676 check strategy for conv2d
Merge pull request !21676 from yangzhenzhang/check-strategy-for-conv2d
2021-08-12 01:29:37 +00:00
i-robot 73b55cff72 !20794 add adafactor
Merge pull request !20794 from jiangzhenguang/add_adafactor_optimizer
2021-08-12 01:27:03 +00:00
yangzhenzhang d18c813ee4 check strategy for conv2d 2021-08-11 19:12:48 +08:00
zhoufeng 03a56f2bb0 alltoall exception handle
Signed-off-by: zhoufeng <zhoufeng54@huawei.com>
2021-08-11 17:30:49 +08:00
jonyguo 42b3512a1b fix: when field is none in mr 2021-08-11 17:11:38 +08:00
jiangzhenguang a3bb780ce4 optimize run memory 2021-08-10 20:45:25 +08:00
chenx2ovo e72acf362c [feat][assistant][I3CEGH] add op timemasking 2021-08-10 12:06:07 +08:00
i-robot f154db1bb0 !20680 [assistant][ops] Add New SoftMarginLoss and SoftMarginLossGrad
Merge pull request !20680 from 孟权令/SoftMarginLoss
2021-08-10 02:39:28 +00:00