Commit Graph

979 Commits

Author SHA1 Message Date
i-robot fc4abc99f5
!28595 Fix some code review probelms
Merge pull request !28595 from xiaotianci/update_code_review
2022-01-12 09:30:28 +00:00
i-robot 5c961f9fb2
!28812 [MD UT] Misc AutoTune and Profiling UT updates
Merge pull request !28812 from cathwong/ckw_prof_misc
2022-01-12 03:03:13 +00:00
Cathy Wong 12b4e81f55 MD UT: Misc AutoTune and Profiling UT updates 2022-01-11 11:56:06 -05:00
Xiao Tianci 96a2e38d01 update review problems 2022-01-11 15:31:53 +08:00
i-robot b073af4b5d
!28559 [MD][Offload] Added dimension check to required Offload ops.
Merge pull request !28559 from alashkari/offload-fix
2022-01-05 07:38:31 +00:00
i-robot a1720c210d
!22348 [assistant][ops] Add new loader EnWik9Dataset
Merge pull request !22348 from 杨旭华/EnWik9Dataset
2022-01-05 07:36:48 +00:00
Rescue fac68dbb46 Added dimension check to required Offload ops. 2022-01-05 04:26:31 +00:00
i-robot de030c8d41
!28204 Improved HwcToChw support multi-channel input.
Merge pull request !28204 from unseenme/mindcon_coding_hwc2chw
2022-01-04 11:50:04 +00:00
unseenme 755cb0adfa Improved HwcToChw support multi-channel input. 2022-01-04 15:47:04 +09:00
Eden 63ab65e3a4 [feat] [assistant] [#I40GYF] add new loader EnWik9Dataset 2022-01-03 21:45:43 -08:00
vddong 7449b8364b [feat][assistant][I40GYQ] add new dataset operator WIDERFace 2021-12-31 13:49:47 +08:00
jingyangxiang a7f8b3af1c [feat][assistant][ops]New operator implementation, include IMDBDataset
Signed-off-by: zjuter0126 <977180923@qq.com>
2021-12-30 11:16:23 +08:00
zjuter0126 3c2ca41886 [feat][assistant][ops] add new data operator WikiTextDataset 2021-12-29 18:54:54 +08:00
i-robot ac9e545dc8 !22546 add new dataset loading operator CaltechDataset
Merge pull request !22546 from 杨旭华/CaltechDataset
2021-12-29 03:40:06 +00:00
donrichnx 9a0fc0ffc1 [feat] [assistant] [I40GYH] add new dataset loading operator CaltechDataset 2021-12-28 19:04:18 +08:00
i-robot 67e843ec7f !27487 [assistant] [ops][SpectralCentroid]
Merge pull request !27487 from 杨旭华/SpectralCentroidOp
2021-12-28 09:10:32 +00:00
i-robot 7faf774063 !22310 [assistant][ops] Add new loader SemeionDataset
Merge pull request !22310 from 杨旭华/SemeionDataset
2021-12-28 03:13:02 +00:00
i-robot bff8d6ae01 !28247 Fix Python Vocab validation
Merge pull request !28247 from luoyang/vocab
2021-12-28 02:58:25 +00:00
luqilin 896f10d6d5 [feat][assistant][I40GYK] add new dataset loading operator SemeionDataset 2021-12-27 19:49:06 +08:00
tongyue 9a1dcd60fc [fix] [assistant] [I40GXI] fix bug in the infer function of the operator SpectralCentroid 2021-12-27 01:41:31 -08:00
i-robot 69a6c7db98 !23380 [assistant][ops] Add new loader AmazonReview
Merge pull request !23380 from 杨旭华/AmazonReview
2021-12-27 09:36:32 +00:00
luoyang ca3de66559 Fix Python Vocab validation 2021-12-27 17:12:07 +08:00
luoyang 0288480722 Python Vocab refactoring and add ids_to_tokens & tokens_to_ids 2021-12-24 15:26:15 +08:00
chengchuanxing 07aa66ee43 [feat][assistant][I40GY2] add new loader AmazonReview 2021-12-23 16:32:31 +08:00
ms_yan 192983b5da check operator mixed or not 2021-12-23 10:22:03 +08:00
fattycat 289a7997df [feat] [assistant] [#I40GYB] add new loader CoNLL2000ChunkingDataset 2021-12-21 15:31:25 +08:00
i-robot f007b8a99f !27745 [MD][Offload] Move offload checks and split to the C pipeline
Merge pull request !27745 from markuskunej/offload_column_pipeline
2021-12-21 04:26:51 +00:00
i-robot 7331629ceb !22686 [assistant][ops][Dither]
Merge pull request !22686 from Isaac/Dither
2021-12-20 11:16:20 +00:00
haohaonannan97 f480be7c48 [feat][assistant][I40GXF] add new data operator Dither 2021-12-18 08:24:48 -08:00
王天浩 11cb3e4ef7 [fear][assistant][I40GYA] add new loader UDPOSDataset 2021-12-18 23:28:05 +08:00
markuskunej 0c10f52eb4 Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc).
Updated check for offload in python (dataset_helper.py and
iterators.py).

Updated auto_offload test in test_map_offload.py.

Changed MapNode.offload type from bool->int in bindings.cc.

Changed manual offload flag from int->enum.

Update offload end of pipeline detection to be column-specific.
2021-12-17 14:35:17 +00:00
Carry955 2320bb7c70 [feat][assistant][I40GXW] add new loader YahooAnswers 2021-12-16 18:33:47 -08:00
i-robot d1dbdeffcb !27684 Update Python UT removal of generated files
Merge pull request !27684 from zetongzhao/update_python_remove
2021-12-17 01:09:17 +00:00
zetongzhao 7cb6989efd replace python removal with pytest tmp_path 2021-12-16 14:38:49 -05:00
i-robot 05336b03c5 !22332 [assistant][ops][SogouNews]
Merge pull request !22332 from 杨旭华/SogouNews
2021-12-16 01:07:21 +00:00
i-robot f6fe56c20d !27447 [MD][Offload] Fix Offload Normalize op bug, Added extra tests to Offload UT.
Merge pull request !27447 from alashkari/offload-fix
2021-12-15 16:00:26 +00:00
li-qiyao f4bfcb8c25 [feat][assistant][I40GXN] add new loader SogouNews 2021-12-14 22:53:38 -08:00
i-robot 83e9fe5c48 !27542 dataset: change dataset_file into dataset_files for MindDataset
Merge pull request !27542 from ms_yan/datasetfiles_name
2021-12-15 03:09:33 +00:00
i-robot dac636decd !22297 [assistant][ops] Add new loader IWSLTDataset
Merge pull request !22297 from 杨旭华/IWSLTDataset
2021-12-15 02:55:08 +00:00
Rescue dc5c388505 Fixed offload Normalize op, added offload Normalize and Rescale tests to offload UT. 2021-12-14 17:03:11 +00:00
ms_yan a85113c093 change dataset_file into dataset_files for MIndDataset 2021-12-14 10:52:41 +08:00
liannai a99b5461bd [feat][assistant][I40GXH]add new data operator Gain 2021-12-13 22:03:09 +08:00
lufei9026 30bc609ce6 [feat][assistant][I40GY8]add new loader IWSLTDataset 2021-12-13 21:47:55 +08:00
i-robot 2a2cd5e4ca !22222 [assistant][ops] Add new loader PennTreebankDataset
Merge pull request !22222 from 杨旭华/PennTreebankDataset
2021-12-13 11:43:00 +00:00
Megalomania 259854e040 [feat] [assistant] [I40GY5] add new loader PennTreebankDataset 2021-12-08 01:22:40 -08:00
xiefangqi bae1dd3bb0 Revert "Moved the offload operation check and map operation split from python (datasets.py) to c++ (NodeOffloadPass.cc)."
This reverts commit 84d38e547a.
2021-12-08 16:39:10 +08:00
i-robot 895256f69a !20043 [assistant][ops] Add new YelpReview
Merge pull request !20043 from 杨旭华/YelpReview
2021-12-08 08:13:34 +00:00
i-robot 75e35bded2 !27081 [MD][Offload] Move offload checks and split to the C pipeline
Merge pull request !27081 from markuskunej/move_offload_check_to_c
2021-12-07 15:55:16 +00:00
lufei9026 2947f418b1 [feat][assistant][I3T96N]add new loader YelpReview 2021-12-07 17:09:41 +08:00
i-robot 7a8e35b4f1 !26456 [assistant][ops]Add new operator Spectrogram
Merge pull request !26456 from YJfuel123/Spectrogram
2021-12-07 06:39:01 +00:00