Commit Graph

1071 Commits

Author SHA1 Message Date
liu-yongqi-63 767ba8e6f0 Fix the error is reported when the file name is directly transferred 2022-04-02 11:54:56 +08:00
i-robot 8fb38465d4
!32407 [MD][Offload] Reduce Offload UT Computation Time (r1.7)
Merge pull request !32407 from alashkari/update-ut-r1.7
2022-03-31 14:56:45 +00:00
Rescue c9560da255 Decrease test_map_offload.py computation time. 2022-03-31 13:45:29 +00:00
yanghaoran 42af30a70b takedown test_datasets_generator to ensure gate stability 2022-03-31 16:56:47 +08:00
jonyguo 623c5c9598 fix: when return numpy in GeneratorDataset 2022-03-30 20:40:29 +08:00
harshvardhangupta 6bcccd6e3f modify the autotune config 2022-03-29 14:23:27 -04:00
i-robot 1af8b365de
!31880 [MD] add OBSMindDataset
Merge pull request !31880 from liyong126/add_obs_mindrecord_dataset
2022-03-25 06:50:58 +00:00
liyong 419109cf0a add OBSMindDataset 2022-03-25 11:03:53 +08:00
jonyguo 317c48a933 add log warning and op error check 2022-03-25 09:26:29 +08:00
liyong bff0fbc76f fix GIL acquire Misuse 2022-03-24 08:45:30 +08:00
i-robot 4110c3d6d6
!31646 [dataset][bugfix] 修复config 接口typeerror的问题
Merge pull request !31646 from xiefangqi/md_fix_interface_comments
2022-03-23 02:45:01 +00:00
xiefangqi f81c7967ec fix config interface comments 2022-03-22 10:04:12 +08:00
jonyguo 11079eabbb fix: code check 2022-03-17 08:23:12 +08:00
i-robot 1d6834ce4d
!31334 [MD][Autotune] Modify the generated autotune config to improve readability
Merge pull request !31334 from harshvardhangupta/modify_at_config
2022-03-16 18:18:57 +00:00
i-robot 72ea797e4d
!30339 [BUG][MD][FUNC]RandomInvert
Merge pull request !30339 from yangwm/randominvert
2022-03-16 06:39:53 +00:00
i-robot 8e8391dadb
!30429 BUG][MD][FUNC]RandomAutoContrast
Merge pull request !30429 from yangwm/autocontrast
2022-03-16 06:38:54 +00:00
harshvardhangupta accc32da6c modify the at config file 2022-03-15 13:49:00 -04:00
hesham 3d16a4dee2 Fix bug in terminating a failed pipeline 2022-03-15 11:35:28 -04:00
i-robot 313a247ae8
!31178 upgrade Ascend package 11 Mar 22
Merge pull request !31178 from shenwei41/upgrade_ascend_20220311
2022-03-15 11:08:32 +00:00
i-robot 3be552ca39
!31156 test centos ut
Merge pull request !31156 from luoyang/test_centos
2022-03-15 09:38:15 +00:00
shenwei41 f1fde6a262 upgrade Ascend package 11 Mar 22 2022-03-15 16:31:27 +08:00
i-robot d4fc47ef0c
!31211 Clean iterators before forking
Merge pull request !31211 from h.farahat/pytest_problem
2022-03-15 01:47:28 +00:00
i-robot 6be7c42052
!31191 [MD] more tests for failover reset
Merge pull request !31191 from Mohammad Motallebi/failover_more_tests
2022-03-14 21:50:37 +00:00
h.farahat 318e6b8803 fix segfault 2022-03-14 14:55:21 -04:00
mohammad 583eb32723 [MD] Add more UT and a ST for failover reset 2022-03-14 13:52:09 -04:00
luoyang 74d8969b91 ut failed with pillow>=9.0.0, need more validation 2022-03-14 23:58:09 +08:00
i-robot 8b7d7a1e1a
!31141 [MD][Offload] Offload RandomSharpness Op Pure Sharpness Support & UT
Merge pull request !31141 from alashkari/fix-random-sharpness
2022-03-11 21:06:13 +00:00
Rescue face5e51a0 Added sharpness without randomness support and sharpnes op ut.
fix pad issue
2022-03-11 17:30:49 +00:00
shenyu 443da2280d [FIX][BUG][MD][FUNC] RandomInvert 2022-03-11 11:53:04 +08:00
shenyu c14a8084c7 [FIX][BUG][MD][FUNC] RandomAuoContrast 2022-03-11 10:29:49 +08:00
liyong 50fc6f5736 Revert "!30810 [MD] add OBSMindDataset "
This reverts commit 9fcab9184e, reversing
changes made to afb33fff62.
2022-03-10 19:10:11 +08:00
liyong 10ada68fa9 add OBSMindDataset 2022-03-10 11:18:59 +08:00
i-robot 698b99aaa3
!18945 [assistant][ops]New operator implementation, include OmniglotDataset
Merge pull request !18945 from Wangsong95/omniglot_dataset
2022-03-09 06:51:15 +00:00
qkeys ce7597f500 [feat][assistant][I3J6VB] add new data operator OmniglotDataset 2022-03-08 21:36:22 +08:00
i-robot 2655d64720
!30865 [MD] Modify Batch number of workers with Python multiprocessing
Merge pull request !30865 from cathwong/ckw_batch_workers_pymultip
2022-03-07 18:21:16 +00:00
Cathy Wong bc29dd9d72 [MD] Modify Batch number of workers with Python multiprocessing 2022-03-07 10:39:05 -05:00
xiefangqi 2de6c8908b add a clean up subprocess to clean subprocess when main process exit 2022-03-05 17:24:11 +08:00
i-robot b90cf43562
!30553 Support dataset reset() to recover after failure
Merge pull request !30553 from h.farahat/reset
2022-03-04 02:19:45 +00:00
i-robot f01d841113
!27943 [MD][Autotune] Save/Load Autotune config
Merge pull request !27943 from harshvardhangupta/save_load_at_config
2022-03-03 20:42:23 +00:00
i-robot 7b26a32e98
!22608 [assistant][ops]New operator implementation, include KITTIDataset
Merge pull request !22608 from Wangsong95/kitti_dataset
2022-03-03 07:05:40 +00:00
h.farahat a3dec34833 Dataset failover reset 2022-03-02 23:53:56 -05:00
harshvardhangupta bd61adbb72 Implement save/load of autotune dataset pipeline configuration #27943 2022-03-02 15:08:08 -05:00
i-robot 70e61e9014
!30781 [MD] test_pyfunc_multiprocess_autotune.py - enable AutoTune
Merge pull request !30781 from cathwong/ckw_ut_fixup_map_python_multiproc
2022-03-02 19:50:29 +00:00
i-robot edcc6b790d
!30714 [MD][Offload] Add TypeCast op to offload
Merge pull request !30714 from markuskunej/offload_typecast
2022-03-02 19:48:58 +00:00
Cathy Wong eb931c7f88 [MD] test_pyfunc_multiprocess_autotune.py - enable AutoTune 2022-03-02 13:25:35 -05:00
zx 93617ce91e [feat][assistant][I3J6VO] add new data operator KITTI 2022-03-02 19:29:17 +08:00
Cathy Wong b151f90b8d [MD] Add tests for Python Multiprocessing with AutoTune 2022-03-01 20:20:59 -05:00
markuskunej 6de37045ff Added TypeCast op in dataset offload. 2022-03-01 21:55:27 +00:00
i-robot a8686ae3d9
!18827 [assistant][ops]New operator implementation, include LFWDataset
Merge pull request !18827 from Wangsong95/lfw_dataset
2022-02-28 08:31:11 +00:00
zx 2132f62d98 [feat][assistant][I3J6VQ] add new data operator LFW 2022-02-28 13:43:05 +08:00