Commit Graph

21 Commits

Author SHA1 Message Date
Cathy Wong 3fe9a05341 [MD] Profiler Memory Tool Support 2022-01-31 17:46:17 -05:00
Cathy Wong 12b4e81f55 MD UT: Misc AutoTune and Profiling UT updates 2022-01-11 11:56:06 -05:00
zetongzhao 7cb6989efd replace python removal with pytest tmp_path 2021-12-16 14:38:49 -05:00
Cathy Wong 367e5ed1dd MD UT: Use pytest.mark.forked for profiling tests 2021-12-02 10:55:05 -05:00
mohammad 5c8ab5f60c add MD Profiler Save() 2021-11-15 13:18:36 -05:00
Cathy Wong cdf3126459 MD Profiler Start Stop Support 2021-11-05 19:46:39 -04:00
harshvardhangupta 1bb45142c9 Implement autotune api 2021-10-26 11:26:13 -04:00
ms_yan bb314ad07f make ut parallel 2021-10-22 13:17:43 +08:00
hetshah 2c1666fd06 set num epochs for iterators that use the default value
add explicit paramter for infinite iterators

set appropriate value for num_epoch param for iteratos

fix long lines

remove trailing whitespace

fixed typo

remove comment

fixed comments

fixed test
2021-09-22 17:32:50 +00:00
Cathy Wong bc85c606b8 MD Profiling: Update Connector Init to Remove any existing file
to fix sequential pipeline scenario.
2021-09-03 15:45:38 -04:00
zhangyihui 3d19949eb4 device_id to rank_id 2021-08-25 09:52:23 +08:00
Cathy Wong 85931175bc MD Profiling: For mismatch op info btwn files, skip bottleneck analysis.
Add to summary output: per_pipeline_time and per_push_queue_time.
Enhance UT
2021-08-19 12:19:59 -04:00
Cathy Wong c37eb350f6 MD Profiling UT: Check CPU util file. Add sequential pipeline UTs 2021-06-16 15:30:59 -04:00
Cathy Wong b7342efe12 MD Profiling UT: Add MD Analyze UT. Add more pipeline profiling UTs. 2021-06-07 11:00:34 -04:00
Cathy Wong f8beb933ad MD Profiling Analyze: Handle cpu util with missing ops. Enhance UTs. 2021-05-31 20:33:19 -04:00
hesham e4c0bd51a5 Modify concat to be an inlined Op
Modify zip to be an inlined Op
Modify take to be an inlined Op
Modify skip to be an inlined Op
Modify rename to be an inlined Op
Modify filter to consume child's rows using one thread
2021-05-04 12:45:18 -04:00
Zirui Wu a1355a827c introduce a master switch to turn on and off profiler 2020-12-22 16:48:01 -05:00
anthonyaje 2d08d83247 Fixed connector_size and monitor. 2020-09-09 17:54:59 -04:00
nhussain 3bac9d3713 switch input columns and operation
change ImagefolderDV2 name

change ds.transforms.vision to ds.vision

change batch api to match map api more closely

compose op changes

test_pylint

remove compose op from vision, move to transform module, refactor map and batch to use column_order
2020-09-08 10:26:20 -04:00
Alexey Shevlyakov 698abf75fc Connector throughput + PerfData + CyclicArray 2020-06-26 14:45:01 -04:00
Alexey Shevlyakov 4e333a2f22 MindData profiler infrastructure 2020-06-11 14:52:36 -04:00