natas_hw
/
openvino
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
openvino/src/plugins
History
Taylor Yeonbok Lee ba610e67a6
[GPU] Distributed kv cache allocatio to prevent memory peak (#22665) 
### Details:
- If kv caches are reallocated and copied at one time, there will be a
memory peak at that inference.
- Distributed kv cahce allocation period to prevent that issue as a
temporal quick solution

### Tickets:
 - 128982
 		2024-02-06 06:40:34 +00:00
..
auto Delete `single_layer/` folder (#21990) 2024-02-02 18:39:10 +00:00
auto_batch Remove `ie_*` includes (#22657) 2024-02-05 20:12:50 +00:00
hetero [Core]remove ie plugin config (#22479) 2024-02-01 08:56:31 +00:00
intel_cpu [Op][Ref][CPU] Extend Gather op with String support (#22465) 2024-02-06 06:00:39 +00:00
intel_gpu [GPU] Distributed kv cache allocatio to prevent memory peak (#22665) 2024-02-06 06:40:34 +00:00
proxy [Core]remove ie plugin config (#22479) 2024-02-01 08:56:31 +00:00
template [Op][Ref][CPU] Extend Gather op with String support (#22465) 2024-02-06 06:00:39 +00:00
CMakeLists.txt Mark some legacy API as deprecated (#17469) 2023-05-17 11:31:01 +04:00
README.md [DOCS] Move of developer documentation from wiki to md documents - master (#15372) 2023-02-16 11:03:11 +04:00

README.md

OpenVINO Plugins

OpenVINO Plugins provide support for hardware devices.

The list of supported plugins:

See also