mooncake-track
/
Mooncake
0
0
Fork 12
Code Issues Pull Requests 13 Actions Packages Projects Releases Wiki Activity

[CCF Archive] Store object type eviction policy submission #3

Closed
kancel wants to merge 382 commits from kancel:ccf-archive-pr2746 into main
pull from: kancel:ccf-archive-pr2746
merge into: mooncake-track:main
Conversation 0 Commits 382 Files Changed 654 +1 -1
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files
Showing only changes of commit 1352bbec43 - Show all commits

2
docs/source/getting_started/examples/lmdeploy-integration-v0.9.md
View File

@ -74,7 +74,7 @@ lmdeploy serve api_server Qwen/Qwen3-8B \
- The `--role` parameter sets the node role in the disaggregated system (`Prefill` for token embedding and KV cache generation).
- The `--proxy-url` parameter connects the worker instance back to the proxy for coordination.
- The `--backend` parameter specifies the model execution backend (e.g., `pytorch`, `turbomind`).
- The `--migration-backend` parameter defines the KV cache transport mechanism (e.g., `Mooncake` and `DlSllime`).
- The `--migration-backend` parameter defines the KV cache transport mechanism (e.g., `Mooncake` and `DLSlime`).
#### Decode: