Commit Graph

13 Commits

Author SHA1 Message Date
dagil-nvidia e0373bd725
docs: alphabetize backends (SGLang, TensorRT-LLM, vLLM) (#6537)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-25 10:07:59 -06:00
Qi Wang d5add7fffa
docs: embedding cache in vLLM and TRT-LLM (#6555) 2026-02-25 00:04:46 -08:00
Biswa Panda 75fea78797
feat: make KV cache events and routing LoRA-aware (#6517) 2026-02-24 18:35:08 +00:00
Alec 6d3b92f04e
feat: remove --connector flag for vLLM backend (LLM-90) (#6450)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-24 17:49:00 +00:00
Alec 7893f2684e
feat: add --disaggregation-mode enum to vLLM backend (#6483)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-23 19:34:30 -07:00
Biswa Panda 04a532edc4
feat: add multimodal lora docs and deployment example for k8s (#6452) 2026-02-23 10:49:46 -07:00
Qi Wang 4d0380d54a
refactor: introduce worker factory in vLLM multimodal (#6060) 2026-02-18 12:21:21 -08:00
Qi Wang d2a5783938
refactor: delete handlers and disagg EC producer/consumer (#6051) 2026-02-17 18:05:54 -08:00
Tzu-Ling Kan 5624d14481
Rename fetch_llm to fetch_model (#6268)
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
2026-02-13 23:22:35 +00:00
dagil-nvidia dd6c399565
docs: add frontmatter title to all docs pages (#6254)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-12 22:48:44 +00:00
KrishnanPrash 3967ec0fbc
feat: Use SGLang MMEncoder for multimodal EPD encode worker (#6162)
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
2026-02-12 12:04:44 -08:00
dagil-nvidia 5ff88b330b
docs: fix image paths to render on both GitHub and Fern (#6228)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-12 09:48:41 -08:00
Jonathan Tong 39d645e586
docs: migrate Fern docs from fern/ into docs/ (#6206)
Signed-off-by: Jont828 <jt572@cornell.edu>
2026-02-11 16:22:27 -08:00