Commit Graph

12 Commits

Author SHA1 Message Date
jh-nv 42cde26489
fix: migrate example and document to the latest endpoint API (#6542) 2026-02-25 12:00:04 -08:00
dagil-nvidia e0373bd725
docs: alphabetize backends (SGLang, TensorRT-LLM, vLLM) (#6537)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-25 10:07:59 -06:00
Biswa Panda 75fea78797
feat: make KV cache events and routing LoRA-aware (#6517) 2026-02-24 18:35:08 +00:00
Alec 7bbacce196
feat: default kv-events-config to empty (align with vLLM defaults) (#6404)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-20 06:44:51 +00:00
Yan Ru Pei 56d91ee962
docs: update KV event docs to use event plane terminology (#6326)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
2026-02-17 09:54:07 -08:00
Hongkuan Zhou 359765d354
feat: load-based scaling in SLA Planner (#6145)
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
2026-02-14 09:43:02 -08:00
mohammedabdulwahhab a289695c37
fix: consolidate dyn_discovery_backend and dyn_kv_store (#6167)
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
2026-02-13 19:07:11 +00:00
dagil-nvidia dd6c399565
docs: add frontmatter title to all docs pages (#6254)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-12 22:48:44 +00:00
dagil-nvidia 5ff88b330b
docs: fix image paths to render on both GitHub and Fern (#6228)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-12 09:48:41 -08:00
Yan Ru Pei 937398cf61
feat: Flash Indexer (#5785)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: jthomson04 <jothomson@nvidia.com>
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Signed-off-by: Janelle Cai <jcai18@mit.edu>
Co-authored-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Janelle Cai <jcai18@mit.edu>
2026-02-11 22:26:56 -08:00
dagil-nvidia 2ec1c3f503
docs: add Discovery Plane, refactor Event Plane with D2 diagrams (#6229)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-12 03:51:49 +00:00
Jonathan Tong 39d645e586
docs: migrate Fern docs from fern/ into docs/ (#6206)
Signed-off-by: Jont828 <jt572@cornell.edu>
2026-02-11 16:22:27 -08:00