Commit Graph

766 Commits

Author SHA1 Message Date
Ryan McCormick a3f805c79d
docs: add image-to-video support for vLLM-Omni in diffusion support matrix (#7374)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-13 19:01:30 -07:00
dagil-nvidia 1da0ecd46f
docs: revert #7371 (#7373) 2026-03-13 20:47:39 -05:00
dagil-nvidia 34f13a12c6
docs: use GitHub admonitions instead of Fern-native callouts (#7370)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2026-03-13 18:02:45 -07:00
dagil-nvidia 39310c5ada
docs: remove blog section from sidebar navigation (#7371)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2026-03-13 19:31:28 -05:00
dagil-nvidia 46dad85b03
docs: update KVBM diagram and bump container image tags to 1.0.0 (#7365)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2026-03-13 18:08:10 -05:00
dagil-nvidia 1d509252b3
docs: remove duplicate title from introduction frontmatter (#7361)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2026-03-13 17:54:24 -05:00
Anish 5b415abb41
docs: rewrite architecture.md as a clearer system architecture narrative (#7022)
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: Anish <80174047+athreesh@users.noreply.github.com>
Signed-off-by: akshatha-k <akshutk@gmail.com>
Co-authored-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: akshatha-k <akshutk@gmail.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>
2026-03-13 22:08:13 +00:00
dagil-nvidia f744c7c32f
docs: add agentic inference post to blog landing page (#7359)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2026-03-13 16:34:25 -05:00
Keiven C 33604afa19
test: generalize router test infrastructure and expand documentations (#7327)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
2026-03-13 13:58:32 -07:00
Yan Ru Pei 7e07495f6c
feat(mocker): add --decode-speedup-ratio for speculative decoding simulation (#7349)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
2026-03-13 12:35:40 -07:00
dagil-nvidia 19c192cd25
docs: modernize introduction page SVG figures (#7352)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2026-03-13 15:18:45 -04:00
dagil-nvidia 24fe435d08
docs: update support matrix, release artifacts, and README for v1.0.0 (#7350)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2026-03-13 15:17:51 -04:00
Wang, Yi f29753dc89
feat: Add NVTX markers for sglang EPD (#7079)
Signed-off-by: Wang, Yi <yi.a.wang@intel.com>
2026-03-13 10:47:05 -07:00
Yan Ru Pei 5aa2f53fc2
feat(kv-router): add Prometheus metrics to standalone indexer (#7339)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
2026-03-13 10:07:48 -07:00
Yan Ru Pei bddaaa2658
feat(kv-router): pluggable scheduling policy for router queue [DYN-2454] (#7260)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
2026-03-13 04:16:49 +00:00
dagil-nvidia 12785247c2
docs: fix fault tolerance sidebar page order (#7336)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2026-03-12 22:49:44 -05:00
dagil-nvidia b950034bce
docs: update introduction page with links and formatting (#7330)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
2026-03-12 20:05:03 -07:00
dagil-nvidia cd8ba391c9
docs: fix Fern CI failures (broken links, MDX parser, missing KVBM assets) (#7322)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2026-03-12 19:57:02 -07:00
Dmitry Tokarev e3b1081358
fix: Fix kubernetes-operator container image name in docs (#7312)
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-12 22:33:29 -04:00
nikharm 7b1939058a
docs: update KV Router A/B testing guide (#7047)
Signed-off-by: Nikhar Maheshwari <nikharm@nvidia.com>
2026-03-12 15:28:24 -07:00
Anish 197f659589
docs: improve Planner documentation clarity and fix incorrect defaults (#7303)
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-12 13:55:45 -07:00
dagil-nvidia b9d10bdb54
docs: add introduction page to Getting Started (#7292)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
2026-03-12 20:49:53 +00:00
dagil-nvidia 330f001d08
docs: update KVBM diagram from PNG to SVG (#7277)
Signed-off-by: akshatha-k <akshutk@gmail.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: akshatha-k <akshutk@gmail.com>
2026-03-12 15:26:05 -05:00
dagil-nvidia bb43fadaed
chore: remove outdated router_standalone_trtllm example and add standalone router docs (#7278)
Signed-off-by: akshatha-k <akshutk@gmail.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: akshatha-k <akshutk@gmail.com>
2026-03-12 13:04:48 -05:00
Yan Ru Pei bb07b2f455
feat(kv-router): ZMQ gap detection + replay for standalone indexer [LLM-126] (#7209)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
2026-03-12 10:46:01 -07:00
ishandhanani 1e66860808
docs: agentic inference blog post (#7073)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Dan Gil <dagil@nvidia.com>
2026-03-12 10:43:16 -07:00
Ayush Agarwal 1182e2071d
feat: vllm omni image to video support (#6530)
Signed-off-by: ayushag <ayushag@nvidia.com>
2026-03-12 17:30:46 +00:00
hhzhang16 5c7e66ece1
docs: add docs for DGDR usage -- golden path (#6946)
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
2026-03-12 17:18:09 +00:00
dagil-nvidia 545fa300dc
docs: refine contribution guide introduction (#7288)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2026-03-12 09:15:50 -05:00
dagil-nvidia 2adf8a2df6
docs: add FastVideo example and guide with light sidebar reorg (#7283)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2026-03-12 00:19:08 -05:00
dagil-nvidia 64f02ffa2b
docs: move contribution guide to Getting Started section (#7268)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2026-03-11 21:19:53 -05:00
dagil-nvidia 535ba421fa
docs: improve and move contribution guide to docs site (#7264)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2026-03-11 21:56:36 -04:00
dagil-nvidia 35cbc7594d
docs: reorganize sidebar — slim Getting Started, add Resources section (#7263)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2026-03-11 21:22:55 -04:00
Schwinn Saereesitthipitak 92b341f36e
docs: update snapshot checkpointing docs (#7244) 2026-03-11 22:00:24 +00:00
daiyaanarfeen 5d5fd243da
feat: GlobalPlanner --max-total-gpus for cluster-wide GPU budget (#7103)
Signed-off-by: Daiyaan <darfeen@nvidia.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: Anish <80174047+athreesh@users.noreply.github.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>
2026-03-11 21:54:55 +00:00
Neal Vaidya 834eea618c
docs: fix image link (#7227)
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
2026-03-11 10:58:48 -07:00
hhzhang16 611e856d87
feat: hide optimizationType (#7160)
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
2026-03-11 00:36:18 +00:00
akshatha-k 218cb13ce7
docs: add Agentic Workloads feature guide (#6982)
Signed-off-by: akshatha-k <akshutk@gmail.com>
Signed-off-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: Bryan Bednarski <bbednarski@nvidia.com>
2026-03-10 22:58:10 +00:00
jh-nv 734c0b8b0b
feat: Add Loki log aggregation, and enable unified OTLP ingestion for both traces and logs through a single endpoint (#6974) 2026-03-10 15:20:33 -07:00
dagil-nvidia 96f3bdccef
docs: 1.0 documentation improvements (#7168)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-10 17:08:31 -05:00
dagil-nvidia fa474d360e
docs: fix disaggregated deployment example in tracing.md (#6999)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2026-03-10 16:41:10 -05:00
Keiven C 9ab2486a14
docs: document NIXL Prometheus telemetry metrics in observability guide (#7141)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
2026-03-10 11:37:18 -07:00
Ben Hamm 419e936a53
refactor: remove benchmark shim, use AIPerf directly (#7074)
Signed-off-by: Ben Hamm <ben.hamm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Saravana Periyasamy <saperiyasamy@nvidia.com>
2026-03-10 03:41:36 +00:00
Yan Ru Pei 48eb52e777
feat(kv-router): P2P recovery for standalone KV indexer [DYN-2367] (#6934)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-09 23:52:48 +00:00
ishandhanani 51dfd76045
feat: add SGLang chat processor for frontend pre/post processing (#6834)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-09 23:27:34 +00:00
dagil-nvidia 3ec78ec3d3
docs: update support matrix and release artifacts for v0.9.1 (#7044)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2026-03-09 16:32:32 -05:00
Schwinn Saereesitthipitak d54af4f8cf
chore: restrict Dynamo Snapshot to x86_64, document backend support (#7031) 2026-03-09 14:14:39 -07:00
Ryan McCormick 9df36b3868
fix(docs): Fix mermaid chart in MM doc and remove extra table (#7111) 2026-03-09 13:34:07 -07:00
hhzhang16 71f9e7a9de
fix: normalize GPUSKU to AIC system identifier (#6984)
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
2026-03-09 12:58:39 -05:00
Thomas Montfort a22b44b7cd
docs: add rolling-update page to kubernetes nav index (#7094) 2026-03-09 10:21:18 -07:00