Commit Graph

79 Commits

Author SHA1 Message Date
Ryan Olson 72e849e780
chore: set velo crates to initial v0.1.0 (#7156)
Signed-off-by: Ryan Olson <rolson@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
2026-03-10 17:57:24 -06:00
jh-nv 734c0b8b0b
feat: Add Loki log aggregation, and enable unified OTLP ingestion for both traces and logs through a single endpoint (#6974) 2026-03-10 15:20:33 -07:00
Graham King 5265787b5d
chore: Enable "multipart" feature of reqwest (#7084)
Signed-off-by: Graham King <grahamk@nvidia.com>
2026-03-10 13:47:01 +00:00
Ryan Olson 63d7c01c9c
feat: velo-backend (#6547)
Signed-off-by: Ryan Olson <rolson@nvidia.com>
2026-03-09 23:26:25 +00:00
Ryan Olson 57bdbdf1ee
feat: upgrade rust to v1.93.0 (#6802)
Signed-off-by: Ryan Olson <rolson@nvidia.com>
2026-03-03 17:08:35 +00:00
Ryan Olson 7604295938
feat(kvbm): add testing utilities to kvbm-logical and kvbm-physical (#6691)
Signed-off-by: Ryan Olson <rolson@nvidia.com>
2026-03-02 21:18:32 -07:00
Ryan Olson 9ab148dcb9
feat: kvbm-physical (#6490)
Signed-off-by: Ryan Olson <rolson@nvidia.com>
2026-03-01 09:43:03 +00:00
Harrison Saturley-Hall db88c9530b
chore: bump versions to 1.0.0 (#6613)
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
2026-02-25 22:42:33 -05:00
Ryan Olson 7a6283e927
chore: cargo machete - remove unused dependencies (#6453)
Signed-off-by: Ryan Olson <rolson@nvidia.com>
2026-02-20 19:11:52 +00:00
Yan Ru Pei cf51a0c4fd
chore: gate plotters dependency behind bench feature (#6380)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-18 15:27:19 -05:00
Yan Ru Pei c5c6a55190
feat: more flash indexer optimizations (#6305)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-18 09:13:37 -08:00
Ryan Olson 94fad4799f
feat: kvbm-logical (#6033)
Signed-off-by: Ryan Olson <rolson@nvidia.com>
2026-02-14 02:24:26 +00:00
Anant Sharma 3842b24479
fix: update bytes crate version to latest (#6041)
Signed-off-by: Anant Sharma <anants@nvidia.com>
2026-02-06 15:11:04 -05:00
Graham King 2ffd58475b
chore: Remove native-tls / openssl dependency (#5703)
Signed-off-by: Graham King <grahamk@nvidia.com>
2026-01-28 17:36:11 +00:00
Pavithra Vijayakrishnan 66c369964a
chore: version update for 0.9.0 (#5661)
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
2026-01-26 17:18:05 -08:00
Tushar Sharma cf433e6825
chore: update all copyright headers in repo to 2026 (#5130)
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
2026-01-02 22:08:23 +00:00
Anant Sharma 7436e3bc03
chore: update versions for 0.8.0 release (#5031)
Signed-off-by: Anant Sharma <anants@nvidia.com>
2025-12-19 10:21:52 -08:00
Anant Sharma 5b82b8b096
chore: update versions to match latest release (#4966)
Signed-off-by: Anant Sharma <anants@nvidia.com>
2025-12-18 08:45:44 -08:00
Keiven C 00b64ae001
refactor: remove legacy NATS metrics and stats_handler (#4680)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-12-04 09:59:39 -08:00
Graham King f05f7629f3
chore: Make nats_client private at crate level, various tidy up (#4513)
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-11-21 14:35:57 -08:00
Graham King 27904535fb
fix(storage): Correctly encoding FileStore keys (#4539)
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-11-21 17:01:40 -05:00
Graham King 2100f6aac5
feat(mistralrs): Upgrade to support CUDA 13 (#4474)
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-11-19 14:12:17 -08:00
Keiven C 0e77d3442e
refactor: centralize environment variable constants (#4083)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-11-17 11:16:38 -08:00
Graham King fbad28602e
chore: Remove the python bindings for port allocation (#4237)
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-11-11 20:35:36 +00:00
Anant Sharma 23660bc5c3
chore: update versions for 0.7.0 release (#4217)
Signed-off-by: Anant Sharma <anants@nvidia.com>
2025-11-10 21:40:06 +00:00
Keiven C afccc9d434
refactor: consolidate Observability files (e.g. OTEL docker-compose, md files) (#4173)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-11-10 20:19:34 +00:00
Graham King cf630bf7b6
refactor: Make the Runtime and DistributedRuntime fields private (#4193)
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-11-10 15:56:22 +00:00
Graham King 794c0a4431
feat(keyvalue): Filesystem backed KeyValueStore (#4138)
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-11-07 21:11:33 +00:00
Tushar Sharma 9bb1af3376
chore: Update version to 0.6.1 (#3916)
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
2025-10-27 17:17:26 -04:00
Keiven C cbe0b177ab
refactor: redesign the metrics API from Trait to composition to make the code cleaner and easier to understand (#3687)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-10-24 14:34:29 -07:00
Graham King 9ae98ed7f9
refactor(runtime): Replace std::sync::Mutex with parking_lot::Mutex (#3740)
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-10-21 12:38:51 +00:00
Graham King f6ed01b14c
chore: Replace ServiceConfigBuilder with add_stats_service (#3736)
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-10-20 16:47:05 -04:00
Harrison Saturley-Hall cd2389baef
chore: pre-0.6.0 activities (#3592)
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
2025-10-13 17:45:19 -04:00
Graham King 6ffd20a81c
chore: Move model_input, model_type from ModelEntry to ModelDeploymentCard (#3292)
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-09-30 09:35:15 -07:00
Ryan Olson a13c4cb61d
feat: add Rayon compute pool for CPU-intensive operations (#2969)
Signed-off-by: Ryan Olson <rolson@nvidia.com>
2025-09-26 11:23:30 -06:00
Harrison Saturley-Hall 980727bba1
chore: bump versions ahead of 0.5.1 release (#3209)
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
2025-09-24 18:26:38 -04:00
Graham King 7a5a0bd6cd
chore: Upgrade Rust to 1.90 (#3147)
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-09-19 18:54:29 -04:00
Graham King 02a22cbcf3
chore(runtime): Shorten the license header (#3059)
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-09-16 17:13:11 +00:00
Graham King cb5a657a6a
fix: Load the tokenizer JSON once for chat and completions. (#2910)
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-09-05 16:48:16 -04:00
Yan Ru Pei 1995ef9aee
docs: change docs to default port 8000 (#2876)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
2025-09-05 01:16:53 +00:00
Harrison Saturley-Hall 561ecb98a2
chore: bump version numbers ahead of 0.5.0 release (#2812)
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
2025-09-02 16:13:28 -04:00
Graham King bce7458842
chore: Rust to 1.89 and edition 2024 (#2659) 2025-08-22 16:17:15 -07:00
Tzu-Ling Kan 57728909cf
feat: Add model label for vllm backend metrics (#2474)
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-08-21 17:32:34 +00:00
Dmitry Tokarev 9a02188531
chore: Bumped Dynamo version to 0.4.1 (#2545) 2025-08-19 21:55:37 -04:00
Tzu-Ling Kan 6f7f6b12df
feat: Rename dynamo_component_concurrent_requests (#2515)
Signed-off-by: Tzu-Ling Kan <tzulingk@nvidia.com>
2025-08-19 22:23:02 +00:00
Keiven C 0444217339
fix: replace metrics callback with background scraping to prevent tim… (#2480)
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-08-18 12:38:50 -07:00
Harrison Saturley-Hall ffae72b7d2
fix: remove kvmanager feature from python 3.12 ai-dynamo-runtime wheel (#2456) 2025-08-15 16:43:55 -04:00
Keiven C acbdabc464
feat(metrics): add NATS client metrics to prometheus_metrics_fmt (#2292)
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-08-14 19:33:53 -07:00
Tzu-Ling Kan 3a3f5bf275
feat: Add a "model" label to Component metrics (#2389) 2025-08-14 13:48:25 -05:00
Graham King 72ec5f5c7b
feat: Allow an endpoint to serve multiple models (#2418) 2025-08-13 10:48:42 -04:00