mooncake-track
/
dynamo
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,250 Commits 2 Branches 0 Tags 76 MiB
Commit Graph

67 Commits

Author SHA1 Message Date
Anant Sharma 3842b24479
fix: update bytes crate version to latest (#6041) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
 2026-02-06 15:11:04 -05:00
Graham King 2ffd58475b
chore: Remove native-tls / openssl dependency (#5703) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2026-01-28 17:36:11 +00:00
Pavithra Vijayakrishnan 66c369964a
chore: version update for 0.9.0 (#5661) 
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
 2026-01-26 17:18:05 -08:00
Tushar Sharma cf433e6825
chore: update all copyright headers in repo to 2026 (#5130) 
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
 2026-01-02 22:08:23 +00:00
Anant Sharma 7436e3bc03
chore: update versions for 0.8.0 release (#5031) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
 2025-12-19 10:21:52 -08:00
Anant Sharma 5b82b8b096
chore: update versions to match latest release (#4966) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
 2025-12-18 08:45:44 -08:00
Keiven C 00b64ae001
refactor: remove legacy NATS metrics and stats_handler (#4680) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-12-04 09:59:39 -08:00
Graham King f05f7629f3
chore: Make nats_client private at crate level, various tidy up (#4513) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2025-11-21 14:35:57 -08:00
Graham King 27904535fb
fix(storage): Correctly encoding FileStore keys (#4539) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2025-11-21 17:01:40 -05:00
Graham King 2100f6aac5
feat(mistralrs): Upgrade to support CUDA 13 (#4474) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2025-11-19 14:12:17 -08:00
Keiven C 0e77d3442e
refactor: centralize environment variable constants (#4083) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-11-17 11:16:38 -08:00
Graham King fbad28602e
chore: Remove the python bindings for port allocation (#4237) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2025-11-11 20:35:36 +00:00
Anant Sharma 23660bc5c3
chore: update versions for 0.7.0 release (#4217) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
 2025-11-10 21:40:06 +00:00
Keiven C afccc9d434
refactor: consolidate Observability files (e.g. OTEL docker-compose, md files) (#4173) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-11-10 20:19:34 +00:00
Graham King cf630bf7b6
refactor: Make the Runtime and DistributedRuntime fields private (#4193) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2025-11-10 15:56:22 +00:00
Graham King 794c0a4431
feat(keyvalue): Filesystem backed KeyValueStore (#4138) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2025-11-07 21:11:33 +00:00
Tushar Sharma 9bb1af3376
chore: Update version to 0.6.1 (#3916) 
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
 2025-10-27 17:17:26 -04:00
Keiven C cbe0b177ab
refactor: redesign the metrics API from Trait to composition to make the code cleaner and easier to understand (#3687) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-10-24 14:34:29 -07:00
Graham King 9ae98ed7f9
refactor(runtime): Replace std::sync::Mutex with parking_lot::Mutex (#3740) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2025-10-21 12:38:51 +00:00
Graham King f6ed01b14c
chore: Replace ServiceConfigBuilder with add_stats_service (#3736) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2025-10-20 16:47:05 -04:00
Harrison Saturley-Hall cd2389baef
chore: pre-0.6.0 activities (#3592) 
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
 2025-10-13 17:45:19 -04:00
Graham King 6ffd20a81c
chore: Move model_input, model_type from ModelEntry to ModelDeploymentCard (#3292) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2025-09-30 09:35:15 -07:00
Ryan Olson a13c4cb61d
feat: add Rayon compute pool for CPU-intensive operations (#2969) 
Signed-off-by: Ryan Olson <rolson@nvidia.com>
 2025-09-26 11:23:30 -06:00
Harrison Saturley-Hall 980727bba1
chore: bump versions ahead of 0.5.1 release (#3209) 
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
 2025-09-24 18:26:38 -04:00
Graham King 7a5a0bd6cd
chore: Upgrade Rust to 1.90 (#3147) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2025-09-19 18:54:29 -04:00
Graham King 02a22cbcf3
chore(runtime): Shorten the license header (#3059) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2025-09-16 17:13:11 +00:00
Graham King cb5a657a6a
fix: Load the tokenizer JSON once for chat and completions. (#2910) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2025-09-05 16:48:16 -04:00
Yan Ru Pei 1995ef9aee
docs: change docs to default port 8000 (#2876) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2025-09-05 01:16:53 +00:00
Harrison Saturley-Hall 561ecb98a2
chore: bump version numbers ahead of 0.5.0 release (#2812) 
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
 2025-09-02 16:13:28 -04:00
Graham King bce7458842
chore: Rust to 1.89 and edition 2024 (#2659) 2025-08-22 16:17:15 -07:00
Tzu-Ling Kan 57728909cf
feat: Add model label for vllm backend metrics (#2474) 
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-08-21 17:32:34 +00:00
Dmitry Tokarev 9a02188531
chore: Bumped Dynamo version to 0.4.1 (#2545) 2025-08-19 21:55:37 -04:00
Tzu-Ling Kan 6f7f6b12df
feat: Rename dynamo_component_concurrent_requests (#2515) 
Signed-off-by: Tzu-Ling Kan <tzulingk@nvidia.com>
 2025-08-19 22:23:02 +00:00
Keiven C 0444217339
fix: replace metrics callback with background scraping to prevent tim… (#2480) 
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-08-18 12:38:50 -07:00
Harrison Saturley-Hall ffae72b7d2
fix: remove kvmanager feature from python 3.12 ai-dynamo-runtime wheel (#2456) 2025-08-15 16:43:55 -04:00
Keiven C acbdabc464
feat(metrics): add NATS client metrics to prometheus_metrics_fmt (#2292) 
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-08-14 19:33:53 -07:00
Tzu-Ling Kan 3a3f5bf275
feat: Add a "model" label to Component metrics (#2389) 2025-08-14 13:48:25 -05:00
Graham King 72ec5f5c7b
feat: Allow an endpoint to serve multiple models (#2418) 2025-08-13 10:48:42 -04:00
Keiven C c91e2e4967
refactor: rename to system status server for consistency (#2354) 
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-08-11 15:14:34 -07:00
Graham King a3f7a39faf
chore(metrics): Remove the Arc (#2357) 2025-08-07 14:40:53 -04:00
Yingge He 254f4819f1
refactor: Rename HTTP server to metrics server in worker process (#2318) 2025-08-06 18:55:24 -07:00
Keiven C efd863d67e
fix: dynamo_component to be added in metric names (#2180) 
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-07-31 19:56:28 -07:00
Dmitry Tokarev 4c90b1b924
chore: Version bump to 0.4.0 (#2179) 2025-07-30 02:07:31 +00:00
Keiven C 615580d8e6
feat: Base metrics: add generic ingress handler metrics (#2090) 
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-07-28 10:35:56 -07:00
Keiven C 4498a77d0b
fix: move docker-compose.yml to deploy/, and update frontend port (#2121) 
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-07-25 23:07:57 +00:00
Keiven C e5a8628fb7
feat: add a hierarchical Prometheus MetricsRegistry trait for DistributedRuntime, Namespace, Components, and Endpoint (#2008) 
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Ryan Olson <rolson@nvidia.com>
 2025-07-22 08:39:32 -07:00
Graham King aba60996f2
perf(router): Remove lock from router hot path (#1963) 2025-07-16 12:26:32 -04:00
ZichengMa ece76a6201
feat: Build DistributedRuntime-level HTTP server with /health /metrics (#1656) 2025-07-08 22:49:28 +00:00
Anant Sharma c4935b3497
chore: update versions for 0.3.2 release (#1793) 2025-07-07 17:21:02 -04:00
Graham King 4ab476174a
chore(engines): Upgrade mistralrs to 0.6.0 (#1767) 2025-07-03 12:45:58 -07:00