Commit Graph

29 Commits

Author SHA1 Message Date
Ruoyu Qin dedfbde5da
[Doc] Update docs for a better quick start (#814)
* add transfer engine python api

* add quick start

* add lmcache v1 integration

* update trace

* fix

* modify segment size
2025-09-06 11:16:42 +08:00
ykwd cd717c7091
[Chores] Offset Allocator Test Fix & Docs Fix (#806)
* Fix unit test

* fix docs
2025-09-05 10:38:19 +08:00
Vladislav Nosivskoy aa9d4471a1
[Store] Add replication guarantees (#744)
* add replication guarantees

Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>

* refactor implementation

Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>

* fix merge aftermath

Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>

* less copies

Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>

* try fix wheel tests

Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>

* fix wheel tests

Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>

* remove old comment

Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>

* fix wheel tests and add replication fault tolerance wheel test

Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>

* split wheel tests

Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>

* simplify code

Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>

* replica allocation is best effort operation

Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>

* fix tests for new best-effort behaviour

Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>

* fix

Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>

* update docs

Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>

* update another docs

Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>

---------

Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
2025-08-25 20:24:41 +08:00
Xuchun Shang 2833d8be8b
[Doc] update doc for *Regex interface (#776)
* [Doc] update doc for *Regex interface

Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>

* Fix

Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>

* fix

Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>

---------

Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
2025-08-25 11:05:24 +08:00
ykwd 9acf12080f
[Doc] Allocator Performance (#774) 2025-08-24 09:46:09 +08:00
JinYan Su fb26af7613
refactor(store): remove garbage collection implementation (#763)
* refactor(store): remove garbage collection implementation and related configurations

* fix(client-monitor): stop client monitor thread before joining in destructor

* feat(master-service): add eviction thread functionality

Signed-off-by: Jinyang Su <751080330@qq.com>

---------

Signed-off-by: Jinyang Su <751080330@qq.com>
2025-08-21 12:50:42 +08:00
Sgt.Pepper b63322c9e8
[Doc] fix 3fs doc link problem (#762) 2025-08-20 20:00:28 +08:00
ykwd 75bcd92086
[Doc] Minor Update: Explain Return Value of batch_put_from (#747) 2025-08-14 23:06:44 +08:00
Sgt.Pepper 81f492c033
[Store]feat: Migrate Persistence Metadata from Client to Master Service (#690)
* initial commit

* fix client::query return fault

* fix isexist return fault

* fix test bug

* fix clearinvalidhandles problem

* add file description for 3fs

* change ssd function start from client to master

* fix naming error

* edit doc description

* edit doc

* clang format

* fix as the review comment

* fix formmat

* add master service test for ssd

* fix format

* add log and cli

* fix putend test
2025-08-14 14:34:51 +08:00
JinYan Su d2fa93dfb2
refactor(store): move python bidning to `pybind_client` (#723)
* refactor(store): replace SliceBuffer with BufferHandle in Python bindings

* refactor(store_py): introduce PyClient and wrapper class for Python bindings

* fix

Signed-off-by: Jinyang Su <751080330@qq.com>

---------

Signed-off-by: Jinyang Su <751080330@qq.com>
2025-08-11 14:09:42 +08:00
Hao Li 1b8981a840
add instructions for running on AMD GPU (#689)
Co-authored-by: Li <haoli1@amd.com>
2025-07-31 09:50:39 +08:00
JinYan Su 82c83d7fbf
docs: add RDMA memory registration troubleshooting guide (#694) 2025-07-31 09:23:07 +08:00
Sgt.Pepper f236958805
[Doc] Minor formatting fix (#685) 2025-07-29 16:46:11 +08:00
ykwd 010d120e6a
[Store] Master Service Support OffsetAllocater (#657)
This PR introduces the OffsetAllocator as an additional and default memory allocator option.
2025-07-24 13:03:51 +08:00
ykwd 1f71517d72
[Store] Enlarge the Default KV TTL to 5 Seconds (#660)
* change default kv lease ttl to 5 sec
2025-07-24 10:34:35 +08:00
JinYan Su d41591f3c7
docs(store): add Python API documentation for mooncake store (#646)
* docs(store): add Python API documentation for mooncake store

* docs: add Python API reference link

* Update docs/source/mooncake-store-api/python-binding.md

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* docs: add zero-copy and preferred segment allocation documentation

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-07-22 15:07:42 +08:00
ykwd 41d376b5ef
[Doc] Update Mooncake Store Docs (#612) 2025-07-11 17:13:28 +08:00
Barry_zhang 6a591eafc5
[doc] Update mooncake-store doc (#603) 2025-07-09 10:57:08 +08:00
Letian Ruan f4a9a17d11
docs: add support for LMDeploy (#592)
* docs: add support for LMDeploy

* chore: rm specific ip address in doc
2025-07-09 02:07:23 +08:00
ykwd 60ccc133a9
[Store] Soft Pin for Important Object (#587)
This PR adds a soft pin mechanism for important and frequently used objects, such as system prompts and hot objects.
2025-07-08 19:37:41 +08:00
Sgt.Pepper 92fcdced0e
[DOC]: Add Description for Data Persistence and KVCache offloading in Store (#585)
* add doc for data persistence function and change description for consistency

* fix

* edit multi-tiered storage support

* edit description
2025-07-04 23:19:21 +08:00
ykwd baf7e5cca2
[DOC] Add Description for High Availability in Store (#576) 2025-07-02 10:23:19 +08:00
Shangming Cai f0cb5618c9
[Build] Deprecate stale adaptor usage to reduce whl package size (#529)
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
2025-06-20 14:19:41 +08:00
Chenhao Ye 8ccf6932bd
[DOC] fix: default slice_size is 64KB (#444) 2025-06-04 10:23:29 +08:00
maobaolong a5cf796b73
[Store] feat: Add high watermark ratio flag to avoid trigger eviction until put failed (#403)
* followup(#374)(master): Add high watermark ratio flag to avoid trigger eviction until put failed

* Address comments

* fix type

* Add related docs
2025-05-29 15:39:40 +08:00
jiafu zhang 072248ba68
make backlog size of handshake listen configurable (#388)
and change default value to 128

Co-authored-by: doujiang24 <doujiang24@gmail.com>

---------

Signed-off-by: jiafu.zhang <jiafu.zhang@intel.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Teng Ma <teng-ma@linux.alibaba.com>
Co-authored-by: doujiang24 <doujiang24@gmail.com>
2025-05-29 09:50:59 +08:00
ykwd 9f363ba781
[Store] Add features: lease and eviction (#374)
* [Store] New feature: lease and LRU eviction

* Slightly adjust the ordering of the unit test cases

* Fix failed client_integration_test due to new the lease feature

* Modify test_distributed_object_store.py: adjust unit test behaviour accordingly

* bugfix: don't evict objects whose put are still not complete

* Refactor the codes according to review comments

* Add eviction related metrics in master;
Improve a unit test case for eviction.

* Fix a typo

* Refactor some codes;
Fix a unit test;

* Update docs: add lease and eviction policy

* make eviction_ratio configurable;
improve eviction algorithm to better achieve evicted_count / object_count = eviction_ration, especially when there are not so many objects.

* Fix a typo
2025-05-21 16:18:31 +08:00
Letian Ruan cfbb87660c
[DOC] fix: incorrect url and update lmcache (#363) 2025-05-14 20:29:57 +08:00
Letian Ruan ee64b6a25b
[DOC] feat(docs): build documentation website for Mooncake using Sphinx (#354)
* feat: init mooncake docs websire

* feat: add CI to deploy web for docs

* chore: wrong picture rendering

* docs: update mooncake news

* fix: modify website url
2025-05-12 23:33:18 +08:00