* feat(client): add transfer submitter for optimized data transfer
Signed-off-by: Jinyang Su <751080330@qq.com>
* feat(store): implement async memcpy task execution with worker pool
Add `MemcpyWorkerPool` to manage asynchronous execution of memcpy tasks. Refactor `BatchGet` and `BatchPut` methods for parallel execution and enhance logging for better traceability.
* Squashed commit of the following:
commit 38c435fcc6
Author: Feng Ren <alogfans@users.noreply.github.com>
Date: Wed Jun 11 16:50:29 2025 +0800
Revert "[TransferEngine] Fix minor bugs in NVLink transport and benchmark (#468)" (#469)
This reverts commit ffaad6aa18.
commit 41b1df7954
Author: ykwd <oneday117@qq.com>
Date: Wed Jun 11 16:37:05 2025 +0800
[Store] Add initial support for master high availability failover (#451)
* A temp version. Better to continue development after merging the latest main branch
* Temp version to merge the latest main branch
* Allow optional use HA mode, in default use non-HA mode. Fix a minor metrics bug.
* Refactor the etcd_helper
* refactor ha_helper
* Add some unit tests. Refactor the code
* Update cmakelists: build etcd_wrapper in default
* Fix ci problems. Compile etcd wrapper only when use_etcd or with_store are set.
* Update python config relating to mooncake-store client
* make some blocking etcd helper function cancellable.
bug fix: add string name of new errors that will be used in tostring.
* Refactor etcd related code
* Bug fix
* Add basic masterviewhelper unit tests
* In ci flow, install and start etcd to run HA feature unit test.
* Fix a ci bug
* Reuse master_server_address parameter and remove enable_ha parameter.
* Format the code. Fix a minor bug.
* Handle the error case: the coro server may fail to start or return internal error.
commit ffaad6aa18
Author: Feng Ren <alogfans@users.noreply.github.com>
Date: Wed Jun 11 16:02:41 2025 +0800
[TransferEngine] Fix minor bugs in NVLink transport and benchmark (#468)
* [TransferEngine] Fix compilation bug in NVLink xport
* [TransferEngine] Fix minor bugs in nvlink benchmark
Signed-off-by: Jinyang Su <751080330@qq.com>
---------
Signed-off-by: Jinyang Su <751080330@qq.com>
* A temp version. Better to continue development after merging the latest main branch
* Temp version to merge the latest main branch
* Allow optional use HA mode, in default use non-HA mode. Fix a minor metrics bug.
* Refactor the etcd_helper
* refactor ha_helper
* Add some unit tests. Refactor the code
* Update cmakelists: build etcd_wrapper in default
* Fix ci problems. Compile etcd wrapper only when use_etcd or with_store are set.
* Update python config relating to mooncake-store client
* make some blocking etcd helper function cancellable.
bug fix: add string name of new errors that will be used in tostring.
* Refactor etcd related code
* Bug fix
* Add basic masterviewhelper unit tests
* In ci flow, install and start etcd to run HA feature unit test.
* Fix a ci bug
* Reuse master_server_address parameter and remove enable_ha parameter.
* Format the code. Fix a minor bug.
* Handle the error case: the coro server may fail to start or return internal error.
* feat(ci): enable nvlink hook in build configuration
Signed-off-by: Jinyang Su <751080330@qq.com>
* chore(build): add fallback to g++ if nvcc is unavailable
Signed-off-by: Jinyang Su <751080330@qq.com>
---------
Signed-off-by: Jinyang Su <751080330@qq.com>
* chore: automate build output directory and update scripts
* feat(ci): enable CUDA support in workflows
Signed-off-by: Jinyang Su <751080330@qq.com>
* chore(build): switch to nvcc for nvlink hook compilation
Signed-off-by: Jinyang Su <751080330@qq.com>
---------
Signed-off-by: Jinyang Su <751080330@qq.com>
* [TransferEngine]Enable NVLINK transport across multiple processes in the same machine
Signed-off-by: Feng Ren <alogfans@gmail.com>
* update locking stragegy and fix minor problems
* removing thread pool in nvlink transport
* add the support of fabric
* add include
* fix compile bugs
* fix bug
* fix bugs
* add test code in nvlink transport
* minor fix
* enable cuda memory allocation in pywrapper
* extract supportFabricMem()
* add hook plugin to intercept malloc/free for torch program
* set build options
* install go binary according to arch
* copy granularity fix to the nvlink transport
---------
Signed-off-by: Feng Ren <alogfans@gmail.com>
* [TransferEngine]Enable NVLINK transport across multiple processes in the same machine
Signed-off-by: Feng Ren <alogfans@gmail.com>
* update locking stragegy and fix minor problems
* removing thread pool in nvlink transport
* add the support of fabric
* add include
* fix compile bugs
* fix bug
* fix bugs
* add test code in nvlink transport
* minor fix
* enable cuda memory allocation in pywrapper
* extract supportFabricMem()
---------
Signed-off-by: Feng Ren <alogfans@gmail.com>
* chore: artifact include etcd by default
* chore(ci): trim down python versions to 3.10 and 3.12
---------
Co-authored-by: xunqyzhao <xunqyzhao@tencent.com>
and change default value to 128
Co-authored-by: doujiang24 <doujiang24@gmail.com>
---------
Signed-off-by: jiafu.zhang <jiafu.zhang@intel.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Teng Ma <teng-ma@linux.alibaba.com>
Co-authored-by: doujiang24 <doujiang24@gmail.com>
* leave endpoint status unchanged when delete endpoint reference to avoid endpoint deconstruction before CQ being generated
Signed-off-by: jiafu.zhang <jiafu.zhang@intel.com>
* leave endpoint status unchanged when delete endpoint reference to avoid endpoint deconstruction before CQ being generated
Signed-off-by: jiafu.zhang <jiafu.zhang@intel.com>
* leave endpoint status unchanged when delete endpoint reference to avoid endpoint deconstruction before CQ being generated
Signed-off-by: jiafu.zhang <jiafu.zhang@intel.com>
---------
Signed-off-by: jiafu.zhang <jiafu.zhang@intel.com>
* Add eviction related metrics to metrics output;
Decrease key_count and allocated_size metrics when unmount segment.
* Change metrics value type from double to int64_t
* For MasterMetricManager: add getter functions and basic unit tests
Teng Ma