From 32a76aa3eb0fb24e596d0ba5fd40e8bb4d2f8702 Mon Sep 17 00:00:00 2001 From: gujing Date: Tue, 13 May 2025 20:31:58 +0800 Subject: [PATCH] fix wrong command in XpYd (#357) Signed-off-by: zibai --- doc/en/sglang-integration-v1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/doc/en/sglang-integration-v1.md b/doc/en/sglang-integration-v1.md index b2820b59..5684a37e 100644 --- a/doc/en/sglang-integration-v1.md +++ b/doc/en/sglang-integration-v1.md @@ -97,5 +97,5 @@ Note: - TP is supported but not required, you can remove `--tp-size 2` if you want. - The `--disaggregation-ib-device` is the device to be used for data transmission, it is optional since we will detect this config automatically. Or you can still explicitly specify devices if needed. If multiple NIC devices are used, they can be separated by commas, such as "erdma_0,erdma_1". Please note that there are no spaces between them. - XpYd is supported. It is ok to run one prefill and multiple decode instances on the same node, however, multiple prefill instances on the same node are not supported due to the port conflict of bootstrap server. - - e.g., `python3 -m sglang.srt.disaggregation.mini_lb --prefill http://192.168.0.137:30000,http://192.168.0.140:30000 --decode http://192.168.0.137:30001,http://192.168.0.140:30001 --host 0.0.0.0 --port 8000` + - e.g., `python3 -m sglang.srt.disaggregation.mini_lb --prefill http://192.168.0.137:30000 http://192.168.0.140:30000 --decode http://192.168.0.137:30001 http://192.168.0.140:30001 --host 0.0.0.0 --port 8000` - HuggingFace timeout can be addressed by `export SGLANG_USE_MODELSCOPE=true` \ No newline at end of file