Skip to content

Fix visual DP calculation for multi-node deployment - #1594

Merged
sufubao merged 1 commit into
ModelTC:mainfrom
sufubao:fix-multinode-visual-dp
Sep 29, 2026
Merged

sufubao merged 1 commit into
ModelTC:mainfrom
sufubao:fix-multinode-visual-dp

Conversation

@sufubao

@sufubao sufubao commented Sep 29, 2026

Copy link
Copy Markdown
Collaborator

双机各 8 卡、--tp 16 --dp 16 启动多模态模型时,视觉并行度按全局 tp 自动计算为 16,导致每台机器尝试访问 GPU 8–15,报 CUDA error: invalid device ordinal。

改为使用 tp // nnodes 计算本机视觉并行度,使上述配置每台启动 8 个视觉实例。保持单机及视觉代理模式的现有行为。

验证:Black、Flake8 和 git diff --check 通过;现有启动参数测试 20 项通过。未新增测试,尚未执行双机端到端启动验证。

@sufubao
sufubao merged commit 6c9e03b into ModelTC:main Sep 29, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant