Python#
Module |
Description |
|---|---|
Distributed KV cache storage client — |
|
High-performance RDMA/TCP data transfer between nodes |
|
Expert-parallel backend for large MoE model deployment |
Module |
Description |
|---|---|
Distributed KV cache storage client — |
|
High-performance RDMA/TCP data transfer between nodes |
|
Expert-parallel backend for large MoE model deployment |