Popular repositories Loading

1. vllm-pcie-allreduce vllm-pcie-allreduce Public

   Fast tensor-parallel all-reduce for V100 GPUs connected only by PCIe. Patches 1Cat-vLLM so its SM70 push kernel runs across PCIe peer-to-peer instead of NCCL: 4-GPU decode 76 → 91 tok/s, within 4% …

   Python