DCAI
← 返回全部动态
vLLM 官方博客(网页)规则精选09月07日 00:00

Serving LLMs on Tenstorrent Hardware: Inside the vLLM TT Plugin

Tenstorrent accelerators join vLLM as an out-of-tree platform plugin, driven by mesh-architecture choices: phase-based scheduling, single-process data paralleli

阅读 vLLM 官方博客(网页) 原文 ↗