目录
- .agentsImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- .claudeImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- .geminiImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- .githubImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- benchmarksImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- cmakeImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- csrcImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- docsImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- examplesImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- testsImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- toolsImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- vllm_ascendImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- .clang-formatImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- .gitignoreImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- .markdownlint.yamlImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- .pre-commit-config.yamlImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- .readthedocs.yamlImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- AGENTS.mdImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- CLAUDE.mdImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- CMakeLists.txtImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- CODE_OF_CONDUCT.mdImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- CONTRIBUTING.mdImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- DCOImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- DockerfileImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- Dockerfile.310pImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- Dockerfile.310p.openEulerImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- Dockerfile.a3Import vllm-ascend codebase as baseline for CCF competition PRs19天前
- Dockerfile.a3.openEulerImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- Dockerfile.openEulerImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- LICENSEImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- README.mdImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- README.zh.mdImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- codecov.ymlImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- collect_env.pyImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- format.shImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- mypy.iniImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- packages.txtImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- pyproject.tomlImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- requirements-dev.txtImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- requirements-lint.txtImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- requirements.txtImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- setup.pyImport vllm-ascend codebase as baseline for CCF competition PRs19天前
- typos.tomlImport vllm-ascend codebase as baseline for CCF competition PRs19天前
邀请码
版权所有：中国计算机学会技术支持：开源发展技术委员会
京ICP备13000930号-9
京公网安备 11010802047560号
vLLM Ascend Plugin
| 关于昇腾 | 官方文档 | #sig-ascend | 用户论坛 | 社区例会 |
English | 中文
最新消息 🔥
总览
vLLM 昇腾插件 (
vllm-ascend) 是一个由社区维护的让vLLM在Ascend NPU无缝运行的后端插件。此插件是 vLLM 社区中支持昇腾后端的推荐方式。它遵循[RFC]: Hardware pluggable所述原则：通过解耦的方式提供了vLLM对Ascend NPU的支持。
使用 vLLM 昇腾插件，可以让类Transformer、混合专家(MOE)、嵌入、多模态等流行的大语言模型在 Ascend NPU 上无缝运行。
准备
开始使用
推荐您使用以下版本快速开始使用：
贡献
请参考 CONTRIBUTING 文档了解更多关于开发环境搭建、功能测试以及 PR 提交规范的信息。
我们欢迎并重视任何形式的贡献与合作：
分支策略
vllm-ascend有主干分支和开发分支。
releases/v0.13.0是vllm-asend针对vLLMv0.13.0版本的开发分支。下面是维护中的分支：
请参阅版本策略了解更多详细信息。
社区例会
许可证
Apache 许可证 2.0，如 LICENSE 文件中所示。