inclusionAI/ling-cookbook
Jupyter Notebook
Captured source
source ↗inclusionAI/ling-cookbook
Description: Guide, document and practical tips for getting the most out of the Ling model series.
Language: Jupyter Notebook
Stars: 0
Forks: 0
Open issues: 0
Created: 2026-08-13T06:42:16Z
Pushed: 2026-08-16T02:36:21Z
Default branch: main
Fork: no
Archived: no
README:
Ling Cookbook
> Ling Cookbook provides deployment recipes and practical examples for the Ling model family. Work in progress.
> inclusionAI/ling-cookbook 是 Ling 系列大语言模型的部署与开发指南仓库,提供已验证的硬件部署方案和模型的工程特性与使用技巧。当前正在开发中。
---
相关资源与社群
- 官方网站:ant-ling.com
- Hugging Face:inclusionAI
- ModelScope:inclusionAI
- GitHub:inclusionAI/ling-cookbook
- Discord:Ling Community
- X (Twitter):@AntLingAGI
---
内容目录
本地部署 (guide/local-deploy/)
包含在消费级硬件和设备上部署 Ling 系列模型提供推理服务的示例。
Ling-3.0-flash
| 模型 | 设备 | 框架 | 量化 | 链接 | | :--- |:----------------------| :--- | :--- | :--- | | Ling-3.0-flash | 单台 NVIDIA DGX Spark | SGLang | MXFP4 (W4A16 / W4A8) | [文档: SGLang MXFP4 部署指南](guide/local-deploy/ling-3.0-flash/dgx-spark-sglang-mxfp4.ipynb) | | Ling-3.0-flash | 单台 NVIDIA DGX Spark | SGLang | INT4 (W4A16) | [文档: SGLang INT4 部署指南](guide/local-deploy/ling-3.0-flash/dgx-spark-sglang-int4.ipynb) | | Ling-3.0-flash | 单台 NVIDIA DGX Spark | vLLM | INT4 (W4A16) | [文档: vLLM INT4 部署指南](guide/local-deploy/ling-3.0-flash/dgx-spark-vllm-int4.ipynb) | | Ling-3.0-flash | 单台 NVIDIA DGX Spark | llama.cpp | GGUF (Q6_K / Q4_K) | [文档: llama.cpp GGUF 部署指南](guide/local-deploy/ling-3.0-flash/dgx-spark-llamacpp-gguf.ipynb) |