siliconflow/ComfyUI-llama-cpp_vlm

siliconflow/ComfyUI-llama-cpp_vlm

Description: Run LLM/VLM models natively in ComfyUI based on llama.cpp

Language: Python

Stars: 7

Forks: 0

Open issues: 0

Created: 2026-03-02T01:53:01Z

Pushed: 2026-03-02T08:02:19Z

Default branch: main

Fork: yes

Parent repository: lihaoyun6/ComfyUI-llama-cpp_vlm

Archived: no

README:

ComfyUI-llama-cpp

Run LLM/VLM models natively in ComfyUI based on llama.cpp [[📃中文版](./README_zh.md)]

Changelog

2025-11-03

• Initial release, added support for Qwen3-VL

Preview


Installation

Install the node:

cd ComfyUI/custom_nodes
git clone https://github.com/lihaoyun6/ComfyUI-llama-cpp.git
python -m pip install -r ComfyUI-llama-cpp/requirements.txt

Download models:

• Place your model files in the ComfyUI/models/LLM folder.

> If you need a VLM model to process image input, don't forget to download the mmproj weights.

Credits

• llama-cpp-python @JamePeng
• ComfyUI-llama-cpp @kijai
• ComfyUI @comfyanonymous