LLM RunnerC++

Llama.cpp

ggerganov/llama.cpp

LLM inference in C/C++ - run Llama, Mistral, Falcon and more models on CPU/GPU.

Install Command

git clone https://github.com/ggerganov/llama.cpp && cd llama.cpp && make

GitHub Stats

Stars0

Forks0

LanguageC++

Deployment

✔ Linux (native / Docker)

✔ macOS

✔ Windows (WSL2)

✔ Cloud (AWS · GCP · Azure)