good first issuehelp wantedroadmap
Repository metrics
- Stars
- (110,169 stars)
- PR merge metrics
- (Avg merge 6d 8h) (389 merged PRs in 30d)
Description
Project: https://github.com/orgs/ggml-org/projects/6
List:
- guide : running gpt-oss with llama.cpp
- guide : adding new model architectures
- guide : using the new WebUI of llama.cpp
- tutorial : offline agentic coding with llama-server
- tutorial : compute embeddings using llama.cpp
- tutorial : parallel inference using Hugging Face dedicated endpoints
- tutorial : KV cache reuse with llama-server
- tutorial : measuring time to first token (TTFT) and time between tokens (TBT)
- tutorial : reusing multiple prompt prefixes with slots (-np) in llama-server
TODO:
- https://github.com/ggml-org/llama.cpp/discussions/13488
- https://github.com/ggml-org/llama.cpp/discussions/13134
- https://github.com/ggml-org/llama.cpp/discussions/13251
- https://github.com/ggml-org/llama.cpp/discussions/12742
- How to get started with webui development (ref: https://github.com/ggml-org/llama.cpp/issues/13523#issuecomment-2879256096)
- etc.
Simply search for "How to" in the Discussions: https://github.com/ggml-org/llama.cpp/discussions?discussions_q=is%3Aopen+How+to
Contributions for writing tutorials are welcome!