ggml-org/llama.cpp

tts : add support for Orpheus

Open

#12,476 opened on Mar 20, 2025

View on GitHub
 (9 comments) (27 reactions) (0 assignees)C++ (18,202 forks)batch import
good first issuetts

Repository metrics

Stars
 (110,169 stars)
PR merge metrics
 (Avg merge 6d 8h) (389 merged PRs in 30d)

Description

HF: https://huggingface.co/collections/canopylabs/orpheus-tts-67d9ea3f6c05a941c06ad9d2

These TTS models seem suitable for supporting. To do that, we need to implement the SNAC audio codec: https://github.com/hubertsiuzdak/snac/

Sample implementation using Python-based inference of SNAC: https://github.com/isaiahbjork/orpheus-tts-local

Similar model support (OuteTTS): https://github.com/ggml-org/llama.cpp/pull/10784 Can be used as a reference how to implement this.

Contributor guide

Research direction
Study the SNAC audio codec specification and the reference Python implementation. Examine the OuteTTS pull request (#10784) in llama.cpp for a similar model integration. Then design the C++ implementation of the SNAC codec within the llama.cpp framework, following the patterns from the OuteTTS PR.
Tech stack
cpp
Domain
backendmachine learning
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
3-5 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
C++Git
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
60