grafana/mimir

Docs: Kafka capacity planning for ingest storage architecture

Open

#13,981 opened on Jan 9, 2026

View on GitHub
 (7 comments) (2 reactions) (0 assignees)Go (808 forks)auto 404
help wantedingest-storagetype/docs

Repository metrics

Stars
 (5,181 stars)
PR merge metrics
 (PR metrics pending)

Description

Is your documentation request related to a feature? If so, which one?

Ingest Storage Architecture

What is the solution that you would like or the expected outcome?

Latest Mimir documentation has vague information on how to do capacity planning on Kafka topic. It will be helpful to have it documented.

What did you think would happen?

At present we are evaluating the Kafka topic setup for production use so as per the present documentation we don't have any clue on how to decide on below things.

  1. How many partitions should we have on the topic?
  2. What is the ideal retention to set on Kafka topic?
  3. Should the Kafka broker setup be a stretch cluster vs mirror maker one?
  4. How to switch between Kafka sites if it has multiple sites. like Main vs DR sites.

What was your environment?

Present: POC with Mimir 3.0.1 on Centos 7/8/9 (for production) Deployment mode: manually through scripting.

Any additional context to share?

No response

Contributor guide

Research direction
Tech stack
Domain
Issue type
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Prerequisites
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.