provectus/kafka-ui

Clustered KSQLDB support

Open

#2,204 opened on Jun 24, 2022

View on GitHub
 (4 comments) (2 reactions) (0 assignees)Java (977 forks)batch import
good first issuescope/backendscope/frontendstatus/acceptedtype/enhancement

Repository metrics

Stars
 (7,799 stars)
PR merge metrics
 (No merged PRs in 30d)

Description

Is your proposal related to a problem?

We decided to deploy multiple ksqlDB per use case (e.g one service one ksqlDB) as recommended by ksql docs in one kafka cluster. However, when we try to integrate ksqlDB to kafka-ui, we don't see any setting to setup this configuration.

Describe the solution you'd like

Support multiple ksqlDB in one cluster like kafka connect.

As environment variable

KAFKA_CLUSTERS_0_KSQLDBSERVER_0_NAME=first
KAFKA_CLUSTERS_0_KSQLDBSERVER_0_ADDRESS=http://localhost:8088

or as config YAML file

kafka:
  clusters:
    - name: local
      ksqldbServer: 
        - name: first
          address: http://localhost:8088
      kafkaConnect:
        - name: first
          address: http://localhost:8083
      jmxPort: 9997

Describe alternatives you've considered

Deploy multiple kafka-ui for each ksqlDB

Additional context

ksqlDB docs - Deploy recommendation and best practices

Contributor guide

Research direction
Examine how ksqlDB servers are currently configured in kafka ui and extend the configuration model to allow multiple ksqlDB servers per cluster, similar to Kafka Connect support. Update environment variable parsing and YAML configuration accordingly.
Tech stack
java
Domain
backendapi
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
Half day
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
KafkaksqlDB
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
50