vllm-project/semantic-router

feat: add tenant-scoped config snapshots and recipe activation

Open

#2,363 opened on Jul 5, 2026

View on GitHub
 (0 comments) (0 reactions) (0 assignees)Go (699 forks)github user discovery
area/corearea/dashboardenhancementhelp wantedoperationspriority/P1roadmap

Repository metrics

Stars
 (4,293 stars)
PR merge metrics
 (PR metrics pending)

Description

Summary

Add tenant-scoped config snapshot, validation, activation, and rollback semantics for shared-router multi-tenancy.

Parent roadmap: #2287 Parent issue: #2342 Depends on: #2326, #2331 Related code: src/semantic-router/pkg/config, dashboard/backend/handlers/config.go, dashboard/backend/configprojection, deploy/operator

Motivation

Versioned config snapshots are necessary but not sufficient for multi-tenancy. Each tenant needs isolated routing/recipe activation while sharing global system resources where allowed. This issue defines the config-control-plane semantics for that split.

Scope

Define and implement:

  • shared base config plus tenant overrides;
  • tenant-scoped validation/diff/activate/rollback;
  • per-tenant entrypoint/recipe mapping;
  • config dump/status that can show tenant scope safely;
  • dashboard/operator handling for tenant config operations.

Non-goals

  • Do not duplicate global model assets per tenant by default.
  • Do not let one tenant activate config for another tenant.
  • Do not bypass #2326 snapshot semantics.

Acceptance criteria

  • Tenant configs can be validated and activated independently.
  • Shared global resources and per-tenant routing profiles are separated in config.
  • Rollback and diagnostics operate at tenant scope.

Contributor guide