vllm-project/semantic-router
View on GitHubresearch: add fleet-wide caller reputation with cross-agent threat propagation
Open
#2,548 opened on Jul 15, 2026
area/agentarea/corearea/researchenhancementevaluationhelp wantedpriority/P2roadmapsafety
Repository metrics
- Stars
- (4,293 stars)
- PR merge metrics
- (PR metrics pending)
Description
Motivation
Investigate whether privacy-bounded caller risk evidence can be shared across router replicas or cooperating agents inside an explicit trust domain. Current main has no fleet-wide caller-reputation system, and Router Memory must not be used as one.
Preconditions
- Trusted, impersonation-resistant caller/tenant identity (#2362).
- Typed local risk observations and session-level evaluation (#2543).
- Explicit operator-defined trust domain, retention policy, and threat model.
- Router Learning experience/state contract (#2238/#2243).
Research scope
- Define content-minimized, signed/attested risk observations with source, policy/model version, event class, uncertainty, timestamp, and expiry.
- Define federation boundaries: tenant isolation, allowed producers/consumers, namespace, residency, and revocation.
- Aggregate asynchronously with decay, minimum evidence, uncertainty, and poisoning/outlier defenses.
- Separate observed evidence from derived caller risk and from an enforcement decision.
- Feed a derived signal into classification/decision policy only after shadow evaluation.
- Compare local-only, shared-within-replica-set, and federated modes.
- Design correction/appeal, deletion, audit, and recovery semantics.
Boundaries
- No global universal reputation identity.
- No identity derived from prompt text, IP alone, or arbitrary headers.
- No raw prompts, memory entries, or tool arguments in the shared evidence by default.
- Cross-agent evidence cannot directly bypass local authorization or safety policy.
- Sparse, conflicting, stale, or unverifiable evidence fails to unknown.
- No synchronous federation call on the routing hot path.
Acceptance criteria
- Threat model covers spoofing, Sybil behavior, poisoning, collusion, replay, privacy leakage, and tenant crossover.
- Trust-domain and identity prerequisites are machine-validated.
- Schemas, signatures/attestation, TTL, correction, and deletion behavior are tested.
- Shadow evaluation reports false positives, uncertainty, and subgroup/tenant isolation.
- Every downstream policy effect is reconstructable with bounded reasons.
- Loss of the shared store has a documented safe degradation mode.
- Live enforcement requires an explicit later approval gate.
Likely change surfaces
src/semantic-router/pkg/routerruntime/, src/semantic-router/pkg/routerreplay/, src/semantic-router/pkg/classification/, src/semantic-router/pkg/extproc/, src/semantic-router/pkg/config/, observability, security docs, and tests.
Depends on #2362 and #2543. Related: #2238, #2243, #2357, #2547.