vllm-project/tpu-inference

[Feature] Deprecate pre-quantized model loading via Qwix for the JAX/Flax path

Open

#1,680 opened on Feb 10, 2026

View on GitHub
 (2 comments) (0 reactions) (1 assignee)Python (205 forks)github user discovery
good first issue

Repository metrics

Stars
 (348 stars)
PR merge metrics
 (PR metrics pending)

Description

🚀 The feature, motivation and pitch

Once #1623 is complete, we should fully deprecate using Qwix to load prequantized models (example)

More specifically, we need to do the followng:

  1. Deprecate the usage of apply_qwix_on_abstract_model, since we should only be applying Qwix "on-the-fly" (that is, on an unquantized model). We only apply need to Qwix on the abstract model in the case that the model is pre-quantized
  2. Deprecate all of the "default" quantization logic
  3. Convert Llama4 and GPT-OSS to avoid using Qwix to load the pre-quantized model

Alternatives

No response

Additional context

No response

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

Contributor guide

Research direction
Follow the steps in the issue: deprecate apply qwix on abstract model, deprecate default quantization logic, convert Llama4 and GPT OSS to avoid using Qwix for pre quantized loading. Inspect the referenced code files and ensure the changes are made without breaking existing functionality.
Tech stack
python
Domain
backendmachine learning
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-2 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
PythonGit
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
40