sgl-project/sglang
View on GitHub[Feature] Implement Image Number Limitation for Image Processors
Open
#8,540 opened on Jul 29, 2025
Multi-modalgood first issue
Repository metrics
- Stars
- (28,442 stars)
- PR merge metrics
- (Avg merge 2d 1h) (1,000 merged PRs in 30d)
Description
Checklist
- 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
- 2. Please use English, otherwise it will be closed.
Motivation
At present, there is no limitation on the number of images during the processing of mm data. It is necessary to impose such a limitation to prevent potential OOM and other problems.
(When using fast image processor, the GPU memory usage is roughly 1GiB for each 4K image)
Related resources
Implementation Steps:
- Define a constant, such as
IMAGE_NUM_LIMITATION = 5, for each processor. - Modify the
baseprocessorto utilize this constant for request validation. - Incorporate a server argument to enable modification of this numerical value.
In case you lack familiarity with the mm data processing pipeline, it is advisable to first refer to here