Open
Reducing the time to import sglang
good first issuehigh priority
Why recommendedHas a beginner-friendly label
Has a beginner-friendly label
6 comments4 reactions1 assignee
Repository Issues
sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
Issues
Open
[Performance] Remove instances of `torch.nonzero()` where appropriate
good first issueperformance
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly label
9 comments1 reaction0 assignees
Open
[Feature] Create benchmark and dataset usage scripts for embedding models
good first issuehelp wanted
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly label
6 comments0 reactions0 assignees
Open
[Feature] Implement Image Number Limitation for Image Processors
Multi-modalgood first issue
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly label
3 comments0 reactions0 assignees
Open
[Tracking] Improve Multimodal CI coverage
Multi-modalcigood first issueperformance
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly label
3 comments5 reactions0 assignees
Open
[Bug] Mllama ambiguous multi-image behaviour
Multi-modalgood first issuehelp wanted
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly label
3 comments0 reactions0 assignees
Open
[Feature] Benchmark with audio input
Multi-modalgood first issuehelp wanted
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly label
4 comments0 reactions0 assignees
Open
[Feature] Enable EPLB in Draft Models
good first issue
Why recommendedHas a beginner-friendly label
Has a beginner-friendly label
6 comments0 reactions1 assignee
Open
[Feature] Enable Two-Batch Overlap in Draft Models
good first issue
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly label
5 comments0 reactions0 assignees
Open
[Bug] Kimi VL GPU memory usage too high
Multi-modalgood first issue
Why recommendedHas a beginner-friendly label
Has a beginner-friendly label
16 comments0 reactions2 assignees
Open
[Feature] Increase server payload size limit
good first issue
Why recommendedHas a beginner-friendly label
Has a beginner-friendly label
9 comments1 reaction3 assignees
Open
[Feature] Support `abort_request` in the router
good first issue
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly label
2 comments0 reactions0 assignees
Open
[Feature] Support varied input formats for remaining VLM
good first issuehelp wanted
Why recommendedHas a beginner-friendly label
Has a beginner-friendly label
7 comments0 reactions3 assignees
Open
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly label
4 comments1 reaction0 assignees
Open
[Feature] Add KV cache usage prometheus metrics
good first issue
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly label
8 comments5 reactions0 assignees
Open
[Feature] Support more multi-modal input for VLM
Multi-modalfeaturegood first issuehelp wanted
Why recommendedHas a beginner-friendly label
Has a beginner-friendly label
5 comments5 reactions1 assignee
Open
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly label
2 comments0 reactions0 assignees
Open
Extensive benchmarking of reasoning models including variance
good first issue
Why recommendedHas a beginner-friendly label
Has a beginner-friendly label
3 comments0 reactions1 assignee
Open
[Feature] Automatically truncate when the maximum tokens are exceeded instead of throwing an error
good first issue
Why recommendedHas a beginner-friendly label
Has a beginner-friendly label
7 comments0 reactions1 assignee
Open
[Feature] support `gather` instead of `all_gather` when gathering the logits
good first issuehelp wanted
Why recommendedHas a beginner-friendly label
Has a beginner-friendly label
9 comments0 reactions1 assignee