Repository Issues

niieani/gpt-tokenizer

The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken with additional features.

View on GitHub
Stars
 (808 stars)
Forks
 (56 forks)
Indexed issues
 (1 indexed issue)
open beginner issues
 (0 open beginner issues)
Latest indexed
Jul 21, 2026
Last GitHub push
Feb 10, 2026
License
MIT License
Contributing guide
No contributing guide
Code of conduct
No code of conduct
Dominant language
TypeScript
PR merge metrics
 (PR metrics pending)
Beginner labels
No beginner labels indexed

Issues

1 open indexed issue

RSSAtom
Open
Picture tokens
help wanted

niieani/gpt-tokenizer #41 opened Jan 27, 2024 · TypeScript · 808 stars

Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly label
3 comments1 reaction0 assignees