Repository Issues

kyegomez/attn_res

A clean, single-file PyTorch implementation of Attention Residuals (Kimi Team, MoonshotAI, 2026), integrated with Grouped Query Attention (GQA), SwiGLU feed-forward networks, and Rotary Position Embeddings (RoPE).

View on GitHub
Stars
 (29 stars)
Forks
 (2 forks)
Indexed issues
 (0 indexed issues)
open beginner issues
 (0 open beginner issues)
Latest indexed
Jul 20, 2026
Last GitHub push
Mar 16, 2026
License
Apache License 2.0
Contributing guide
No contributing guide
Code of conduct
No code of conduct
Dominant language
Python
PR merge metrics
 (PR metrics pending)
Beginner labels
No beginner labels indexed

Issues

0 open indexed issues

RSSAtom

No open indexed issues found for this repository.