Shapeless, an all-new serene TaoMorphic web development philosophy
Repositories
kyegomez repositories
Implementation of the paper "SHORTCIRCUIT: ALPHAZERO-DRIVEN CIRCUIT DESIGN" in PyTorch
Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.
Shuurai - An In-Depth Analysis of Highly Experimental Swarms of Transformer Architecture
A simpler Pytorch + Zeta Implementation of the paper: "SiMBA: Simplified Mamba-based Architecture for Vision and Multivariate Time series"
Implementation of a simple Diffusion model so I can learn how they work, they are my weakness now.
Implementation of a modular, high-performance, and simplistic mamba for high-speed applications
An simple implementation of Unet because all the implementations i've seen are wayy tooo complicated.
SimplifiedTransformer simplifies transformer block without affecting training. Skip connections, projection parameters, sequential sub-blocks, and normalization layers are removed. Experimental results confirm similar training speed and performance.
This repository provides a minimal, single-file implementation of SingLoRA (Single Matrix Low-Rank Adaptation) as described in the paper "SingLoRA: Low Rank Adaptation Using a Single Matrix" by Bensaïd et al.
Scraper for Slack Messages
Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.
Implementation of the premier Text to Video model from OpenAI
Implementation of SoundtStream from the paper: "SoundStream: An End-to-End Neural Audio Codec"
Pytorch Implementation of the sparse attention from the paper: "Generating Long Sequences with Sparse Transformers"
My own implementation of "Fast Inference from Transformers via Speculative Decoding"
Multi-agent Social Simulation + Efficient, Effective, and Stable alternative of RLHF. Code for the paper "Training Socially Aligned Language Models in Simulated Human Society".
StarForce-X, an enterprise-grade, AI-driven model engineered to intercept, analyze, and decode alien radio frequencies and communications with unparalleled precision.
A multi-modal AI Model that can generate high quality novel videos with text, images, or video clips.
SuperPrompt is an attempt to engineer prompts that might help us understand AI agents. I made an prompt optimization swarm and updated it hundreds of times. This is the 400th iteration