Multi-Modality Trees of Thoughts
Repositories
kyegomez repositories
An experimental repository on research for training multiple models all at once in an evolutionary capacity!
Implementation of the all-new paper "GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints"
Multi-Modal Tree of thoughts for DALLE-3 like auto self improvement
The open source implementation of the cross attention mechanism from the paper: "JOINTLY TRAINING LARGE AUTOREGRESSIVE MULTIMODAL MODELS"
A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.
This is a simple torch implementation of the high performance Multi-Query Attention
Multi-Query Attention with Sub-linear Masking, Superposition, and Entanglement
This repository is an open source implementation of the MuonClip strategy from the KIMI K2 Model from Moonshot AI
Implementation of "NExT-GPT: Any-to-Any Multimodal LLM",
My implementation of "Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution"
open-source nanotech CAD
A Transformer GAN with Reinforcement Learning on generating novel ready to mass manufacture nanomachines
NanoForge is a powerful Rust package specifically crafted for designing and manufacturing ultra-high-performance nanomachines. It is positioned to be the PyTorch equivalent in the nanotechnology domain, merging simplicity with high performance.
The open source implementation of "NeVA: NeMo Vision and Language Assistant"
An Multi-Modality Foundation Model for Humanoid robots
The next evolution of Agents
My implementation of the original Nerf paper with beautiful code.
Modular, high-performance, and re-useable building blocks for your hacking and infiltration!
Orbital Propulsion Archives -- Library of AI-Generated Rocket Fuel Formulas