Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
(224 stars) (16 forks) (0 indexed issues) (0 open good first issues)
Repositories
kyegomez repositories
All mathematics research papers sourced from ArXiv and meticulously curated for LLM pretraining purposes.
(7 stars) (0 forks) (0 indexed issues) (0 open good first issues)
Democratization of Med-Flamingo, "Med-Flamingo: A Multimodal Medical Few-shot Learner"
(2 stars) (0 forks) (0 indexed issues) (0 open good first issues)
kyegomez/Med-PaLMPython
Towards Generalist Biomedical AI
(432 stars) (59 forks) (0 indexed issues) (0 open good first issues)
kyegomez/MegaVITPython
The open source implementation of the model from "Scaling Vision Transformers to 22 Billion Parameters"
(32 stars) (1 fork) (0 indexed issues) (0 open good first issues)
Tree of Thoughts with an meta prompt for 50% boost in model reasoning
(10 stars) (1 fork) (0 indexed issues) (0 open good first issues)
kyegomez/MidasShell
Implementation of Midas from [Towards Robust Monocular Depth Estimation] in Pytorch and Zeta
(7 stars) (0 forks) (0 indexed issues) (0 open good first issues)
Democratization of "Cinematic Mindscapes: High-quality Video Reconstruction from Brain Activity" in Pytorch
(2 stars) (0 forks) (0 indexed issues) (0 open good first issues)
kyegomez/MinervaPython
Implementation of Minerva from "Minerva: Solving Quantitative Reasoning Problems with Language Models"
(7 stars) (1 fork) (0 indexed issues) (0 open good first issues)
kyegomez/MirasolPython
Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"
(26 stars) (0 forks) (0 indexed issues) (0 open good first issues)
Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
(121 stars) (7 forks) (0 indexed issues) (0 open good first issues)
kyegomez/Mixture-of-MQAPython
An implementation of a switch transformer like Multi-query attention model
(8 stars) (0 forks) (0 indexed issues) (0 open good first issues)
kyegomez/MoE-MambaPython
Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Zeta
(130 stars) (10 forks) (0 indexed issues) (0 open good first issues)
kyegomez/MobileVLMPython
Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant for Mobile Devices"
(15 stars) (0 forks) (0 indexed issues) (0 open good first issues)
kyegomez/Model-Infra-TemplateMakefile
A template for deploying ultra powerful LLMs effortlessly with the best optimizations
(5 stars) (0 forks) (0 indexed issues) (0 open good first issues)
A simple, thorough, and reliable template I use to build new models from scratch:
(1 star) (0 forks) (0 indexed issues) (0 open good first issues)
kyegomez/ModelHubShell
The Ultimate Hub of AI Models - Simplified, Streamlined, and Scalable for Production-Grade Deployment.
(5 stars) (1 fork) (0 indexed issues) (0 open good first issues)
This paper presents a groundbreaking framework that models economic systems as intelligent neural networks, offering a novel approach to understanding how economies learn, adapt, and self-organize.
(4 stars) (0 forks) (0 indexed issues) (0 open good first issues)
An experimental inquiry into monte carlo tree of thoughts algorithmic systems
(0 stars) (0 forks) (0 indexed issues) (0 open good first issues)
kyegomez/MovieChatPython
🔥 chat with over 10K frames of video!
(0 stars) (0 forks) (0 indexed issues) (0 open good first issues)