Openkubernetes exampleenhancementhelp wantedkubernetesggml-org/llama.cpp #6,546 opened Apr 8, 2024 · C++ · 110,169 starsWhy recommendedHas a beginner-friendly label · Contributing guide availableHas a beginner-friendly labelContributing guide available25 comments10 reactions1 assignee
OpenQuestion: How to generate an MPS gputracehelp wantedhigh priorityggml-org/llama.cpp #6,506 opened Apr 5, 2024 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available11 comments0 reactions0 assignees
Openllama cpp server cant open to publicenhancementgood first issueserverggml-org/llama.cpp #6,268 opened Mar 24, 2024 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available5 comments0 reactions0 assignees
Opensplit: allow --split-max-size optionenhancementgood first issuehelp wantedsplitggml-org/llama.cpp #6,259 opened Mar 23, 2024 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available4 comments1 reaction0 assignees
Openserver : add "token healing" supportenhancementgood first issueroadmapggml-org/llama.cpp #5,765 opened Feb 28, 2024 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available9 comments14 reactions0 assignees
OpenSupport for Sparse MoE models like Camelidae and Sparsetralenhancementgood first issueggml-org/llama.cpp #5,365 opened Feb 6, 2024 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available6 comments35 reactions0 assignees
OpenMiniCPM 2b model support?enhancementgood first issueggml-org/llama.cpp #5,276 opened Feb 2, 2024 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available26 comments8 reactions0 assignees
OpenInclude `eos_token` and `bos_token` from `tokenizer_config.json` for chat templatingenhancementhelp wantedggml-org/llama.cpp #5,040 opened Jan 19, 2024 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available12 comments4 reactions0 assignees
Openllama : integer type consistency in `llama.h`enhancementgood first issuerefactoringroadmapggml-org/llama.cpp #4,574 opened Dec 21, 2023 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available3 comments4 reactions0 assignees
OpenGGUF endianness cannot be determined from GGUF itselfbreaking changeenhancementgood first issueggml-org/llama.cpp #3,957 opened Nov 5, 2023 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available20 comments4 reactions0 assignees
Openci : fix Docker workflowbuildhelp wantedggml-org/llama.cpp #3,628 opened Oct 15, 2023 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available16 comments0 reactions0 assignees
OpenRequest: Nougat OCR Integrationhelp wantedmodelggml-org/llama.cpp #3,294 opened Sep 21, 2023 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available8 comments13 reactions0 assignees
OpenUsing MPI w/ 65b model but each node uses the full RAM.help wantedggml-org/llama.cpp #2,209 opened Jul 13, 2023 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available3 comments0 reactions0 assignees
Openmpi : attempt inference of 65B LLaMA on a cluster of Raspberry Pishardwarehelp wantedresearch 🔬ggml-org/llama.cpp #2,164 opened Jul 10, 2023 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available54 comments29 reactions0 assignees
Open[IDEA] Global token enhancement/depressionhelp wantedresearch 🔬ggml-org/llama.cpp #1,865 opened Jun 15, 2023 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available1 comment0 reactions0 assignees
OpenSupport CoreML like whisper.cpp?help wantedmacosperformanceggml-org/llama.cpp #1,714 opened Jun 6, 2023 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available11 comments17 reactions0 assignees
OpenTest replit-code-v1-3b modelhelp wantedmodelggml-org/llama.cpp #1,299 opened May 3, 2023 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available7 comments0 reactions0 assignees
OpenStudy how LM Evaluation Harness works and try to implement itenhancementgeneration qualityhelp wantedhigh priorityresearch 🔬ggml-org/llama.cpp #231 opened Mar 17, 2023 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available10 comments9 reactions0 assignees
Openkubernetes exampleenhancementhelp wantedkubernetesggml-org/llama.cpp #6,546 opened Apr 8, 2024 · C++ · 110,169 starsWhy recommendedHas a beginner-friendly label · Contributing guide availableHas a beginner-friendly labelContributing guide available25 comments10 reactions1 assignee
OpenQuestion: How to generate an MPS gputracehelp wantedhigh priorityggml-org/llama.cpp #6,506 opened Apr 5, 2024 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available11 comments0 reactions0 assignees
Openllama cpp server cant open to publicenhancementgood first issueserverggml-org/llama.cpp #6,268 opened Mar 24, 2024 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available5 comments0 reactions0 assignees
Opensplit: allow --split-max-size optionenhancementgood first issuehelp wantedsplitggml-org/llama.cpp #6,259 opened Mar 23, 2024 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available4 comments1 reaction0 assignees
Openserver : add "token healing" supportenhancementgood first issueroadmapggml-org/llama.cpp #5,765 opened Feb 28, 2024 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available9 comments14 reactions0 assignees
OpenSupport for Sparse MoE models like Camelidae and Sparsetralenhancementgood first issueggml-org/llama.cpp #5,365 opened Feb 6, 2024 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available6 comments35 reactions0 assignees
OpenMiniCPM 2b model support?enhancementgood first issueggml-org/llama.cpp #5,276 opened Feb 2, 2024 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available26 comments8 reactions0 assignees
OpenInclude `eos_token` and `bos_token` from `tokenizer_config.json` for chat templatingenhancementhelp wantedggml-org/llama.cpp #5,040 opened Jan 19, 2024 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available12 comments4 reactions0 assignees
Openllama : integer type consistency in `llama.h`enhancementgood first issuerefactoringroadmapggml-org/llama.cpp #4,574 opened Dec 21, 2023 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available3 comments4 reactions0 assignees
OpenGGUF endianness cannot be determined from GGUF itselfbreaking changeenhancementgood first issueggml-org/llama.cpp #3,957 opened Nov 5, 2023 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available20 comments4 reactions0 assignees
Openci : fix Docker workflowbuildhelp wantedggml-org/llama.cpp #3,628 opened Oct 15, 2023 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available16 comments0 reactions0 assignees
OpenRequest: Nougat OCR Integrationhelp wantedmodelggml-org/llama.cpp #3,294 opened Sep 21, 2023 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available8 comments13 reactions0 assignees
OpenUsing MPI w/ 65b model but each node uses the full RAM.help wantedggml-org/llama.cpp #2,209 opened Jul 13, 2023 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available3 comments0 reactions0 assignees
Openmpi : attempt inference of 65B LLaMA on a cluster of Raspberry Pishardwarehelp wantedresearch 🔬ggml-org/llama.cpp #2,164 opened Jul 10, 2023 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available54 comments29 reactions0 assignees
Open[IDEA] Global token enhancement/depressionhelp wantedresearch 🔬ggml-org/llama.cpp #1,865 opened Jun 15, 2023 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available1 comment0 reactions0 assignees
OpenSupport CoreML like whisper.cpp?help wantedmacosperformanceggml-org/llama.cpp #1,714 opened Jun 6, 2023 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available11 comments17 reactions0 assignees
OpenTest replit-code-v1-3b modelhelp wantedmodelggml-org/llama.cpp #1,299 opened May 3, 2023 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available7 comments0 reactions0 assignees
OpenStudy how LM Evaluation Harness works and try to implement itenhancementgeneration qualityhelp wantedhigh priorityresearch 🔬ggml-org/llama.cpp #231 opened Mar 17, 2023 · C++ · 110,169 starsWhy recommendedNo assignee yet · Has a beginner-friendly labelNo assignee yetHas a beginner-friendly labelContributing guide available10 comments9 reactions0 assignees