Inference Providers
Active filters: llamacpp
rob-x-ai/neural-chat-7b-v3-1-GGUF
7B • Updated • 27
Druvith/mistralmed-7b-v1.5.gguf
7B • Updated • 15
rxavier/Taurus-7B-1.0-GGUF
7B • Updated • 53
BramVanroy/GEITje-7B-ultra-GGUF
7B • Updated • 745
• 10
Vikhrmodels/it-5.3-fp16-32k-GGUF
8B • Updated • 597
• 2
rubra-ai/Meta-Llama-3-8B-Instruct-GGUF
9B • Updated • 304
• 4
Vikhrmodels/it-5.4-fp16-orpo-v2-GGUF
8B • Updated • 502
• 4
Dracones/gemma-2-9b-it-GGUF
Text Generation
• 9B • Updated • 143
Dracones/gemma-2-27b-it-GGUF
Text Generation
• 27B • Updated • 156
Vikhrmodels/Vikhr-Gemma-2B-instruct-GGUF
Text Generation
• 3B • Updated • 3.61k
• 20
flowaicom/Flow-Judge-v0.1-GGUF
Text Generation
• 4B • Updated • 385
• 10
Vikhrmodels/Vikhr-Llama-3.2-1B-instruct-GGUF
Text Generation
• 1B • Updated • 2.6k
• 17
Vikhrmodels/Vikhr-Qwen-2.5-0.5B-instruct-GGUF
Text Generation
• 0.5B • Updated • 838
• 10
DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters
Updated • 257
Vikhrmodels/QVikhr-2.5-1.5B-Instruct-SMPO_GGUF
2B • Updated • 564
• 10
Vikhrmodels/QVikhr-2.5-1.5B-Instruct-r_GGUF
2B • Updated • 495
• 4
vicharai/ViCoder-html-32B-preview-GGUF
Text Generation
• 33B • Updated • 167
• 4
Gardeviance/MS-Gardventure-MW-V1-22B-IQ4_NL-GGUF
Text Generation
• 22B • Updated • 39
Dca3271144691983/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters
Updated
lucky087/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters
Updated
rowandwhelan/llamacpp-vocab-array-type-mismatch-poc
Updated
wazimondo/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters
Updated
XXXMARK/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters
Updated
Text Generation
• Updated • 1
Arm/deepseek-r1-distill-qwen-1-5b-q4-k-m-llamacpp-vivo-x300
Text Generation
• 2B • Updated • 571
Arm/qwen3-5-0-8b-q4-k-m-llamacpp-vivo-x300
Text Generation
• 0.8B • Updated • 618
Arm/qwen3-vl-2b-instruct-q4-k-m-ggml-llama-cpp-vivo-x300
Image-Text-to-Text
• 2B • Updated • 554
UCB-team/unclickbait-sft-4b-v2-gguf
Text Generation
• 4B • Updated • 162