Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,231

Full-text search

Active filters: llama.cpp

TeichAI/GLM-4.7-Flash-Claude-Opus-4.5-High-Reasoning-Distill-GGUF

30B • Updated 5 days ago • 80.2k • 374

LiquidAI/LFM2-24B-A2B-GGUF

Text Generation • 24B • Updated 10 days ago • 12k • 59

LiquidAI/LFM2.5-1.2B-Instruct-GGUF

Text Generation • 1B • Updated Jan 5 • 48.9k • 137

NexaAI/LFM2-24B-A2B-GGUF

Text Generation • 24B • Updated 3 days ago • 499 • 6

TeichAI/Qwen3-32B-Kimi-K2-Thinking-Distill-GGUF

33B • Updated 23 days ago • 5.38k • 5

TeichAI/Qwen3-4B-Thinking-2507-GPT-5.2-High-Reasoning-Distill-GGUF

4B • Updated Dec 20, 2025 • 4.21k • 4

LiquidAI/LFM2.5-Audio-1.5B-GGUF

1B • Updated 23 days ago • 6.74k • 79

LiquidAI/LFM2.5-1.2B-Thinking-GGUF

Text Generation • 1B • Updated Jan 16 • 45.2k • 59

jinaai/jina-embeddings-v5-text-small-retrieval

Sentence Similarity • 0.6B • Updated 2 days ago • 61.4k • 9

jinaai/jina-embeddings-v5-text-small-retrieval-GGUF

Sentence Similarity • 0.6B • Updated 2 days ago • 5.73k • 4

LiquidAI/LFM2-8B-A1B-GGUF

Text Generation • 8B • Updated Dec 5, 2025 • 4.87k • 88

TeichAI/Qwen3-14B-GPT-5.2-High-Reasoning-Distill-GGUF

15B • Updated Dec 23, 2025 • 3.65k • 7

TeichAI/Qwen3-4B-Instruct-2507-Gemini-3-Pro-Preview-Distill-GGUF

4B • Updated Dec 24, 2025 • 2.07k • 7

jinaai/jina-embeddings-v5-text-small-text-matching

Sentence Similarity • 0.6B • Updated 2 days ago • 13.2k • 4

prithivMLmods/Qwen3-VL-8B-Instruct-Unredacted-MAX-GGUF

Image-Text-to-Text • 8B • Updated 6 days ago • 1.95k • 3

nvjob/crack-ru-v2-gguf

12B • Updated Feb 24, 2025 • 251 • 3

LiquidAI/LFM2-700M-GGUF

Text Generation • 0.7B • Updated Dec 5, 2025 • 29.1k • 45

mistralai/Magistral-Small-2507-GGUF

Text Generation • 24B • Updated Jul 25, 2025 • 386 • 13

LiquidAI/LFM2-Audio-1.5B-GGUF

0.3B • Updated Dec 5, 2025 • 1.04k • 28

Avarok/nvidia-nemotron-nano-12b-v2-q4_k_m

12B • Updated Nov 3, 2025 • 53 • 1

prithivMLmods/Qwen3-VisionCaption-2B

Image-Text-to-Text • 2B • Updated Nov 29, 2025 • 42 • 5

TeichAI/Qwen3-8B-DeepSeek-v3.2-Speciale-Distill-GGUF

8B • Updated Dec 10, 2025 • 11.1k • 18

TeichAI/Qwen3-4B-Instruct-2507-Claude-Haiku-4.5-Distill-GGUF

4B • Updated Dec 23, 2025 • 238 • 1

spikymoth/G3-Heresy-MPOA-G-W99-D0.0690-R02-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 154 • 1

spikymoth/G3-Heresy-MPOA-G-W99-D0.0690-R02-i1-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 69 • 1

TeichAI/Qwen3-4B-Instruct-2507-Claude-Opus-3-Distill-GGUF

4B • Updated Dec 26, 2025 • 1.59k • 5

Navpy/phi-3.5-AI-Vtuber-json

Text Generation • 4B • Updated 4 days ago • 278 • 1

LiquidAI/LFM2.5-VL-1.6B-GGUF

Image-Text-to-Text • 1B • Updated 14 days ago • 86.3k • 64

Avarok/IQuest-Coder-V1-40B-Loop-Instruct-GGUF

Text Generation • Updated Jan 7 • 1

andrelu08mj/btc-scalper-llama3

8B • Updated Jan 11 • 89 • 1