Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

26,334

Full-text search

Active filters: llama-cpp

LocoreMind/LocoOperator-4B

Text Generation • 4B • Updated 5 days ago • 2.36k • 242

ruv/ruvltra-claude-code

Text Generation • 0.5B • Updated Jan 20 • 10.5k • 121

Edge-Quant/Nanbeige4.1-3B-Q4_K_M-GGUF

Text Generation • 4B • Updated 18 days ago • 10.8k • 34

alexdenton/Qwen3.5-35B-A3B-heretic-GGUF

35B • Updated 3 days ago • 2.96k • 9

LocoreMind/LocoOperator-4B-GGUF

4B • Updated 5 days ago • 1.3k • 8

mradermacher/LocoOperator-4B-GGUF

4B • Updated 5 days ago • 706 • 7

HeYujie/Qwen3.5-35B-A3B-abliterated-GGUF

Image-Text-to-Text • 35B • Updated 1 day ago • 1.05k • 5

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 685 • 140

AlicanKiraz0/BaronLLM-v2-OffensiveSecurityLLM-Q8

15B • Updated Aug 21, 2025 • 245 • 16

Hack337/ChatGPT-5-Q8_0-GGUF

0.5B • Updated Apr 17, 2025 • 2.82k • 13

squ11z1/gpt-oss-nano

Text Generation • 9B • Updated 3 days ago • 9.34k • 19

jinaai/jina-embeddings-v5-text-small-retrieval

Sentence Similarity • 0.6B • Updated 4 days ago • 113k • 9

jinaai/jina-embeddings-v5-text-nano-retrieval

Sentence Similarity • 0.2B • Updated 2 days ago • 21.3k • 7

jinaai/jina-embeddings-v5-text-small-retrieval-GGUF

Sentence Similarity • 0.6B • Updated 4 days ago • 5.91k • 4

alexdenton/Qwen3.5-27B-heretic-GGUF

27B • Updated 3 days ago • 765 • 2

jfer1015/Mistral-7B-Instruct-v0.3-Q4_K_M-GGUF

7B • Updated Jun 24, 2024 • 3.57k • 6

OmnicromsBrain/Eros_Scribe-10.7b-V.02-Q8_0-GGUF

11B • Updated Jul 4, 2024 • 5 • 1

SkyNotion/deepseek-coder-7b-instruct-v1.5-Q4_K_M-GGUF

7B • Updated Jul 30, 2024 • 888 • 1

Nehal07/Mistral-Nemo-Instruct-2407-Q4_K_M-GGUF

12B • Updated Aug 4, 2024 • 46 • 1

Such0442/coedit-xl-composite-Q4_K_M-GGUF

3B • Updated Aug 10, 2024 • 14 • 1

Lucy-in-the-Sky/Mistral-Nemo-Instruct-2407-Q2_K-GGUF

12B • Updated Aug 25, 2024 • 18 • 1

hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 517k • 44

Triangle104/magnum-v4-12b-Q4_K_M-GGUF

Text Generation • 12B • Updated Oct 31, 2024 • 93 • 1

Triangle104/magnum-v4-12b-Q8_0-GGUF

Text Generation • 12B • Updated Oct 24, 2024 • 146 • 2

marroyo777/flan-t5-base-Q4_K_M-GGUF

0.2B • Updated Oct 26, 2024 • 7 • 2

t-tech/T-lite-it-1.0-Q8_0-GGUF

8B • Updated Dec 17, 2024 • 71 • 19

ggml-org/LoRA-Qwen2.5-1.5B-Instruct-abliterated-F16-GGUF

93.6M • Updated Jan 23, 2025 • 41 • 4

tinybiggames/DeepHermes-3-Llama-3-8B-Preview-Q4_K_M-GGUF

8B • Updated Feb 14, 2025 • 30 • 3

fluently-lm/FluentlyLM-Prinum-Q4_K_M-GGUF

Text Generation • 33B • Updated Feb 20, 2025 • 24 • 6

ggml-org/Nomic-Embed-Text-V2-GGUF

Sentence Similarity • 0.5B • Updated Apr 30, 2025 • 3.25k • 16