This is just my test with imatrix, quality unknown. I don't even know if I did it correctly...
JoyAI-LLM-Flash-GGUF
Weighted/imatrix quants of jdopensource/JoyAI-LLM-Flash using tomngdev/imatrix-calibration-data for calibration.
- Downloads last month
- 1,681
Hardware compatibility
Log In to add your hardware
2-bit
3-bit
4-bit
Model tree for tomngdev/JoyAI-LLM-Flash-imatrix-GGUF
Base model
jdopensource/JoyAI-LLM-Flash