APEX Quants (GGUF)
Collection
MoE models quantized with the APEX Quantization technique ( https://github.com/mudler/apex-quant ) • 27 items • Updated • 70
Erick Will
erickwill
·
AI & ML interests
None yet
Recent Activity
liked a model 8 days ago
mudler/Carnice-MoE-35B-A3B-APEX-GGUF liked a model 8 days ago
mudler/Qwopus-MoE-35B-A3B-APEX-GGUF liked a model 8 days ago
mudler/NVIDIA-Nemotron-3-Super-120B-A12B-APEX-GGUFOrganizations
None yet
upvoted a collection 8 days ago
upvoted an article almost 2 years ago
Article
Run the strongest open-source LLM model: Llama3 70B with just a single 4GB GPU!
•
44
upvoted a collection about 2 years ago