Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models.
AI & ML interests
Decentralized GenAI Agents network on the Edge
Gaia compatible quants for Llama 3.1, 3.2 and 3.3 Instruct models.
-
gaianet/Llama-3.2-1B-Instruct-GGUF
Text Generation β’ 1B β’ Updated β’ 206 -
gaianet/Llama-3.2-3B-Instruct-GGUF
Text Generation β’ 3B β’ Updated β’ 214 β’ 1 -
gaianet/Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation β’ 8B β’ Updated β’ 923 -
gaianet/Llama-3.3-70B-Instruct-GGUF
Text Generation β’ 71B β’ Updated β’ 973
-
gaianet/Mistral-Small-24B-Instruct-2501-GGUF
Text Generation β’ 24B β’ Updated β’ 49 -
gaianet/Mistral-7B-Instruct-v0.3-GGUF
Text Generation β’ 7B β’ Updated β’ 142 β’ 1 -
gaianet/Mistral-Nemo-Instruct-2407-GGUF
Text Generation β’ 12B β’ Updated β’ 439 β’ 1 -
gaianet/Mistral-Large-Instruct-2407-GGUF
123B β’ Updated β’ 128
-
gaianet/DeepSeek-R1-Distill-Llama-70B-GGUF
Text Generation β’ 71B β’ Updated β’ 96 β’ 1 -
gaianet/DeepSeek-R1-Distill-Qwen-32B-GGUF
Text Generation β’ 33B β’ Updated β’ 85 -
gaianet/DeepSeek-R1-Distill-Llama-8B-GGUF
Text Generation β’ 8B β’ Updated β’ 136 β’ 1 -
gaianet/DeepSeek-R1-Distill-Qwen-7B-GGUF
Text Generation β’ 8B β’ Updated β’ 239
Gaia compatible quants for InternLM-2.5 models.
-
gaianet/gemma-3-27b-it-GGUF
Image-Text-to-Text β’ 27B β’ Updated β’ 99 β’ 1 -
gaianet/gemma-3-12b-it-GGUF
Image-Text-to-Text β’ 12B β’ Updated β’ 353 β’ 1 -
gaianet/gemma-3-4b-it-GGUF
Image-Text-to-Text β’ 4B β’ Updated β’ 203 β’ 1 -
gaianet/gemma-3-1b-it-GGUF
Text Generation β’ 1.0B β’ Updated β’ 194 β’ 2
Gaia compatible quants for Qwen 2.5 instruct and coder models.
-
gaianet/Qwen2.5-72B-Instruct-GGUF
Text Generation β’ 73B β’ Updated β’ 92 β’ 1 -
gaianet/Qwen2.5-14B-Instruct-GGUF
Text Generation β’ 15B β’ Updated β’ 202 -
gaianet/Qwen2.5-3B-Instruct-GGUF
Text Generation β’ 3B β’ Updated β’ 163 β’ 1 -
gaianet/Qwen2.5-32B-Instruct-GGUF
Text Generation β’ 33B β’ Updated β’ 128
Gaia compatible quants for Qwen2.5-Coder models.
-
gaianet/Qwen2.5-Coder-32B-Instruct-GGUF
Text Generation β’ 33B β’ Updated β’ 277 -
gaianet/Qwen2.5-Coder-14B-Instruct-GGUF
Text Generation β’ 15B β’ Updated β’ 87 -
gaianet/Qwen2.5-Coder-3B-Instruct-GGUF
Text Generation β’ 3B β’ Updated β’ 244 β’ 2 -
gaianet/Qwen2.5-Coder-0.5B-Instruct-GGUF
Text Generation β’ 0.5B β’ Updated β’ 114
Gaia compatible quants for functionary models
Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models.
-
gaianet/gemma-3-27b-it-GGUF
Image-Text-to-Text β’ 27B β’ Updated β’ 99 β’ 1 -
gaianet/gemma-3-12b-it-GGUF
Image-Text-to-Text β’ 12B β’ Updated β’ 353 β’ 1 -
gaianet/gemma-3-4b-it-GGUF
Image-Text-to-Text β’ 4B β’ Updated β’ 203 β’ 1 -
gaianet/gemma-3-1b-it-GGUF
Text Generation β’ 1.0B β’ Updated β’ 194 β’ 2
Gaia compatible quants for Llama 3.1, 3.2 and 3.3 Instruct models.
-
gaianet/Llama-3.2-1B-Instruct-GGUF
Text Generation β’ 1B β’ Updated β’ 206 -
gaianet/Llama-3.2-3B-Instruct-GGUF
Text Generation β’ 3B β’ Updated β’ 214 β’ 1 -
gaianet/Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation β’ 8B β’ Updated β’ 923 -
gaianet/Llama-3.3-70B-Instruct-GGUF
Text Generation β’ 71B β’ Updated β’ 973
Gaia compatible quants for Qwen 2.5 instruct and coder models.
-
gaianet/Qwen2.5-72B-Instruct-GGUF
Text Generation β’ 73B β’ Updated β’ 92 β’ 1 -
gaianet/Qwen2.5-14B-Instruct-GGUF
Text Generation β’ 15B β’ Updated β’ 202 -
gaianet/Qwen2.5-3B-Instruct-GGUF
Text Generation β’ 3B β’ Updated β’ 163 β’ 1 -
gaianet/Qwen2.5-32B-Instruct-GGUF
Text Generation β’ 33B β’ Updated β’ 128
-
gaianet/Mistral-Small-24B-Instruct-2501-GGUF
Text Generation β’ 24B β’ Updated β’ 49 -
gaianet/Mistral-7B-Instruct-v0.3-GGUF
Text Generation β’ 7B β’ Updated β’ 142 β’ 1 -
gaianet/Mistral-Nemo-Instruct-2407-GGUF
Text Generation β’ 12B β’ Updated β’ 439 β’ 1 -
gaianet/Mistral-Large-Instruct-2407-GGUF
123B β’ Updated β’ 128
Gaia compatible quants for Qwen2.5-Coder models.
-
gaianet/Qwen2.5-Coder-32B-Instruct-GGUF
Text Generation β’ 33B β’ Updated β’ 277 -
gaianet/Qwen2.5-Coder-14B-Instruct-GGUF
Text Generation β’ 15B β’ Updated β’ 87 -
gaianet/Qwen2.5-Coder-3B-Instruct-GGUF
Text Generation β’ 3B β’ Updated β’ 244 β’ 2 -
gaianet/Qwen2.5-Coder-0.5B-Instruct-GGUF
Text Generation β’ 0.5B β’ Updated β’ 114
-
gaianet/DeepSeek-R1-Distill-Llama-70B-GGUF
Text Generation β’ 71B β’ Updated β’ 96 β’ 1 -
gaianet/DeepSeek-R1-Distill-Qwen-32B-GGUF
Text Generation β’ 33B β’ Updated β’ 85 -
gaianet/DeepSeek-R1-Distill-Llama-8B-GGUF
Text Generation β’ 8B β’ Updated β’ 136 β’ 1 -
gaianet/DeepSeek-R1-Distill-Qwen-7B-GGUF
Text Generation β’ 8B β’ Updated β’ 239
Gaia compatible quants for functionary models
Gaia compatible quants for InternLM-2.5 models.