Instructions to use calcuis/gguf-node with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use calcuis/gguf-node with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("calcuis/gguf-node", dtype=torch.bfloat16, device_map="cuda") prompt = "anime style anime girl with massive fennec ears and one big fluffy tail, she has blonde long hair blue eyes wearing a maid outfit with a long black gold leaf pattern dress, walking slowly to the front with sweetie smile, holding a fancy black forest cake with candles on top in the kitchen of an old dark Victorian mansion lit by candlelight with a bright window to the foggy forest" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
How to make Q_4_K_M with your GGUF converter?
7
#1 opened over 1 year ago
by
PixelPlayer