Visual Generation Models
Collection
18 items β’ Updated β’ 1
How to use BiliSakura/ProMoE-diffusers with Diffusers:
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("BiliSakura/ProMoE-diffusers", dtype=torch.bfloat16, device_map="cuda")
prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Load checkpoints with native Hugging Face diffusers and this folder on the Hub (or via custom_pipeline):
import torch
from diffusers import DiffusionPipeline
pipe = DiffusionPipeline.from_pretrained(
"BiliSakura/ProMoE-diffusers",
trust_remote_code=True,
torch_dtype=torch.float16,
)
pipe.to("cuda")
| Path | Purpose |
|---|---|
pipeline.py |
ProMoEPipeline |
transformer/ |
backbone_diffmoe.py, backbone_dit.py, backbone_ecdit.py, backbone_promoe_ec.py, backbone_promoe_tc.py, backbone_tcdit.py, β¦ |
scheduler/ |
scheduling_flow_match_promoe.py |
Each variant keeps an English id2label map in model_index.json (DiT-style).
pipe.id2label β id β English label (comma-separated synonyms)pipe(class_labels=207, ...) β class-conditional sampling with integer idsCopy the full 1000-class id2label block from BiliSakura/DiT-diffusers when publishing a model repo.
model_index.json
Copy entries from model_index.json.example into your model repo after save_pretrained.
Use ["_class_name"] = ["pipeline", "ProMoEPipeline"] and custom module stems for each component.
"scheduler": ["scheduling_flow_match_promoe", "ProMoEFlowMatchScheduler"]"vae": ["diffusers", "AutoencoderKL"] with stabilityai/sd-vae-ft-mse weights or bundled safetensorsProMoE_TC_S, ProMoE_TC_B, ProMoE_TC_L, ProMoE_TC_XL (see convert script)Regenerate: python scripts/build_community_pipelines.py