Skip to content

Optimum SDXL Usage

missionfloyd edited this page Sep 9, 2023 · 6 revisions

Here's a quick listing of things to tune for your setup:

Commandline arguments:

  • Nvidia (12gb+) --xformers
  • Nvidia (8gb) --medvram-sdxl --xformers
  • Nvidia (4gb) --lowvram --xformers

System:

  • Downgrade Nvidia drivers to 531 or lower prevent extreme slowdowns for largest pictures.
  • Add a pagefile to prevent failure loading weights due to low RAM.
  • (Linux) install tcmalloc, greatly reducing RAM usage: sudo apt install --no-install-recommends google-perftools (#10117).
  • Use an SSD for faster load time, especially if a pagefile is required.
  • Convert .safetensors to .ckpt for reduced RAM usage (#12086).

Model weights:

  • Use a VAE that will not need to run in fp32 for increased speed and less VRAM usage: sdxl_vae.safetensors.
  • Use TAESD.
  • Use fp16 weights (~7gb) for less RAM usage.
Clone this wiki locally