[Bug]: In ver1.10.1, loading is slow when there are a large number of models. #16399
Comments
|
I am posting using Claude's Japanese translation. |
first disable extensions using the command ling arg |
|
Oh my, is that so? My apologies for the oversight. |
2 minutes that's still feels very slow what do you actually mean by "load time"
for server load time you can see details from the
how many lora do have? happens if you temporarily remove all your lora?
what kind of storage are you using?
if the issue is due to the amount of Loras then this could help |
|
"load time" refers to the time it takes for the tab contents to become viewable. The There are approximately 2,500 LoRa models. The storage is HDD. (I'd like to switch to SSD, but the cost...) It seems that rather than the number of LoRas, some extension might be causing the slowdown. |
|
For me after i get a high amount loras (over 1k) in reForge:
I think it be a problem with webui handing a large amount of Lora in general since Pre UI update for the lora tab (when it had one button for sorting and not three), using |
|
the same proplem, i think it happen when i frequent switching checkpoint,then sdwebui crazy read my other hdd(no the local of app),if i Use checkpoint all the time there is no proplem happen. |
Checklist
What happened?
After updating from the previous version 1.9.x to version 1.10.1, loading of various tabs became slower.
It seems data may not be loading properly, as even in the prompt input field, it indicates that existing LoRa models are not found.
When trying to disable extensions, the list doesn't load.
Attempting to update the UI is not possible as this is already the latest major update with a version tag.
There don't seem to be any existing reports of this issue.
Tried backing up and deleting config.json and ui-config.json before starting, but it wouldn't launch.
Steps to reproduce the problem
Place a large number of models in various folders. This includes LoRas, Checkpoints, TIs, etc. In my environment, there are many LoRas.
The "--lora-dir" argument is used to specify the loading location. Since it was working normally before, I don't think the problem lies there.
If left running, it seems to improve at some point. This might be due to the completion of some kind of database construction. Clearing the UI from the browser resets it to the initial state.
What should have happened?
The UI should load within a reasonable time frame, allowing browsing of various tabs, extension lists, etc. For LoRas that exist, the prompt should not show errors about their absence, while showing errors only for truly non-existent ones or those not yet updated.
(Ideally, updates would take effect immediately and errors would only show for truly non-existent items, but that might be a separate issue.)
What browsers do you use to access the UI ?
Mozilla Firefox
Sysinfo
{ "date": "Sun Aug 18 02:02:04 2024", "timestamp": "02:02:09", "uptime": "Sun Aug 18 01:58:36 2024", "version": { "app": "stable-diffusion-webui.git", "updated": "2024-07-27", "hash": "82a973c0", "url": "https://github.com/AUTOMATIC1111/stable-diffusion-webui.git/tree/master" }, "torch": "2.1.0+cu121 autocast half", "gpu": { "device": "NVIDIA GeForce RTX 3060 (1) (sm_90) (8, 6)", "cuda": "12.1", "cudnn": 8801, "driver": "546.01" }, "state": { "started": "Sun Aug 18 02:02:09 2024", "step": "0 / 0", "jobs": "0 / 0", "flags": "", "job": "", "text-info": "" }, "memory": { "ram": { "free": 63.17, "used": 0.69, "total": 63.86 }, "gpu": { "free": 3.13, "used": 8.87, "total": 12 }, "gpu-active": { "current": 7.04, "peak": 7.04 }, "gpu-allocated": { "current": 7.04, "peak": 7.04 }, "gpu-reserved": { "current": 7.3, "peak": 7.3 }, "gpu-inactive": { "current": 0.26, "peak": 0.28 }, "events": { "retries": 0, "oom": 0 }, "utilization": 0 }, "optimizations": [ "none" ], "libs": { "xformers": "0.0.20", "diffusers": "0.16.1", "transformers": "4.30.2" }, "repos": { "Stable Diffusion": "[cf1d67a] 2023-03-25", "Stable Diffusion XL": "[45c443b] 2023-07-26", "BLIP": "[48211a1] 2022-06-07", "k_diffusion": "[ab527a9] 2023-08-12" }, "device": { "active": "cuda", "dtype": "torch.float16", "vae": "torch.float32", "unet": "torch.float16" }, "model": { "configured": { "base": "Pony_その他／汎\\はっさくXL(変態)(Ikena)_v1_3 目改良 [hassakuXLHentai_v13BetterEyesVersion].safetensors [bbad3bea96]", "refiner": "", "vae": "sdxl_vae MadeByollin氏改.safetensors" }, "loaded": { "base": "D:\\Programs_D\\_MachineLearning\\StableDiffusionModels\\Online\\CheckPoint\\Pony_その他／汎\\はっさくXL(変態)(Ikena)_v1_3 目改良 [hassakuXLHentai_v13BetterEyesVersion].safetensors", "refiner": "", "vae": "D:\\Programs_D\\_MachineLearning\\StableDiffusionModels\\Online\\vae\\SDXL\\sdxl_vae MadeByollin氏改.safetensors" } }, "schedulers": [ "DDIM", "DDIM CFG++", "DPM adaptive", "DPM fast", "DPM++ 2M", "DPM++ 2M SDE", "DPM++ 2M SDE Heun", "DPM++ 2S a", "DPM++ 3M SDE", "DPM++ SDE", "DPM2", "DPM2 a", "Euler", "Euler a", "Heun", "LCM", "LMS", "PLMS", "Restart", "UniPC" ], "extensions": [ "Generate-TransparentIMG (enabled)", "LDSR (enabled builtin)", "Lora (enabled builtin)", "PBRemTools (enabled)", "ScuNET (enabled builtin)", "Stable-Diffusion-WebUI-TensorRT (disabled)", "Stable-Diffusion-Webui-Civitai-Helper (enabled)", "SwinIR (enabled builtin)", "a1111-sd-webui-tagcomplete (enabled)", "adetailer (enabled)", "canvas-zoom (enabled)", "canvas-zoom-and-pan (enabled builtin)", "extra-options-section (enabled builtin)", "hypertile (enabled builtin)", "mobile (enabled builtin)", "novelai-2-local-prompt (enabled)", "openpose-editor (enabled)", "postprocessing-for-training (enabled builtin)", "prompt-bracket-checker (enabled builtin)", "prompt_translator (disabled)", "sd-colab-commands-browser (disabled)", "sd-dynamic-prompts (enabled)", "sd-extension-system-info (enabled)", "sd-webui-animatediff (enabled)", "sd-webui-ar (enabled)", "sd-webui-bilingual-localization (enabled)", "sd-webui-cardmaster (enabled)", "sd-webui-controlnet (enabled)", "sd-webui-custom-autolaunch (enabled)", "sd-webui-cutoff (disabled)", "sd-webui-deepdanbooru-object-recognition (enabled)", "sd-webui-deepdanbooru-tag2folder (enabled)", "sd-webui-enable-checker (enabled)", "sd-webui-freeu (enabled)", "sd-webui-lora-block-weight (enabled)", "sd-webui-lycoris-sorter (enabled)", "sd-webui-model-converter (enabled)", "sd-webui-negpip (enabled)", "sd-webui-prompt-history (enabled)", "sd-webui-regional-prompter (enabled)", "sd-webui-txt-img-to-3d-model (enabled)", "sd-webui-weight-helper (enabled)", "sd_extension-prompt_formatter (enabled)", "sd_lama_cleaner (enabled)", "sdweb-merge-block-weighted-gui (enabled)", "sdwebui-close-confirmation-dialogue (enabled)", "soft-inpainting (enabled builtin)", "stable-diffusion-webui-localization-ja_JP (enabled)", "stable-diffusion-webui-pixelization (enabled)", "stable-diffusion-webui-wd14-tagger (enabled)" ], "platform": { "arch": "AMD64", "cpu": "Intel64 Family 6 Model 167 Stepping 1, GenuineIntel", "system": "Windows", "release": "Windows-10-10.0.19045-SP0", "python": "3.10.9" }, "crossattention": "Automatic", "backend": "", "pipeline": "" }Console logs
Additional information
No response
The text was updated successfully, but these errors were encountered: