CUDA lazy loading.

[SplitMilky]

May help with less vram usage but I read the link provided and don't know where to enable it. I'm playing with the TensorRT and having issues with some models (JuggernaultXL)

[W] CUDA lazy loading is not enabled. Enabling it can significantly reduce device memory usage and speed up TensorRT initialization. See "Lazy Loading" section of CUDA documentation https://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html#lazy-loading.

I asked Win Co-Pilot and it said to put it in the system environmental variables but I think it has to be in a script somewhere

[missionfloyd]

Lazy Loading is enabled by setting the CUDA_MODULE_LOADING environment variable to LAZY.

That means add set CUDA_MODULE_LOADING=LAZY to webui-user.bat, anywhere before line 8.

[Legendaryl123]

first legit response i've seen that actually listed a command line arg. great work.