Python 3.11

[nblzv]

In case there is someone else as crazy as me to try and get this running on 3.11 now that numba finally updated.
I am here to sadly report that there is no real improvement in performance over 3.10.
Maybe ~0.1it/s on a 3080, but it's really in the margin of error.

Tested with torch 2, no compile though.

[CapsAdmin]

I wonder how much of a gain a 4090 would get, seems like it's already pretty fast and maybe the cpu side is the bottleneck.

How is the startup time?

[Sakura-Luna]

Why do you think it will speed up WebUI? If an operation cannot affect PyTorch, then it is almost impossible to have a significant performance improvement.

[nblzv]

Allegedly 3.11's specializing interpreter could improve PyTorch and it probably does to some extent, it's just negligible.

[Sakura-Luna]

The bottom layer of PyTorch is C++ and CUDA, and the scope that Python can affect is too small.

[nblzv]

Going through the python layer and back is definitely nonzero overhead, however the optimizations in 3.11 don't help much out with that, since they are aimed at optimizing python-only loops for the most part.

[bbecausereasonss]

Any tips on getting it running with 3.11?

[freecoderwaifu]

This is on Windows. If you already had an existing install before upgrading to Python 3.11, delete the venv folder beforehand.
Then let the launch.bat remake it.
Everything should install normally but you'll get an error eventually. When you get that error, close the console and install torch and xformers manually

cd venv/Scripts
activate
pip install --force-reinstall torch torchvision --index-url https://download.pytorch.org/whl/cu118
pip install --force-reinstall --no-deps --pre xformers

https://github.com/d8ahazard/sd_dreambooth_extension/releases/tag/1.0.13

Add --skip-python-version-check to your launch.bat to skip console warnings

If done right everything should work normally. This is what I did when I tried Python 3.11.4 and everything worked as expected. There might be a way to do it without deleting the venv but maybe not. I reverted back to 3.10.11 today though, because of a different AI music/tts UI working better with it (tts-generation-webui).

[Sarolta]

I run 3.11 on ubuntu 23.04 and its noticeably faster when i run deforum with little/no other extensions.

[Demcrew]

No issue reported so far, using 3.11, only the warning message.
If someone could drill down pros and cons to use 3.11, he or she's more than welcome