How to overcome "total bytes of NDArray > 2**32" on Macs?

[A2Sumie]

AppleSilicon Macs has a huge unified memory but it can't be used. Large resolutions cause crash like
/AppleInternal/Library/BuildRoots/f0468ab4-4115-11ed-8edc-7ef33c48bc85/Library/Caches/com.apple.xbs/Sources/MetalPerformanceShaders/MPSCore/Types/MPSNDArray.mm:724: failed assertion `[MPSNDArray initWithDevice:descriptor:] Error: total bytes of NDArray > 2**32'
medvram or lowvram would not help.
Is there a way to overcome this or these are solid limitations from MPS?

[rworne]

I do not know how you setup SD and Automatic, but on the Mac it seems to have issues with even multiples of 512. 512x512 is OK, but 1024x1024 will give the above error. When doing batches or aesthetic embeddings it will do this too. So if you get this error, change the size up or down one setting and it will usually work.

[rachelcenter]

not up....im trying 1280 x 720 and my comfyui workflow gets to 90% or so then crashes

when it says "reconnecting" on comfyui screen, terminal on mac says:

0%| | 0/12 [00:00<?, ?it/s]/AppleInternal/Library/BuildRoots/91a344b1-f985-11ee-b563-fe8bc7981bff/Library/Caches/com.apple.xbs/Sources/MetalPerformanceShaders/MPSCore/Types/MPSNDArray.mm:788: failed assertion `[MPSNDArray initWithDevice:descriptor:] Error: total bytes of NDArray > 2**32'

/Users/rachel/.pyenv/versions/3.12.4/lib/python3.12/multiprocessing/resource_tracker.py:254: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown

warnings.warn('resource_tracker: There appear to be %d '

zsh: abort python3.12 main.py

[brkirch]

Resolutions of 1024x1024, 2048x512, and 512x2048 do not work currently, but I've put in a PR (#5796) to get that addressed. AFAIK all other resolutions should work as long as you are using a M1 or M2 Mac with enough RAM (32 GB+ is likely needed for large resolutions).

[rachelcenter]

other resolutions do not work. I have 128gb ram m2 ultra. tried a comfyui workflow (Video 2 video) 1280x720 and it crashes my comfyui.