how to use torch compile with lora?

[frankyifei]

I could not get lora to work with torch compile, only checkpoints work,

[LukeG89]

At the moment you can't, because as Kijai said in this Reddit post:

LoRAs do not currently work with torch.compile because the torch.compile happens before LoRA weights are loaded (in the core code, nothing to do with the node order in the graph).

I modified that bit of the code to swap the order of things, and it seems to work then. This might break some other stuff, so I've let ComfyUI team know and we'll probably get better way to deal with this issue soon.

[LukeG89]

@frankyifei I don't use torch compile, but I guess ComfyUI-KJNodes just found a solution for that: kijai/ComfyUI-KJNodes@8cfbbaf

Try Patch Model Patcher Order node from KJNodes.