Setting up agents with cross-region inference (Claude 3.5 Sonnet v2)

[Jank601]

Can someone give me a pointer on how to set up an inference profile for cross-region use? I am very new to AWS Python CDK and cannot for the life of me figure this out. I was able to set something up, but I kept getting an error on my deploy saying I could not use on-demand with this model (when testing this through the counsel, you do not need provisioned throughput to use cross-region inference).

Any help would be appreciated.