some info regarding Multi GPU #1234
FurkanGozukara
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Dear @kohya-ss, @KohakuBlueleaf can you give some info regarding Multi GPU that is coming with this pull request
https://github.com/bmaltais/kohya_ss/pull/2192/files
Previously, when we were training on a multi gpu platform, it was cloning the training process on each gpu
so lets say training on 1 gpu takes 20 gb. this was cloned on all gpus
thus lets say if i have 2 gpus, it was becoming effective batch size 2
with this new options can you explain difference? how to utilize? any info? thank you so much
Beta Was this translation helpful? Give feedback.
All reactions