Over/under training (unet and text_encoder) - how to identify on faces #1202
Replies: 3 comments
-
I think this is a very good question that I also don't know the answer to - but I had the impression that "overtraining" manifested itself in "not being able to style properly anymore". I.e. whatever you prompt for, you almost get the exact input pictures back, and can't change the style. |
Beta Was this translation helpful? Give feedback.
-
always test images with style, like apply watercolor, or oil painting or artist that has a very specific style, if that style dose not show up, but your real human looking face dose, its over trained. I messed up a lot of models with over training, more then undertraining. |
Beta Was this translation helpful? Give feedback.
-
if you overtrain the text_encoder, you won't be able to apply any style to the trained subject, that's why 250-400 steps is always enough. |
Beta Was this translation helpful? Give feedback.
-
Hi Guys
In DreamBooth the two main parameters seems to be unet and text_encoder. Most questions here are answered with:
Train unet/text_encoder with XXX steps and then train more if that is not enough. But how do I know if it's not trained enough in either of the two parameters.
For unet:
"under training" seems to be "the face features are not strongly expressed"
"over training" seems to be "the face gets extremely distorted and any traits gets over expressed"
For text_encoder I am not so sure, it seems to be something like this:
"under training" seems to be "the face only shows up rarely, but when it does its okay"
"over training" seems to be "the face shows up on all people, even Brad Pitt"
Anyone have more observations?
Beta Was this translation helpful? Give feedback.
All reactions