Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Alpha loss integration leads to low PSNR and high mask error during training #170

Open
sanscosk opened this issue Oct 22, 2024 · 1 comment

Comments

@sanscosk
Copy link

sanscosk commented Oct 22, 2024

Hi, I integrated an alpha loss into the original 2DGS code, but the PSNR value during training is significantly lower than expected. Additionally, the mask_error remains high and doesn't decrease as training progresses.
Here is the part of the code I added:
in readCamerasFromTransforms assign gt_alpha to alpha_channel

image-20241022212832931

in train.py add alpha loss to loss
image-20241022214020117

During the training process, the changes of mask_error are as follows:
image

PSNR:
image

The command I used for training is:
OMP_NUM_THREADS=4 CUDA_VISIBLE_DEVICES=0 python train.py -s data/nerf_synthetic/chair/ -m output/exp_nerf_synthetic/chair --eval --white_background --lambda_normal 0.0 --lambda_mask 0.1

@hbb1
Copy link
Owner

hbb1 commented Oct 23, 2024

I am not entirely sure what happens. I have experimented regressing RGBA with L1 loss, and it worked well for me.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants