Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Using end_image with Nim-Video/cogvideox-2b-img2vid renders pink noise #322

Open
PeterTucker opened this issue Dec 11, 2024 · 2 comments
Open

Comments

@PeterTucker
Copy link

Not sure if I can give much more details, but when trying to use Nim-Video/cogvideox-2b-img2vid with end_image. I always generate pink noise. Very strange. Attached is my workflow.
CogVideoX_1_5_I2V_00001.json

CogVideoX_1_5_I2V_00006.mp4
@PeterTucker
Copy link
Author

@kijai any idea why this is happening?

@kijai
Copy link
Owner

kijai commented Dec 15, 2024

@kijai any idea why this is happening?

The model probably just doesn't support that, even if it didn't generate noise it probably wouldn't work well. The only models trained for interpolation are the specific 5b Interpolation model and the Fun -models.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants