Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

about nuscenes data convert #15

Open
AMzhanghan opened this issue Dec 24, 2024 · 1 comment
Open

about nuscenes data convert #15

AMzhanghan opened this issue Dec 24, 2024 · 1 comment

Comments

@AMzhanghan
Copy link

The data conversion is very slow, about 6 minutes per frame. Why is it so slow?
image

@rb93dett
Copy link
Collaborator

Yes, the inference speed of LLaVA-1.6-34B is relatively slow, and each sample requires generating multiple QA responses. If you need to speed up data production, you might consider using 4-bit or 8-bit inference here. If you have sufficient GPU resources, you can also consider splitting the dataset and generating data in parallel.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants