Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to save a temp = 0 #110

Open
ccoq opened this issue Dec 9, 2024 · 1 comment
Open

Unable to save a temp = 0 #110

ccoq opened this issue Dec 9, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@ccoq
Copy link

ccoq commented Dec 9, 2024

Enter in the sampling panel
Choose "temperature" as sampling method, and set temp to 0
Save
Come back to the sampling panel : the sampling method is set to "greedy"

Other values (0,01 for example) are working.

@guinmoon guinmoon added the bug Something isn't working label Dec 10, 2024
@guinmoon
Copy link
Owner

Hi sampling in llama.cpp has recently undergone many changes, new samplers added, new API, etc.
I can hardly keep up with this trend.
Previously llama.cpp itself decided that greedy sampling mode is enabled if temp=0.
I don't know how it is now. I'll try to figure it out later.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants