You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Enter in the sampling panel
Choose "temperature" as sampling method, and set temp to 0
Save
Come back to the sampling panel : the sampling method is set to "greedy"
Other values (0,01 for example) are working.
The text was updated successfully, but these errors were encountered:
Hi sampling in llama.cpp has recently undergone many changes, new samplers added, new API, etc.
I can hardly keep up with this trend.
Previously llama.cpp itself decided that greedy sampling mode is enabled if temp=0.
I don't know how it is now. I'll try to figure it out later.
Enter in the sampling panel
Choose "temperature" as sampling method, and set temp to 0
Save
Come back to the sampling panel : the sampling method is set to "greedy"
Other values (0,01 for example) are working.
The text was updated successfully, but these errors were encountered: