What is reasoning_effort of o1 in the new polyglot leaderboard?

[rodion-m]

Issue

Paul, thanks a lot for a great new benchmark! But what is reasoning_effort of o1 in the new polyglot leaderboard?

https://aider.chat/docs/leaderboards/#polyglot-leaderboard

https://platform.openai.com/docs/api-reference/chat/create#chat-create-reasoning_effort

Version and model info

No response

[paul-gauthier]

Thanks for trying aider and filing this issue.

It was using reasoning effort high. I've noted it more clearly in the graph.

[rodion-m]

Thank you Paul! And another suggestion - add "generation elapsed time" column to the leaderboard.