Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Store times and scores explicitly #16

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

camillobruni
Copy link
Contributor

Prepare the benchmarks for more flexible result calculation and visualisations:

  • Store all metrics as times and as scores
  • Add uiFriendlyScore to mark displayed values explicitly as score
  • Rename Benchmark.subTimes to Benchmark.subScores

@kmiller68
Copy link
Contributor

What's the goal here? I think I'm missing some context.

@camillobruni
Copy link
Contributor Author

I want to make the units explicit and make sure we have time+score everywhere available for consistency.
Personally not a big fan of scores (especially if they're arbitrarily scaled), and we have [ms] everywhere in speedometer.

Preparing this should make it a bit easier in the future whether we want to switch to times and only have a global score or not.

Copy link
Contributor

@kmiller68 kmiller68 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah, gotcha, I'm mostly indifferent on time vs score as mention previously. Maybe for now we could print the times too for CLIs?

summaryElement.onclick = displayCategoryScores;
if (showScoreDetails)
displayCategoryScores();
statusElement.innerHTML = '';
} else if (!dumpJSONResults) {
console.log("\n");
for (let [category, scores] of categoryScores)
console.log(`${category}: ${uiFriendlyNumber(geomean(scores))}`);
console.log(`${category}: ${uiFriendlyScore(geomean(scores))}`);
Copy link
Contributor

@kmiller68 kmiller68 Dec 9, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

e.g. can we do ${category}: ${uiFriendlyScore(geomean(scores))}, ${uiFriendlyDuration(geomean(times))}?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants