Code

Homogeneize generation params#428

Code

Merged

clefourrier merged 44 commits intomainhuggingface/lighteval:mainfrom clem_homogeneize_generation_paramshuggingface/lighteval:clem_homogeneize_generation_paramsCopy head branch name to clipboardJan 2, 2025

+404-113

Commits

Commits on Dec 10, 2024

• adding input generation config

  clefourrier

  committed
  1ff5a78

• added tgi model

  clefourrier

  committed
  12c6a90

• grammar is task dependant, removed from the cofnig

  clefourrier

  committed
  c9657d2

• added openai config + moved everything to dict

  clefourrier

  committed
  ac6565a

• added generation configs to models

  clefourrier

  committed
  2628571

• added generation configs to models

  clefourrier

  committed
  c24bf9b

• fix

  clefourrier

  committed
  0aa2e19

• fix

  clefourrier

  committed
  e3311bd

• added doc

  clefourrier

  committed
  a3f535f

• Saved GenerationParameter class in model config classes, then saved in the models to use other attributes later

  clefourrier

  committed
  286668f

• changed model args

  clefourrier

  committed
  0b2475a

• test

  clefourrier

  committed
  521559f

Commits on Dec 11, 2024

• Merge branch 'main' into clem_homogeneize_generation_params

  clefourrier

  authored
  91363fe

Commits on Dec 12, 2024

• updated launchers

  clefourrier

  committed
  c088ab6

• Merge branch 'main' into clem_homogeneize_generation_params

  clefourrier

  committed
  e1bd34f

• rename base_model to transformers_model

  clefourrier

  committed
  3eb7d0f

• removed the use of a GenerationConfig object, as it's got lots of params set by default which slow down generations

  clefourrier

  committed
  a585701

• revert

  clefourrier

  committed
  f9ab29b

• fix docs

  clefourrier

  committed
  4833929

• fix #16 by also allowing a generationconfig object to be passed programmatically if needed

  clefourrier

  committed
  30bed89

• Merge branch 'main' into clem_homogeneize_generation_params

  clefourrier

  authored
  431b4f2

Commits on Dec 16, 2024

• Apply suggestions from code review

  Show description for fb4ecdc
  

  3 peopleauthored
  fb4ecdc

• Update src/lighteval/models/transformers/transformers_model.py

  Show description for be99c5e
  

  clefourrier

  and

  NathanHB

  authored
  be99c5e

• Merge branch 'main' into clem_homogeneize_generation_params

  clefourrier

  authored
  e8b9057

Commits on Dec 17, 2024

• removed temperature from default vllm params as it should be passed via the generationparams instead

  clefourrier

  committed
  dece2f9

• Merge branch 'main' into clem_homogeneize_generation_params

  clefourrier

  committed
  8e3b7e2

Commits on Dec 18, 2024

• Update src/lighteval/models/transformers/transformers_model.py

  Show description for 5c89fe2
  

  clefourrier

  and

  albertvillanova

  authored
  5c89fe2

• logging fix

  clefourrier

  committed
  6a18b81

• Merge branch 'main' into clem_homogeneize_generation_params

  clefourrier

  authored
  83cbb10

• Merge branch 'main' into clem_homogeneize_generation_params

  clefourrier

  authored
  c6f42ca

• added default gen params

  clefourrier

  committed
  90593a9

Commits on Dec 26, 2024

• Apply suggestions from code review

  Show description for ff5026b
  

  3 peopleauthored
  ff5026b

• rename file

  clefourrier

  committed
  87d052c

• added from path to openai model

  clefourrier

  committed
  3f96b95

• style

  clefourrier

  committed
  843b572

• Update src/lighteval/models/transformers/transformers_model.py

  Show description for e233190
  

  clefourrier

  and

  NathanHB

  authored
  e233190

• inferenceendpoint renamed to ie

  clefourrier

  committed
  97db620

• Merge branch 'main' into clem_homogeneize_generation_params

  clefourrier

  authored
  e2d512b

• style 2

  clefourrier

  committed
  e636f73

• fix vllm

  clefourrier

  committed
  ded4cf0

Commits on Jan 2, 2025

• Merge branch 'main' into clem_homogeneize_generation_params

  clefourrier

  authored
  fddfa6f

• Merge branch 'main' into clem_homogeneize_generation_params

  NathanHB

  authored
  c0566ee

• restore line

  clefourrier

  committed
  7a54afa

• Merge branch 'main' into clem_homogeneize_generation_params

  clefourrier

  committed
  4319230