We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Currently, the example config files have a parameter named dtype.
dtype
When parsing the config file into the config class, this parameter is renamed to model_dtype.
model_dtype
Align the name to model_dtype in both config files and config classes.
In the config files
model
model_name
instance
instance_type
instance_size
This was discussed in:
Leave it as it is.
The text was updated successfully, but these errors were encountered:
That works for me if you want to homogeneize the code across the models for this :)
Sorry, something went wrong.
Implement TGI model config from path (#448)
1b9e2c3
Implement TGI model config from path: ```python TGIModelConfig.from_path(model_config_path) ``` Follow-up to: - #434 Related to: - #439
albertvillanova
No branches or pull requests
Issue encountered
Currently, the example config files have a parameter named
dtype
.When parsing the config file into the config class, this parameter is renamed to
model_dtype
.Solution/Feature
Align the name to
model_dtype
in both config files and config classes.Context:
In the config files
model
parameter calledmodel_name
instance
parameters calledinstance_type
andinstance_size
This was discussed in:
Possible alternatives
Leave it as it is.
The text was updated successfully, but these errors were encountered: