Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to use fine tuned models #127

Open
mortenscheel opened this issue Dec 27, 2024 · 9 comments
Open

Unable to use fine tuned models #127

mortenscheel opened this issue Dec 27, 2024 · 9 comments
Labels
docker Related to docker

Comments

@mortenscheel
Copy link

Version 2.0.0, using the WebUI via athomasson2/ebook2audiobookxtts:huggingface.

  • Selecting one of the models from the "Fine tuned models" dropdown makes the conversion hang forever. The container's output is Loading TTS xtts model from {modelName}... but there's no network or CPU activity.
  • Downloading the required files from https://huggingface.co/drewThomasson/fineTunedTTSModels/tree/main/xtts-v2/eng, zipping them and uploading them as Custom XTTS model, doesn't work either. After uploading, the progress indicator says Error: cannot unpack non-iterable async_generator object.
@ROBERT-MCDOWELL
Copy link
Collaborator

ROBERT-MCDOWELL commented Dec 27, 2024

where did you find the code where there is"athomasson2/ebook2audiobookxtts:huggingface" ?
about custom upload, it's a bug that will be fixed in the next update (today or tomorrow)

@DrewThomasson
Copy link
Owner

Weird that docker image should be doing it for you.....

I'll see if i can update the docker image or something so it's actually based on the compose

And not the huggingface

@mortenscheel
Copy link
Author

@ROBERT-MCDOWELL

ebook2audiobook/README.md

Lines 231 to 242 in 5abebec

#### Running the Docker Container
To run the Docker container and start the Gradio interface, use the following command:
-Run with CPU only
```powershell
docker run -it --rm -p 7860:7860 --platform=linux/amd64 athomasson2/ebook2audiobookxtts:huggingface python app.py
```
-Run with GPU Speedup (Nvida graphics cards only)
```powershell
docker run -it --rm --gpus all -p 7860:7860 --platform=linux/amd64 athomasson2/ebook2audiobookxtts:huggingface python app.py
```

@mortenscheel
Copy link
Author

I don't know if it's related, but the container also fails to download the Danish model:

Loading TTS tts_models/dan/fairseq/vits model from tts_models/dan/fairseq/vits...
                     Bad tar file - https://dl.fbaipublicfiles.com/mms/tts/dan.tar.gz

That URL returns a 403 response with this body

<?xml version="1.0" encoding="UTF-8"?>
<Error><Code>AccessDenied</Code><Message>Access Denied</Message><RequestId>1Q2Q331NEY8XCFC0</RequestId><HostId>LUI3E4L2GuuI2uy6ORl2eVMwjA35DxEWCu0q4iRD/p6t/LNOnQn3/5mmMye5Oqw7TcywnNFq5W50ipuI0EuTAQ==</HostId></Error>

@ROBERT-MCDOWELL
Copy link
Collaborator

ROBERT-MCDOWELL commented Dec 27, 2024

@mortenscheel I'm afraid I made the same mistake than Croatian language, it was supported only by a token library called spacy which can work with Danish language, but xtts-v2 and fairseq standard models not.
as Croatian we must search for a TTS engine compatible with Danish. we planned to implement all best TTS but don't know when it will be released. probably for the next version. I you know a TTS engine capable to manage Danish so let us know!

@ROBERT-MCDOWELL
Copy link
Collaborator

@DrewThomasson I just realized we forgot to update the pip package list on dockers file and missed to add regex package on requirements.txt and pyproject.toml. Pushed in the next PR.
with athomasson2/ebook2audiobookxtts:huggingface I always thing that ebook2audiobookxtts means the old version of eb2ab, maybe it would be nice to change the name to ebook2audiobook

@DrewThomasson
Copy link
Owner

Your right I'll see if I can change it without having to create a whole new docker hub thing

@DrewThomasson
Copy link
Owner

@ROBERT-MCDOWELL

Kk changed it

It now will grab from the new correctly named docker hub repo

@ROBERT-MCDOWELL ROBERT-MCDOWELL added the docker Related to docker label Dec 29, 2024
@ThePagi
Copy link

ThePagi commented Dec 31, 2024

FYI the Docker instructions in the readme don't work for me, but using athomasson2/ebook2audiobookxtts:huggingface still does.

EDIT: Now it seems to work, maybe I tried just as it was being changed lol

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
docker Related to docker
Projects
None yet
Development

No branches or pull requests

4 participants