No Module/Attribute

[NickDeBeenSAE]

(gpt4all) [insertusernamehere@fedora python]$ python3 -c "import gpt4all; print(gpt4all.models.list_models())"
Traceback (most recent call last):
  File "", line 1, in 
AttributeError: module 'gpt4all' has no attribute 'models'
(gpt4all) [insertusernamehere@fedora python]$ python3 -c "import gpt4all_bindings.python; print(gpt4all.models.list_models())"
Traceback (most recent call last):
  File "", line 1, in 
ModuleNotFoundError: No module named 'gpt4all_bindings'

[NickDeBeenSAE]

There appears to be no modules nor attributes that get installed when using the following python command:

python3 install -e .

[mudler]

@NickDeBeenSAE did you had a look at the getting started guide? https://localai.io/basics/getting_started/

[mudler]

For Fedora: https://docs.docker.com/engine/install/fedora/#uninstall-old-versions

[NickDeBeenSAE]

Nope. My version of Docker is the latest as I installed it directly from its repository.

[NickDeBeenSAE]

And plus, I built LocalAI directly but its giving me this when I gave it the ./local-ai command:

{"error":{"code":404,"message":"Cannot GET /","type":""}}

[mudler]

this looks correct. You need to install a model and use it with the OpenAI clients or you can build yours, the example here: https://localai.io/basics/getting_started/#example-use-gpt4all-j-model-with-docker-compose shows gpt4all and how to start to use it right after.

[NickDeBeenSAE]

I am using gpt4all.

[mudler]

docker-compose up -d --pull always
bash: docker-compose: command not found...
Install package 'docker-compose' to provide command 'docker-compose'? [N/y] y

• Waiting in queue...
• Loading list of packages....
• Downloading details about the software repositories....
• Loading list of packages....
  The following packages have to be installed:
  docker-compose-1.29.2-7.fc38.noarch Multi-container orchestration for Docker

That's not latest for sure, see here:

$ docker-compose --version                                        
Docker Compose version 2.20.2

[NickDeBeenSAE]

Fedora........ It can't install newer versions of docker.

[NickDeBeenSAE]

docker-compose version 1.29.2, build unknown
docker-py version: 5.0.3
CPython version: 3.11.4
OpenSSL version: OpenSSL 3.0.9 30 May 2023

[NickDeBeenSAE]

sudo dnf upgrade docker
AMDGPU 5.5.3 repository                         109  B/s | 162  B     00:01    
Errors during downloading metadata for repository 'amdgpu':
  - Status code: 404 for https://repo.radeon.com/amdgpu/5.5.3/rhel//main/x86_64/repodata/repomd.xml (IP: 13.82.220.49)
Error: Failed to download metadata for repo 'amdgpu': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried
Ignoring repositories: amdgpu
Last metadata expiration check: 0:29:10 ago on Sat 12 Aug 2023 21:53:29.
Dependencies resolved.
Nothing to do.
Complete!

[mtutty]

@NickDeBeenSAE You might try https://get.docker.com/ instead of relying on Fedora's repo process.

[NickDeBeenSAE]

Ok, time to check the version again.

[NickDeBeenSAE]

Its version is 24.

Thats good.

I have built and tested the LocalAI by building it from source code however.

[NickDeBeenSAE]

Here in this case:

https://localai.io/basics/build/