Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GRPC: stderr load_binding_model: error: unable to load model #3

Open
pasqualesimonetti opened this issue Aug 25, 2023 · 1 comment
Open

GRPC: stderr load_binding_model: error: unable to load model #3

pasqualesimonetti opened this issue Aug 25, 2023 · 1 comment

Comments

@pasqualesimonetti
Copy link

pasqualesimonetti commented Aug 25, 2023 •
edited
Loading

LocalAGI version:
August, 25th 2023

Environment, CPU architecture, OS, and version:
MacBook Pro 2018
Intel x86 Core i7 2,6 GHz
16 GB 2400. MHz DDR4
macOS Ventura 13.5.1
Docker Desktop 4.22.0

Issue:
GRPC: stderr load_binding_model: error: unable to load model

How to reproduce:

1. Clone the repository
 
git clone https://github.com/mudler/LocalAGI.git
cd LocalAGI
2. Comment or delete the following lines in docker-compose.yaml file
 
    devices:
    - /dev/snd

to avoid this error...

Error response from daemon: error gathering device information while adding custom device "/dev/snd": no such file or directory

(Even brew install pulseaudio && brew services start pulseaudio isn't enough to solve this issue).

3. Then run the container with the --skip-avatar argument to avoid the following error...
 
INFO     | __main__:<module>:391 - Creating avatar, please wait...
Traceback (most recent call last):
  File "/app/./main.py", line 392, in <module>
    display_avatar(localagi)
  File "/app/./main.py", line 158, in display_avatar
    image_url = agi.get_avatar(input_text, model)
TypeError: LocalAGI.get_avatar() takes 2 positional arguments but 3 were given
Here is LocalAGI log: 
% docker-compose run -i --rm localagi --skip-avatar
[+] Running 20/20
 ✔ api 19 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿]      0B/0B      Pulled           1127.4s 
   ✔ 6a70103cc499 Already exists                                           0.0s 
   ✔ ccb4221e2c63 Already exists                                           0.0s 
   ✔ 9fe6e67e69c8 Already exists                                           0.0s 
   ✔ d4960566fad8 Pull complete                                           60.9s 
   ✔ 75df79f77651 Pull complete                                          128.8s 
   ✔ 2aea24d2c7fb Pull complete                                          128.9s 
   ✔ 2c0457ed6212 Pull complete                                          157.2s 
   ✔ 4f4fb700ef54 Pull complete                                          157.3s 
   ✔ a05ae947f92c Pull complete                                          159.3s 
   ✔ 38f15235e87f Pull complete                                          164.2s 
   ✔ 1b63c30bfd38 Pull complete                                          355.6s 
   ✔ e33ff4fe2f50 Pull complete                                         1028.4s 
   ✔ 8562064ddd50 Pull complete                                         1034.7s 
   ✔ 32f598439fb4 Pull complete                                         1036.5s 
   ✔ 8fbc41ea9b16 Pull complete                                         1065.0s 
   ✔ 48c0b51e5e89 Pull complete                                         1072.4s 
   ✔ a2ea6b91b6ef Pull complete                                         1072.7s 
   ✔ 267e23db1f55 Pull complete                                         1116.1s 
   ✔ f3ce65614ee7 Pull complete                                         1123.9s 
[+] Creating 2/2
 ✔ Network localagi_default  Created                                       0.3s 
 ✔ Container localagi-api-1  Created                                       1.8s 
[+] Running 1/1
 ✔ Container localagi-api-1  Started                                       1.3s 
[+] Building 17.3s (13/13) FINISHED                        docker:desktop-linux
 => [localagi internal] load build definition from Dockerfile              0.3s
 => => transferring dockerfile: 456B                                       0.1s
 => [localagi internal] load .dockerignore                                 0.3s
 => => transferring context: 51B                                           0.0s
 => [localagi internal] load metadata for docker.io/library/python:3.10-b  2.3s
 => [localagi auth] library/python:pull token for registry-1.docker.io     0.0s
 => [localagi 1/7] FROM docker.io/library/python:3.10-bullseye@sha256:02c  0.0s
 => [localagi internal] load build context                                 0.1s
 => => transferring context: 215.89kB                                      0.1s
 => CACHED [localagi 2/7] WORKDIR /app                                     0.0s
 => CACHED [localagi 3/7] COPY ./requirements.txt /app/requirements.txt    0.0s
 => CACHED [localagi 4/7] RUN pip install --no-cache-dir -r requirements.  0.0s
 => CACHED [localagi 5/7] RUN apt-get update -y &&     apt-get install -y  0.0s
 => [localagi 6/7] COPY . /app                                             0.6s
 => [localagi 7/7] RUN pip install .                                      13.7s
 => [localagi] exporting to image                                          0.1s 
 => => exporting layers                                                    0.1s 
 => => writing image sha256:384ae0e839bc4f372ebc384065877176a6aa5ae4cac81  0.0s 
 => => naming to docker.io/library/localagi-localagi                       0.0s 
2023-08-25 16:17:25.098 | INFO     | __main__:<module>:366 - Creating LocalAGI instance                                                                         
2023-08-25 16:17:25.099 | INFO     | __main__:<module>:387 - Welcome to LocalAGI
2023-08-25 16:17:25.099 | INFO     | __main__:<module>:397 - LocalAGI internally can do the following actions: 'search_internet' 'save_file' 'save_memory' 'search_memory' 'plan' 'reply'
2023-08-25 16:17:25.099 | INFO     | __main__:<module>:400 - >>> Interactive mode <<<
2023-08-25 16:17:25.099 | INFO     | __main__:<module>:420 - >>> Ready! What can I do for you? ( try with: plan a roadtrip to San Francisco ) <<<
>>> plan a roadtrip to San Francisco
2023-08-25 16:17:54.995 | ERROR    | localagi.localagi:evaluate:499 - ==> error: 
2023-08-25 16:17:54.995 | ERROR    | localagi.localagi:evaluate:500 - could not load model: rpc error: code = Unknown desc = failed loading model {"error":{"code":500,"message":"could not load model: rpc error: code = Unknown desc = failed loading model","type":""}} 500 {'error': {'code': 500, 'message': 'could not load model: rpc error: code = Unknown desc = failed loading model', 'type': ''}} {'Date': 'Fri, 25 Aug 2023 16:17:54 GMT', 'Content-Type': 'application/json', 'Content-Length': '120'}
2023-08-25 16:17:54.996 | INFO     | localagi.localagi:evaluate:618 - ==> no action needed
Traceback (most recent call last):
  File "/app/./main.py", line 425, in <module>
    conversation_history=localagi.evaluate(
  File "/usr/local/lib/python3.10/site-packages/localagi/localagi.py", line 626, in evaluate
    response = self.converse(conversation_history)
  File "/usr/local/lib/python3.10/site-packages/localagi/localagi.py", line 289, in converse
    response = openai.ChatCompletion.create(
  File "/usr/local/lib/python3.10/site-packages/openai/api_resources/chat_completion.py", line 25, in create
    return super().create(*args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/openai/api_resources/abstract/engine_api_resource.py", line 153, in create
    response, _, api_key = requestor.request(
  File "/usr/local/lib/python3.10/site-packages/openai/api_requestor.py", line 298, in request
    resp, got_stream = self._interpret_response(result, stream)
  File "/usr/local/lib/python3.10/site-packages/openai/api_requestor.py", line 700, in _interpret_response
    self._interpret_response_line(
  File "/usr/local/lib/python3.10/site-packages/openai/api_requestor.py", line 765, in _interpret_response_line
    raise self.handle_error_response(
openai.error.APIError: could not load model: rpc error: code = Unknown desc = failed loading model {"error":{"code":500,"message":"could not load model: rpc error: code = Unknown desc = failed loading model","type":""}} 500 {'error': {'code': 500, 'message': 'could not load model: rpc error: code = Unknown desc = failed loading model', 'type': ''}} {'Date': 'Fri, 25 Aug 2023 16:17:56 GMT', 'Content-Type': 'application/json', 'Content-Length': '120'}
@pasqualesimonetti
Copy link
Author

pasqualesimonetti commented Aug 25, 2023 •
edited
Loading

Here is LocalAGI API full log: 
2023-08-25 17:11:07 localagi-api-1  | @@@@@
2023-08-25 17:11:07 localagi-api-1  | Skipping rebuild
2023-08-25 17:11:07 localagi-api-1  | @@@@@
2023-08-25 17:11:07 localagi-api-1  | If you are experiencing issues with the pre-compiled builds, try setting REBUILD=true
2023-08-25 17:11:07 localagi-api-1  | If you are still experiencing issues with the build, try setting CMAKE_ARGS and disable the instructions set as needed:
2023-08-25 17:11:07 localagi-api-1  | CMAKE_ARGS="-DLLAMA_F16C=OFF -DLLAMA_AVX512=OFF -DLLAMA_AVX2=OFF -DLLAMA_FMA=OFF"
2023-08-25 17:11:07 localagi-api-1  | see the documentation at: https://localai.io/basics/build/index.html
2023-08-25 17:11:07 localagi-api-1  | Note: See also https://github.com/go-skynet/LocalAI/issues/288
2023-08-25 17:11:07 localagi-api-1  | @@@@@
2023-08-25 17:11:07 localagi-api-1  | CPU info:
2023-08-25 17:11:07 localagi-api-1  | model name        : Intel(R) Core(TM) i7-8850H CPU @ 2.60GHz
2023-08-25 17:11:07 localagi-api-1  | flags             : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch fsgsbase bmi1 hle avx2 smep bmi2 erms rdseed adx smap clflushopt xsaveopt xsavec xgetbv1 arat
2023-08-25 17:11:07 localagi-api-1  | CPU:    AVX    found OK
2023-08-25 17:11:07 localagi-api-1  | CPU:    AVX2   found OK
2023-08-25 17:11:08 localagi-api-1  | CPU: no AVX512 found
2023-08-25 17:11:08 localagi-api-1  | @@@@@
2023-08-25 17:11:08 localagi-api-1  | 3:11PM INF Starting LocalAI using 14 threads, with models path: /models
2023-08-25 17:11:08 localagi-api-1  | 3:11PM INF LocalAI version: d15508f (d15508f52c1b7227546e0eadffd082afe353c7c3)
2023-08-25 17:11:09 localagi-api-1  | 3:11PM DBG Extracting backend assets files to /tmp/localai/backend_data
2023-08-25 17:11:26 localagi-api-1  | 3:11PM DBG Config overrides map[context_size:2048 f16:true mirostat:2 mirostat_eta:0.1 mirostat_tau:5 mmap:true parameters:map[model:wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin temperature:0.1 top_k:40 top_p:0.95]]
2023-08-25 17:11:26 localagi-api-1  | 3:11PM DBG Checking "wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin" exists and matches SHA
2023-08-25 17:11:26 localagi-api-1  | 3:11PM DBG Downloading "https://huggingface.co/TheBloke/WizardLM-13B-V1.0-Uncensored-GGML/resolve/main/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin"
2023-08-25 17:11:27 localagi-api-1  | 3:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 32.0 KiB/7.3 GiB (0.00%) ETA: 1160h1m23.158882454s
2023-08-25 17:11:32 localagi-api-1  | 3:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 25.1 MiB/7.3 GiB (0.33%) ETA: 1h51m13.573270482s
2023-08-25 17:11:37 localagi-api-1  | 3:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 49.5 MiB/7.3 GiB (0.66%) ETA: 1h8m47.092130707s
2023-08-25 17:11:42 localagi-api-1  | 3:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 71.8 MiB/7.3 GiB (0.96%) ETA: 55m52.577308996s
2023-08-25 17:11:47 localagi-api-1  | 3:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 92.0 MiB/7.3 GiB (1.23%) ETA: 50m13.935110964s
2023-08-25 17:11:52 localagi-api-1  | 3:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 114.7 MiB/7.3 GiB (1.53%) ETA: 45m32.762191754s
2023-08-25 17:11:57 localagi-api-1  | 3:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 139.5 MiB/7.3 GiB (1.86%) ETA: 41m43.801512221s
2023-08-25 17:12:02 localagi-api-1  | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 166.6 MiB/7.3 GiB (2.22%) ETA: 38m29.518137494s
2023-08-25 17:12:07 localagi-api-1  | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 195.9 MiB/7.3 GiB (2.61%) ETA: 35m42.22766659s
2023-08-25 17:12:12 localagi-api-1  | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 227.0 MiB/7.3 GiB (3.03%) ETA: 33m20.958874437s
2023-08-25 17:12:22 localagi-api-1  | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 253.6 MiB/7.3 GiB (3.38%) ETA: 34m42.90436436s
2023-08-25 17:12:27 localagi-api-1  | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 294.0 MiB/7.3 GiB (3.92%) ETA: 31m49.174989357s
2023-08-25 17:12:32 localagi-api-1  | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 333.6 MiB/7.3 GiB (4.45%) ETA: 29m40.80482878s
2023-08-25 17:12:37 localagi-api-1  | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 374.5 MiB/7.3 GiB (4.99%) ETA: 27m52.411444056s
2023-08-25 17:12:42 localagi-api-1  | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 414.7 MiB/7.3 GiB (5.53%) ETA: 26m27.03396895s
2023-08-25 17:12:47 localagi-api-1  | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 453.7 MiB/7.3 GiB (6.05%) ETA: 25m20.443821888s
2023-08-25 17:12:52 localagi-api-1  | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 493.4 MiB/7.3 GiB (6.58%) ETA: 24m21.317492521s
2023-08-25 17:12:57 localagi-api-1  | 3:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 532.3 MiB/7.3 GiB (7.10%) ETA: 23m32.545553841s
2023-08-25 17:13:02 localagi-api-1  | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 562.7 MiB/7.3 GiB (7.50%) ETA: 23m11.984294504s
2023-08-25 17:13:07 localagi-api-1  | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 593.9 MiB/7.3 GiB (7.92%) ETA: 22m51.208973299s
2023-08-25 17:13:12 localagi-api-1  | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 624.3 MiB/7.3 GiB (8.32%) ETA: 22m33.730933172s
2023-08-25 17:13:17 localagi-api-1  | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 656.0 MiB/7.3 GiB (8.75%) ETA: 22m14.615396656s
2023-08-25 17:13:22 localagi-api-1  | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 685.4 MiB/7.3 GiB (9.14%) ETA: 22m1.674150039s
2023-08-25 17:13:27 localagi-api-1  | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 715.9 MiB/7.3 GiB (9.54%) ETA: 21m47.063076868s
2023-08-25 17:13:32 localagi-api-1  | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 744.6 MiB/7.3 GiB (9.93%) ETA: 21m36.845879927s
2023-08-25 17:13:37 localagi-api-1  | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 771.1 MiB/7.3 GiB (10.28%) ETA: 21m30.995989232s
2023-08-25 17:13:44 localagi-api-1  | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 793.3 MiB/7.3 GiB (10.58%) ETA: 21m49.084205443s
2023-08-25 17:13:49 localagi-api-1  | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 822.4 MiB/7.3 GiB (10.96%) ETA: 21m37.991246358s
2023-08-25 17:13:54 localagi-api-1  | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 850.3 MiB/7.3 GiB (11.34%) ETA: 21m29.258105183s
2023-08-25 17:13:59 localagi-api-1  | 3:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 879.1 MiB/7.3 GiB (11.72%) ETA: 21m19.249936622s
2023-08-25 17:14:04 localagi-api-1  | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 908.5 MiB/7.3 GiB (12.11%) ETA: 21m8.684302416s
2023-08-25 17:14:09 localagi-api-1  | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 937.8 MiB/7.3 GiB (12.50%) ETA: 20m58.578750544s
2023-08-25 17:14:14 localagi-api-1  | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 971.4 MiB/7.3 GiB (12.95%) ETA: 20m42.412434857s
2023-08-25 17:14:19 localagi-api-1  | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 994.9 MiB/7.3 GiB (13.26%) ETA: 20m41.495523441s
2023-08-25 17:14:24 localagi-api-1  | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1021.4 MiB/7.3 GiB (13.62%) ETA: 20m35.994690129s
2023-08-25 17:14:29 localagi-api-1  | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.0 GiB/7.3 GiB (13.99%) ETA: 20m28.403407252s
2023-08-25 17:14:34 localagi-api-1  | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.1 GiB/7.3 GiB (14.37%) ETA: 20m20.937255329s
2023-08-25 17:14:39 localagi-api-1  | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.1 GiB/7.3 GiB (14.59%) ETA: 20m28.312626963s
2023-08-25 17:14:44 localagi-api-1  | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.1 GiB/7.3 GiB (14.80%) ETA: 20m37.397763944s
2023-08-25 17:14:49 localagi-api-1  | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.1 GiB/7.3 GiB (15.10%) ETA: 20m35.781882001s
2023-08-25 17:14:54 localagi-api-1  | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.1 GiB/7.3 GiB (15.41%) ETA: 20m34.366402496s
2023-08-25 17:14:59 localagi-api-1  | 3:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.2 GiB/7.3 GiB (15.72%) ETA: 20m32.77579477s
2023-08-25 17:15:04 localagi-api-1  | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.2 GiB/7.3 GiB (16.06%) ETA: 20m27.703140357s
2023-08-25 17:15:09 localagi-api-1  | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.2 GiB/7.3 GiB (16.41%) ETA: 20m22.377718994s
2023-08-25 17:15:14 localagi-api-1  | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.2 GiB/7.3 GiB (16.75%) ETA: 20m16.976247522s
2023-08-25 17:15:19 localagi-api-1  | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.3 GiB/7.3 GiB (17.10%) ETA: 20m11.642698705s
2023-08-25 17:15:24 localagi-api-1  | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.3 GiB/7.3 GiB (17.45%) ETA: 20m5.786874175s
2023-08-25 17:15:29 localagi-api-1  | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.3 GiB/7.3 GiB (17.78%) ETA: 20m1.543224566s
2023-08-25 17:15:34 localagi-api-1  | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.3 GiB/7.3 GiB (18.09%) ETA: 19m59.434568991s
2023-08-25 17:15:39 localagi-api-1  | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.3 GiB/7.3 GiB (18.41%) ETA: 19m56.254501787s
2023-08-25 17:15:44 localagi-api-1  | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.4 GiB/7.3 GiB (18.73%) ETA: 19m52.532006253s
2023-08-25 17:15:49 localagi-api-1  | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.4 GiB/7.3 GiB (19.07%) ETA: 19m47.833014478s
2023-08-25 17:15:54 localagi-api-1  | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.4 GiB/7.3 GiB (19.38%) ETA: 19m45.451840315s
2023-08-25 17:15:59 localagi-api-1  | 3:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.4 GiB/7.3 GiB (19.69%) ETA: 19m42.215799705s
2023-08-25 17:16:04 localagi-api-1  | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.5 GiB/7.3 GiB (20.00%) ETA: 19m40.020451056s
2023-08-25 17:16:09 localagi-api-1  | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.5 GiB/7.3 GiB (20.30%) ETA: 19m37.296948593s
2023-08-25 17:16:14 localagi-api-1  | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.5 GiB/7.3 GiB (20.62%) ETA: 19m33.935310229s
2023-08-25 17:16:19 localagi-api-1  | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.5 GiB/7.3 GiB (20.94%) ETA: 19m30.394287487s
2023-08-25 17:16:24 localagi-api-1  | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.6 GiB/7.3 GiB (21.28%) ETA: 19m25.372887639s
2023-08-25 17:16:29 localagi-api-1  | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.6 GiB/7.3 GiB (21.61%) ETA: 19m20.699834206s
2023-08-25 17:16:34 localagi-api-1  | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.6 GiB/7.3 GiB (21.75%) ETA: 19m29.294962248s
2023-08-25 17:16:39 localagi-api-1  | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.6 GiB/7.3 GiB (22.08%) ETA: 19m24.188437566s
2023-08-25 17:16:44 localagi-api-1  | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.6 GiB/7.3 GiB (22.44%) ETA: 19m17.601819766s
2023-08-25 17:16:49 localagi-api-1  | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.7 GiB/7.3 GiB (22.80%) ETA: 19m11.106938736s
2023-08-25 17:16:54 localagi-api-1  | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.7 GiB/7.3 GiB (23.15%) ETA: 19m5.143893263s
2023-08-25 17:16:59 localagi-api-1  | 3:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.7 GiB/7.3 GiB (23.50%) ETA: 18m59.130991854s
2023-08-25 17:17:04 localagi-api-1  | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.7 GiB/7.3 GiB (23.86%) ETA: 18m53.040572641s
2023-08-25 17:17:09 localagi-api-1  | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.8 GiB/7.3 GiB (24.20%) ETA: 18m47.708131736s
2023-08-25 17:17:14 localagi-api-1  | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.8 GiB/7.3 GiB (24.55%) ETA: 18m41.676343219s
2023-08-25 17:17:19 localagi-api-1  | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.8 GiB/7.3 GiB (24.88%) ETA: 18m36.7639545s
2023-08-25 17:17:24 localagi-api-1  | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.8 GiB/7.3 GiB (25.24%) ETA: 18m30.497419178s
2023-08-25 17:17:29 localagi-api-1  | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.9 GiB/7.3 GiB (25.59%) ETA: 18m24.618300723s
2023-08-25 17:17:34 localagi-api-1  | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.9 GiB/7.3 GiB (25.93%) ETA: 18m19.82038486s
2023-08-25 17:17:39 localagi-api-1  | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.9 GiB/7.3 GiB (26.25%) ETA: 18m15.611140395s
2023-08-25 17:17:44 localagi-api-1  | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 1.9 GiB/7.3 GiB (26.58%) ETA: 18m11.266168185s
2023-08-25 17:17:49 localagi-api-1  | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.0 GiB/7.3 GiB (26.90%) ETA: 18m7.048943796s
2023-08-25 17:17:54 localagi-api-1  | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.0 GiB/7.3 GiB (27.22%) ETA: 18m3.109761596s
2023-08-25 17:17:59 localagi-api-1  | 3:17PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.0 GiB/7.3 GiB (27.36%) ETA: 18m8.555035167s
2023-08-25 17:18:04 localagi-api-1  | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.0 GiB/7.3 GiB (27.68%) ETA: 18m4.397042663s
2023-08-25 17:18:09 localagi-api-1  | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.0 GiB/7.3 GiB (27.98%) ETA: 18m1.121307167s
2023-08-25 17:18:14 localagi-api-1  | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.1 GiB/7.3 GiB (28.29%) ETA: 17m57.204746782s
2023-08-25 17:18:19 localagi-api-1  | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.1 GiB/7.3 GiB (28.60%) ETA: 17m53.354857927s
2023-08-25 17:18:24 localagi-api-1  | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.1 GiB/7.3 GiB (28.91%) ETA: 17m49.792106435s
2023-08-25 17:18:29 localagi-api-1  | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.1 GiB/7.3 GiB (29.22%) ETA: 17m45.73561303s
2023-08-25 17:18:34 localagi-api-1  | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.2 GiB/7.3 GiB (29.55%) ETA: 17m40.827579363s
2023-08-25 17:18:39 localagi-api-1  | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.2 GiB/7.3 GiB (29.88%) ETA: 17m36.299823656s
2023-08-25 17:18:44 localagi-api-1  | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.2 GiB/7.3 GiB (30.21%) ETA: 17m31.307468157s
2023-08-25 17:18:49 localagi-api-1  | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.2 GiB/7.3 GiB (30.48%) ETA: 17m29.455463108s
2023-08-25 17:18:54 localagi-api-1  | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.3 GiB/7.3 GiB (30.83%) ETA: 17m23.324266684s
2023-08-25 17:18:59 localagi-api-1  | 3:18PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.3 GiB/7.3 GiB (31.17%) ETA: 17m18.199433324s
2023-08-25 17:19:04 localagi-api-1  | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.3 GiB/7.3 GiB (31.52%) ETA: 17m12.300001286s
2023-08-25 17:19:09 localagi-api-1  | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.3 GiB/7.3 GiB (31.85%) ETA: 17m7.112836381s
2023-08-25 17:19:14 localagi-api-1  | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.4 GiB/7.3 GiB (32.21%) ETA: 17m0.994874068s
2023-08-25 17:19:19 localagi-api-1  | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.4 GiB/7.3 GiB (32.54%) ETA: 16m56.055774973s
2023-08-25 17:19:24 localagi-api-1  | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.4 GiB/7.3 GiB (32.88%) ETA: 16m50.408642473s
2023-08-25 17:19:29 localagi-api-1  | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.4 GiB/7.3 GiB (33.22%) ETA: 16m45.439241271s
2023-08-25 17:19:34 localagi-api-1  | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.5 GiB/7.3 GiB (33.54%) ETA: 16m40.612797697s
2023-08-25 17:19:39 localagi-api-1  | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.5 GiB/7.3 GiB (33.87%) ETA: 16m35.91858101s
2023-08-25 17:19:44 localagi-api-1  | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.5 GiB/7.3 GiB (34.20%) ETA: 16m30.797456962s
2023-08-25 17:19:49 localagi-api-1  | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.5 GiB/7.3 GiB (34.54%) ETA: 16m25.80084117s
2023-08-25 17:19:54 localagi-api-1  | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.6 GiB/7.3 GiB (34.86%) ETA: 16m21.054863164s
2023-08-25 17:19:59 localagi-api-1  | 3:19PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.6 GiB/7.3 GiB (35.18%) ETA: 16m16.486333033s
2023-08-25 17:20:07 localagi-api-1  | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.6 GiB/7.3 GiB (35.28%) ETA: 16m27.02196543s
2023-08-25 17:20:12 localagi-api-1  | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.6 GiB/7.3 GiB (35.59%) ETA: 16m22.656893748s
2023-08-25 17:20:17 localagi-api-1  | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.6 GiB/7.3 GiB (35.92%) ETA: 16m17.654029242s
2023-08-25 17:20:22 localagi-api-1  | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.7 GiB/7.3 GiB (36.24%) ETA: 16m12.88673457s
2023-08-25 17:20:27 localagi-api-1  | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.7 GiB/7.3 GiB (36.57%) ETA: 16m8.055811954s
2023-08-25 17:20:32 localagi-api-1  | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.7 GiB/7.3 GiB (36.88%) ETA: 16m3.478360861s
2023-08-25 17:20:37 localagi-api-1  | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.7 GiB/7.3 GiB (37.21%) ETA: 15m58.678258573s
2023-08-25 17:20:42 localagi-api-1  | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.8 GiB/7.3 GiB (37.55%) ETA: 15m52.890718631s
2023-08-25 17:20:47 localagi-api-1  | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.8 GiB/7.3 GiB (37.70%) ETA: 15m55.189332576s
2023-08-25 17:20:52 localagi-api-1  | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.8 GiB/7.3 GiB (38.05%) ETA: 15m49.385689435s
2023-08-25 17:20:57 localagi-api-1  | 3:20PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.8 GiB/7.3 GiB (38.39%) ETA: 15m43.778819788s
2023-08-25 17:21:02 localagi-api-1  | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.8 GiB/7.3 GiB (38.73%) ETA: 15m38.366130574s
2023-08-25 17:21:07 localagi-api-1  | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.9 GiB/7.3 GiB (39.07%) ETA: 15m32.749597745s
2023-08-25 17:21:12 localagi-api-1  | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.9 GiB/7.3 GiB (39.42%) ETA: 15m26.770776732s
2023-08-25 17:21:17 localagi-api-1  | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.9 GiB/7.3 GiB (39.75%) ETA: 15m21.687334663s
2023-08-25 17:21:22 localagi-api-1  | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 2.9 GiB/7.3 GiB (40.07%) ETA: 15m16.983377134s
2023-08-25 17:21:32 localagi-api-1  | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.0 GiB/7.3 GiB (40.32%) ETA: 15m22.664352352s
2023-08-25 17:21:38 localagi-api-1  | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.0 GiB/7.3 GiB (40.62%) ETA: 15m18.373829356s
2023-08-25 17:21:43 localagi-api-1  | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.0 GiB/7.3 GiB (40.95%) ETA: 15m13.031691476s
2023-08-25 17:21:48 localagi-api-1  | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.0 GiB/7.3 GiB (41.27%) ETA: 15m8.440209048s
2023-08-25 17:21:53 localagi-api-1  | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.0 GiB/7.3 GiB (41.59%) ETA: 15m3.594932153s
2023-08-25 17:21:58 localagi-api-1  | 3:21PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.1 GiB/7.3 GiB (41.91%) ETA: 14m58.67475933s
2023-08-25 17:22:03 localagi-api-1  | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.1 GiB/7.3 GiB (42.22%) ETA: 14m53.888823691s
2023-08-25 17:22:08 localagi-api-1  | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.1 GiB/7.3 GiB (42.55%) ETA: 14m48.817506838s
2023-08-25 17:22:13 localagi-api-1  | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.1 GiB/7.3 GiB (42.86%) ETA: 14m44.361093748s
2023-08-25 17:22:18 localagi-api-1  | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.2 GiB/7.3 GiB (43.10%) ETA: 14m42.424477497s
2023-08-25 17:22:23 localagi-api-1  | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.2 GiB/7.3 GiB (43.42%) ETA: 14m37.311131625s
2023-08-25 17:22:28 localagi-api-1  | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.2 GiB/7.3 GiB (43.76%) ETA: 14m31.891968173s
2023-08-25 17:22:33 localagi-api-1  | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.2 GiB/7.3 GiB (44.09%) ETA: 14m26.64999921s
2023-08-25 17:22:38 localagi-api-1  | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.3 GiB/7.3 GiB (44.42%) ETA: 14m21.397252165s
2023-08-25 17:22:43 localagi-api-1  | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.3 GiB/7.3 GiB (44.75%) ETA: 14m15.885711914s
2023-08-25 17:22:48 localagi-api-1  | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.3 GiB/7.3 GiB (45.07%) ETA: 14m11.030314974s
2023-08-25 17:22:53 localagi-api-1  | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.3 GiB/7.3 GiB (45.40%) ETA: 14m5.713721982s
2023-08-25 17:22:58 localagi-api-1  | 3:22PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.4 GiB/7.3 GiB (45.74%) ETA: 14m0.344593152s
2023-08-25 17:23:03 localagi-api-1  | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.4 GiB/7.3 GiB (46.07%) ETA: 13m55.117411405s
2023-08-25 17:23:08 localagi-api-1  | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.4 GiB/7.3 GiB (46.41%) ETA: 13m49.453485998s
2023-08-25 17:23:13 localagi-api-1  | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.4 GiB/7.3 GiB (46.76%) ETA: 13m43.623272228s
2023-08-25 17:23:18 localagi-api-1  | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.5 GiB/7.3 GiB (47.10%) ETA: 13m38.052157518s
2023-08-25 17:23:23 localagi-api-1  | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.5 GiB/7.3 GiB (47.45%) ETA: 13m32.28195579s
2023-08-25 17:23:28 localagi-api-1  | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.5 GiB/7.3 GiB (47.80%) ETA: 13m26.389803735s
2023-08-25 17:23:33 localagi-api-1  | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.5 GiB/7.3 GiB (48.14%) ETA: 13m20.909850581s
2023-08-25 17:23:38 localagi-api-1  | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.6 GiB/7.3 GiB (48.48%) ETA: 13m15.31538669s
2023-08-25 17:23:43 localagi-api-1  | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.6 GiB/7.3 GiB (48.83%) ETA: 13m9.483990621s
2023-08-25 17:23:48 localagi-api-1  | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.6 GiB/7.3 GiB (49.17%) ETA: 13m3.976471744s
2023-08-25 17:23:53 localagi-api-1  | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.6 GiB/7.3 GiB (49.50%) ETA: 12m58.733045778s
2023-08-25 17:23:58 localagi-api-1  | 3:23PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.6 GiB/7.3 GiB (49.81%) ETA: 12m54.294751725s
2023-08-25 17:24:03 localagi-api-1  | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.7 GiB/7.3 GiB (50.04%) ETA: 12m52.020575059s
2023-08-25 17:24:08 localagi-api-1  | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.7 GiB/7.3 GiB (50.30%) ETA: 12m49.119077319s
2023-08-25 17:24:13 localagi-api-1  | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.7 GiB/7.3 GiB (50.55%) ETA: 12m46.200523347s
2023-08-25 17:24:18 localagi-api-1  | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.7 GiB/7.3 GiB (50.82%) ETA: 12m42.886130275s
2023-08-25 17:24:23 localagi-api-1  | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.7 GiB/7.3 GiB (51.05%) ETA: 12m40.787286769s
2023-08-25 17:24:28 localagi-api-1  | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.8 GiB/7.3 GiB (51.32%) ETA: 12m37.307356791s
2023-08-25 17:24:33 localagi-api-1  | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.8 GiB/7.3 GiB (51.58%) ETA: 12m34.123582718s
2023-08-25 17:24:38 localagi-api-1  | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.8 GiB/7.3 GiB (51.86%) ETA: 12m30.383542156s
2023-08-25 17:24:43 localagi-api-1  | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.8 GiB/7.3 GiB (52.16%) ETA: 12m26.035022003s
2023-08-25 17:24:48 localagi-api-1  | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.8 GiB/7.3 GiB (52.47%) ETA: 12m21.502504697s
2023-08-25 17:24:53 localagi-api-1  | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.9 GiB/7.3 GiB (52.79%) ETA: 12m16.250250842s
2023-08-25 17:24:58 localagi-api-1  | 3:24PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.9 GiB/7.3 GiB (53.13%) ETA: 12m10.906401894s
2023-08-25 17:25:03 localagi-api-1  | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.9 GiB/7.3 GiB (53.47%) ETA: 12m5.177824983s
2023-08-25 17:25:08 localagi-api-1  | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 3.9 GiB/7.3 GiB (53.77%) ETA: 12m0.823133643s
2023-08-25 17:25:13 localagi-api-1  | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.0 GiB/7.3 GiB (54.05%) ETA: 11m56.986892335s
2023-08-25 17:25:18 localagi-api-1  | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.0 GiB/7.3 GiB (54.37%) ETA: 11m52.170566986s
2023-08-25 17:25:23 localagi-api-1  | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.0 GiB/7.3 GiB (54.65%) ETA: 11m48.091344524s
2023-08-25 17:25:28 localagi-api-1  | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.0 GiB/7.3 GiB (54.95%) ETA: 11m43.893414811s
2023-08-25 17:25:33 localagi-api-1  | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.0 GiB/7.3 GiB (55.24%) ETA: 11m39.615241426s
2023-08-25 17:25:38 localagi-api-1  | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.1 GiB/7.3 GiB (55.53%) ETA: 11m35.345070267s
2023-08-25 17:25:46 localagi-api-1  | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.1 GiB/7.3 GiB (55.68%) ETA: 11m38.170659014s
2023-08-25 17:25:51 localagi-api-1  | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.1 GiB/7.3 GiB (56.02%) ETA: 11m32.774051445s
2023-08-25 17:25:56 localagi-api-1  | 3:25PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.1 GiB/7.3 GiB (56.36%) ETA: 11m27.053724117s
2023-08-25 17:26:01 localagi-api-1  | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.2 GiB/7.3 GiB (56.68%) ETA: 11m22.08403689s
2023-08-25 17:26:06 localagi-api-1  | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.2 GiB/7.3 GiB (57.00%) ETA: 11m16.916852564s
2023-08-25 17:26:12 localagi-api-1  | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.2 GiB/7.3 GiB (57.33%) ETA: 11m11.476663608s
2023-08-25 17:26:17 localagi-api-1  | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.2 GiB/7.3 GiB (57.66%) ETA: 11m6.171470937s
2023-08-25 17:26:22 localagi-api-1  | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.2 GiB/7.3 GiB (58.00%) ETA: 11m0.62937032s
2023-08-25 17:26:27 localagi-api-1  | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.3 GiB/7.3 GiB (58.14%) ETA: 11m0.330436919s
2023-08-25 17:26:32 localagi-api-1  | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.3 GiB/7.3 GiB (58.48%) ETA: 10m54.878750887s
2023-08-25 17:26:37 localagi-api-1  | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.3 GiB/7.3 GiB (58.82%) ETA: 10m49.25692654s
2023-08-25 17:26:42 localagi-api-1  | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.3 GiB/7.3 GiB (59.16%) ETA: 10m43.538901174s
2023-08-25 17:26:47 localagi-api-1  | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.4 GiB/7.3 GiB (59.50%) ETA: 10m37.873720135s
2023-08-25 17:26:52 localagi-api-1  | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.4 GiB/7.3 GiB (59.86%) ETA: 10m31.809885996s
2023-08-25 17:26:57 localagi-api-1  | 3:26PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.4 GiB/7.3 GiB (60.22%) ETA: 10m25.827255313s
2023-08-25 17:27:02 localagi-api-1  | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.4 GiB/7.3 GiB (60.58%) ETA: 10m19.800208293s
2023-08-25 17:27:07 localagi-api-1  | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.5 GiB/7.3 GiB (60.93%) ETA: 10m13.913690128s
2023-08-25 17:27:12 localagi-api-1  | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.5 GiB/7.3 GiB (61.27%) ETA: 10m8.283971765s
2023-08-25 17:27:17 localagi-api-1  | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.5 GiB/7.3 GiB (61.62%) ETA: 10m2.481418934s
2023-08-25 17:27:22 localagi-api-1  | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.5 GiB/7.3 GiB (61.97%) ETA: 9m56.708343548s
2023-08-25 17:27:27 localagi-api-1  | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.6 GiB/7.3 GiB (62.32%) ETA: 9m50.91170664s
2023-08-25 17:27:32 localagi-api-1  | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.6 GiB/7.3 GiB (62.66%) ETA: 9m45.449901827s
2023-08-25 17:27:37 localagi-api-1  | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.6 GiB/7.3 GiB (62.99%) ETA: 9m40.014182466s
2023-08-25 17:27:42 localagi-api-1  | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.6 GiB/7.3 GiB (63.32%) ETA: 9m34.797978724s
2023-08-25 17:27:47 localagi-api-1  | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.7 GiB/7.3 GiB (63.65%) ETA: 9m29.480798152s
2023-08-25 17:27:53 localagi-api-1  | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.7 GiB/7.3 GiB (63.70%) ETA: 9m32.359437237s
2023-08-25 17:27:58 localagi-api-1  | 3:27PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.7 GiB/7.3 GiB (64.05%) ETA: 9m26.356445924s
2023-08-25 17:28:03 localagi-api-1  | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.7 GiB/7.3 GiB (64.42%) ETA: 9m20.142564774s
2023-08-25 17:28:08 localagi-api-1  | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.7 GiB/7.3 GiB (64.79%) ETA: 9m13.92563419s
2023-08-25 17:28:13 localagi-api-1  | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.8 GiB/7.3 GiB (65.16%) ETA: 9m7.708261603s
2023-08-25 17:28:18 localagi-api-1  | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.8 GiB/7.3 GiB (65.53%) ETA: 9m1.34773687s
2023-08-25 17:28:23 localagi-api-1  | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.8 GiB/7.3 GiB (65.89%) ETA: 8m55.446844944s
2023-08-25 17:28:28 localagi-api-1  | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.9 GiB/7.3 GiB (66.25%) ETA: 8m49.479491131s
2023-08-25 17:28:33 localagi-api-1  | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.9 GiB/7.3 GiB (66.60%) ETA: 8m43.6578998s
2023-08-25 17:28:38 localagi-api-1  | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.9 GiB/7.3 GiB (66.95%) ETA: 8m37.891858536s
2023-08-25 17:28:43 localagi-api-1  | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 4.9 GiB/7.3 GiB (67.28%) ETA: 8m32.638835397s
2023-08-25 17:28:48 localagi-api-1  | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.0 GiB/7.3 GiB (67.62%) ETA: 8m27.284724739s
2023-08-25 17:28:53 localagi-api-1  | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.0 GiB/7.3 GiB (67.95%) ETA: 8m22.01044305s
2023-08-25 17:28:58 localagi-api-1  | 3:28PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.0 GiB/7.3 GiB (68.28%) ETA: 8m16.813724216s
2023-08-25 17:29:03 localagi-api-1  | 3:29PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.0 GiB/7.3 GiB (68.61%) ETA: 8m11.561919741s
2023-08-25 17:29:09 localagi-api-1  | 3:29PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.0 GiB/7.3 GiB (68.93%) ETA: 8m6.478325472s
2023-08-25 17:29:15 localagi-api-1  | 3:29PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.1 GiB/7.3 GiB (69.17%) ETA: 8m3.794660979s
2023-08-25 17:29:20 localagi-api-1  | 3:29PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.1 GiB/7.3 GiB (69.50%) ETA: 7m58.654310711s
2023-08-25 17:29:25 localagi-api-1  | 3:29PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.1 GiB/7.3 GiB (69.83%) ETA: 7m53.260175828s
2023-08-25 17:29:30 localagi-api-1  | 3:29PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.1 GiB/7.3 GiB (70.19%) ETA: 7m47.479800137s
2023-08-25 17:29:35 localagi-api-1  | 3:29PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.2 GiB/7.3 GiB (70.54%) ETA: 7m41.86881001s
2023-08-25 17:29:40 localagi-api-1  | 3:29PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.2 GiB/7.3 GiB (70.88%) ETA: 7m36.296089413s
2023-08-25 17:29:45 localagi-api-1  | 3:29PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.2 GiB/7.3 GiB (71.23%) ETA: 7m30.54516436s
2023-08-25 17:29:50 localagi-api-1  | 3:29PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.2 GiB/7.3 GiB (71.60%) ETA: 7m24.59215289s
2023-08-25 17:30:00 localagi-api-1  | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.3 GiB/7.3 GiB (71.89%) ETA: 7m22.384151287s
2023-08-25 17:30:05 localagi-api-1  | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.3 GiB/7.3 GiB (72.25%) ETA: 7m16.294592863s
2023-08-25 17:30:10 localagi-api-1  | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.3 GiB/7.3 GiB (72.63%) ETA: 7m9.989322452s
2023-08-25 17:30:15 localagi-api-1  | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.3 GiB/7.3 GiB (73.02%) ETA: 7m3.572005697s
2023-08-25 17:30:20 localagi-api-1  | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.4 GiB/7.3 GiB (73.39%) ETA: 6m57.482790273s
2023-08-25 17:30:25 localagi-api-1  | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.4 GiB/7.3 GiB (73.74%) ETA: 6m51.723936478s
2023-08-25 17:30:30 localagi-api-1  | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.4 GiB/7.3 GiB (74.08%) ETA: 6m46.289392743s
2023-08-25 17:30:35 localagi-api-1  | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.5 GiB/7.3 GiB (74.44%) ETA: 6m40.453960662s
2023-08-25 17:30:42 localagi-api-1  | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.5 GiB/7.3 GiB (74.45%) ETA: 6m42.498754262s
2023-08-25 17:30:47 localagi-api-1  | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.5 GiB/7.3 GiB (74.83%) ETA: 6m36.290802482s
2023-08-25 17:30:52 localagi-api-1  | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.5 GiB/7.3 GiB (75.22%) ETA: 6m29.726397616s
2023-08-25 17:30:57 localagi-api-1  | 3:30PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.5 GiB/7.3 GiB (75.60%) ETA: 6m23.377199471s
2023-08-25 17:31:02 localagi-api-1  | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.6 GiB/7.3 GiB (75.96%) ETA: 6m17.496802935s
2023-08-25 17:31:07 localagi-api-1  | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.6 GiB/7.3 GiB (76.32%) ETA: 6m11.779402279s
2023-08-25 17:31:12 localagi-api-1  | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.6 GiB/7.3 GiB (76.66%) ETA: 6m6.221988698s
2023-08-25 17:31:17 localagi-api-1  | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.6 GiB/7.3 GiB (77.01%) ETA: 6m0.594352684s
2023-08-25 17:31:22 localagi-api-1  | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.7 GiB/7.3 GiB (77.36%) ETA: 5m54.988617228s
2023-08-25 17:31:27 localagi-api-1  | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.7 GiB/7.3 GiB (77.69%) ETA: 5m49.825749927s
2023-08-25 17:31:32 localagi-api-1  | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.7 GiB/7.3 GiB (78.01%) ETA: 5m44.822874072s
2023-08-25 17:31:37 localagi-api-1  | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.7 GiB/7.3 GiB (78.32%) ETA: 5m39.81219167s
2023-08-25 17:31:42 localagi-api-1  | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.8 GiB/7.3 GiB (78.64%) ETA: 5m34.793898765s
2023-08-25 17:31:47 localagi-api-1  | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.8 GiB/7.3 GiB (78.97%) ETA: 5m29.642342195s
2023-08-25 17:31:52 localagi-api-1  | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.8 GiB/7.3 GiB (79.31%) ETA: 5m24.344060961s
2023-08-25 17:31:57 localagi-api-1  | 3:31PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.8 GiB/7.3 GiB (79.63%) ETA: 5m19.211793884s
2023-08-25 17:32:06 localagi-api-1  | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.8 GiB/7.3 GiB (79.82%) ETA: 5m17.805561415s
2023-08-25 17:32:11 localagi-api-1  | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.9 GiB/7.3 GiB (80.17%) ETA: 5m12.170485547s
2023-08-25 17:32:16 localagi-api-1  | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.9 GiB/7.3 GiB (80.55%) ETA: 5m6.018303599s
2023-08-25 17:32:21 localagi-api-1  | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 5.9 GiB/7.3 GiB (80.92%) ETA: 4m59.982040555s
2023-08-25 17:32:26 localagi-api-1  | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.0 GiB/7.3 GiB (81.28%) ETA: 4m54.075160731s
2023-08-25 17:32:31 localagi-api-1  | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.0 GiB/7.3 GiB (81.65%) ETA: 4m48.064577336s
2023-08-25 17:32:36 localagi-api-1  | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.0 GiB/7.3 GiB (82.02%) ETA: 4m42.190651695s
2023-08-25 17:32:41 localagi-api-1  | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.0 GiB/7.3 GiB (82.39%) ETA: 4m36.11044512s
2023-08-25 17:32:48 localagi-api-1  | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.0 GiB/7.3 GiB (82.41%) ETA: 4m37.279563799s
2023-08-25 17:32:53 localagi-api-1  | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.1 GiB/7.3 GiB (82.77%) ETA: 4m31.334343168s
2023-08-25 17:32:58 localagi-api-1  | 3:32PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.1 GiB/7.3 GiB (83.16%) ETA: 4m25.064159896s
2023-08-25 17:33:03 localagi-api-1  | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.1 GiB/7.3 GiB (83.55%) ETA: 4m18.727316009s
2023-08-25 17:33:08 localagi-api-1  | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.1 GiB/7.3 GiB (83.93%) ETA: 4m12.574052657s
2023-08-25 17:33:13 localagi-api-1  | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.2 GiB/7.3 GiB (84.29%) ETA: 4m6.672507429s
2023-08-25 17:33:18 localagi-api-1  | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.2 GiB/7.3 GiB (84.63%) ETA: 4m1.380403797s
2023-08-25 17:33:23 localagi-api-1  | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.2 GiB/7.3 GiB (84.95%) ETA: 3m56.245009324s
2023-08-25 17:33:31 localagi-api-1  | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.2 GiB/7.3 GiB (85.02%) ETA: 3m56.350434138s
2023-08-25 17:33:36 localagi-api-1  | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.3 GiB/7.3 GiB (85.36%) ETA: 3m50.873512841s
2023-08-25 17:33:41 localagi-api-1  | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.3 GiB/7.3 GiB (85.70%) ETA: 3m45.452081801s
2023-08-25 17:33:46 localagi-api-1  | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.3 GiB/7.3 GiB (86.04%) ETA: 3m40.12545014s
2023-08-25 17:33:51 localagi-api-1  | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.3 GiB/7.3 GiB (86.38%) ETA: 3m34.671901584s
2023-08-25 17:33:56 localagi-api-1  | 3:33PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.4 GiB/7.3 GiB (86.71%) ETA: 3m29.380932967s
2023-08-25 17:34:01 localagi-api-1  | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.4 GiB/7.3 GiB (87.04%) ETA: 3m24.167731775s
2023-08-25 17:34:06 localagi-api-1  | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.4 GiB/7.3 GiB (87.37%) ETA: 3m18.903337351s
2023-08-25 17:34:11 localagi-api-1  | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.4 GiB/7.3 GiB (87.70%) ETA: 3m13.760789832s
2023-08-25 17:34:16 localagi-api-1  | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.4 GiB/7.3 GiB (88.02%) ETA: 3m8.731062831s
2023-08-25 17:34:21 localagi-api-1  | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.5 GiB/7.3 GiB (88.35%) ETA: 3m3.456562105s
2023-08-25 17:34:26 localagi-api-1  | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.5 GiB/7.3 GiB (88.69%) ETA: 2m58.117618021s
2023-08-25 17:34:31 localagi-api-1  | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.5 GiB/7.3 GiB (89.02%) ETA: 2m52.891370694s
2023-08-25 17:34:36 localagi-api-1  | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.5 GiB/7.3 GiB (89.35%) ETA: 2m47.571875478s
2023-08-25 17:34:41 localagi-api-1  | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.6 GiB/7.3 GiB (89.69%) ETA: 2m42.305334213s
2023-08-25 17:34:46 localagi-api-1  | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.6 GiB/7.3 GiB (90.02%) ETA: 2m37.026365414s
2023-08-25 17:34:54 localagi-api-1  | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.6 GiB/7.3 GiB (90.17%) ETA: 2m35.356344868s
2023-08-25 17:34:59 localagi-api-1  | 3:34PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.6 GiB/7.3 GiB (90.54%) ETA: 2m29.398809795s
2023-08-25 17:35:04 localagi-api-1  | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.7 GiB/7.3 GiB (90.92%) ETA: 2m23.306501411s
2023-08-25 17:35:09 localagi-api-1  | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.7 GiB/7.3 GiB (91.29%) ETA: 2m17.295006523s
2023-08-25 17:35:14 localagi-api-1  | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.7 GiB/7.3 GiB (91.66%) ETA: 2m11.520996946s
2023-08-25 17:35:19 localagi-api-1  | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.7 GiB/7.3 GiB (92.01%) ETA: 2m5.817621571s
2023-08-25 17:35:24 localagi-api-1  | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.8 GiB/7.3 GiB (92.36%) ETA: 2m0.318285529s
2023-08-25 17:35:29 localagi-api-1  | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.8 GiB/7.3 GiB (92.72%) ETA: 1m54.667092557s
2023-08-25 17:35:36 localagi-api-1  | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.8 GiB/7.3 GiB (92.75%) ETA: 1m54.594768281s
2023-08-25 17:35:41 localagi-api-1  | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.8 GiB/7.3 GiB (93.12%) ETA: 1m48.740386968s
2023-08-25 17:35:46 localagi-api-1  | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.8 GiB/7.3 GiB (93.50%) ETA: 1m42.665622802s
2023-08-25 17:35:51 localagi-api-1  | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.9 GiB/7.3 GiB (93.88%) ETA: 1m36.536511587s
2023-08-25 17:35:56 localagi-api-1  | 3:35PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.9 GiB/7.3 GiB (94.25%) ETA: 1m30.632805243s
2023-08-25 17:36:01 localagi-api-1  | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 6.9 GiB/7.3 GiB (94.62%) ETA: 1m24.812570583s
2023-08-25 17:36:06 localagi-api-1  | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.0 GiB/7.3 GiB (94.96%) ETA: 1m19.371899134s
2023-08-25 17:36:11 localagi-api-1  | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.0 GiB/7.3 GiB (95.31%) ETA: 1m13.906750315s
2023-08-25 17:36:16 localagi-api-1  | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.0 GiB/7.3 GiB (95.63%) ETA: 1m8.815639758s
2023-08-25 17:36:21 localagi-api-1  | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.0 GiB/7.3 GiB (95.96%) ETA: 1m3.64973243s
2023-08-25 17:36:26 localagi-api-1  | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.1 GiB/7.3 GiB (96.29%) ETA: 58.478146583s
2023-08-25 17:36:31 localagi-api-1  | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.1 GiB/7.3 GiB (96.61%) ETA: 53.402750696s
2023-08-25 17:36:36 localagi-api-1  | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.1 GiB/7.3 GiB (96.94%) ETA: 48.260231331s
2023-08-25 17:36:41 localagi-api-1  | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.1 GiB/7.3 GiB (97.25%) ETA: 43.368217601s
2023-08-25 17:36:46 localagi-api-1  | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.1 GiB/7.3 GiB (97.58%) ETA: 38.105579603s
2023-08-25 17:36:51 localagi-api-1  | 3:36PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.2 GiB/7.3 GiB (97.92%) ETA: 32.81132063s
2023-08-25 17:37:01 localagi-api-1  | 3:37PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.2 GiB/7.3 GiB (98.17%) ETA: 28.970745549s
2023-08-25 17:37:06 localagi-api-1  | 3:37PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.2 GiB/7.3 GiB (98.52%) ETA: 23.311608499s
2023-08-25 17:37:11 localagi-api-1  | 3:37PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.2 GiB/7.3 GiB (98.88%) ETA: 17.715404274s
2023-08-25 17:37:16 localagi-api-1  | 3:37PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.3 GiB/7.3 GiB (99.22%) ETA: 12.295851605s
2023-08-25 17:37:21 localagi-api-1  | 3:37PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.3 GiB/7.3 GiB (99.57%) ETA: 6.760272639s
2023-08-25 17:37:26 localagi-api-1  | 3:37PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin: 7.3 GiB/7.3 GiB (99.92%) ETA: 1.287626746s
2023-08-25 17:37:27 localagi-api-1  | 3:37PM DBG File "wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin" downloaded and verified
2023-08-25 17:37:27 localagi-api-1  | 3:37PM DBG Prompt template "wizardlm-completion" written
2023-08-25 17:37:27 localagi-api-1  | 3:37PM DBG Prompt template "wizardlm-chat" written
2023-08-25 17:37:27 localagi-api-1  | 3:37PM DBG Written config file /models/gpt-4.yaml
2023-08-25 17:37:42 localagi-api-1  | 3:37PM DBG Checking "stablediffusion_assets/AutoencoderKL-256-256-fp16-opt.param" exists and matches SHA
2023-08-25 17:37:42 localagi-api-1  | 3:37PM DBG Downloading "https://raw.githubusercontent.com/EdVince/Stable-Diffusion-NCNN/main/x86/linux/assets/AutoencoderKL-256-256-fp16-opt.param"
2023-08-25 17:37:42 localagi-api-1  | 3:37PM DBG Downloading: 16.7 KiB
2023-08-25 17:37:42 localagi-api-1  | 3:37PM DBG File "stablediffusion_assets/AutoencoderKL-256-256-fp16-opt.param" downloaded and verified
2023-08-25 17:37:42 localagi-api-1  | 3:37PM DBG Checking "stablediffusion_assets/AutoencoderKL-512-512-fp16-opt.param" exists and matches SHA
2023-08-25 17:37:42 localagi-api-1  | 3:37PM DBG Downloading "https://raw.githubusercontent.com/EdVince/Stable-Diffusion-NCNN/main/x86/linux/assets/AutoencoderKL-512-512-fp16-opt.param"
2023-08-25 17:37:42 localagi-api-1  | 3:37PM DBG File "stablediffusion_assets/AutoencoderKL-512-512-fp16-opt.param" downloaded and verified
2023-08-25 17:37:42 localagi-api-1  | 3:37PM DBG Checking "stablediffusion_assets/AutoencoderKL-base-fp16.param" exists and matches SHA
2023-08-25 17:37:42 localagi-api-1  | 3:37PM DBG Downloading "https://raw.githubusercontent.com/EdVince/Stable-Diffusion-NCNN/main/x86/linux/assets/AutoencoderKL-base-fp16.param"
2023-08-25 17:37:42 localagi-api-1  | 3:37PM DBG File "stablediffusion_assets/AutoencoderKL-base-fp16.param" downloaded and verified
2023-08-25 17:37:42 localagi-api-1  | 3:37PM DBG Checking "stablediffusion_assets/AutoencoderKL-encoder-512-512-fp16.bin" exists and matches SHA
2023-08-25 17:37:42 localagi-api-1  | 3:37PM DBG Downloading "https://github.com/lenaxia/stablediffusion-bins/releases/download/2023.05.24/AutoencoderKL-encoder-512-512-fp16.bin"
2023-08-25 17:37:47 localagi-api-1  | 3:37PM DBG Downloading stablediffusion_assets/AutoencoderKL-encoder-512-512-fp16.bin: 16.7 MiB/65.2 MiB (25.55%) ETA: 56.938166657s
2023-08-25 17:37:52 localagi-api-1  | 3:37PM DBG Downloading stablediffusion_assets/AutoencoderKL-encoder-512-512-fp16.bin: 42.1 MiB/65.2 MiB (64.60%) ETA: 13.446919582s
2023-08-25 17:37:56 localagi-api-1  | 3:37PM DBG File "stablediffusion_assets/AutoencoderKL-encoder-512-512-fp16.bin" downloaded and verified
2023-08-25 17:37:56 localagi-api-1  | 3:37PM DBG Checking "stablediffusion_assets/AutoencoderKL-fp16.bin" exists and matches SHA
2023-08-25 17:37:56 localagi-api-1  | 3:37PM DBG Downloading "https://github.com/lenaxia/stablediffusion-bins/releases/download/2023.05.24/AutoencoderKL-fp16.bin"
2023-08-25 17:37:57 localagi-api-1  | 3:37PM DBG Downloading stablediffusion_assets/AutoencoderKL-fp16.bin: 271.4 KiB/94.5 MiB (0.28%) ETA: 2h55m2.942067667s
2023-08-25 17:38:02 localagi-api-1  | 3:38PM DBG Downloading stablediffusion_assets/AutoencoderKL-fp16.bin: 25.1 MiB/94.5 MiB (26.55%) ETA: 1m35.60086898s
2023-08-25 17:38:07 localagi-api-1  | 3:38PM DBG Downloading stablediffusion_assets/AutoencoderKL-fp16.bin: 50.7 MiB/94.5 MiB (53.71%) ETA: 34.097725835s
2023-08-25 17:38:12 localagi-api-1  | 3:38PM DBG Downloading stablediffusion_assets/AutoencoderKL-fp16.bin: 76.1 MiB/94.5 MiB (80.60%) ETA: 10.725745184s
2023-08-25 17:38:15 localagi-api-1  | 3:38PM DBG File "stablediffusion_assets/AutoencoderKL-fp16.bin" downloaded and verified
2023-08-25 17:38:15 localagi-api-1  | 3:38PM DBG Checking "stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin" exists and matches SHA
2023-08-25 17:38:15 localagi-api-1  | 3:38PM DBG Downloading "https://github.com/lenaxia/stablediffusion-bins/releases/download/2023.05.24/FrozenCLIPEmbedder-fp16.bin"
2023-08-25 17:38:17 localagi-api-1  | 3:38PM DBG Downloading stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin: 5.0 MiB/235.1 MiB (2.13%) ETA: 38m0.9226026s
2023-08-25 17:38:23 localagi-api-1  | 3:38PM DBG Downloading stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin: 25.6 MiB/235.1 MiB (10.90%) ETA: 7m32.960517287s
2023-08-25 17:38:28 localagi-api-1  | 3:38PM DBG Downloading stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin: 51.0 MiB/235.1 MiB (21.71%) ETA: 3m37.898329753s
2023-08-25 17:38:33 localagi-api-1  | 3:38PM DBG Downloading stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin: 76.9 MiB/235.1 MiB (32.71%) ETA: 2m14.553513213s
2023-08-25 17:38:38 localagi-api-1  | 3:38PM DBG Downloading stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin: 103.0 MiB/235.1 MiB (43.83%) ETA: 1m30.258932242s
2023-08-25 17:38:43 localagi-api-1  | 3:38PM DBG Downloading stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin: 128.3 MiB/235.1 MiB (54.58%) ETA: 1m2.767845077s
2023-08-25 17:38:48 localagi-api-1  | 3:38PM DBG Downloading stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin: 154.2 MiB/235.1 MiB (65.60%) ETA: 42.175626662s
2023-08-25 17:38:53 localagi-api-1  | 3:38PM DBG Downloading stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin: 179.7 MiB/235.1 MiB (76.43%) ETA: 26.340457044s
2023-08-25 17:38:58 localagi-api-1  | 3:38PM DBG Downloading stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin: 205.5 MiB/235.1 MiB (87.40%) ETA: 13.036886207s
2023-08-25 17:39:03 localagi-api-1  | 3:39PM DBG Downloading stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin: 231.4 MiB/235.1 MiB (98.43%) ETA: 1.518087126s
2023-08-25 17:39:03 localagi-api-1  | 3:39PM DBG File "stablediffusion_assets/FrozenCLIPEmbedder-fp16.bin" downloaded and verified
2023-08-25 17:39:03 localagi-api-1  | 3:39PM DBG Checking "stablediffusion_assets/FrozenCLIPEmbedder-fp16.param" exists and matches SHA
2023-08-25 17:39:03 localagi-api-1  | 3:39PM DBG Downloading "https://raw.githubusercontent.com/EdVince/Stable-Diffusion-NCNN/main/x86/linux/assets/FrozenCLIPEmbedder-fp16.param"
2023-08-25 17:39:04 localagi-api-1  | 3:39PM DBG File "stablediffusion_assets/FrozenCLIPEmbedder-fp16.param" downloaded and verified
2023-08-25 17:39:04 localagi-api-1  | 3:39PM DBG Checking "stablediffusion_assets/log_sigmas.bin" exists and matches SHA
2023-08-25 17:39:04 localagi-api-1  | 3:39PM DBG Downloading "https://github.com/EdVince/Stable-Diffusion-NCNN/raw/main/x86/linux/assets/log_sigmas.bin"
2023-08-25 17:39:04 localagi-api-1  | 3:39PM DBG File "stablediffusion_assets/log_sigmas.bin" downloaded and verified
2023-08-25 17:39:04 localagi-api-1  | 3:39PM DBG Checking "stablediffusion_assets/UNetModel-256-256-MHA-fp16-opt.param" exists and matches SHA
2023-08-25 17:39:04 localagi-api-1  | 3:39PM DBG Downloading "https://raw.githubusercontent.com/EdVince/Stable-Diffusion-NCNN/main/x86/linux/assets/UNetModel-256-256-MHA-fp16-opt.param"
2023-08-25 17:39:05 localagi-api-1  | 3:39PM DBG File "stablediffusion_assets/UNetModel-256-256-MHA-fp16-opt.param" downloaded and verified
2023-08-25 17:39:05 localagi-api-1  | 3:39PM DBG Checking "stablediffusion_assets/UNetModel-512-512-MHA-fp16-opt.param" exists and matches SHA
2023-08-25 17:39:05 localagi-api-1  | 3:39PM DBG Downloading "https://raw.githubusercontent.com/EdVince/Stable-Diffusion-NCNN/main/x86/linux/assets/UNetModel-512-512-MHA-fp16-opt.param"
2023-08-25 17:39:05 localagi-api-1  | 3:39PM DBG File "stablediffusion_assets/UNetModel-512-512-MHA-fp16-opt.param" downloaded and verified
2023-08-25 17:39:05 localagi-api-1  | 3:39PM DBG Checking "stablediffusion_assets/UNetModel-base-MHA-fp16.param" exists and matches SHA
2023-08-25 17:39:05 localagi-api-1  | 3:39PM DBG Downloading "https://raw.githubusercontent.com/EdVince/Stable-Diffusion-NCNN/main/x86/linux/assets/UNetModel-base-MHA-fp16.param"
2023-08-25 17:39:06 localagi-api-1  | 3:39PM DBG File "stablediffusion_assets/UNetModel-base-MHA-fp16.param" downloaded and verified
2023-08-25 17:39:06 localagi-api-1  | 3:39PM DBG Checking "stablediffusion_assets/UNetModel-MHA-fp16.bin" exists and matches SHA
2023-08-25 17:39:06 localagi-api-1  | 3:39PM DBG Downloading "https://github.com/lenaxia/stablediffusion-bins/releases/download/2023.05.24/UNetModel-MHA-fp16.bin"
2023-08-25 17:39:08 localagi-api-1  | 3:39PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 7.2 MiB/1.6 GiB (0.44%) ETA: 6h17m59.890437293s
2023-08-25 17:39:13 localagi-api-1  | 3:39PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 32.1 MiB/1.6 GiB (1.96%) ETA: 1h27m57.286930339s
2023-08-25 17:39:18 localagi-api-1  | 3:39PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 57.4 MiB/1.6 GiB (3.50%) ETA: 50m47.01494865s
2023-08-25 17:39:23 localagi-api-1  | 3:39PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 83.2 MiB/1.6 GiB (5.07%) ETA: 36m1.059608235s
2023-08-25 17:39:28 localagi-api-1  | 3:39PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 109.0 MiB/1.6 GiB (6.65%) ETA: 28m11.753295591s
2023-08-25 17:39:33 localagi-api-1  | 3:39PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 134.6 MiB/1.6 GiB (8.21%) ETA: 23m23.556231892s
2023-08-25 17:39:38 localagi-api-1  | 3:39PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 160.7 MiB/1.6 GiB (9.80%) ETA: 20m1.080820555s
2023-08-25 17:39:49 localagi-api-1  | 3:39PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 187.2 MiB/1.6 GiB (11.41%) ETA: 18m22.885136281s
2023-08-25 17:39:54 localagi-api-1  | 3:39PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 216.2 MiB/1.6 GiB (13.18%) ETA: 16m8.831553165s
2023-08-25 17:39:59 localagi-api-1  | 3:39PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 245.5 MiB/1.6 GiB (14.96%) ETA: 14m24.031819352s
2023-08-25 17:40:04 localagi-api-1  | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 274.0 MiB/1.6 GiB (16.70%) ETA: 13m3.082703469s
2023-08-25 17:40:09 localagi-api-1  | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 301.9 MiB/1.6 GiB (18.40%) ETA: 11m58.474609491s
2023-08-25 17:40:14 localagi-api-1  | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 327.8 MiB/1.6 GiB (19.98%) ETA: 11m8.924209617s
2023-08-25 17:40:19 localagi-api-1  | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 353.7 MiB/1.6 GiB (21.56%) ETA: 10m25.964267434s
2023-08-25 17:40:24 localagi-api-1  | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 378.8 MiB/1.6 GiB (23.09%) ETA: 9m49.81801908s
2023-08-25 17:40:29 localagi-api-1  | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 404.0 MiB/1.6 GiB (24.63%) ETA: 9m17.265168836s
2023-08-25 17:40:34 localagi-api-1  | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 428.4 MiB/1.6 GiB (26.11%) ETA: 8m49.245471776s
2023-08-25 17:40:39 localagi-api-1  | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 453.1 MiB/1.6 GiB (27.62%) ETA: 8m23.278832925s
2023-08-25 17:40:44 localagi-api-1  | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 477.1 MiB/1.6 GiB (29.08%) ETA: 8m0.587643649s
2023-08-25 17:40:49 localagi-api-1  | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 501.7 MiB/1.6 GiB (30.58%) ETA: 7m38.64961531s
2023-08-25 17:40:54 localagi-api-1  | 3:40PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 526.1 MiB/1.6 GiB (32.07%) ETA: 7m18.598469317s
2023-08-25 17:41:00 localagi-api-1  | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 550.4 MiB/1.6 GiB (33.55%) ETA: 7m0.100599108s
2023-08-25 17:41:05 localagi-api-1  | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 574.1 MiB/1.6 GiB (34.99%) ETA: 6m43.269869452s
2023-08-25 17:41:13 localagi-api-1  | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 587.5 MiB/1.6 GiB (35.81%) ETA: 6m45.060395943s
2023-08-25 17:41:18 localagi-api-1  | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 615.6 MiB/1.6 GiB (37.53%) ETA: 6m24.560687026s
2023-08-25 17:41:23 localagi-api-1  | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 643.4 MiB/1.6 GiB (39.22%) ETA: 6m5.76501277s
2023-08-25 17:41:28 localagi-api-1  | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 672.4 MiB/1.6 GiB (40.99%) ETA: 5m46.987552009s
2023-08-25 17:41:33 localagi-api-1  | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 699.5 MiB/1.6 GiB (42.64%) ETA: 5m30.942787725s
2023-08-25 17:41:38 localagi-api-1  | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 724.3 MiB/1.6 GiB (44.15%) ETA: 5m17.532193502s
2023-08-25 17:41:43 localagi-api-1  | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 749.9 MiB/1.6 GiB (45.71%) ETA: 5m4.070571651s
2023-08-25 17:41:48 localagi-api-1  | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 775.0 MiB/1.6 GiB (47.24%) ETA: 4m51.476391205s
2023-08-25 17:41:56 localagi-api-1  | 3:41PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 783.0 MiB/1.6 GiB (47.73%) ETA: 4m54.376370533s
2023-08-25 17:42:01 localagi-api-1  | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 810.2 MiB/1.6 GiB (49.39%) ETA: 4m40.564825791s
2023-08-25 17:42:06 localagi-api-1  | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 838.3 MiB/1.6 GiB (51.10%) ETA: 4m26.777359484s
2023-08-25 17:42:11 localagi-api-1  | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 866.0 MiB/1.6 GiB (52.79%) ETA: 4m13.771498382s
2023-08-25 17:42:16 localagi-api-1  | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 893.4 MiB/1.6 GiB (54.46%) ETA: 4m1.523535565s
2023-08-25 17:42:21 localagi-api-1  | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 920.8 MiB/1.6 GiB (56.13%) ETA: 3m49.632125383s
2023-08-25 17:42:26 localagi-api-1  | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 947.8 MiB/1.6 GiB (57.77%) ETA: 3m38.376605723s
2023-08-25 17:42:31 localagi-api-1  | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 973.6 MiB/1.6 GiB (59.35%) ETA: 3m28.077383379s
2023-08-25 17:42:36 localagi-api-1  | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 998.8 MiB/1.6 GiB (60.88%) ETA: 3m18.399175565s
2023-08-25 17:42:41 localagi-api-1  | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.0 GiB/1.6 GiB (62.46%) ETA: 3m8.61266218s
2023-08-25 17:42:46 localagi-api-1  | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.0 GiB/1.6 GiB (63.98%) ETA: 2m59.461835272s
2023-08-25 17:42:51 localagi-api-1  | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.0 GiB/1.6 GiB (65.54%) ETA: 2m50.261224507s
2023-08-25 17:42:56 localagi-api-1  | 3:42PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.1 GiB/1.6 GiB (67.11%) ETA: 2m41.172019396s
2023-08-25 17:43:01 localagi-api-1  | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.1 GiB/1.6 GiB (68.64%) ETA: 2m32.4989343s
2023-08-25 17:43:06 localagi-api-1  | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.1 GiB/1.6 GiB (70.23%) ETA: 2m23.606239342s
2023-08-25 17:43:11 localagi-api-1  | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.2 GiB/1.6 GiB (71.82%) ETA: 2m14.873662952s
2023-08-25 17:43:16 localagi-api-1  | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.2 GiB/1.6 GiB (73.32%) ETA: 2m6.894547786s
2023-08-25 17:43:21 localagi-api-1  | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.2 GiB/1.6 GiB (74.84%) ETA: 1m58.926896001s
2023-08-25 17:43:26 localagi-api-1  | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.2 GiB/1.6 GiB (76.31%) ETA: 1m51.394612665s
2023-08-25 17:43:31 localagi-api-1  | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.2 GiB/1.6 GiB (77.79%) ETA: 1m43.853940123s
2023-08-25 17:43:36 localagi-api-1  | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.3 GiB/1.6 GiB (79.26%) ETA: 1m36.519646093s
2023-08-25 17:43:41 localagi-api-1  | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.3 GiB/1.6 GiB (80.76%) ETA: 1m29.084662348s
2023-08-25 17:43:46 localagi-api-1  | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.3 GiB/1.6 GiB (82.27%) ETA: 1m21.652233394s
2023-08-25 17:43:51 localagi-api-1  | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.3 GiB/1.6 GiB (83.83%) ETA: 1m14.026745s
2023-08-25 17:43:56 localagi-api-1  | 3:43PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.4 GiB/1.6 GiB (85.38%) ETA: 1m6.568601149s
2023-08-25 17:44:01 localagi-api-1  | 3:44PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.4 GiB/1.6 GiB (86.92%) ETA: 59.25735593s
2023-08-25 17:44:06 localagi-api-1  | 3:44PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.4 GiB/1.6 GiB (88.47%) ETA: 51.98745797s
2023-08-25 17:44:11 localagi-api-1  | 3:44PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.4 GiB/1.6 GiB (90.02%) ETA: 44.776780455s
2023-08-25 17:44:16 localagi-api-1  | 3:44PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.5 GiB/1.6 GiB (91.53%) ETA: 37.826817273s
2023-08-25 17:44:21 localagi-api-1  | 3:44PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.5 GiB/1.6 GiB (93.08%) ETA: 30.758091622s
2023-08-25 17:44:26 localagi-api-1  | 3:44PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.5 GiB/1.6 GiB (94.66%) ETA: 23.65020277s
2023-08-25 17:44:31 localagi-api-1  | 3:44PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.5 GiB/1.6 GiB (96.19%) ETA: 16.785389539s
2023-08-25 17:44:36 localagi-api-1  | 3:44PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.6 GiB/1.6 GiB (97.80%) ETA: 9.645912666s
2023-08-25 17:44:45 localagi-api-1  | 3:44PM DBG Downloading stablediffusion_assets/UNetModel-MHA-fp16.bin: 1.6 GiB/1.6 GiB (98.69%) ETA: 5.814153569s
2023-08-25 17:44:49 localagi-api-1  | 3:44PM DBG File "stablediffusion_assets/UNetModel-MHA-fp16.bin" downloaded and verified
2023-08-25 17:44:49 localagi-api-1  | 3:44PM DBG Checking "stablediffusion_assets/vocab.txt" exists and matches SHA
2023-08-25 17:44:49 localagi-api-1  | 3:44PM DBG Downloading "https://raw.githubusercontent.com/EdVince/Stable-Diffusion-NCNN/main/x86/linux/assets/vocab.txt"
2023-08-25 17:44:49 localagi-api-1  | 3:44PM DBG File "stablediffusion_assets/vocab.txt" downloaded and verified
2023-08-25 17:44:49 localagi-api-1  | 3:44PM DBG Written config file /models/stablediffusion.yaml
2023-08-25 17:44:58 localagi-api-1  | 3:44PM DBG Checking "voice-en-us-kathleen-low.tar.gz" exists and matches SHA
2023-08-25 17:44:58 localagi-api-1  | 3:44PM DBG Downloading "https://github.com/rhasspy/piper/releases/download/v0.0.2/voice-en-us-kathleen-low.tar.gz"
2023-08-25 17:44:58 localagi-api-1  | 3:44PM DBG Downloading voice-en-us-kathleen-low.tar.gz: 32.0 KiB/55.6 MiB (0.06%) ETA: 4h30m12.935090177s
2023-08-25 17:45:03 localagi-api-1  | 3:45PM DBG Downloading voice-en-us-kathleen-low.tar.gz: 29.8 MiB/55.6 MiB (53.57%) ETA: 12.245668299s
2023-08-25 17:45:08 localagi-api-1  | 3:45PM DBG SHA missing for "voice-en-us-kathleen-low.tar.gz". Skipping validation
2023-08-25 17:45:08 localagi-api-1  | 3:45PM DBG File "voice-en-us-kathleen-low.tar.gz" downloaded and verified
2023-08-25 17:45:08 localagi-api-1  | 3:45PM DBG File "voice-en-us-kathleen-low.tar.gz" is an archive, uncompressing to /models
2023-08-25 17:45:16 localagi-api-1  | 3:45PM DBG Config overrides map[backend:huggingface-embeddings embeddings:true parameters:map[model:all-MiniLM-L6-v2]]
2023-08-25 17:45:16 localagi-api-1  | 3:45PM DBG Prompt template "completion" written
2023-08-25 17:45:16 localagi-api-1  | 3:45PM DBG Prompt template "chat" written
2023-08-25 17:45:16 localagi-api-1  | 3:45PM DBG Written config file /models/all-MiniLM-L6-v2.yaml
2023-08-25 17:45:25 localagi-api-1  | 3:45PM DBG Config overrides map[context_size:2048 f16:true function:map[disable_no_action:true] mirostat:2 mirostat_eta:0.1 mirostat_tau:5 mmap:true parameters:map[model:wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin temperature:0.1 top_k:40 top_p:0.95] roles:map[assistant:ASSISTANT: assistant_function_call:FUNCTION_CALL: function:FUNCTION CALL RESULT: system:SYSTEM:] template:map[chat: completion:]]
2023-08-25 17:45:25 localagi-api-1  | 3:45PM DBG Checking "wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin" exists and matches SHA
2023-08-25 17:45:25 localagi-api-1  | 3:45PM DBG Downloading "https://huggingface.co/TheBloke/WizardLM-13B-V1.0-Uncensored-GGML/resolve/main/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin"
2023-08-25 17:45:26 localagi-api-1  | 3:45PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 32.0 KiB/6.8 GiB (0.00%) ETA: 614h52m19.040349984s
2023-08-25 17:45:31 localagi-api-1  | 3:45PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 29.3 MiB/6.8 GiB (0.42%) ETA: 58m53.562987733s
2023-08-25 17:45:36 localagi-api-1  | 3:45PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 56.8 MiB/6.8 GiB (0.81%) ETA: 40m26.193791576s
2023-08-25 17:45:41 localagi-api-1  | 3:45PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 84.0 MiB/6.8 GiB (1.20%) ETA: 34m7.085027374s
2023-08-25 17:45:46 localagi-api-1  | 3:45PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 110.0 MiB/6.8 GiB (1.58%) ETA: 31m8.715846813s
2023-08-25 17:45:51 localagi-api-1  | 3:45PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 135.4 MiB/6.8 GiB (1.94%) ETA: 29m25.856540429s
2023-08-25 17:45:56 localagi-api-1  | 3:45PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 160.6 MiB/6.8 GiB (2.30%) ETA: 28m16.084889081s
2023-08-25 17:46:01 localagi-api-1  | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 185.8 MiB/6.8 GiB (2.66%) ETA: 27m23.353737309s
2023-08-25 17:46:09 localagi-api-1  | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 197.8 MiB/6.8 GiB (2.83%) ETA: 30m34.838834555s
2023-08-25 17:46:14 localagi-api-1  | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 224.8 MiB/6.8 GiB (3.22%) ETA: 29m18.312524751s
2023-08-25 17:46:19 localagi-api-1  | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 252.4 MiB/6.8 GiB (3.61%) ETA: 28m13.29145975s
2023-08-25 17:46:24 localagi-api-1  | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 280.7 MiB/6.8 GiB (4.02%) ETA: 27m15.764827334s
2023-08-25 17:46:29 localagi-api-1  | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 307.7 MiB/6.8 GiB (4.41%) ETA: 26m34.20106392s
2023-08-25 17:46:34 localagi-api-1  | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 334.9 MiB/6.8 GiB (4.79%) ETA: 25m58.510846915s
2023-08-25 17:46:39 localagi-api-1  | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 360.4 MiB/6.8 GiB (5.16%) ETA: 25m34.304463107s
2023-08-25 17:46:44 localagi-api-1  | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 385.8 MiB/6.8 GiB (5.52%) ETA: 25m13.63422926s
2023-08-25 17:46:49 localagi-api-1  | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 396.9 MiB/6.8 GiB (5.68%) ETA: 25m51.680304828s
2023-08-25 17:46:54 localagi-api-1  | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 422.9 MiB/6.8 GiB (6.05%) ETA: 25m28.241492514s
2023-08-25 17:46:59 localagi-api-1  | 3:46PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 449.6 MiB/6.8 GiB (6.44%) ETA: 25m4.252377344s
2023-08-25 17:47:04 localagi-api-1  | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 475.8 MiB/6.8 GiB (6.81%) ETA: 24m44.079224197s
2023-08-25 17:47:09 localagi-api-1  | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 501.5 MiB/6.8 GiB (7.18%) ETA: 24m27.156780518s
2023-08-25 17:47:14 localagi-api-1  | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 527.6 MiB/6.8 GiB (7.55%) ETA: 24m10.125181485s
2023-08-25 17:47:19 localagi-api-1  | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 553.6 MiB/6.8 GiB (7.93%) ETA: 23m54.734561213s
2023-08-25 17:47:24 localagi-api-1  | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 580.5 MiB/6.8 GiB (8.31%) ETA: 23m37.701889286s
2023-08-25 17:47:29 localagi-api-1  | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 604.5 MiB/6.8 GiB (8.66%) ETA: 23m29.084928037s
2023-08-25 17:47:34 localagi-api-1  | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 626.5 MiB/6.8 GiB (8.97%) ETA: 23m25.662018804s
2023-08-25 17:47:39 localagi-api-1  | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 646.9 MiB/6.8 GiB (9.26%) ETA: 23m25.944030306s
2023-08-25 17:47:44 localagi-api-1  | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 667.6 MiB/6.8 GiB (9.56%) ETA: 23m25.214801587s
2023-08-25 17:47:49 localagi-api-1  | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 684.9 MiB/6.8 GiB (9.81%) ETA: 23m32.059327738s
2023-08-25 17:47:54 localagi-api-1  | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 702.2 MiB/6.8 GiB (10.05%) ETA: 23m38.267074715s
2023-08-25 17:47:59 localagi-api-1  | 3:47PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 719.0 MiB/6.8 GiB (10.29%) ETA: 23m45.088227298s
2023-08-25 17:48:04 localagi-api-1  | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 735.3 MiB/6.8 GiB (10.53%) ETA: 23m52.366225392s
2023-08-25 17:48:09 localagi-api-1  | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 748.5 MiB/6.8 GiB (10.72%) ETA: 24m5.789634092s
2023-08-25 17:48:14 localagi-api-1  | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 755.9 MiB/6.8 GiB (10.82%) ETA: 24m31.255451005s
2023-08-25 17:48:19 localagi-api-1  | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 771.7 MiB/6.8 GiB (11.05%) ETA: 24m37.719377079s
2023-08-25 17:48:24 localagi-api-1  | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 777.9 MiB/6.8 GiB (11.14%) ETA: 25m4.775894072s
2023-08-25 17:48:29 localagi-api-1  | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 789.5 MiB/6.8 GiB (11.30%) ETA: 25m19.083901564s
2023-08-25 17:48:34 localagi-api-1  | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 807.5 MiB/6.8 GiB (11.56%) ETA: 25m19.300396497s
2023-08-25 17:48:39 localagi-api-1  | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 826.7 MiB/6.8 GiB (11.84%) ETA: 25m16.505580285s
2023-08-25 17:48:44 localagi-api-1  | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 847.4 MiB/6.8 GiB (12.13%) ETA: 25m10.741555212s
2023-08-25 17:48:49 localagi-api-1  | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 869.8 MiB/6.8 GiB (12.45%) ETA: 25m1.660771614s
2023-08-25 17:48:54 localagi-api-1  | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 891.1 MiB/6.8 GiB (12.76%) ETA: 24m54.81318706s
2023-08-25 17:48:59 localagi-api-1  | 3:48PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 907.9 MiB/6.8 GiB (13.00%) ETA: 24m56.714185144s
2023-08-25 17:49:04 localagi-api-1  | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 925.2 MiB/6.8 GiB (13.25%) ETA: 24m57.257341449s
2023-08-25 17:49:09 localagi-api-1  | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 942.6 MiB/6.8 GiB (13.50%) ETA: 24m57.448848322s
2023-08-25 17:49:14 localagi-api-1  | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 959.4 MiB/6.8 GiB (13.74%) ETA: 24m58.734426286s
2023-08-25 17:49:19 localagi-api-1  | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 977.8 MiB/6.8 GiB (14.00%) ETA: 24m56.658442969s
2023-08-25 17:49:24 localagi-api-1  | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 995.5 MiB/6.8 GiB (14.25%) ETA: 24m55.762827266s
2023-08-25 17:49:29 localagi-api-1  | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1012.4 MiB/6.8 GiB (14.50%) ETA: 24m56.212050715s
2023-08-25 17:49:34 localagi-api-1  | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.0 GiB/6.8 GiB (14.78%) ETA: 24m51.156651539s
2023-08-25 17:49:39 localagi-api-1  | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.0 GiB/6.8 GiB (15.08%) ETA: 24m45.25550841s
2023-08-25 17:49:44 localagi-api-1  | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.0 GiB/6.8 GiB (15.31%) ETA: 24m46.648610092s
2023-08-25 17:49:49 localagi-api-1  | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.0 GiB/6.8 GiB (15.39%) ETA: 25m5.069933867s
2023-08-25 17:49:54 localagi-api-1  | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.1 GiB/6.8 GiB (15.60%) ETA: 25m7.851151984s
2023-08-25 17:49:59 localagi-api-1  | 3:49PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.1 GiB/6.8 GiB (15.91%) ETA: 24m59.843546032s
2023-08-25 17:50:04 localagi-api-1  | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.1 GiB/6.8 GiB (16.19%) ETA: 24m54.932627035s
2023-08-25 17:50:09 localagi-api-1  | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.1 GiB/6.8 GiB (16.42%) ETA: 24m55.104952647s
2023-08-25 17:50:14 localagi-api-1  | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.1 GiB/6.8 GiB (16.67%) ETA: 24m53.861627663s
2023-08-25 17:50:19 localagi-api-1  | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.1 GiB/6.8 GiB (16.80%) ETA: 25m4.536074904s
2023-08-25 17:50:24 localagi-api-1  | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.2 GiB/6.8 GiB (17.05%) ETA: 25m2.056516166s
2023-08-25 17:50:29 localagi-api-1  | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.2 GiB/6.8 GiB (17.33%) ETA: 24m56.314692485s
2023-08-25 17:50:34 localagi-api-1  | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.2 GiB/6.8 GiB (17.62%) ETA: 24m50.148371411s
2023-08-25 17:50:39 localagi-api-1  | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.2 GiB/6.8 GiB (17.92%) ETA: 24m42.732668761s
2023-08-25 17:50:45 localagi-api-1  | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.2 GiB/6.8 GiB (18.22%) ETA: 24m35.131474208s
2023-08-25 17:50:50 localagi-api-1  | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.3 GiB/6.8 GiB (18.55%) ETA: 24m25.959062061s
2023-08-25 17:50:55 localagi-api-1  | 3:50PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.3 GiB/6.8 GiB (18.88%) ETA: 24m15.639683608s
2023-08-25 17:51:00 localagi-api-1  | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.3 GiB/6.8 GiB (19.22%) ETA: 24m5.30559338s
2023-08-25 17:51:05 localagi-api-1  | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.3 GiB/6.8 GiB (19.54%) ETA: 23m56.33904647s
2023-08-25 17:51:10 localagi-api-1  | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.4 GiB/6.8 GiB (19.86%) ETA: 23m47.249835957s
2023-08-25 17:51:15 localagi-api-1  | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.4 GiB/6.8 GiB (20.18%) ETA: 23m39.000545325s
2023-08-25 17:51:20 localagi-api-1  | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.4 GiB/6.8 GiB (20.51%) ETA: 23m29.621017321s
2023-08-25 17:51:25 localagi-api-1  | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.4 GiB/6.8 GiB (20.83%) ETA: 23m21.431435087s
2023-08-25 17:51:30 localagi-api-1  | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.4 GiB/6.8 GiB (21.15%) ETA: 23m13.763702334s
2023-08-25 17:51:35 localagi-api-1  | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.5 GiB/6.8 GiB (21.46%) ETA: 23m6.45824725s
2023-08-25 17:51:40 localagi-api-1  | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.5 GiB/6.8 GiB (21.71%) ETA: 23m4.302905075s
2023-08-25 17:51:46 localagi-api-1  | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.5 GiB/6.8 GiB (21.75%) ETA: 23m25.659225723s
2023-08-25 17:51:51 localagi-api-1  | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.5 GiB/6.8 GiB (22.06%) ETA: 23m18.076507891s
2023-08-25 17:51:56 localagi-api-1  | 3:51PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.5 GiB/6.8 GiB (22.38%) ETA: 23m9.723191308s
2023-08-25 17:52:01 localagi-api-1  | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.5 GiB/6.8 GiB (22.70%) ETA: 23m0.890955399s
2023-08-25 17:52:06 localagi-api-1  | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.6 GiB/6.8 GiB (23.04%) ETA: 22m51.898918337s
2023-08-25 17:52:11 localagi-api-1  | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.6 GiB/6.8 GiB (23.36%) ETA: 22m43.736657334s
2023-08-25 17:52:16 localagi-api-1  | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.6 GiB/6.8 GiB (23.66%) ETA: 22m36.969808172s
2023-08-25 17:52:21 localagi-api-1  | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.6 GiB/6.8 GiB (23.97%) ETA: 22m30.076277514s
2023-08-25 17:52:26 localagi-api-1  | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.7 GiB/6.8 GiB (24.28%) ETA: 22m23.113157142s
2023-08-25 17:52:31 localagi-api-1  | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.7 GiB/6.8 GiB (24.57%) ETA: 22m17.379214499s
2023-08-25 17:52:36 localagi-api-1  | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.7 GiB/6.8 GiB (24.86%) ETA: 22m11.701384074s
2023-08-25 17:52:41 localagi-api-1  | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.7 GiB/6.8 GiB (25.16%) ETA: 22m5.734602425s
2023-08-25 17:52:46 localagi-api-1  | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.7 GiB/6.8 GiB (25.44%) ETA: 22m0.615750964s
2023-08-25 17:52:51 localagi-api-1  | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.8 GiB/6.8 GiB (25.73%) ETA: 21m55.011226301s
2023-08-25 17:52:56 localagi-api-1  | 3:52PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.8 GiB/6.8 GiB (26.03%) ETA: 21m48.981109654s
2023-08-25 17:53:01 localagi-api-1  | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.8 GiB/6.8 GiB (26.33%) ETA: 21m43.234211947s
2023-08-25 17:53:09 localagi-api-1  | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.8 GiB/6.8 GiB (26.60%) ETA: 21m44.85644611s
2023-08-25 17:53:14 localagi-api-1  | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.8 GiB/6.8 GiB (26.90%) ETA: 21m38.916124492s
2023-08-25 17:53:19 localagi-api-1  | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.9 GiB/6.8 GiB (27.20%) ETA: 21m32.105912939s
2023-08-25 17:53:24 localagi-api-1  | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.9 GiB/6.8 GiB (27.52%) ETA: 21m25.005707793s
2023-08-25 17:53:29 localagi-api-1  | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.9 GiB/6.8 GiB (27.83%) ETA: 21m17.912107128s
2023-08-25 17:53:34 localagi-api-1  | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.9 GiB/6.8 GiB (28.14%) ETA: 21m11.321791611s
2023-08-25 17:53:39 localagi-api-1  | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 1.9 GiB/6.8 GiB (28.46%) ETA: 21m3.93448686s
2023-08-25 17:53:44 localagi-api-1  | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.0 GiB/6.8 GiB (28.78%) ETA: 20m56.98373563s
2023-08-25 17:53:49 localagi-api-1  | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.0 GiB/6.8 GiB (29.09%) ETA: 20m50.416393521s
2023-08-25 17:53:54 localagi-api-1  | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.0 GiB/6.8 GiB (29.41%) ETA: 20m43.381401303s
2023-08-25 17:53:59 localagi-api-1  | 3:53PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.0 GiB/6.8 GiB (29.71%) ETA: 20m37.152239049s
2023-08-25 17:54:04 localagi-api-1  | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.0 GiB/6.8 GiB (29.98%) ETA: 20m32.817981929s
2023-08-25 17:54:09 localagi-api-1  | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.1 GiB/6.8 GiB (30.26%) ETA: 20m28.049910642s
2023-08-25 17:54:14 localagi-api-1  | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.1 GiB/6.8 GiB (30.53%) ETA: 20m24.004479208s
2023-08-25 17:54:19 localagi-api-1  | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.1 GiB/6.8 GiB (30.80%) ETA: 20m20.062819647s
2023-08-25 17:54:24 localagi-api-1  | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.1 GiB/6.8 GiB (31.07%) ETA: 20m15.500767517s
2023-08-25 17:54:29 localagi-api-1  | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.1 GiB/6.8 GiB (31.34%) ETA: 20m11.224202546s
2023-08-25 17:54:34 localagi-api-1  | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.2 GiB/6.8 GiB (31.61%) ETA: 20m6.844568665s
2023-08-25 17:54:39 localagi-api-1  | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.2 GiB/6.8 GiB (31.89%) ETA: 20m2.383315912s
2023-08-25 17:54:44 localagi-api-1  | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.2 GiB/6.8 GiB (32.19%) ETA: 19m56.636977835s
2023-08-25 17:54:49 localagi-api-1  | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.2 GiB/6.8 GiB (32.47%) ETA: 19m51.487288471s
2023-08-25 17:54:54 localagi-api-1  | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.2 GiB/6.8 GiB (32.76%) ETA: 19m46.168736556s
2023-08-25 17:54:59 localagi-api-1  | 3:54PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.3 GiB/6.8 GiB (33.07%) ETA: 19m39.914101608s
2023-08-25 17:55:04 localagi-api-1  | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.3 GiB/6.8 GiB (33.38%) ETA: 19m33.612478728s
2023-08-25 17:55:09 localagi-api-1  | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.3 GiB/6.8 GiB (33.69%) ETA: 19m27.196363002s
2023-08-25 17:55:15 localagi-api-1  | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.3 GiB/6.8 GiB (33.89%) ETA: 19m28.007308085s
2023-08-25 17:55:20 localagi-api-1  | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.3 GiB/6.8 GiB (34.21%) ETA: 19m21.357373415s
2023-08-25 17:55:25 localagi-api-1  | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.4 GiB/6.8 GiB (34.54%) ETA: 19m13.936370629s
2023-08-25 17:55:30 localagi-api-1  | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.4 GiB/6.8 GiB (34.87%) ETA: 19m6.572813151s
2023-08-25 17:55:35 localagi-api-1  | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.4 GiB/6.8 GiB (35.19%) ETA: 18m59.55307753s
2023-08-25 17:55:40 localagi-api-1  | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.4 GiB/6.8 GiB (35.52%) ETA: 18m52.354750762s
2023-08-25 17:55:45 localagi-api-1  | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.4 GiB/6.8 GiB (35.83%) ETA: 18m46.287884185s
2023-08-25 17:55:50 localagi-api-1  | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.5 GiB/6.8 GiB (36.13%) ETA: 18m40.327528666s
2023-08-25 17:55:55 localagi-api-1  | 3:55PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.5 GiB/6.8 GiB (36.44%) ETA: 18m34.582194394s
2023-08-25 17:56:00 localagi-api-1  | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.5 GiB/6.8 GiB (36.57%) ETA: 18m36.97730824s
2023-08-25 17:56:05 localagi-api-1  | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.5 GiB/6.8 GiB (36.85%) ETA: 18m31.953734017s
2023-08-25 17:56:10 localagi-api-1  | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.5 GiB/6.8 GiB (37.14%) ETA: 18m26.7178465s
2023-08-25 17:56:15 localagi-api-1  | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.6 GiB/6.8 GiB (37.43%) ETA: 18m21.333355991s
2023-08-25 17:56:20 localagi-api-1  | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.6 GiB/6.8 GiB (37.72%) ETA: 18m16.337356877s
2023-08-25 17:56:25 localagi-api-1  | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.6 GiB/6.8 GiB (38.00%) ETA: 18m11.300524768s
2023-08-25 17:56:30 localagi-api-1  | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.6 GiB/6.8 GiB (38.29%) ETA: 18m6.113650471s
2023-08-25 17:56:35 localagi-api-1  | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.6 GiB/6.8 GiB (38.59%) ETA: 18m0.581502712s
2023-08-25 17:56:40 localagi-api-1  | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.6 GiB/6.8 GiB (38.73%) ETA: 18m2.097905662s
2023-08-25 17:56:45 localagi-api-1  | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.7 GiB/6.8 GiB (39.00%) ETA: 17m57.837553421s
2023-08-25 17:56:50 localagi-api-1  | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.7 GiB/6.8 GiB (39.29%) ETA: 17m52.586951028s
2023-08-25 17:56:55 localagi-api-1  | 3:56PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.7 GiB/6.8 GiB (39.57%) ETA: 17m47.585849956s
2023-08-25 17:57:00 localagi-api-1  | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.7 GiB/6.8 GiB (39.87%) ETA: 17m42.000951679s
2023-08-25 17:57:05 localagi-api-1  | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.7 GiB/6.8 GiB (40.16%) ETA: 17m36.612665656s
2023-08-25 17:57:10 localagi-api-1  | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.8 GiB/6.8 GiB (40.46%) ETA: 17m30.753236951s
2023-08-25 17:57:15 localagi-api-1  | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.8 GiB/6.8 GiB (40.76%) ETA: 17m25.252370198s
2023-08-25 17:57:20 localagi-api-1  | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.8 GiB/6.8 GiB (41.05%) ETA: 17m19.907245261s
2023-08-25 17:57:25 localagi-api-1  | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.8 GiB/6.8 GiB (41.34%) ETA: 17m14.75974087s
2023-08-25 17:57:30 localagi-api-1  | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.8 GiB/6.8 GiB (41.62%) ETA: 17m9.789433337s
2023-08-25 17:57:35 localagi-api-1  | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.9 GiB/6.8 GiB (41.90%) ETA: 17m5.110573113s
2023-08-25 17:57:40 localagi-api-1  | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.9 GiB/6.8 GiB (42.17%) ETA: 17m0.427255164s
2023-08-25 17:57:45 localagi-api-1  | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.9 GiB/6.8 GiB (42.46%) ETA: 16m55.43891319s
2023-08-25 17:57:50 localagi-api-1  | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.9 GiB/6.8 GiB (42.73%) ETA: 16m50.834745697s
2023-08-25 17:57:55 localagi-api-1  | 3:57PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 2.9 GiB/6.8 GiB (43.01%) ETA: 16m46.160252203s
2023-08-25 17:58:00 localagi-api-1  | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.0 GiB/6.8 GiB (43.29%) ETA: 16m41.217654738s
2023-08-25 17:58:07 localagi-api-1  | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.0 GiB/6.8 GiB (43.34%) ETA: 16m48.259185605s
2023-08-25 17:58:12 localagi-api-1  | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.0 GiB/6.8 GiB (43.66%) ETA: 16m41.769766152s
2023-08-25 17:58:17 localagi-api-1  | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.0 GiB/6.8 GiB (43.98%) ETA: 16m35.359351352s
2023-08-25 17:58:22 localagi-api-1  | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.0 GiB/6.8 GiB (44.30%) ETA: 16m28.534509825s
2023-08-25 17:58:27 localagi-api-1  | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.0 GiB/6.8 GiB (44.63%) ETA: 16m21.769909449s
2023-08-25 17:58:32 localagi-api-1  | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.1 GiB/6.8 GiB (44.94%) ETA: 16m15.683075482s
2023-08-25 17:58:37 localagi-api-1  | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.1 GiB/6.8 GiB (45.21%) ETA: 16m11.083112347s
2023-08-25 17:58:42 localagi-api-1  | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.1 GiB/6.8 GiB (45.51%) ETA: 16m5.434041376s
2023-08-25 17:58:47 localagi-api-1  | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.1 GiB/6.8 GiB (45.78%) ETA: 16m0.902770047s
2023-08-25 17:58:52 localagi-api-1  | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.1 GiB/6.8 GiB (46.04%) ETA: 15m56.739178012s
2023-08-25 17:58:57 localagi-api-1  | 3:58PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.2 GiB/6.8 GiB (46.30%) ETA: 15m52.467389484s
2023-08-25 17:59:02 localagi-api-1  | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.2 GiB/6.8 GiB (46.58%) ETA: 15m47.790774876s
2023-08-25 17:59:07 localagi-api-1  | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.2 GiB/6.8 GiB (46.82%) ETA: 15m44.145870079s
2023-08-25 17:59:12 localagi-api-1  | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.2 GiB/6.8 GiB (47.05%) ETA: 15m41.206626327s
2023-08-25 17:59:17 localagi-api-1  | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.2 GiB/6.8 GiB (47.26%) ETA: 15m38.983179602s
2023-08-25 17:59:22 localagi-api-1  | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.2 GiB/6.8 GiB (47.46%) ETA: 15m36.937692259s
2023-08-25 17:59:27 localagi-api-1  | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.3 GiB/6.8 GiB (47.67%) ETA: 15m34.737070156s
2023-08-25 17:59:32 localagi-api-1  | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.3 GiB/6.8 GiB (47.85%) ETA: 15m33.32879484s
2023-08-25 17:59:37 localagi-api-1  | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.3 GiB/6.8 GiB (48.02%) ETA: 15m32.496607183s
2023-08-25 17:59:42 localagi-api-1  | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.3 GiB/6.8 GiB (48.10%) ETA: 15m34.747064941s
2023-08-25 17:59:47 localagi-api-1  | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.3 GiB/6.8 GiB (48.28%) ETA: 15m33.680546627s
2023-08-25 17:59:52 localagi-api-1  | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.3 GiB/6.8 GiB (48.46%) ETA: 15m32.056156998s
2023-08-25 17:59:57 localagi-api-1  | 3:59PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.3 GiB/6.8 GiB (48.66%) ETA: 15m29.988031538s
2023-08-25 18:00:02 localagi-api-1  | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.3 GiB/6.8 GiB (48.86%) ETA: 15m27.890348455s
2023-08-25 18:00:13 localagi-api-1  | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.3 GiB/6.8 GiB (49.07%) ETA: 15m31.606490288s
2023-08-25 18:00:18 localagi-api-1  | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.4 GiB/6.8 GiB (49.30%) ETA: 15m28.107022753s
2023-08-25 18:00:23 localagi-api-1  | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.4 GiB/6.8 GiB (49.56%) ETA: 15m23.53524591s
2023-08-25 18:00:28 localagi-api-1  | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.4 GiB/6.8 GiB (49.83%) ETA: 15m18.578561154s
2023-08-25 18:00:33 localagi-api-1  | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.4 GiB/6.8 GiB (50.12%) ETA: 15m13.306949066s
2023-08-25 18:00:38 localagi-api-1  | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.4 GiB/6.8 GiB (50.41%) ETA: 15m7.524497412s
2023-08-25 18:00:43 localagi-api-1  | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.5 GiB/6.8 GiB (50.70%) ETA: 15m1.969624599s
2023-08-25 18:00:48 localagi-api-1  | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.5 GiB/6.8 GiB (50.99%) ETA: 14m56.391647821s
2023-08-25 18:00:53 localagi-api-1  | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.5 GiB/6.8 GiB (51.29%) ETA: 14m50.291923361s
2023-08-25 18:00:58 localagi-api-1  | 4:00PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.5 GiB/6.8 GiB (51.57%) ETA: 14m45.218338962s
2023-08-25 18:01:03 localagi-api-1  | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.5 GiB/6.8 GiB (51.85%) ETA: 14m40.085193323s
2023-08-25 18:01:08 localagi-api-1  | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.6 GiB/6.8 GiB (52.14%) ETA: 14m34.293876557s
2023-08-25 18:01:13 localagi-api-1  | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.6 GiB/6.8 GiB (52.45%) ETA: 14m28.073762252s
2023-08-25 18:01:18 localagi-api-1  | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.6 GiB/6.8 GiB (52.75%) ETA: 14m22.115468631s
2023-08-25 18:01:23 localagi-api-1  | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.6 GiB/6.8 GiB (53.05%) ETA: 14m16.278394391s
2023-08-25 18:01:28 localagi-api-1  | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.6 GiB/6.8 GiB (53.34%) ETA: 14m10.726885056s
2023-08-25 18:01:34 localagi-api-1  | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.6 GiB/6.8 GiB (53.51%) ETA: 14m9.550513848s
2023-08-25 18:01:39 localagi-api-1  | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.7 GiB/6.8 GiB (53.82%) ETA: 14m3.518252548s
2023-08-25 18:01:44 localagi-api-1  | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.7 GiB/6.8 GiB (54.13%) ETA: 13m57.174044755s
2023-08-25 18:01:49 localagi-api-1  | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.7 GiB/6.8 GiB (54.42%) ETA: 13m51.731530367s
2023-08-25 18:01:54 localagi-api-1  | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.7 GiB/6.8 GiB (54.71%) ETA: 13m46.117925225s
2023-08-25 18:01:59 localagi-api-1  | 4:01PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.7 GiB/6.8 GiB (54.95%) ETA: 13m42.272999701s
2023-08-25 18:02:04 localagi-api-1  | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.8 GiB/6.8 GiB (55.18%) ETA: 13m38.701071288s
2023-08-25 18:02:09 localagi-api-1  | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.8 GiB/6.8 GiB (55.39%) ETA: 13m35.693754726s
2023-08-25 18:02:16 localagi-api-1  | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.8 GiB/6.8 GiB (55.60%) ETA: 13m34.435797394s
2023-08-25 18:02:21 localagi-api-1  | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.8 GiB/6.8 GiB (55.79%) ETA: 13m32.154217308s
2023-08-25 18:02:26 localagi-api-1  | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.8 GiB/6.8 GiB (56.00%) ETA: 13m29.481735915s
2023-08-25 18:02:31 localagi-api-1  | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.8 GiB/6.8 GiB (56.23%) ETA: 13m25.708748348s
2023-08-25 18:02:36 localagi-api-1  | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.9 GiB/6.8 GiB (56.46%) ETA: 13m22.090860913s
2023-08-25 18:02:41 localagi-api-1  | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.9 GiB/6.8 GiB (56.67%) ETA: 13m19.011460843s
2023-08-25 18:02:46 localagi-api-1  | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.9 GiB/6.8 GiB (56.90%) ETA: 13m15.549359171s
2023-08-25 18:02:51 localagi-api-1  | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.9 GiB/6.8 GiB (57.11%) ETA: 13m12.426732692s
2023-08-25 18:02:56 localagi-api-1  | 4:02PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.9 GiB/6.8 GiB (57.34%) ETA: 13m8.655749443s
2023-08-25 18:03:01 localagi-api-1  | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.9 GiB/6.8 GiB (57.54%) ETA: 13m5.821821024s
2023-08-25 18:03:06 localagi-api-1  | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 3.9 GiB/6.8 GiB (57.77%) ETA: 13m2.340846741s
2023-08-25 18:03:11 localagi-api-1  | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.0 GiB/6.8 GiB (58.01%) ETA: 12m58.220907395s
2023-08-25 18:03:16 localagi-api-1  | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.0 GiB/6.8 GiB (58.23%) ETA: 12m54.70794477s
2023-08-25 18:03:21 localagi-api-1  | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.0 GiB/6.8 GiB (58.45%) ETA: 12m51.292111935s
2023-08-25 18:03:26 localagi-api-1  | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.0 GiB/6.8 GiB (58.69%) ETA: 12m47.324531711s
2023-08-25 18:03:31 localagi-api-1  | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.0 GiB/6.8 GiB (58.94%) ETA: 12m43.070612456s
2023-08-25 18:03:36 localagi-api-1  | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.0 GiB/6.8 GiB (59.20%) ETA: 12m38.1792959s
2023-08-25 18:03:44 localagi-api-1  | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.0 GiB/6.8 GiB (59.34%) ETA: 12m39.827562348s
2023-08-25 18:03:49 localagi-api-1  | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.1 GiB/6.8 GiB (59.65%) ETA: 12m33.454715319s
2023-08-25 18:03:54 localagi-api-1  | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.1 GiB/6.8 GiB (59.97%) ETA: 12m26.625994889s
2023-08-25 18:03:59 localagi-api-1  | 4:03PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.1 GiB/6.8 GiB (60.31%) ETA: 12m19.565248914s
2023-08-25 18:04:04 localagi-api-1  | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.1 GiB/6.8 GiB (60.63%) ETA: 12m12.790517847s
2023-08-25 18:04:09 localagi-api-1  | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.2 GiB/6.8 GiB (60.97%) ETA: 12m5.870761896s
2023-08-25 18:04:14 localagi-api-1  | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.2 GiB/6.8 GiB (61.29%) ETA: 11m59.082871981s
2023-08-25 18:04:19 localagi-api-1  | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.2 GiB/6.8 GiB (61.60%) ETA: 11m52.902275574s
2023-08-25 18:04:24 localagi-api-1  | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.2 GiB/6.8 GiB (61.90%) ETA: 11m46.924159349s
2023-08-25 18:04:29 localagi-api-1  | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.2 GiB/6.8 GiB (62.20%) ETA: 11m41.162498688s
2023-08-25 18:04:34 localagi-api-1  | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.3 GiB/6.8 GiB (62.49%) ETA: 11m35.666352299s
2023-08-25 18:04:39 localagi-api-1  | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.3 GiB/6.8 GiB (62.77%) ETA: 11m30.080220218s
2023-08-25 18:04:44 localagi-api-1  | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.3 GiB/6.8 GiB (63.03%) ETA: 11m25.38085855s
2023-08-25 18:04:49 localagi-api-1  | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.3 GiB/6.8 GiB (63.30%) ETA: 11m20.468914226s
2023-08-25 18:04:54 localagi-api-1  | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.3 GiB/6.8 GiB (63.57%) ETA: 11m15.504013663s
2023-08-25 18:05:00 localagi-api-1  | 4:04PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.4 GiB/6.8 GiB (63.82%) ETA: 11m11.1770899s
2023-08-25 18:05:06 localagi-api-1  | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.4 GiB/6.8 GiB (64.02%) ETA: 11m9.089279112s
2023-08-25 18:05:11 localagi-api-1  | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.4 GiB/6.8 GiB (64.28%) ETA: 11m4.313815051s
2023-08-25 18:05:16 localagi-api-1  | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.4 GiB/6.8 GiB (64.54%) ETA: 10m59.405509312s
2023-08-25 18:05:21 localagi-api-1  | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.4 GiB/6.8 GiB (64.83%) ETA: 10m53.929449954s
2023-08-25 18:05:26 localagi-api-1  | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.4 GiB/6.8 GiB (65.10%) ETA: 10m48.76507989s
2023-08-25 18:05:31 localagi-api-1  | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.5 GiB/6.8 GiB (65.40%) ETA: 10m43.01768139s
2023-08-25 18:05:36 localagi-api-1  | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.5 GiB/6.8 GiB (65.69%) ETA: 10m37.429193049s
2023-08-25 18:05:41 localagi-api-1  | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.5 GiB/6.8 GiB (65.98%) ETA: 10m31.720278154s
2023-08-25 18:05:46 localagi-api-1  | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.5 GiB/6.8 GiB (66.29%) ETA: 10m25.80162278s
2023-08-25 18:05:51 localagi-api-1  | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.5 GiB/6.8 GiB (66.43%) ETA: 10m24.287810662s
2023-08-25 18:05:56 localagi-api-1  | 4:05PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.6 GiB/6.8 GiB (66.74%) ETA: 10m18.104310187s
2023-08-25 18:06:01 localagi-api-1  | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.6 GiB/6.8 GiB (67.05%) ETA: 10m12.104076964s
2023-08-25 18:06:06 localagi-api-1  | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.6 GiB/6.8 GiB (67.35%) ETA: 10m6.052951185s
2023-08-25 18:06:11 localagi-api-1  | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.6 GiB/6.8 GiB (67.66%) ETA: 10m0.060696827s
2023-08-25 18:06:16 localagi-api-1  | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.6 GiB/6.8 GiB (67.96%) ETA: 9m54.099435666s
2023-08-25 18:06:21 localagi-api-1  | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.7 GiB/6.8 GiB (68.25%) ETA: 9m48.656619273s
2023-08-25 18:06:26 localagi-api-1  | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.7 GiB/6.8 GiB (68.54%) ETA: 9m43.255673835s
2023-08-25 18:06:31 localagi-api-1  | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.7 GiB/6.8 GiB (68.68%) ETA: 9m41.671256852s
2023-08-25 18:06:36 localagi-api-1  | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.7 GiB/6.8 GiB (68.99%) ETA: 9m35.656983881s
2023-08-25 18:06:41 localagi-api-1  | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.7 GiB/6.8 GiB (69.27%) ETA: 9m30.143321642s
2023-08-25 18:06:46 localagi-api-1  | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.7 GiB/6.8 GiB (69.57%) ETA: 9m24.537726355s
2023-08-25 18:06:51 localagi-api-1  | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.8 GiB/6.8 GiB (69.86%) ETA: 9m18.938844309s
2023-08-25 18:06:56 localagi-api-1  | 4:06PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.8 GiB/6.8 GiB (70.17%) ETA: 9m12.931654463s
2023-08-25 18:07:01 localagi-api-1  | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.8 GiB/6.8 GiB (70.46%) ETA: 9m7.308826747s
2023-08-25 18:07:06 localagi-api-1  | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.8 GiB/6.8 GiB (70.74%) ETA: 9m2.008076402s
2023-08-25 18:07:16 localagi-api-1  | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.8 GiB/6.8 GiB (70.93%) ETA: 9m1.047036298s
2023-08-25 18:07:21 localagi-api-1  | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.9 GiB/6.8 GiB (71.19%) ETA: 8m56.158391194s
2023-08-25 18:07:26 localagi-api-1  | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.9 GiB/6.8 GiB (71.48%) ETA: 8m50.826955478s
2023-08-25 18:07:31 localagi-api-1  | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.9 GiB/6.8 GiB (71.74%) ETA: 8m45.940389132s
2023-08-25 18:07:36 localagi-api-1  | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.9 GiB/6.8 GiB (71.99%) ETA: 8m41.305765303s
2023-08-25 18:07:41 localagi-api-1  | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.9 GiB/6.8 GiB (72.23%) ETA: 8m37.060355169s
2023-08-25 18:07:46 localagi-api-1  | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 4.9 GiB/6.8 GiB (72.46%) ETA: 8m33.120765242s
2023-08-25 18:07:51 localagi-api-1  | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.0 GiB/6.8 GiB (72.68%) ETA: 8m29.393681809s
2023-08-25 18:07:56 localagi-api-1  | 4:07PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.0 GiB/6.8 GiB (72.80%) ETA: 8m28.285210586s
2023-08-25 18:08:01 localagi-api-1  | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.0 GiB/6.8 GiB (73.01%) ETA: 8m24.672860617s
2023-08-25 18:08:06 localagi-api-1  | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.0 GiB/6.8 GiB (73.24%) ETA: 8m20.640913259s
2023-08-25 18:08:11 localagi-api-1  | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.0 GiB/6.8 GiB (73.47%) ETA: 8m16.467069603s
2023-08-25 18:08:16 localagi-api-1  | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.0 GiB/6.8 GiB (73.74%) ETA: 8m11.44694112s
2023-08-25 18:08:21 localagi-api-1  | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.0 GiB/6.8 GiB (74.00%) ETA: 8m6.585506185s
2023-08-25 18:08:26 localagi-api-1  | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.1 GiB/6.8 GiB (74.27%) ETA: 8m1.62243921s
2023-08-25 18:08:31 localagi-api-1  | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.1 GiB/6.8 GiB (74.53%) ETA: 7m56.894302845s
2023-08-25 18:08:36 localagi-api-1  | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.1 GiB/6.8 GiB (74.81%) ETA: 7m51.414019369s
2023-08-25 18:08:41 localagi-api-1  | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.1 GiB/6.8 GiB (75.12%) ETA: 7m45.479982641s
2023-08-25 18:08:46 localagi-api-1  | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.1 GiB/6.8 GiB (75.42%) ETA: 7m39.619528514s
2023-08-25 18:08:51 localagi-api-1  | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.2 GiB/6.8 GiB (75.71%) ETA: 7m34.129648075s
2023-08-25 18:08:56 localagi-api-1  | 4:08PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.2 GiB/6.8 GiB (76.01%) ETA: 7m28.235826132s
2023-08-25 18:09:01 localagi-api-1  | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.2 GiB/6.8 GiB (76.31%) ETA: 7m22.525467308s
2023-08-25 18:09:06 localagi-api-1  | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.2 GiB/6.8 GiB (76.62%) ETA: 7m16.549150124s
2023-08-25 18:09:11 localagi-api-1  | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.2 GiB/6.8 GiB (76.92%) ETA: 7m10.547510408s
2023-08-25 18:09:16 localagi-api-1  | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.3 GiB/6.8 GiB (77.24%) ETA: 7m4.47756304s
2023-08-25 18:09:21 localagi-api-1  | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.3 GiB/6.8 GiB (77.57%) ETA: 6m57.985694452s
2023-08-25 18:09:26 localagi-api-1  | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.3 GiB/6.8 GiB (77.82%) ETA: 6m53.294005846s
2023-08-25 18:09:31 localagi-api-1  | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.3 GiB/6.8 GiB (78.14%) ETA: 6m47.137895265s
2023-08-25 18:09:36 localagi-api-1  | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.4 GiB/6.8 GiB (78.46%) ETA: 6m40.88492467s
2023-08-25 18:09:41 localagi-api-1  | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.4 GiB/6.8 GiB (78.76%) ETA: 6m35.150211654s
2023-08-25 18:09:46 localagi-api-1  | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.4 GiB/6.8 GiB (79.05%) ETA: 6m29.631762823s
2023-08-25 18:09:51 localagi-api-1  | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.4 GiB/6.8 GiB (79.32%) ETA: 6m24.641141372s
2023-08-25 18:09:56 localagi-api-1  | 4:09PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.4 GiB/6.8 GiB (79.62%) ETA: 6m18.908317801s
2023-08-25 18:10:02 localagi-api-1  | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.4 GiB/6.8 GiB (79.80%) ETA: 6m16.117367894s
2023-08-25 18:10:07 localagi-api-1  | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.5 GiB/6.8 GiB (80.09%) ETA: 6m10.773735368s
2023-08-25 18:10:12 localagi-api-1  | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.5 GiB/6.8 GiB (80.37%) ETA: 6m5.403021255s
2023-08-25 18:10:17 localagi-api-1  | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.5 GiB/6.8 GiB (80.67%) ETA: 5m59.776270536s
2023-08-25 18:10:22 localagi-api-1  | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.5 GiB/6.8 GiB (80.95%) ETA: 5m54.473322338s
2023-08-25 18:10:27 localagi-api-1  | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.5 GiB/6.8 GiB (81.25%) ETA: 5m48.76248359s
2023-08-25 18:10:32 localagi-api-1  | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.6 GiB/6.8 GiB (81.53%) ETA: 5m43.484782136s
2023-08-25 18:10:37 localagi-api-1  | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.6 GiB/6.8 GiB (81.80%) ETA: 5m38.433378011s
2023-08-25 18:10:42 localagi-api-1  | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.6 GiB/6.8 GiB (82.09%) ETA: 5m32.996178441s
2023-08-25 18:10:47 localagi-api-1  | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.6 GiB/6.8 GiB (82.38%) ETA: 5m27.522223831s
2023-08-25 18:10:52 localagi-api-1  | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.6 GiB/6.8 GiB (82.66%) ETA: 5m22.22272015s
2023-08-25 18:10:57 localagi-api-1  | 4:10PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.7 GiB/6.8 GiB (82.95%) ETA: 5m16.755724722s
2023-08-25 18:11:02 localagi-api-1  | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.7 GiB/6.8 GiB (83.24%) ETA: 5m11.281434553s
2023-08-25 18:11:07 localagi-api-1  | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.7 GiB/6.8 GiB (83.53%) ETA: 5m5.880152326s
2023-08-25 18:11:12 localagi-api-1  | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.7 GiB/6.8 GiB (83.82%) ETA: 5m0.511839483s
2023-08-25 18:11:17 localagi-api-1  | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.7 GiB/6.8 GiB (84.11%) ETA: 4m55.045996116s
2023-08-25 18:11:22 localagi-api-1  | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.8 GiB/6.8 GiB (84.40%) ETA: 4m49.485795997s
2023-08-25 18:11:27 localagi-api-1  | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.8 GiB/6.8 GiB (84.71%) ETA: 4m43.634459912s
2023-08-25 18:11:32 localagi-api-1  | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.8 GiB/6.8 GiB (85.01%) ETA: 4m37.994409707s
2023-08-25 18:11:37 localagi-api-1  | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.8 GiB/6.8 GiB (85.30%) ETA: 4m32.622602717s
2023-08-25 18:11:42 localagi-api-1  | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.8 GiB/6.8 GiB (85.60%) ETA: 4m26.913791085s
2023-08-25 18:11:47 localagi-api-1  | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.9 GiB/6.8 GiB (85.90%) ETA: 4m21.161609875s
2023-08-25 18:11:52 localagi-api-1  | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.9 GiB/6.8 GiB (86.21%) ETA: 4m15.356739718s
2023-08-25 18:11:57 localagi-api-1  | 4:11PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.9 GiB/6.8 GiB (86.52%) ETA: 4m9.528609303s
2023-08-25 18:12:02 localagi-api-1  | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.9 GiB/6.8 GiB (86.81%) ETA: 4m4.001963542s
2023-08-25 18:12:12 localagi-api-1  | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 5.9 GiB/6.8 GiB (87.02%) ETA: 4m1.048926561s
2023-08-25 18:12:17 localagi-api-1  | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.0 GiB/6.8 GiB (87.29%) ETA: 3m55.97409621s
2023-08-25 18:12:22 localagi-api-1  | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.0 GiB/6.8 GiB (87.56%) ETA: 3m50.99062437s
2023-08-25 18:12:27 localagi-api-1  | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.0 GiB/6.8 GiB (87.84%) ETA: 3m45.771004627s
2023-08-25 18:12:32 localagi-api-1  | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.0 GiB/6.8 GiB (88.12%) ETA: 3m40.600449328s
2023-08-25 18:12:37 localagi-api-1  | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.0 GiB/6.8 GiB (88.37%) ETA: 3m35.890610589s
2023-08-25 18:12:42 localagi-api-1  | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.0 GiB/6.8 GiB (88.65%) ETA: 3m30.851850173s
2023-08-25 18:12:47 localagi-api-1  | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.1 GiB/6.8 GiB (88.91%) ETA: 3m25.999589056s
2023-08-25 18:12:52 localagi-api-1  | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.1 GiB/6.8 GiB (89.15%) ETA: 3m21.584694867s
2023-08-25 18:12:57 localagi-api-1  | 4:12PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.1 GiB/6.8 GiB (89.36%) ETA: 3m17.715512412s
2023-08-25 18:13:02 localagi-api-1  | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.1 GiB/6.8 GiB (89.60%) ETA: 3m13.358626513s
2023-08-25 18:13:07 localagi-api-1  | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.1 GiB/6.8 GiB (89.85%) ETA: 3m8.812391493s
2023-08-25 18:13:12 localagi-api-1  | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.1 GiB/6.8 GiB (90.07%) ETA: 3m4.808628209s
2023-08-25 18:13:17 localagi-api-1  | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.2 GiB/6.8 GiB (90.30%) ETA: 3m0.523451918s
2023-08-25 18:13:22 localagi-api-1  | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.2 GiB/6.8 GiB (90.50%) ETA: 2m57.008417955s
2023-08-25 18:13:27 localagi-api-1  | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.2 GiB/6.8 GiB (90.70%) ETA: 2m53.330160972s
2023-08-25 18:13:32 localagi-api-1  | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.2 GiB/6.8 GiB (90.91%) ETA: 2m49.582338841s
2023-08-25 18:13:37 localagi-api-1  | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.2 GiB/6.8 GiB (91.11%) ETA: 2m46.048302309s
2023-08-25 18:13:42 localagi-api-1  | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.2 GiB/6.8 GiB (91.29%) ETA: 2m42.702070733s
2023-08-25 18:13:47 localagi-api-1  | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.2 GiB/6.8 GiB (91.50%) ETA: 2m38.944535936s
2023-08-25 18:13:52 localagi-api-1  | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.3 GiB/6.8 GiB (91.70%) ETA: 2m35.236035019s
2023-08-25 18:13:57 localagi-api-1  | 4:13PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.3 GiB/6.8 GiB (91.88%) ETA: 2m32.041828866s
2023-08-25 18:14:02 localagi-api-1  | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.3 GiB/6.8 GiB (92.07%) ETA: 2m28.749454204s
2023-08-25 18:14:07 localagi-api-1  | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.3 GiB/6.8 GiB (92.27%) ETA: 2m25.131856823s
2023-08-25 18:14:12 localagi-api-1  | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.3 GiB/6.8 GiB (92.45%) ETA: 2m21.762885231s
2023-08-25 18:14:17 localagi-api-1  | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.3 GiB/6.8 GiB (92.64%) ETA: 2m18.360025214s
2023-08-25 18:14:22 localagi-api-1  | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.3 GiB/6.8 GiB (92.84%) ETA: 2m14.71506397s
2023-08-25 18:14:27 localagi-api-1  | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.3 GiB/6.8 GiB (93.05%) ETA: 2m10.711225834s
2023-08-25 18:14:32 localagi-api-1  | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.4 GiB/6.8 GiB (93.28%) ETA: 2m6.612335569s
2023-08-25 18:14:37 localagi-api-1  | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.4 GiB/6.8 GiB (93.51%) ETA: 2m2.274872167s
2023-08-25 18:14:42 localagi-api-1  | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.4 GiB/6.8 GiB (93.71%) ETA: 1m58.527892595s
2023-08-25 18:14:47 localagi-api-1  | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.4 GiB/6.8 GiB (93.91%) ETA: 1m54.865448868s
2023-08-25 18:14:52 localagi-api-1  | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.4 GiB/6.8 GiB (94.13%) ETA: 1m50.846887449s
2023-08-25 18:14:57 localagi-api-1  | 4:14PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.4 GiB/6.8 GiB (94.37%) ETA: 1m46.340396868s
2023-08-25 18:15:02 localagi-api-1  | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.5 GiB/6.8 GiB (94.58%) ETA: 1m42.349770137s
2023-08-25 18:15:07 localagi-api-1  | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.5 GiB/6.8 GiB (94.81%) ETA: 1m37.970879676s
2023-08-25 18:15:12 localagi-api-1  | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.5 GiB/6.8 GiB (95.02%) ETA: 1m34.167566185s
2023-08-25 18:15:17 localagi-api-1  | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.5 GiB/6.8 GiB (95.26%) ETA: 1m29.612522994s
2023-08-25 18:15:22 localagi-api-1  | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.5 GiB/6.8 GiB (95.48%) ETA: 1m25.525214221s
2023-08-25 18:15:27 localagi-api-1  | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.5 GiB/6.8 GiB (95.68%) ETA: 1m21.681644775s
2023-08-25 18:15:32 localagi-api-1  | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.5 GiB/6.8 GiB (95.94%) ETA: 1m16.940595383s
2023-08-25 18:15:39 localagi-api-1  | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.6 GiB/6.8 GiB (96.20%) ETA: 1m12.058492418s
2023-08-25 18:15:44 localagi-api-1  | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.6 GiB/6.8 GiB (96.46%) ETA: 1m7.205805865s
2023-08-25 18:15:49 localagi-api-1  | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.6 GiB/6.8 GiB (96.68%) ETA: 1m2.893971776s
2023-08-25 18:15:54 localagi-api-1  | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.6 GiB/6.8 GiB (96.93%) ETA: 58.324875404s
2023-08-25 18:15:59 localagi-api-1  | 4:15PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.6 GiB/6.8 GiB (97.17%) ETA: 53.657568668s
2023-08-25 18:16:04 localagi-api-1  | 4:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.6 GiB/6.8 GiB (97.43%) ETA: 48.727128035s
2023-08-25 18:16:09 localagi-api-1  | 4:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.7 GiB/6.8 GiB (97.69%) ETA: 43.900597194s
2023-08-25 18:16:14 localagi-api-1  | 4:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.7 GiB/6.8 GiB (97.95%) ETA: 38.847864622s
2023-08-25 18:16:19 localagi-api-1  | 4:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.7 GiB/6.8 GiB (98.24%) ETA: 33.363225549s
2023-08-25 18:16:24 localagi-api-1  | 4:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.7 GiB/6.8 GiB (98.51%) ETA: 28.33793103s
2023-08-25 18:16:29 localagi-api-1  | 4:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.7 GiB/6.8 GiB (98.78%) ETA: 23.123694714s
2023-08-25 18:16:34 localagi-api-1  | 4:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.8 GiB/6.8 GiB (99.07%) ETA: 17.705069539s
2023-08-25 18:16:39 localagi-api-1  | 4:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.8 GiB/6.8 GiB (99.32%) ETA: 12.972167055s
2023-08-25 18:16:44 localagi-api-1  | 4:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.8 GiB/6.8 GiB (99.57%) ETA: 8.195311872s
2023-08-25 18:16:49 localagi-api-1  | 4:16PM DBG Downloading wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin: 6.8 GiB/6.8 GiB (99.84%) ETA: 3.068730204s
2023-08-25 18:16:53 localagi-api-1  | 4:16PM DBG File "wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin" downloaded and verified
2023-08-25 18:16:53 localagi-api-1  | 4:16PM DBG Prompt template "wizardlm-completion" written
2023-08-25 18:16:53 localagi-api-1  | 4:16PM DBG Prompt template "wizardlm-chat" written
2023-08-25 18:16:53 localagi-api-1  | 4:16PM DBG Written config file /models/functions.yaml
2023-08-25 18:16:53 localagi-api-1  | 
2023-08-25 18:16:53 localagi-api-1  |  ┌───────────────────────────────────────────────────┐ 
2023-08-25 18:16:53 localagi-api-1  |  │                   Fiber v2.48.0                   │ 
2023-08-25 18:16:53 localagi-api-1  |  │               http://127.0.0.1:8080               │ 
2023-08-25 18:16:53 localagi-api-1  |  │       (bound on host 0.0.0.0 and port 8080)       │ 
2023-08-25 18:16:53 localagi-api-1  |  │                                                   │ 
2023-08-25 18:16:53 localagi-api-1  |  │ Handlers ............ 59  Processes ........... 1 │ 
2023-08-25 18:16:53 localagi-api-1  |  │ Prefork ....... Disabled  PID ................ 14 │ 
2023-08-25 18:16:53 localagi-api-1  |  └───────────────────────────────────────────────────┘ 
2023-08-25 18:16:53 localagi-api-1  | 
2023-08-25 18:17:17 localagi-api-1  | [127.0.0.1]:42644  200  -  GET      /readyz
2023-08-25 18:17:52 localagi-api-1  | 4:17PM DBG Request received: 
2023-08-25 18:17:52 localagi-api-1  | 4:17PM DBG Configuration read: &{PredictionOptions:{Model:wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin Language: N:0 TopP:0.95 TopK:40 Temperature:0.1 Maxtokens:0 Echo:false Batch:0 F16:false IgnoreEOS:false RepeatPenalty:0 Keep:0 MirostatETA:0 MirostatTAU:0 Mirostat:0 FrequencyPenalty:0 TFZ:0 TypicalP:0 Seed:0 NegativePrompt: RopeFreqBase:0 RopeFreqScale:0 NegativePromptScale:0 UseFastTokenizer:false ClipSkip:0 Tokenizer:} Name:functions F16:true Threads:14 Debug:true Roles:map[assistant:ASSISTANT: assistant_function_call:FUNCTION_CALL: function:FUNCTION CALL RESULT: system:SYSTEM:] Embeddings:false Backend:llama TemplateConfig:{Chat: ChatMessage: Completion: Edit: Functions:} PromptStrings:[] InputStrings:[] InputToken:[] functionCallString: functionCallNameString:intent FunctionsConfig:{DisableNoAction:true NoActionFunctionName: NoActionDescriptionName:} FeatureFlag:map[] LLMConfig:{SystemPrompt: TensorSplit: MainGPU: RMSNormEps:0 NGQA:0 PromptCachePath: PromptCacheAll:false PromptCacheRO:false MirostatETA:0.1 MirostatTAU:5 Mirostat:2 NGPULayers:0 MMap:true MMlock:false LowVRAM:false Grammar: StopWords:[] Cutstrings:[] TrimSpace:[] ContextSize:2048 NUMA:false} AutoGPTQ:{ModelBaseName: Device: Triton:false UseFastTokenizer:false} Diffusers:{PipelineType: SchedulerType: CUDA:false EnableParameters: CFGScale:0 IMG2IMG:false ClipSkip:0 ClipModel: ClipSubFolder:} Step:0 GRPC:{Attempts:0 AttemptsSleepTime:0}}
2023-08-25 18:17:52 localagi-api-1  | 4:17PM DBG Response needs to process functions
2023-08-25 18:17:52 localagi-api-1  | 4:17PM DBG Parameters: &{PredictionOptions:{Model:wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin Language: N:0 TopP:0.95 TopK:40 Temperature:0.1 Maxtokens:0 Echo:false Batch:0 F16:false IgnoreEOS:false RepeatPenalty:0 Keep:0 MirostatETA:0 MirostatTAU:0 Mirostat:0 FrequencyPenalty:0 TFZ:0 TypicalP:0 Seed:0 NegativePrompt: RopeFreqBase:0 RopeFreqScale:0 NegativePromptScale:0 UseFastTokenizer:false ClipSkip:0 Tokenizer:} Name:functions F16:true Threads:14 Debug:true Roles:map[assistant:ASSISTANT: assistant_function_call:FUNCTION_CALL: function:FUNCTION CALL RESULT: system:SYSTEM:] Embeddings:false Backend:llama TemplateConfig:{Chat: ChatMessage: Completion: Edit: Functions:} PromptStrings:[] InputStrings:[] InputToken:[] functionCallString: functionCallNameString:intent FunctionsConfig:{DisableNoAction:true NoActionFunctionName: NoActionDescriptionName:} FeatureFlag:map[] LLMConfig:{SystemPrompt: TensorSplit: MainGPU: RMSNormEps:0 NGQA:0 PromptCachePath: PromptCacheAll:false PromptCacheRO:false MirostatETA:0.1 MirostatTAU:5 Mirostat:2 NGPULayers:0 MMap:true MMlock:false LowVRAM:false Grammar:string ::= "\"" (
2023-08-25 18:17:52 localagi-api-1  |                   [^"\\] |
2023-08-25 18:17:52 localagi-api-1  |                   "\\" (["\\/bfnrt] | "u" [0-9a-fA-F] [0-9a-fA-F] [0-9a-fA-F] [0-9a-fA-F])
2023-08-25 18:17:52 localagi-api-1  |             )* "\"" space
2023-08-25 18:17:52 localagi-api-1  | root-0-arguments ::= "{" space "\"action\"" space ":" space root-0-arguments-action "," space "\"confidence\"" space ":" space number "," space "\"detailed_reasoning\"" space ":" space string "}" space
2023-08-25 18:17:52 localagi-api-1  | root-0-function ::= "\"intent\""
2023-08-25 18:17:52 localagi-api-1  | root-0 ::= "{" space "\"arguments\"" space ":" space root-0-arguments "," space "\"function\"" space ":" space root-0-function "}" space
2023-08-25 18:17:52 localagi-api-1  | root ::= root-0
2023-08-25 18:17:52 localagi-api-1  | space ::= " "?
2023-08-25 18:17:52 localagi-api-1  | root-0-arguments-action ::= "\"search_internet\"" | "\"save_file\"" | "\"save_memory\"" | "\"search_memory\"" | "\"plan\"" | "\"reply\""
2023-08-25 18:17:52 localagi-api-1  | number ::= ("-"? ([0-9] | [1-9] [0-9]*)) ("." [0-9]+)? ([eE] [-+]? [0-9]+)? space StopWords:[] Cutstrings:[] TrimSpace:[] ContextSize:2048 NUMA:false} AutoGPTQ:{ModelBaseName: Device: Triton:false UseFastTokenizer:false} Diffusers:{PipelineType: SchedulerType: CUDA:false EnableParameters: CFGScale:0 IMG2IMG:false ClipSkip:0 ClipModel: ClipSubFolder:} Step:0 GRPC:{Attempts:0 AttemptsSleepTime:0}}
2023-08-25 18:17:52 localagi-api-1  | 4:17PM DBG Prompt (before templating): Transcript of AI assistant responding to user requests. Replies with the action to perform and the reasoning.
2023-08-25 18:17:52 localagi-api-1  |     For searching the internet with a query, the assistant replies with the action "search_internet" and the query to search.
2023-08-25 18:17:52 localagi-api-1  | The assistant replies with the action "save_file", the filename and content to save for writing a file to disk permanently. This can be used to store the result of complex actions locally.
2023-08-25 18:17:52 localagi-api-1  | The assistant replies with the action "save_memory" and the string to remember or store an information that thinks it is relevant permanently.
2023-08-25 18:17:52 localagi-api-1  | The assistant replies with the action "search_memory" for searching between its memories with a query term.
2023-08-25 18:17:52 localagi-api-1  | The assistant for solving complex tasks that involves calling more functions in sequence, replies with the action "plan".
2023-08-25 18:17:52 localagi-api-1  | For replying to the user, the assistant replies with the action "reply" and the reply to the user directly when there is nothing to do.
2023-08-25 18:17:52 localagi-api-1  | 
2023-08-25 18:17:52 localagi-api-1  | Request: plan a roadtrip to San Francisco
2023-08-25 18:17:52 localagi-api-1  | 
2023-08-25 18:17:52 localagi-api-1  | Function call: 
2023-08-25 18:17:52 localagi-api-1  | 4:17PM DBG Template failed loading: failed loading a template for wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin
2023-08-25 18:17:52 localagi-api-1  | 4:17PM DBG Prompt (after templating): Transcript of AI assistant responding to user requests. Replies with the action to perform and the reasoning.
2023-08-25 18:17:52 localagi-api-1  |     For searching the internet with a query, the assistant replies with the action "search_internet" and the query to search.
2023-08-25 18:17:52 localagi-api-1  | The assistant replies with the action "save_file", the filename and content to save for writing a file to disk permanently. This can be used to store the result of complex actions locally.
2023-08-25 18:17:52 localagi-api-1  | The assistant replies with the action "save_memory" and the string to remember or store an information that thinks it is relevant permanently.
2023-08-25 18:17:52 localagi-api-1  | The assistant replies with the action "search_memory" for searching between its memories with a query term.
2023-08-25 18:17:52 localagi-api-1  | The assistant for solving complex tasks that involves calling more functions in sequence, replies with the action "plan".
2023-08-25 18:17:52 localagi-api-1  | For replying to the user, the assistant replies with the action "reply" and the reply to the user directly when there is nothing to do.
2023-08-25 18:17:52 localagi-api-1  | 
2023-08-25 18:17:52 localagi-api-1  | Request: plan a roadtrip to San Francisco
2023-08-25 18:17:52 localagi-api-1  | 
2023-08-25 18:17:52 localagi-api-1  | Function call: 
2023-08-25 18:17:52 localagi-api-1  | 4:17PM DBG Grammar: string ::= "\"" (
2023-08-25 18:17:52 localagi-api-1  |                   [^"\\] |
2023-08-25 18:17:52 localagi-api-1  |                   "\\" (["\\/bfnrt] | "u" [0-9a-fA-F] [0-9a-fA-F] [0-9a-fA-F] [0-9a-fA-F])
2023-08-25 18:17:52 localagi-api-1  |             )* "\"" space
2023-08-25 18:17:52 localagi-api-1  | root-0-arguments ::= "{" space "\"action\"" space ":" space root-0-arguments-action "," space "\"confidence\"" space ":" space number "," space "\"detailed_reasoning\"" space ":" space string "}" space
2023-08-25 18:17:52 localagi-api-1  | root-0-function ::= "\"intent\""
2023-08-25 18:17:52 localagi-api-1  | root-0 ::= "{" space "\"arguments\"" space ":" space root-0-arguments "," space "\"function\"" space ":" space root-0-function "}" space
2023-08-25 18:17:52 localagi-api-1  | root ::= root-0
2023-08-25 18:17:52 localagi-api-1  | space ::= " "?
2023-08-25 18:17:52 localagi-api-1  | root-0-arguments-action ::= "\"search_internet\"" | "\"save_file\"" | "\"save_memory\"" | "\"search_memory\"" | "\"plan\"" | "\"reply\""
2023-08-25 18:17:52 localagi-api-1  | number ::= ("-"? ([0-9] | [1-9] [0-9]*)) ("." [0-9]+)? ([eE] [-+]? [0-9]+)? space
2023-08-25 18:17:52 localagi-api-1  | 4:17PM DBG Loading model llama from wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin
2023-08-25 18:17:52 localagi-api-1  | 4:17PM DBG Loading model in memory from file: /models/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin
2023-08-25 18:17:52 localagi-api-1  | 4:17PM DBG Loading GRPC Model llama: {backendString:llama model:wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin threads:14 assetDir:/tmp/localai/backend_data context:{emptyCtx:{}} gRPCOptions:0xc0030c0dc0 externalBackends:map[autogptq:/build/extra/grpc/autogptq/autogptq.py bark:/build/extra/grpc/bark/ttsbark.py diffusers:/build/extra/grpc/diffusers/backend_diffusers.py exllama:/build/extra/grpc/exllama/exllama.py huggingface-embeddings:/build/extra/grpc/huggingface/huggingface.py] grpcAttempts:20 grpcAttemptsDelay:2 singleActiveBackend:false}
2023-08-25 18:17:52 localagi-api-1  | 4:17PM DBG Loading GRPC Process: /tmp/localai/backend_data/backend-assets/grpc/llama
2023-08-25 18:17:52 localagi-api-1  | 4:17PM DBG GRPC Service for wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin will be running at: '127.0.0.1:45259'
2023-08-25 18:17:52 localagi-api-1  | 4:17PM DBG GRPC Service state dir: /tmp/go-processmanager1416834915
2023-08-25 18:17:52 localagi-api-1  | 4:17PM DBG GRPC Service Started
2023-08-25 18:17:52 localagi-api-1  | rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:45259: connect: connection refused"
2023-08-25 18:17:52 localagi-api-1  | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin-127.0.0.1:45259): stderr 2023/08/25 16:17:52 gRPC Server listening at 127.0.0.1:45259
2023-08-25 18:17:54 localagi-api-1  | 4:17PM DBG GRPC Service Ready
2023-08-25 18:17:54 localagi-api-1  | 4:17PM DBG GRPC: Loading model with options: {state:{NoUnkeyedLiterals:{} DoNotCompare:[] DoNotCopy:[] atomicMessageInfo:<nil>} sizeCache:0 unknownFields:[] Model:wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin ContextSize:2048 Seed:0 NBatch:512 F16Memory:true MLock:false MMap:true VocabOnly:false LowVRAM:false Embeddings:false NUMA:false NGPULayers:0 MainGPU: TensorSplit: Threads:14 LibrarySearchPath: RopeFreqBase:0 RopeFreqScale:0 RMSNormEps:0 NGQA:0 ModelFile:/models/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin Device: UseTriton:false ModelBaseName: UseFastTokenizer:false PipelineType: SchedulerType: CUDA:false CFGScale:0 IMG2IMG:false CLIPModel: CLIPSubfolder: CLIPSkip:0 Tokenizer:}
2023-08-25 18:17:54 localagi-api-1  | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin-127.0.0.1:45259): stderr create_gpt_params: loading model /models/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin
2023-08-25 18:17:54 localagi-api-1  | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin-127.0.0.1:45259): stderr gguf_init_from_file: invalid magic number 67676a74
2023-08-25 18:17:54 localagi-api-1  | [172.20.0.3]:57816  500  -  POST     /v1/chat/completions
2023-08-25 18:17:54 localagi-api-1  | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin-127.0.0.1:45259): stderr error loading model: llama_model_loader: failed to load model from /models/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin
2023-08-25 18:17:54 localagi-api-1  | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin-127.0.0.1:45259): stderr 
2023-08-25 18:17:54 localagi-api-1  | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin-127.0.0.1:45259): stderr llama_load_model_from_file: failed to load model
2023-08-25 18:17:54 localagi-api-1  | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin-127.0.0.1:45259): stderr llama_init_from_gpt_params: error: failed to load model '/models/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin'
2023-08-25 18:17:54 localagi-api-1  | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_0.bin-127.0.0.1:45259): stderr load_binding_model: error: unable to load model
2023-08-25 18:17:54 localagi-api-1  | 4:17PM DBG Request received: 
2023-08-25 18:17:55 localagi-api-1  | 4:17PM DBG Configuration read: &{PredictionOptions:{Model:wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin Language: N:0 TopP:0.95 TopK:40 Temperature:0.1 Maxtokens:0 Echo:false Batch:0 F16:false IgnoreEOS:false RepeatPenalty:0 Keep:0 MirostatETA:0 MirostatTAU:0 Mirostat:0 FrequencyPenalty:0 TFZ:0 TypicalP:0 Seed:0 NegativePrompt: RopeFreqBase:0 RopeFreqScale:0 NegativePromptScale:0 UseFastTokenizer:false ClipSkip:0 Tokenizer:} Name:gpt-4 F16:true Threads:14 Debug:true Roles:map[] Embeddings:false Backend:llama TemplateConfig:{Chat:wizardlm-chat ChatMessage: Completion:wizardlm-completion Edit: Functions:} PromptStrings:[] InputStrings:[] InputToken:[] functionCallString: functionCallNameString: FunctionsConfig:{DisableNoAction:false NoActionFunctionName: NoActionDescriptionName:} FeatureFlag:map[] LLMConfig:{SystemPrompt: TensorSplit: MainGPU: RMSNormEps:0 NGQA:0 PromptCachePath: PromptCacheAll:false PromptCacheRO:false MirostatETA:0.1 MirostatTAU:5 Mirostat:2 NGPULayers:0 MMap:true MMlock:false LowVRAM:false Grammar: StopWords:[] Cutstrings:[] TrimSpace:[] ContextSize:2048 NUMA:false} AutoGPTQ:{ModelBaseName: Device: Triton:false UseFastTokenizer:false} Diffusers:{PipelineType: SchedulerType: CUDA:false EnableParameters: CFGScale:0 IMG2IMG:false ClipSkip:0 ClipModel: ClipSubFolder:} Step:0 GRPC:{Attempts:0 AttemptsSleepTime:0}}
2023-08-25 18:17:55 localagi-api-1  | 4:17PM DBG Parameters: &{PredictionOptions:{Model:wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin Language: N:0 TopP:0.95 TopK:40 Temperature:0.1 Maxtokens:0 Echo:false Batch:0 F16:false IgnoreEOS:false RepeatPenalty:0 Keep:0 MirostatETA:0 MirostatTAU:0 Mirostat:0 FrequencyPenalty:0 TFZ:0 TypicalP:0 Seed:0 NegativePrompt: RopeFreqBase:0 RopeFreqScale:0 NegativePromptScale:0 UseFastTokenizer:false ClipSkip:0 Tokenizer:} Name:gpt-4 F16:true Threads:14 Debug:true Roles:map[] Embeddings:false Backend:llama TemplateConfig:{Chat:wizardlm-chat ChatMessage: Completion:wizardlm-completion Edit: Functions:} PromptStrings:[] InputStrings:[] InputToken:[] functionCallString: functionCallNameString: FunctionsConfig:{DisableNoAction:false NoActionFunctionName: NoActionDescriptionName:} FeatureFlag:map[] LLMConfig:{SystemPrompt: TensorSplit: MainGPU: RMSNormEps:0 NGQA:0 PromptCachePath: PromptCacheAll:false PromptCacheRO:false MirostatETA:0.1 MirostatTAU:5 Mirostat:2 NGPULayers:0 MMap:true MMlock:false LowVRAM:false Grammar: StopWords:[] Cutstrings:[] TrimSpace:[] ContextSize:2048 NUMA:false} AutoGPTQ:{ModelBaseName: Device: Triton:false UseFastTokenizer:false} Diffusers:{PipelineType: SchedulerType: CUDA:false EnableParameters: CFGScale:0 IMG2IMG:false ClipSkip:0 ClipModel: ClipSubFolder:} Step:0 GRPC:{Attempts:0 AttemptsSleepTime:0}}
2023-08-25 18:17:55 localagi-api-1  | 4:17PM DBG Prompt (before templating): plan a roadtrip to San Francisco
2023-08-25 18:17:55 localagi-api-1  | 4:17PM DBG Template found, input modified to: plan a roadtrip to San Francisco
2023-08-25 18:17:55 localagi-api-1  | 
2023-08-25 18:17:55 localagi-api-1  | ### Response:
2023-08-25 18:17:55 localagi-api-1  | 4:17PM DBG Prompt (after templating): plan a roadtrip to San Francisco
2023-08-25 18:17:55 localagi-api-1  | 
2023-08-25 18:17:55 localagi-api-1  | ### Response:
2023-08-25 18:17:55 localagi-api-1  | 4:17PM DBG Loading model llama from wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin
2023-08-25 18:17:55 localagi-api-1  | 4:17PM DBG Loading model in memory from file: /models/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin
2023-08-25 18:17:55 localagi-api-1  | 4:17PM DBG Loading GRPC Model llama: {backendString:llama model:wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin threads:14 assetDir:/tmp/localai/backend_data context:{emptyCtx:{}} gRPCOptions:0xc0001a2dc0 externalBackends:map[autogptq:/build/extra/grpc/autogptq/autogptq.py bark:/build/extra/grpc/bark/ttsbark.py diffusers:/build/extra/grpc/diffusers/backend_diffusers.py exllama:/build/extra/grpc/exllama/exllama.py huggingface-embeddings:/build/extra/grpc/huggingface/huggingface.py] grpcAttempts:20 grpcAttemptsDelay:2 singleActiveBackend:false}
2023-08-25 18:17:55 localagi-api-1  | 4:17PM DBG Loading GRPC Process: /tmp/localai/backend_data/backend-assets/grpc/llama
2023-08-25 18:17:55 localagi-api-1  | 4:17PM DBG GRPC Service for wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin will be running at: '127.0.0.1:40749'
2023-08-25 18:17:55 localagi-api-1  | 4:17PM DBG GRPC Service state dir: /tmp/go-processmanager3315229286
2023-08-25 18:17:55 localagi-api-1  | 4:17PM DBG GRPC Service Started
2023-08-25 18:17:55 localagi-api-1  | rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp 127.0.0.1:40749: connect: connection refused"
2023-08-25 18:17:55 localagi-api-1  | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin-127.0.0.1:40749): stderr 2023/08/25 16:17:55 gRPC Server listening at 127.0.0.1:40749
2023-08-25 18:17:57 localagi-api-1  | 4:17PM DBG GRPC Service Ready
2023-08-25 18:17:57 localagi-api-1  | 4:17PM DBG GRPC: Loading model with options: {state:{NoUnkeyedLiterals:{} DoNotCompare:[] DoNotCopy:[] atomicMessageInfo:<nil>} sizeCache:0 unknownFields:[] Model:wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin ContextSize:2048 Seed:0 NBatch:512 F16Memory:true MLock:false MMap:true VocabOnly:false LowVRAM:false Embeddings:false NUMA:false NGPULayers:0 MainGPU: TensorSplit: Threads:14 LibrarySearchPath: RopeFreqBase:0 RopeFreqScale:0 RMSNormEps:0 NGQA:0 ModelFile:/models/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin Device: UseTriton:false ModelBaseName: UseFastTokenizer:false PipelineType: SchedulerType: CUDA:false CFGScale:0 IMG2IMG:false CLIPModel: CLIPSubfolder: CLIPSkip:0 Tokenizer:}
2023-08-25 18:17:57 localagi-api-1  | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin-127.0.0.1:40749): stderr create_gpt_params: loading model /models/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin
2023-08-25 18:17:57 localagi-api-1  | [172.20.0.3]:57816  500  -  POST     /v1/chat/completions
2023-08-25 18:17:57 localagi-api-1  | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin-127.0.0.1:40749): stderr gguf_init_from_file: invalid magic number 67676a74
2023-08-25 18:17:57 localagi-api-1  | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin-127.0.0.1:40749): stderr error loading model: llama_model_loader: failed to load model from /models/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin
2023-08-25 18:17:57 localagi-api-1  | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin-127.0.0.1:40749): stderr 
2023-08-25 18:17:57 localagi-api-1  | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin-127.0.0.1:40749): stderr llama_load_model_from_file: failed to load model
2023-08-25 18:17:57 localagi-api-1  | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin-127.0.0.1:40749): stderr llama_init_from_gpt_params: error: failed to load model '/models/wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin'
2023-08-25 18:17:57 localagi-api-1  | 4:17PM DBG GRPC(wizardlm-13b-v1.0-uncensored.ggmlv3.q4_K_M.bin-127.0.0.1:40749): stderr load_binding_model: error: unable to load model
1970-01-01 01:00:00 localagi-api-1 exited with code 0
1970-01-01 01:00:00

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@pasqualesimonetti