Skip to content

Releases: likelovewant/ollama-for-amd

v0.5.4

18 Dec 10:57
Compare
Choose a tag to compare
  • Detailed Installation Guide: please refer to the wiki guide:
    Demo Release Version:
  • Add experimental support for gfx900:xnack-
    This release OllamaSetup.exe build with `ROCm6.1.2 hipsdk 6.1.2, make sure to replace the libs with v0.6.1.2

Tip

ROCm5.7 version *No need to update for this release

ROCmlibs for 6.1.2 available at ROCmlibs for 6.1.2

Support lists gfx803 (may not detected ) gfx900:xnack- gfx902 gfx90c:xnack- gfx906:xnack- gfx1010:xnack- gfx1011 gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150

ollama-windows-amd64-rocm5.7-v2.7z ( rebuild for gfx803 gfx900:xnack- gfx902 gfx906:xnack- gfx90c:xnack- gfx1010:xnack-)

Note

OllamaSetup.exe is same as ollama-windows-amd64.7z ,you don't need them both . * Refer to the Standalone CLI guide:

For a complete list of changes and bug fixes, please check ollama changelog:
ollama/releases

v0.5.1

07 Dec 06:07
a0caaa2
Compare
Choose a tag to compare
  • Detailed Installation Guide: please refer to the wiki guide:
    Demo Release Version:
  • Add experimental support for gfx1150 (890M,880M): please refer to the wiki guide:
    This release OllamaSetup.exe build with `ROCm6.1.2 hipsdk 6.1.2, make sure to replace the libs with v0.6.1.2

Tip

ROCm5.7 version *ollama-windows-amd64-rocm5.7.7z.

ROCmlibs for 6.1.2 available at ROCmlibs for 6.1.2
ROCmlibs for 5.7 available at ROCmlibs for 5.7

Support lists gfx803 gfx900 gfx902 gfx90c:xnack- gfx906:xnack- gfx90a:xnack- gfx1010:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1102 gfx1103 gfx1150

OllamaSetup.exe is same as ollama-windows-amd64.7z ,you don't need them both . * Refer to the Standalone CLI guide:

For a complete list of changes and bug fixes, please check ollama changelog:
ollama/releases

v0.4.6

29 Nov 04:52
1c28a2d
Compare
Choose a tag to compare

This release OllamaSetup.exe build with `ROCm6.1.2 hipsdk 6.1.2, make sure to replace the libs with v0.6.1.2 otherwise ,it's may fail to detected

Note the drop replacement with ollama-windows-amd64 not working if have earlier version v0.4.0 installed .

ROCmlibs for 6.1.2 available at ROCmlibs for 6.1.2

If you encounter issues with certain GPUs being undetected by ROCm 6.1.2, It is recommend using ROCm 5.7 as an
alternative. You can download the appropriate version for your system: ollama-windows-amd64-rocm5.7.7z

ROCmlibs for 5.7 available at ROCmlibs for 5.7

Important

(update info for those who skip reading the Detailed Installation Guide , Demo Release Version: )
Install and Replace Files: Run the OllamaSetup.exe installer first, replace files in your Ollama program folder with the rocblas.dll and rocblas/library folder matches your GPU architecture with the correct ROCmlibs for 6.1.2.(eg. the file in `C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama)

Support lists gfx803 gfx900 gfx902 gfx90c:xnack- gfx906:xnack- gfx90a:xnack- gfx1010:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1102 gfx1103 ( if you arches are not on the lists or multi-gpu , please build yourself with the guide available at wiki , or feel free to share you arches info by type hipinfo in terminal when you have hipsdk availalbe . then the arch lists can add it to the lists)

For a complete list of changes and bug fixes, please check ollama changelog:
ollama/releases

v0.4.4

25 Nov 04:37
4c4e048
Compare
Choose a tag to compare

V0.4.4 is equal to V0.4.5 from ollama/releases

This release OllamaSetup.exe build with `ROCm6.1.2 hipsdk 6.1.2, make sure to replace the libs with v0.6.1.2 otherwise ,it's may fail to detected

Note the drop replacement with ollama-windows-amd64 not working if have earlier version v0.4.0 installed .

ROCmlibs for 6.1.2 available at ROCmlibs for 6.1.2

Important

(update info for those who skip reading the Detailed Installation Guide , Demo Release Version: )
Install and Replace Files: Run the OllamaSetup.exe installer first, replace files in your Ollama program folder with the rocblas.dll and rocblas/library folder matches your GPU architecture with the correct ROCmlibs for 6.1.2.(eg. the file in `C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama)

Support lists gfx900 gfx902 gfx906:xnack- gfx90a:xnack- gfx1010:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1102 gfx1103 ( if you arches are not on the lists or multi-gpu , please build yourself with the guide available at wiki , or feel free to share you arches info by type hipinfo in terminal when you have hipsdk availalbe . then the arch lists can add it to the lists)

Tip

When a model partially loads onto shared VRAM, even with sufficient total VRAM, response times become excessively
slow. Reinstalling the graphics drivers typically resolves this issue.

Note

For GFX803 and GFX90C users, recommend using the earlier release bundled with ROCm 5.7. However, due to its
limited user and lower performance as reported by some gfx803 users, ... considering removing it from supported
options. As an alternative, could potentially downgrade the entire project from ROCm 6.1.2 to 5.7. Do you have
any other suggestions?

For a complete list of changes and bug fixes, please check ollama changelog:
ollama/releases

v0.4.2

19 Nov 04:24
8b2fc10
Compare
Choose a tag to compare

This release OllamaSetup.exe build with `ROCm6.1.2 hipsdk 6.1.2, make sure to replace the libs with v0.6.1.2 otherwise ,it's may fail to detected

Note the drop replacement with ollama-windows-amd64 not working if have earlier version v0.4.0 installed .

ROCmlibs for 6.1.2 available at ROCmlibs for 6.1.2

If you encounter issues with certain GPUs being undetected by ROCm 6.1.2, It is recommend using ROCm 5.7 as an
alternative. You can download the appropriate version for your system: ollama-windows-amd64-rocm5.7.7z

ROCmlibs for 5.7 available at ROCmlibs for 5.7

Important

(update info for those who skip reading the Detailed Installation Guide , Demo Release Version: )
Install and Replace Files: Run the OllamaSetup.exe installer first, replace files in your Ollama program folder with the rocblas.dll and rocblas/library folder matches your GPU architecture with the correct ROCmlibs for 6.1.2.(eg. the file in `C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama)

Support lists gfx803 gfx900 gfx902 gfx90c:xnack- gfx906:xnack- gfx90a:xnack- gfx1010:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1102 gfx1103 ( if you arches are not on the lists or multi-gpu , please build yourself with the guide available at wiki , or feel free to share you arches info by type hipinfo in terminal when you have hipsdk availalbe . then the arch lists can add it to the lists)

For a complete list of changes and bug fixes, please check ollama changelog:
ollama/releases

v0.4.1

09 Nov 04:11
e0d2c33
Compare
Choose a tag to compare

This release OllamaSetup.exe build with ROCm5.7 (hipsdk 5.7) due to the upstream ollama breaking change, make sure to replace the libs with v0.5.7 otherwise ,it's may fail to detected

Note the drop replacement with ollama-windows-amd64 not working if have earlier version installed .

ROCmlibs for 5.7 available at ROCmlibs for 5.7

Important

(update info for those who skip reading the first line , the wiki guide )
Install and Replace Files: Run the OllamaSetup.exe installer first, replace files in your Ollama program folder with the rocblas.dll and rocblas/library folder matches your GPU architecture with the correct ROCmlibs for 5.7.(eg. the file in `C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama)

Support lists for rocm5.7 gfx803 gfx900 gfx902 gfx90c:xnack- gfx940 gfx941 gfx942 gfx1010:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1102 gfx1103 ( if you arches are not on the lists or multi-gpu , please build yourself with the guide available at wiki , or feel free to share you arches info by type hipinfo in terminal when you have hipsdk availalbe . then the arch lists can add it to the lists)

For a complete list of changes and bug fixes, please check ollama changelog:
ollama/releases

v0.3.14

21 Oct 10:52
b8b8a38
Compare
Choose a tag to compare

For a complete list of changes and bug fixes, please check ollama changelog:
ollama/releases

v0.3.13

13 Oct 05:18
77da3e3
Compare
Choose a tag to compare

For a complete list of changes and bug fixes, please check ollama changelog:
ollama/releases

v0.3.11

21 Sep 06:52
c8d6d9a
Compare
Choose a tag to compare
  • Detailed Installation Guide: please refer to the wiki guide:
    Demo Release Version:

  • exit status 0xc0000005: no gpu detected, run on cpu
    trouble-shootings

  • ollama-windows-amd64-rocm-5.7.7z: For those cards don't support ROCm 6.1.2

For a complete list of changes and bug fixes, please check ollama changelog:
ollama/releases

v0.3.10

09 Sep 11:34
486ae43
Compare
Choose a tag to compare

For a complete list of changes and bug fixes, please check ollama changelog:
ollama/releases