Code

feat: WIP: Adjust GPU Layers#3737

Code

Draft

siddimore wants to merge 27 commits intomudler:mastermudler/LocalAI:masterfrom siddimore:adjust_default_gpu_layerssiddimore/LocalAI:adjust_default_gpu_layersCopy head branch name to clipboard

+690-1

Commits

Commits on Oct 6, 2024

• Add GGUF Parser

  Show description for 790700b
  siddimore

  committed
  790700b

• chore: ⬆️ Update ggerganov/llama.cpp to a39ab216aa624308fda7fa84439c6b61dc98b87a (mudler#3718)

  Show description for a234da5
  

  2 peopleauthored and

  siddimore

  committed
  a234da5

• chore: ⬆️ Update ggerganov/whisper.cpp to ede1718f6d45aa3f7ad4a1e169dfbc9d51570c4e (mudler#3719)

  Show description for a3a03a4
  

  2 peopleauthored and

  siddimore

  committed
  a3a03a4

• chore(federated): display a message when nodes are not available (mudler#3721)

  Show description for 0dc66a6
  

  mudler

  authored and

  siddimore

  committed
  0dc66a6

• Update CONTRIBUTING.md (mudler#3723)

  Show description for 717978e
  

  jjasghar

  authored and

  siddimore

  committed
  717978e

• models(gallery): add salamandra-7b-instruct (mudler#3726)

  Show description for 78e29f3
  

  mudler

  authored and

  siddimore

  committed
  78e29f3

• chore: ⬆️ Update ggerganov/llama.cpp to d5ed2b929d85bbd7dbeecb690880f07d9d7a6077 (mudler#3725)

  Show description for af1eb1d
  

  2 peopleauthored and

  siddimore

  committed
  af1eb1d

• chore: ⬆️ Update ggerganov/whisper.cpp to ccc2547210e09e3a1785817383ab770389bb442b (mudler#3724)

  Show description for 16dfee9
  

  2 peopleauthored and

  siddimore

  committed
  16dfee9

• feat(multimodal): allow to template placeholders (mudler#3728)

  Show description for 0ec4dc6
  

  mudler

  authored and

  siddimore

  committed
  0ec4dc6

• Update README.md

  Show description for bb130ff
  

  mudler

  authored and

  siddimore

  committed
  bb130ff

• feat(vllm): add support for image-to-text and video-to-text (mudler#3729)

  Show description for 5b19cee
  

  mudler

  authored and

  siddimore

  committed
  5b19cee

• chore: ⬆️ Update ggerganov/llama.cpp to 71967c2a6d30da9f61580d3e2d4cb00e0223b6fa (mudler#3731)

  Show description for 2d11bfc
  

  2 peopleauthored and

  siddimore

  committed
  2d11bfc

• chore: ⬆️ Update ggerganov/whisper.cpp to 2944cb72d95282378037cb0eb45c9e2b2529ff2c (mudler#3730)

  Show description for fc74bf1
  

  2 peopleauthored and

  siddimore

  committed
  fc74bf1

• feat(shutdown): allow force shutdown of backends (mudler#3733)

  Show description for 4dffc45
  

  mudler

  authored and

  siddimore

  committed
  4dffc45

• fix(base-grpc): close channel in base grpc server (mudler#3734)

  Show description for 1c0300b
  

  mudler

  authored and

  siddimore

  committed
  1c0300b

• chore: ⬆️ Update ggerganov/whisper.cpp to 6a94163b913d8e974e60d9ac56c8930d19f45773 (mudler#3735)

  Show description for 64ade06
  

  2 peopleauthored and

  siddimore

  committed
  64ade06

• chore: ⬆️ Update ggerganov/llama.cpp to 8c475b97b8ba7d678d4c9904b1161bd8811a9b44 (mudler#3736)

  Show description for a8f095a
  

  2 peopleauthored and

  siddimore

  committed
  a8f095a

• fix pr comment

  Show description for 1ad80c9
  siddimore

  committed
  1ad80c9

Commits on Oct 7, 2024

• Add tests

  Show description for 6dee2a6
  siddimore

  committed
  6dee2a6

• Save Model Memory Usage

  Show description for 6d1199d
  siddimore

  committed
  6d1199d

• fix merge conflict

  Show description for eaee726
  siddimore

  committed
  eaee726

• Merge branch 'master' into adjust_default_gpu_layers

  mudler

  authored
  0a306c8

• Merge branch 'master' into adjust_default_gpu_layers

  mudler

  authored
  e2fb38f

Commits on Oct 8, 2024

• Add code to query NVIDIA device

  Show description for 18bcce2
  siddimore

  committed
  18bcce2

• Merge branch 'master' into adjust_default_gpu_layers

  siddimore

  authored
  37f2d65

Commits on Oct 9, 2024

• Add AdjustGPULayers flag

  Show description for 7380f80
  siddimore

  committed
  7380f80

• rename file

  Show description for cd1dc5d
  siddimore

  committed
  cd1dc5d