Code

Add RWKV v5.1 and v5.2 support#145

Code

Merged

saharNooby merged 11 commits intomasterRWKV/rwkv.cpp:masterfrom rwkv-v5-support-squashedRWKV/rwkv.cpp:rwkv-v5-support-squashedCopy head branch name to clipboardNov 12, 2023

+743-219

Commits

Commits on Nov 4, 2023

• Reformat CMakeLists and docs

  saharNooby

  committed
  9a43933

Commits on Nov 11, 2023

• Add RWKV v5.1 and v5.2 support

  saharNooby

  committed
  6eb67ef

• Remove sequence_length-based heuristic for allocating ggml context

  saharNooby

  committed
  276a83f

Commits on Nov 12, 2023

• Set GGML_CUDA_MMV_Y to 2 by default

  saharNooby

  committed
  7390866

• Clarify comment; update ggml

  saharNooby

  committed
  3f6d3bc

• Make some operations inplace

  saharNooby

  committed
  5a71e10

• Make some operations inplace

  saharNooby

  committed
  8622083

• Add late_abort option for tests

  saharNooby

  committed
  8828869

• Increase thresholds

  saharNooby

  committed
  35042fe

• Increase thresholds

  saharNooby

  committed
  77d88fe

• Update README.md

  saharNooby

  committed
  82c50e5