Code

Add initial support for RWKV v6#174

Code

Merged

PicoCreator merged 8 commits intoRWKV:masterRWKV/rwkv.cpp:masterfrom MollySophia:rwkv6MollySophia/rwkv.cpp:rwkv6Copy head branch name to clipboardJul 2, 2024

+598-78

Commits

Commits on Jun 21, 2024

• Initial support for RWKV v6.

  Show description for 458298f
  MollySophia

  committed
  458298f

Commits on Jun 22, 2024

• Fix sequence mode for RWKV v6

  Show description for 10d973a
  MollySophia

  committed
  10d973a

• RWKV v6: Add lora merging

  Show description for 9d5797f
  MollySophia

  committed
  9d5797f

Commits on Jun 24, 2024

• Add tiny-rwkv test for RWKV v6

  Show description for 2c14946
  MollySophia

  committed
  2c14946

• RWKV v6: Make outputs correct and update test values

  Show description for edea0c2
  MollySophia

  committed
  edea0c2

• Apply some code-format changes

  Show description for 2c8daac
  MollySophia

  committed
  2c8daac

Commits on Jun 25, 2024

• tests: Use tiny-rwkv-6v0-3m

  Show description for 29ca869
  MollySophia

  committed
  29ca869

Commits on Jun 27, 2024

• Converter: Fix a problem when tensor cannot be converted to numpy

  Show description for 3c4c01f
  MollySophia

  committed
  3c4c01f