Skip to content

Affect of Quantization on Monosemanticity of 1 layered Networks

License

Notifications You must be signed in to change notification settings

RahulSChand/monosemanticity-quantization

Repository files navigation

Monosemanticity on Quantized Models

image

Forked from the https://github.com/neelnanda-io/1L-Sparse-Autoencoder repo with the following changes

  1. Fixed errors in the script so that the training code works out of the box
  2. Added experiments to see affect of quantization on monosemanticity and sparse autoencoder features.
  3. Changes so that the .ipynb file to analyse features runs on generic models (and not just 1 layer)

About

Affect of Quantization on Monosemanticity of 1 layered Networks

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages