Pinned Loading

1. PygmalionAI/aphrodite-engine PygmalionAI/aphrodite-engine Public

   Large-scale LLM inference engine

   Python 1.2k 135

2. pygmalion.cpp pygmalion.cpp Public archive

   C/C++ implementation of PygmalionAI/pygmalion-6b

   C 56 5

3. sparsegpt-for-LLaMA sparsegpt-for-LLaMA Public

   Forked from IST-DASLab/sparsegpt

   Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.

   Python 71 4

4. tplib tplib Public

   A torch-based, universal tensor-parallel library.

   Python 3

5. huggingface/transformers huggingface/transformers Public

   🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

   Python 137k 27.4k

6. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 32.7k 5k