---
title: SliceGPT: Compress Large Language Models by Deleting Rows and Columns
url: https://www.ml-quant.com/papers/arxiv/2401.15024/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-09-26
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2401.15024
source_url: https://arxiv.org/abs/2401.15024
featured: 2024-01-30
citations: 466
topic: LLMs & Text
---


# SliceGPT: Compress Large Language Models by Deleting Rows and Columns

Compressing Language Models: The paper introduces SliceGPT, a post-training sparsification scheme for large language models that reduces the network's embedding dimension, maintains high performance, reduces inference computation, and reveals computational invariance in transformer networks.

- Source: https://arxiv.org/abs/2401.15024
- Identifier: arXiv:2401.15024
- Released: 2024-01-26
- First featured: Quant Letter No. 35 (2024-01-30): https://www.ml-quant.com/issues/2024-01-30/
- Citations (Semantic Scholar): 466
- Published in: International Conference on Learning Representations
- Topic: LLMs & Text

## Related

- [You Only Cache Once: Decoder-Decoder Architectures for Language Models](https://www.ml-quant.com/papers/arxiv/2405.05254/): YOCO architecture improves large language models by reducing GPU memory usage and speeding up the prefill stage, outperforming the Transformer model.
- [Efficient Adversarial Training in LLMs with Continuous Attacks](https://www.ml-quant.com/papers/arxiv/2405.15589/): CAdvUL, a new adversarial training algorithm, enhances the resilience of large language models against adversarial attacks by efficiently calculating attacks in the continuous embedding space.
- [Gecko: Versatile Text Embeddings Distilled from Large Language Models](https://www.ml-quant.com/papers/arxiv/2403.20327/): Compact Text Embeddings: Gecko is a new text embedding model that improves knowledge extraction from large language models, surpassing other models in the Massive Text Embedding Benchmark.
- [GPT in Game Theory Experiments](https://www.ml-quant.com/papers/arxiv/2305.05516/): The research shows that Generative Pre-trained Transformers (GPT) can mimic human responses in strategic games and can be influenced by fairness or selfishness traits.
- [CoLLEGe: Concept Embedding Generation for Large Language Models](https://www.ml-quant.com/papers/arxiv/2403.15362/): Embedding Generation: CoLLEGe, a new meta-learning framework, is presented which enhances the ability of language models to learn new concepts quickly using a few example sentences or definitions.
- [Transformer Explainer: Learning LLM Transformers with Interactive Visual Explanation and Experimentation](https://www.ml-quant.com/papers/arxiv/2408.04619/): Transformer Explainer, an interactive tool, is unveiled to help non-experts understand Transformers through the GPT-2 model, allowing real-time user input experimentation.