Machine learningLLMs & Text

DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs

Outlier Management for LLMs: DuQuant, a new method for quantizing large language models, uses rotation and permutation transformations to manage outliers, surpassing performance of existing baselines in various tasks.