Machine learningLLMs & Text

ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization

ShiftAddLLM is a new method developed to speed up large language models on devices with limited resources by replacing complex multiplications with simpler operations, thus reducing memory usage and latency and enhancing model performance.