Machine learningLLMs & Text

Bridging the Training-Inference Gap in LLMs by Leveraging Self-Generated Tokens

The paper suggests two methods to address the discrepancy between training and inference time in language models, resulting in enhanced performance in tasks like summarization and question-answering.