Machine learningLLMs & Text

Training Large Language Models to Reason in a Continuous Latent Space

The article presents Coconut, a new approach that uses the last hidden state of large language models for reasoning in an unrestricted latent space, proving its effectiveness in enhancing the LLM on multiple reasoning tasks.