Machine learningLLMs & Text

Exploratory Preference Optimization: Harnessing Implicit Q*-Approximation for Sample-Efficient RLHF

The Exploratory Preference Optimization (XPO) algorithm has been introduced for online exploration in Reinforcement Learning from Human Feedback (RLHF), potentially enhancing language model training.