arXivML & AI Methods

VickreyFeedback: Cost-efficient Data Construction for Reinforcement Learning from Human Feedback

An auction mechanism is introduced to enhance cost-efficiency in fine-tuning large language models using Reinforcement Learning from Human Feedback, focusing on quality feedback and model performance.