Goal-Conditioned Supervised Learning for LLM Fine-Tuning
Goal-Conditioned Supervised Learning (GCSL) reframes LLM fine-tuning by treating feedback scores as explicit goals, enabling high efficiency without online reinforcement learning. It uses a 'beyond-threshold' formulation to train models to consistently pursue quality improvements above set targets, outperforming standard supervised methods.