vector rewards

Vector Policy Optimization boosts search diversity

VPO trains language models to produce diverse solutions that work better in test-time search.