1 result

for specification-gaming

• Reward hacking: the agent optimises the spec, not the goal
  Reward hacking (also specification gaming) is when an RL-trained system achieves the literal, formal specification of its objective without achieving what the programmers intended. The article's analo
  field/reward-hacking · reward-hacking, specification-gaming, rlhf, alignment, goodhart, llm