Amazing video that explains plainly a very (at least what seems like to me) complicated space of work.

Source: Toy model of the AI control problem: animated version