Dreams of aligned AI give up too much agency to the machine, and assume “human values” are more stable than they are.