https://smile.amazon.com/gp/product/B004GUU2PS

Fascinating premise, but desperately in need of a good editor.

Implications:

But judgment of goals depends on goals - recursive, reflective judgment

Not as simple as S1 vs S2

Ultimately, doesn’t really cast any light on how to choose goals, but the reverse-ai-safety framing is provocative.