Discussion about this post

User's avatar
Nathan Metzger's avatar

It's been a hard lesson to learn that not everyone is on the same side. Down at the bottom of the stack, I have more in common with my worst political enemies domestically and abroad then any of us will ever have in common with the likes of Richard Sutton or Nick Bostram.

Some AGI company employees at least approximately share my values, but are being very foolish and naive in the way they are choosing to operationalize them. This is where my empathy and sympathy diverge.

Aaron Bergman's avatar

I think this is the correct stance in an important sense, but sometimes from a purely impartial POV things that superficially look like “wink, it’s cool” are substantively good strategic maneuvers, and you don’t want to count those out ex ante

I’m not sure exactly how this maps on to Pause AI, but the first thing that comes to mind are signals of good faith

Even if you rightly and justly despise your negotiation partner, if they have some power and you have some power, you might find yourself in negotiations with them and it can be good by your own lights to signal that you’re not going to renege or stab them in the back or use your negotiation to try to hurt them in ways that are necessary to defend against (and thereby harm you as well)

1 more comment...

No posts

Ready for more?