Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> The original formulation was [...] would decide to torture people

That formulation is not concerning, except to the extent that all AI is concerning due to the possibility of defects in value alignment.

> You can't be blackmailed by something that doesn't exist yet unless you want to be.

https://www.gwern.net/docs/fiction/2011-yvain-fermiparadox.h...



> Unless...and here 9-tsiak's agent-modeling systems came online...unless ve could negotiate a conditional surrender.

9-tsiak wanted to be. Or, at least, had good reason to risk the possibility.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: