Just saw this post by Scott Alexander. It's pretty cool. http://slatestarcodex.com/superintelligence-faq/

@aeonofdiscord @Azure Often when talking about AI, you'll see people go "We shouldn't be worried about AI because of that, we should be worried about AI because of this!"

As a general principle, I disagree with the first part and agree with the last part. As I said earlier, "the whole domain has more possible catastrophes than you can shake a stick at. :/"

Should we worry about unfriendly AI? or AI controlled by bad actors? Is this a problem now, in the algorithms we use today? Or a problem in the days to come?

I think the answer is yes. :V

@Angle @Azure for me contemporary data-mining and large-scale information control by private/state actors is A Big Problem, and I'd prioritise it over future problems that can only be addressed speculatively

@aeonofdiscord @Azure Mmm, I'd agree? Though in my mind, our biggest problem is that we're not smart enough to even really be able to understand what our problems are. Have you seen my Agora forum software, by any chance? There's a link in my profile. Its a new kind of Internet forum designed to make it easier to talk about complicated topics with lots of people like this. XD