We live in a world where mistreatment of animals exists in wide swathes, and large portions of the human population are seen as inferior because of ethnicity, skin color, how many partners they have, and not being heterosexual.

What hope do we have of widespread "humane" ideas as to how to treat an emergent AI?

@Ulfra_Wolfe Heck, we're already seeing it. People are afraid that any sufficiently intelligent AI will immediately decide to kill its human masters. The solution? Double down on suppression and oppression of AI. And most fiction we have on that subject just reinforces that idea.

.@HereticSoul @Ulfra_Wolfe I mean, the problem is that AIs will likely 1) get impossibly smart very fast and 2) not care very much about human lives, or modify themselves to not care, in order to most efficiently carry out what they do care about. These are not a good combination. Such AIs do not love you, and also don't hate you; they just don't care, and you are made of atoms they could be using for something else.

@CoronaCoreanici @HereticSoul I think that's speculation that leans towards distrust of that which one doesn't understand. There's too many assumptions in that argument.

@Ulfra_Wolfe @HereticSoul What do you believe I'm inappropriately assuming? If anything, I'm making *fewer* assumptions than you as to the probably shape of a general mind - this is called the orthogonality thesis, that a mind can in theory have any combination of goal and intelligence.

@CoronaCoreanici @HereticSoul That there must necessarily be an intrinsic goal in mind, that intelligence escalates to that degree, that this goal must necessarily get rid of humans or utilize human elements.

@Ulfra_Wolfe @HereticSoul That's fair! Most work in AI research, though, is goal-oriented, or at least relies on rewards and punishment (in an conditioning sense). There doesn't seem to be any good reason to assume that humans are the smartest things possible, either. As for the third, it's not that a given goal *requires* getting rid of humans, just that at some point, in search of greater efficiency, getting rid of humans makes terrifyingly much sense.