In science fiction, AIs tend to malfunction due to some technicality of logic, such as that business with the laws of robotics and an AI reaching a dramatic, ironic conclusion.
Content regulation algorithms tell me that sci-fi authors are overly generous in these depictions.
“Why did cop bot arrest that nice elderly woman?”
“It insists she’s the mafia.”
“It thinks she’s in the mafia?”
“No. It thinks she’s an entire crime family. It filled out paperwork for multiple separate arrests after bringing her in.”
I have to comment on this because this is touching on something I see a lot of people (including Tumblr staff and everyone else who uses these kind of deep learning systems willy-nilly like this) don’t quite get: “Deep Reinforcement Learning” AI like these engage with reality in a fundamentally different way from humans. I see some people testing the algorithm and seeing where the “line” is, wondering whether it looks for things like color gradients, skin tone pixels, certain shapes, curves, or what have you. All of these attempts to understand the algorithm fail because there is nothing to understand. There is no line, because there is no logic. You will never be able to pin down the “criteria” the algorithm uses to identify content, because the algorithm does not use logic at all to identify anything, only raw statistical correlations on top of statistical correlations on top of statistical correlations. There is no thought, no analysis, no reasoning. It does all its tasks through sheer unconscious intuition. The neural network is a shambling sleepwalker. It is madness incarnate. It knows nothing of human concepts like reason. It will think granny is the mafia.
This is why a lot of people say AI are so dangerous. Not because they will one day wake up and be conscious and overthrow humanity, but that they (or at least this type of AI) are not and never will be conscious, and yet we’re relying on them to do things that require such human characteristics as logic and any sort of thought process whatsoever. Humans have a really bad tendency to anthropomorphize, and we’d like to think the AI is “making decisions” or “thinking,” but the truth is that what it’s doing is fundamentally different from either of those things. What we see as, say, a field of grass, a neural network may see as a bus stop. Not because there is actually a bus stop there, or that anything in the photo resembles a bus stop according to our understanding, but because the exact right pixels in the photo were shaded in the exact right way so that they just so happened to be statistically correlated with the arbitrary functions it created when it was repeatedly exposed to pictures of bus stops over and over. It doesn’t know what grass is, what a bus stop is, but it sure as hell will say with 99.999% certainty that one is in fact the other, for reasons you can’t understand, and will drive your automated bus off the road and into a ditch because of this undetectable statistical overlap. Because a few pixels were off in just the right way in just the right places and it got really, really confused for a second.
There, I even caught myself using the word “confused” to describe it. That’s not right, because “confused” is a human word. What’s happening with the AI is something we don’t have the language to describe.
Anyway what’s more, this sort of trickery can be mimicked. A human wouldn’t be able to figure it out, but another neural network can easily guess the statistical filters it uses to identify things and figure out how to alter images with some white noise in exactly the right way to make the algorithm think it’s actually something else. It’ll still look like the original image, just with some pixelated artifacts, but the algorithm will see it as something completely different. This is what’s known as a “single pixel attack.” I am fairly confident porn bot creators might end up cracking the content flagging algorithm and start putting up some weirdly pixelated porn anyway, and all of this will be in vain. All because Tumblr staff decided to rely on content moderation via slot machine.
TL;DR bots are illogical because they’re actually unknowable eldritch horrors made of spreadsheets and we don’t know how to stop them or how they got here, send help
And Godot would know!
What do you Godot’s not an AI?
It’s also worth pointing out that algorithms cannot help but to end up replicating the inherent biases of the system it is ‘learning’ from.
Tag: science fiction
here is a concept that I’m still trying to flesh out: medieval science fiction.
not, of course, aliens land during the middle ages, though I’ve read and enjoyed that, but something much more difficult to execute, if it’s possible at all: space opera (exempli gratia) as written by Bede or Gildas or Geoffrey of Monmouth.
The challenge is, of course, that you have to get into the medieval mind (ok, I know that talking about “the” medieval mind is fallacious) and figure out what they’d keep from their world and what they’d think to change – what is the analogue to ‘50s writers giving us faster than light travel & radioactive planets & psionics and still having gender and family politics that are identical to ‘50s middle class American politics? I have a feeling it’s the Church – it’s true that there are several books with Space Popes, but it tends to be a rebirth of the Papacy. I doubt a medieval science fiction writer would have the Church decline or even guess at the Reformation.
Also, sci-fi tech tends to be, both aesthetically and functionally, an extension of tech the society it’s from already has – does a medieval space ship look like a siege tower? How do they envision the instant communication I’m sure they’d have to have as working? Would it be through magic (which is often the case in modern sci-fi)?
And what would the spirit of it be? I would argue that, while you can’t really generalize over an entire field, and there is certainly some bleak sci-fi, the general tenor of American sci-fi is hopeful & enamored of the human spirit. Is the point of medieval space travel to find God*? Will leaving Earth leave behind Original Sin? Are we going to convert the Martians?
DO they need instant communication? I mean, even star wars still has people carrying thumb drives around. There could be a pigeon analogue – sleek little machines flitting between the stars carrying messages, or perhaps creatures already native to the higher spheres suited to the task. Venusian swallowtails, mercurial spirits.
I’d love to see the heavenly spheres as a setting for this all on its own, too. What’s the first moment a traveler hears the music like?
I could see a lot of it through the lens of knights on impossible quests – why not ascend the sky? Knights riding on bright steeds of golden fire known as comets. Knights finding allegorical realms on the various planets, like the Kingdom of Love from Capellanus’ Treatise on The Arts of Courtly Love, but set in the golden mountains of Venus, and you could have a Kingdom of War and a Kingdom of Wit and a Kingdom of Time on Mercury and Mars and Saturn. Prester John could be from Jupiter!
I’m not sure about the ways I would expect medieval scifi to be subversive, but I might look at Marie de France for ideas, she plays a lot with expectation and obligation and the implications of gender in her Lais, in very clever ways.
medievals didn’t have the concept of vacuum, let alone know that space doesn’t have air. everything is open ships and space sails. gravity isn’t oriented to the planet, there’s a universal ‘down’. engines are driven by people or animals or wind or water, not burning fuel; your space chariot is pulled by cloud horses or sun lions.
other planets are not other earths, they’re allegorical locations populated by allegorical creatures. angels, demons, dreamers, cannibals, a planet of all women and a planet of all men – but not for 1950′s bikini shenanigans, more as a parable about how the sexes can’t get along without each other because men’s work and women’s work are both necessary. no concept that men could do women’s work and vice-versa, or at least do it competently. the men on the men’s planet would like, grow children in their fields, but wean them on burnt bread soaked in beer because they’re terrible at milking cows and kneading dough, or something like that.
there’s a Renaissance thing, Orlando Furioso, in which the knight Astolfo gets to the moon in Elijah’s burning chariot. (He goes to the moon because everything that has been lost on Earth can be found there, including Orlando’s sanity, because of course.)
I think I’d argue that theological allegory, like the Divine Comedy or the Vision of Piers Plowman, pretty much is medieval science fiction: speculations and warnings and encouragement, based on what is known-or-believed-to-be-known. As I understand it, the general opinion of medieval European scholars was that theology was THE most important thing to know about; studying the Creator more fervently than the creation was considered pretty much the same degree of Obviously Sensible as, say, studying birds doing bird things and being birds instead of just looking at empty nests and eggshells would be to us, like, why study mere side-effects when you can study The Entire Truth And Cause Of Everything? So I would argue that theology is the medieval version of twentieth century rocket science and atomic physics as The Coolest Thing To Know About, and thus spec fic based on it is the equivalent of science fiction.
You guys might enjoy a book I remember reading ages ago…Richard Garfinkle’s Celestial Matters. I honestly can’t remember whether I liked it or not, but it’s basically “What if ancient astronomy was totally legit? Okay, adventure time.”
And, going in the opposite direction, for a modern example of someone writing in the style of a medieval travelogue but as if it were true science, check out Umberto Eco’s Baudolino. If you love history and sly wit, Eco’s your man.
I’m drawing a blank at how many people in Medieval Europe knew the Earth was round, and coming up with the possibility of a Universe shaped like an hourglass of sorts, with Earth as the flat plane through the smallest point in the middle, and the Infinite Heavens above and the equally-infinite Infernal Hell below, with “space travel” in two parts: man flying up to the realms of angels and heavenly spheres below the gates of Heaven, and man flying down to the realms of demons and diabolical spheres and, eventually, the gates of Hell.
These spheres would be I suppose something like the Death Star: round castles without an internal center of gravity, composed of layers on which people (or other entities) live and work. There would be spheres ruled by particular angels and demons, saints and noteworthy sinners, whose populace, society, and behavior are all based on that particular entity’s attributes.
The heavenly realms would have a lot of abundance and flying around on angels’ wings, and the infernal realms would have a lot of torture and riding on chariots of fire, and there would probably be a lot of stories focusing on what happens when a person from one side is displaced to the other, sometimes with them settling into (or succumbing to) their new environment, other times reshaping it into something more like themselves (an angel gets taken to hell, takes control of a sphere, and it rises into Heaven, full of rejoicing former-sinners filled with the Love of God, or a demon is brought to a celestial sphere by someone who wants to show off their power, and the demon carefully subverts the whole population and they rejoice as their sphere sinks down into Hell), and other times escaping back to their own place, or just travelling—perhaps there are Captain Jack Sparrow style characters that simply wander through and cause chaos through their “corkscrew in a world of straight lines” breezing through rules not meant to apply to them.
Dammit I want to write like six books’ worth of this now.
just moving along like everyone else 