Untold AI: The survey

What AI Stories Aren’t We Telling (That We Should Be)?

HAL

Last fall I was invited with some other spectacular people to participate in a retreat about AI, happening at the Juvet Landscape Hotel in Ålstad, Norway. (A breathtaking opportunity, and thematically a perfect setting since it was the shooting location for Ex Machina. Thanks to Andy Budd for the whole idea, as well as Ellen de Vries, James Gilyead, and the team at Clearleft who helped organize.) The event was structured like an unconference, so participants could propose sessions and if anyone was interested, join up. One of the workshops I proposed was called “AI Narratives” and it sought to answer the question “What AI Stories Aren’t We Telling (That We Should Be)?” So, why this topic?

Sci-fi, my reasoning goes, plays an informal and largely unacknowledged role in setting public expectations and understanding about technology in general and AI in particular. That, in turn, affects public attitudes, conversations, behaviors at work, and votes. If we found that sci-fi was telling the public misleading stories over and over, we should make a giant call for the sci-fi creating community to consider telling new stories. It’s not that we want to change sci-fi from being entertainment to being propaganda, but rather to try and take its role as informal opinion-shaper more seriously.

Juvet sign

In the workshop we were working with a very short timeframe, so we managed to do good work, but not get very far, even though we doubled our original time frame. I have taken time since to extend that work to get to this series of posts for scifiinterfaces.com.

My process to get to an answer will take six big steps.

  1. First I’ll do some term-setting and describe what we managed to get done in the short time we had at Juvet.
  2. Then I’ll share the set of sci-fi films and television shows I identified that deal with AI to consider as canon for the analysis. (Step one and two are today’s post)
  3. I’ll these properties’ aggregated “takeaways” that pertain to AI: What would an audience reasonably presume given the narrative about AI in the real world? These are the stories we are telling ourselves.
  4. Next I’ll look at the handful of manifestos and books dealing with AI futurism to identify their imperatives.
  5. I’ll map the cinematic takeaways to the imperatives.
  6. Finally I’ll run the “diff” to identify find out what stories we aren’t telling ourselves, and hypothesize a bit about why.

Along the way, we’ll get some fun side-analyses, like:

  • What categories of AI appear in screen sci-fi?
  • Do more robots or software AI appear?
  • Are our stories about AI more positive or negative, and how has that changed over time?
  • What takeaways tend to correlate with other takeaways?
  • What takeaways appear in mostly well-rated movies (and poorly-rated movies)?
  • Which movies are most aligned with computer science’s concerns? Which are least?
  • These will come up in the analysis when they make sense.

Longtime readers of this blog may sense something familiar in this approach, and that’s because I am basing the methodology partly on the thinking I did last year for working through the Fermi Paradox and Sci-Fi question. Also, I should note that, like the Fermi analysis, this isn’t about the interfaces for AI, so it’s technically a little off-topic for the blog. Return later if you’re disinterested in this bit.

Zorg fires the ZF-1

Since AI is a big conceptual space, let me establish some terms of art to frame the discussion.

  1. Narrow AI is the AI of today, in which algorithms enact decisions and learn in narrow domains. They are unable to generalize knowledge and adapt to new domains. The Roomba, the Nest Thermostat, and self-driving cars are real-world examples of this kind of AI. Karen from Spider-Man: Homecoming, S.H.I.E.L.D.’s car AIs (also from the MCU), and even the ZF-1 weapon in The Fifth Element are sci-fi examples.
  2. General AI is the as-yet speculative AI that thinks kind of like a human thinks, able to generalize knowledge and adapt readily to new domains. HAL from 2001: A Space Odyssey, the Replicants in Blade Runner, and the robots in Star Wars like C3PO and BB-8 are examples of this kind of AI.
  3. Super AI is the speculative AI that is orders of magnitude smarter than general AI, and thereby orders of magnitude smarter than us. It’s arguable that we’ve really ever seen a proper Super AI in screen sci-fi (because characters keep outthinking it and wut?), but Deep Thought from The Hitchhiker Guide to the Galaxy, the big AI in The Matrix diegesis, and the titular AI from Colossus: The Forbin Project come close.

There are fine arguments to be made that these are insufficient for the likely breadth of AI that we’re going to be facing, but for now, let’s accept these as working categories, because the strategies (and thereby what stories we should be telling ourselves) for each is different.

  • Narrow AI is the AI of now. It’s in the world. (As long as it’s not autonomous weapons,…) It gets safer as it gets more intelligent. It will enable efficiencies, for some domains, never before seen. It will disrupt our businesses and our civics. It, like any technology, can be misused, but the AI won’t have any ulterior motives of its own.
  • General AI is what lots of big players are gunning for. It doesn’t exist yet. It gets more dangerous as it gets smarter, largely because it will begin to approach a semblance of sentience and approach the evolutionary threshold to superintelligence. We will restructure society to accomodate it, and it will restructure society. It could come to pass in a number of ways: a willing worker class, a revolt, new world citizenry. It/they will have a convincing consciousness, by definition, so their motives and actions become a factor.
  • Super AI is the most risky scenario. If we have seeded it poorly, it presents the existential risk that big names like Gates and Musk are worried about. If seeded poorly, it could wipe us out as a side-effect of pursuing its goals. If seeded well, it might help us solve some of the vexing problems plaguing humanity. (c.f. Climate change, inequality, war, disease, overpopulation, maybe even senescence and death.) It’s very hard to really imagine what life will be like in a world with something approaching godlike intelligence. It could conceivably restructure the planet, the solar system, and us to accomplish whatever its goals are.

Since these things are related but categorically so different, we should take care so speak about them differently when talking about our media strategy toward them.

Also I should clarify that I included AI that was embodied in a mobile form, like C-3PO or cylons, and call them robots in the analysis when its pertinent. Other non-embodied AI is just called AI or unembodied.

Those terms established, let me also talk a bit about the foundational work done with a smart group of thinkers at Juvet.

At Juvet

Juvet was an amazing experience generally (we saw the effing northern lights, y’all) and if you’re interested, there was a group write up afterwards, called the Juvet Agenda. Check that out.

Northern lights

My workshop for “AI Narratives” attracted 8 participants. Shouts out to them follows. Many are doing great work in other domains, so give them a look up sometime.

Juvet attendees

To pursue an answer, this team first wrote up every example of an AI in screen-based sci-fi that we could think of on red Post-It Notes. (A few of us referenced some online sources so it wasn’t just from memory.) Next we clustered those thematically. This was the bulk of the work done there.

I also took time to try and simultaneously put together on yellow Post-It Notes a set of Dire Warnings from the AI community, and even started to use Blake Snyder’s Save the Cat! story frameworks to try and categorize the examples, but we ran out of time before we could begin to pursue any of this. It’s as well. I realized later the Save The Cat! Framework was not useful to this analysis.

Save the Cat

Still, a lot of what came out there is baked into the following posts, so let this serve as a general shout-out and thanks to those awesome participants. Can’t wait to meet you at the next one.

But when I got home and began thinking of posting this to scifiinterfaces, I wanted to make sure I was including everything I could. So, I sought out some other sources to check the list against.  

What AI Stories Are We Telling in Sci-Fi?

This sounds simple, but it’s not. What counts as AI in sci-fi movies and TV shows? Do Robots? Do automatons? What about magic that acts like technology? What about superhero movies that are on the “edge” of sci-fi? Spy shows? Are we sticking to narrow AI, strong AI, or super AI, or all of the above? At Juvet and since, I’ve eschewed trying to work out some formal definition, and instead go with loose, English language definitions, something like the ones I shared above. We’re looking at the big picture. Because of this, trying to hairsplit the details won’t serve us.

How did you come up with the survey of AI shows?

So, I wound up taking the shows identified at Juvet and then adding in shows in this list from Wikipedia and a few stragglers tagged on IMDB with AI as a keyword. That processes resulted in the following list.

2001: A Space Odyssey
A.I. Artificial Intelligence
Agents of S.H.I.E.L.D.
Alien
Alien: Covenant
Aliens
Alphaville
Automata
Avengers: Age of Ultron
Barbarella
Battlestar Galactica
Battlestar Galactica
Bicentennial Man
Big Hero 6
Black Mirror “Be Right Back”
Black Mirror “Black Museum”
Black Mirror “Hang the DJ”
Black Mirror “Hated in the Nation”
Black Mirror “Metalhead”
Black Mirror “San Junipero”
Black Mirror “USS Callister”
Black Mirror “White Christmas”
Blade Runner
Blade Runner 2049
Buck Rogers in the 25th Century
Buffy the Vampire Slayer Intervention
Chappie
Colossus: The Forbin Project
D.A.R.Y.L.
Dark Star
The Day the Earth Stood Still
The Day the Earth Stood Still (2008 film)
Demon Seed
Der Herr der Welt (i.e. Master of the World)
Dr. Who
Eagle Eye
Electric Dreams
Elysium
Enthiran
Ex Machina
Ghost in the Shell
Ghost in the Shell (2017 film)
Her
Hide and Seek
The Hitchhiker’s Guide to the Galaxy
I, Robot
Infinity Chamber
Interstellar
The Invisible Boy
The Iron Giant
Iron Man
Iron Man 3
Knight Rider
Logan’s Run
Max Steel
Metropolis
Mighty Morphin Power Rangers: The Movie
The Machine
The Matrix
The Matrix Reloaded
The Matrix Revolutions
Moon
Morgan
Pacific Rim
Passengers (2016 film)
Person of Interest
Philip K. Dick’s Electric Dreams (Series) “Autofac”
Power Rangers
Prometheus
Psycho-pass: The Movie
Ra.One
Real Steel
Resident Evil
Resident Evil: Extinction
Resident Evil: Retribution
Resident Evil: The Final Chapter
Rick & Morty “The Ricks Must be Crazy”
RoboCop
Robocop (2014 film)
Robocop 2
Robocop 3
Robot & Frank
Rogue One: A Star Wars Story
S1M0NE
Short Circuit
Short Circuit 2
Spider-Man: Homecoming
Star Trek First Contact
Star Trek Generations
Star Trek: The Motion Picture
Star Trek: The Next Generation
Star Wars
Star Wars: Episode I – The Phantom Menace
Star Wars: Episode II – Attack of the Clones
Star Wars: Episode III – Revenge of the Sith
Star Wars: The Force Awakens
Stealth
Superman III
The Terminator
Terminator 2: Judgment Day
Terminator 3: Rise of the Machines
Terminator Genisys, aka Terminator 5
Terminator Salvation
Tomorrowland
Total Recall
Transcendence
Transformers
Transformers: Age of Extinction
Transformers: Dark of the Moon
Transformers: Revenge of the Fallen
Transformers: The Last Knight
Tron
Tron: Legacy
Uncanny
WALL•E
WarGames
Westworld
Westworld
X-Men: Days of Future Past
 

Now sci-fi is vast, and more is being created all the time. Even accounting for the subset that has been committed to television and movie screens, it’s unlikely that this list contains every possible example. If you want to suggest more, feel free to add them in the comments. I am especially interested in examples that would suggest a tweak to the strategic conclusions at the end of this series of posts.

Did anything not make the cut?

A “greedy” definition of narrow AI would include some fairly mundane automatic technologies. The doors found in the Star Trek diegesis, for example, detect many forms of life (including synthetic) and even gauge the intentions of its users to determine whether or not they should activate. That’s more sophisticated than it first seems. (There was a chapter all about sci-fi doors that wound up on the cutting room floor of the book. Maybe I’ll pick that up and post it someday.) But when you think about this example in terms of cultural imperatives, the benefits of the door are so mundane, and the risks near nil (in the Star Trek universe they work perfectly, even if on set they didn’t), it doesn’t really help us answer the ultimate question driving these posts. Let’s call those smart, utilitarian, low-risk technologies mundane, and exclude those.

TOS door blooper

That’s not to say workaday, real-world narrow AI is out. IBM’s Watson for Oncology (full disclosure: I’ve worked there the past year and a half) reads X-rays to help identify tumors faster and more accurately than human doctors can keep up with. (Fuller disclosure: It is not without its criticisms.)…(Fullest disclosure: I do not speak on behalf of IBM anywhere on this blog.)

Watson for Oncology winds up being workaday, but still really valuable. It would be great to see such benefits to humanity writ in sci-fi. It would remind us of why we might pursue it even though it presents risk. On the flip side, mundane examples can have pernicious, hard-to-see consequences when implemented at a social scale, and if it’s clear a sci-fi narrow AI illustrates those kind of risks, it would be very valuable to include.

Also comedy may have AI examples, but for the same reason those examples are very difficult to review, they’re also difficult to include in this analysis. What belongs to the joke and what should be considered actually part of the diegesis? So, say, the Fembots from Austin Powers aren’t included.

No Austin Powers

Why not rate individual AIs?

You’ll note that I put The Avengers: Age of Ultron on one line, rather than listing Ultron, JARVIS, Friday, and Vision as separate things to consider. I did this because the takeaways (detailed in the next post) are tied to the whole story, not just the AI. If a story only has evil AIs, the implied imperative is to steer clear of AI. If a story only has good AIs, it implies we should step on the gas. But when a story has both, the takeaway is more complicated. Maybe it is that we should avoid the thing that made the evil AI evil, or to ensure that AI has human welfare baked into its goals and easy ways to unplug it if it’s become clear that it doesn’t. These examples show that it is the story that is the profitable chunk to examine.

Ultrons

TV shows are more complicated than movies because long-running ones, like Dr. Who or Star Trek, have lots of stories and the strategic takeaways may have changed over episodes much less the decades. For these shows, I’ve had to cheat a little and talk just about Daleks, say, or Data. My one-line coverage does them a bit of a disservice. But to keep this on track and not become a months-long analysis, I’ve gone with the very high level summary.

Similarly, franchises (like the overweighted Terminator series) can get more weight because there are many movies. But without dipping down into counting the actual minutes of time for each show and somehow noting which of those minutes are dedicated, conceptually, to AI, it’s practical simply to note the bias of the selected research strategy and move on.

OMFG you forgot [insert show here]!

If you want to suggest additions, awesome. Look at the Google Sheet (link below), specifically page named “properties”, and comment on this post with all the information that would be necessary to fill in a new row with the new show. Please also be aware a refresh of the subsequent analysis will happen only after some time and/or it becomes apparent that the conclusions would be significantly affected by new examples. Remember that since we’re looking for effects at a social level, the blockbusters and popular shows have more weight than obscure ones. More people see them. And I think the blockbusters and popular shows are all there.

So, that’s the survey from which the rest of this was built.

A first, tiny analysis

Once I had the list, I started working with the shows in the survey. Much of the process was managed in a “Sheets” (Google Docs) spreadsheet, which you can see at the link below.

Not wanting to have such a major post without at least some analysis, I did a quick breakdown of this data is how many of these shows each year involve AI. As you might guess, that number has been increasing a little over time, but has significantly spiked after 2010.

showsperyear
Click for a full-size image

Looking at the data, there’s not really many surprises there. We see one or two at the beginning of the prior century. Things picked up following real-world AI hype between 1970–1990. There was a tiny lull before AI became a mainstay in 1999 and ramped up as of 2011.

There’s a bit of statistical weirdness that the years ending in 0 tend not to have shows, but I think that’s just noise.

What isn’t apparent in the chart itself is that cinematic interest in AI did not show a tight mapping to the real-world “AI Winter (a period of hype-exhaustion that sharply reduced funding and publishing) that computer science suffered in 1974–80 and again 1987–93. It seems that, as audiences, we’re still interested in the narrative issues even when the actual computer science has quieted down.

It’s no sursprise that we’ve been telling ourselves more stories about AI over time. But things get more interesting when we look at the tone of those shows, as discussed in the next post.

A shout out for sci-fi 3D file systems

Hey readers. One of scifiinterface’s writers, Hugh Fisher, is embarking on a cross-show analysis of speculative 3D file browsers. He first started thinking of it when viewing Hackers and remembering Jurassic Park. What others can you think of? (Yes, we know of Johnny Mnemonic, but it’s 3D cyberspace, not files, innit?)

Please list others you can think of in the comments (which is here for those reading RSS). The more detail you can provide, the better. And thanks in advance!

Report Card: The Star Wars Holiday Special

Read all the Star Wars Holiday Special reviews in chronological order.

When The Star Wars Holiday Special aired, it was only one year after the first movie, and while Star Wars was an obvious success at the time, no one knew it was bound to become one of the world’s biggest media juggernauts, which would still be producing blockbuster movies in the same diegesis four decades later (with no end in sight). So we can understand, if not forgive, that it was produced as an afterthought, rather than giving it the full attention and deliberateness we’ve since come to expect from the franchise. In short it was a crass way to keep audiences—and the toy purchasing public—thinking about Star Wars until Empire could be released a year and a half later.

It was doomed from the start. CBS wanted to camp on the movie’s success, and stupidly thought to force-choke it into a variety show format, like The Sonny & Cher Jedi Hour or Donny & Marie, Sith Lords, Variety Show. At the time, Lucas couldn’t be bothered to provide much beyond the framework story and a “Wookiee Bible,” (mentioned here) which explained the background and behavior of the Wookiees, including the fact that they were the center of the story and they can only growl. The first director quit after shooting a few scenes. Other than The Faithful Wookiee, the whole thing seems obviously rushed to production. It had about 30 minutes of script that had to be stretched into 90 minutes of airtime. Though they pulled in some respectable TV names of the time (Harvey Korman, Bea Arthur, Art Carney) to carry the thing and even had the stars of the original cast, those actors couldn’t do much with what amounted to a salad of terrible ideas written by and for goldfish: people pegging the S meter on the Myers-Briggs test.

SWHS_generalalert-11

I’m quite fascinated by the Special partly for its narrative—for there is one, dishwater-flavored though it is—which requires us to be in the narrative and yet out of it at the same time, depending on the need, switching back and forth at a moment’s notice. For instance, you must dismiss the fact that Malla would have any interest in pausing her day for 5 minutes to stare at a security camera feed from inside a shop, because you know the point is the scene in the shop. Or, we dismiss the awkwardness of Itchy watching cross-species VR erotica in the family living room because we know that the point is the Mermeia Wow number. Or, we dismiss the tragic implication that Malla may be mentally challenged, because she takes a comedy cooking skit as literal instructions she should attempt to follow, because we know the point is the “comedy.” But how do we (or the toy-purchasing kids that were the target audience) know which parts to dismiss and which parts to indulge? There are no explicit clues. These are fascinating mental jumps for us to have to make.

It’s also interesting from a sci-fi interfaces point of view because, like most children’s shows, the interfaces are worse than an afterthought. They are created by adults (who don’t understand interaction design) merely to signal high-techn-ess to kids, whom they mistakenly believe aren’t very observant, and they do so under insane budgetary and time constraints. So they half-ass what they can, at best, half-ass, and the result is, well, the interfaces from The Star Wars Holiday Special.

Ordinarily I like to reinforce the notions that what designers are doing in reading this blog is building up a necessary skepticism against sci-fi (and plundering it for great ideas, intentional or otherwise), but in this case I can’t really back that up. What we’re doing here is just staring agape in amazement at what can come out of the illusion machine when everything goes wrong.

But, to compare apples-to-oranges, let’s go through the analysis categories:

Report-Card-SWHS.png

Sci: F (0 of 4) How believable are the interfaces?

They are all not just props but obvious props. Straight up tape recorders. Confusing and contradictory user flows. A secret rebel communication device that shrilly…rings. Generally when they are believable, they are very mundane. Like, I’d say the Chef Gourmaand recipe selector or Saun Dann’s final use of the Imperial Comms (which contradicts Malla’s use of the same device.) The Special interfaces break believability all over the place and in terrible ways.

Fi: F (0 of 4) How well do the interfaces inform the narrative of the story?

If I’m being charitable, maaaaaybe some of them help set the tone? The holocircus and cartoon player tell of the gee-whiz high-tech world of this galaxy far far away. But the Groomer, the Jefferson Projection, and the living room masturbation chair are pointless (and unnerving) diversions that distract. Any goodness in Lumpy’s cartoon player is strictly accidental and depend on heavy apologetics. The Life Day orbs have some nice features, but they’re almost extradiegetic, a cinematic conceit. Admittedly the show only gave a nod to a central narrative anyway because of its genre, but it cannot be said that the interfaces inform the narrative.

Interfaces: F (0 of 4) How well do the interfaces equip the characters to achieve their goals?

This is the easiest rating to get, because it’s the thing movies are usually good at. But with the complicated and contradictory flows of the Imperial Comms, “secret” interfaces that rat out the users, extraneous controls and terrible interaction models, these interfaces are a hindrance much more than a help.

Final Grade F (0 of 12), Dreck.

Report-Card-SWHS

Doing this review was so painful, I note it took a little over two years since I started it. In between the first and last post, I’ve had to take a lot of breaks: a manifesto of sorts, a rumination on the Fermi Paradox in sci-fi, and reviews of the Battlestar Galactica mini-series, Johnny Mnemonic, Children of Men, a Black Mirror episode, and Doctor Strange.

I have not had a review at 0 before, so I had to invent the category name. Now if my ratings were recommendations, The Star Wars Holiday Special would get a MUST-SEE, but for cultural reasons. Like, you must see it because otherwise you would not believe it is real. But for inspiration or even skepticism-building, it’s only useful except as a cautionary tale.

For some reason the Special got a lot of attention this past December (c.f. Vanity Fair, Vox, the Nerdist, Newsweek, Mental Floss) which makes me think it was a concentrated stealth push by Disney to coincide with the release of The Last Jedi. Or maybe it’s just other writers, like me, are filled with a kind of psychological wound that the new films always reopen. A fear that we will once again he asked to watch a stormtrooper watch a “holographic” music video with questionable silhouettes.

SWHS-musicVP-09

Whatever their reasons for talking about the Special, for me it serves as a reminder, kind of like The Laughing Gnome or perhaps Spider-Man 3, that even the greats occasionally have to overcome massive, embarrassing, WTF mistakes.

And with that, the review is done. I have gone into the Wampa cave and come out alive. Godspeed, Star Wars Holiday Special.

Star_Wars_Holiday_Special_8x10__67622.1405345638.1280.1280.jpg

Snitch phone

If you’re reading these chronologically, let me note here that I had to skip Bea Arthur’s marvelous turn as Ackmena, as she tends the bar and rebuffs the amorous petitions of the lovelorn, hole-in-the-head Krelman, before singing her frustrated patrons out of the bar when a curfew is announced. To find the next interface of note, we have to forward to when…

Han and Chewie arrive, only to find a Stormtrooper menacing Lumpy. Han knocks the blaster out of his hand, and when the Stormtrooper dives to retrieve it, he falls through the bannister of the tree house and to his death.

SWHS_generalalert-09.png

Why aren’t these in any way affiiiiixxxxxxeeeeeeddddddd?

Han enters the home and wishes everyone a Happy Life Day. Then he bugs out.

SWHS_generalalert-12.png

But I still have to return for the insane closing number. Hold me.

Then Saun Dann returns to the home just before a general alert comes over the family Imperial Issue Media Console.

Continue reading

Bitching about Transparent Screens

I’ve been tagged a number of times on Twitter from people are asking me to weigh in on the following comic by beloved Parisian comic artist Boulet.

Since folks are asking (and it warms my robotic heart that you do), here’s my take on this issue. Boulet, this is for you.

Sci-fi serves different masters

Interaction and interface design answers to one set of masters: User feedback sessions, long-term user loyalty, competition, procurement channels, app reviews, security, regulation, product management tradeoffs of custom-built vs. off-the-shelf, and, ideally, how well it helps the user achieve their goals.

But technology in movies and television shows don’t have to answer to any of these things. The cause-and-effect is scripted. It could be the most unusable piece of junk tech in that universe and it will still do exactly what it is supposed to do. Hell, it’s entirely likely that the actor was “interacting” with a blank screen on set and the interface painted on afterward (in “post”). Sci-fi interfaces answer to the masters of story, worldbuilding, and often, spectacle.

I have even interviewed one of the darlings of the FUI world about their artistic motivations, and was told explicitly that they got into the business because they hated having to deal with the pesky constraints of usability. (Don’t bother looking for it, I have not published that interview because I could not see how to do so without lambasting it.) Most of these things are pointedly baroque where usability is a luxury priority.

So for goodness’ sake, get rid of the notion that the interfaces in sci-fi are a model for usability. They are not.

They are technology in narrative

We can understand how they became a trope by looking at things from the makers’ perspective. (In this case “maker” means the people who make the sci-fi.)

thankthemaker.gif
Not this Maker.

Transparent screens provide two major benefits to screen sci-fi makers.

First, they quickly inform the audience that this is a high-tech world, simply because we don’t have transparent screens in our everyday lives. Sci-fi makers have to choose very carefully how many new things they want to introduce and explain to the audience over the course of a show. (A pattern that, in the past, I have called What You Know +1.) No one wants to sit through lengthy exposition about how the world works. We want to get to the action.

buckrogers
With some notable exceptions.

So what mostly gets budgeted-for-reimagining and budgeted-for-explanation in a script are technologies that are a) important to the diegesis or b) pivotal to the plot. The display hardware is rarely, if ever, either. Everything else usually falls to trope, because tropes don’t require pausing the action to explain.

Secondly (and moreover) transparent screens allow a cinematographer to show the on-screen action and the actor’s face simultaneously, giving us both the emotional frame of the shot as well as an advancement of plot. The technology is speculative anyway, why would the cinematographer focus on it? Why cut back and forth from opaque screen to an actor’s face? Better to give audiences a single combined shot that subordinates the interface to the actors’ faces.

minrep-155

We should not get any more bent out of shape for this narrative convention than any of these others.

  • My god, these beings, who, though they lived a long time ago and in a galaxy far, far away look identical to humans! What frozen evolution or panspermia resulted in this?
  • They’re speaking languages that are identical to some on modern Earth! How?
  • Hasn’t anyone noticed the insane coincidence that these characters from the future happen to look exactly like certain modern actors?
  • How are there cameras everywhere that capture these events as they unfold? Who is controlling them? Why aren’t the villains smashing them?
  • Where the hell is that orchestra music coming from?
  • This happens in the future, how are we learning about it here in their past?

The Matter of Believability

It could be, that what we are actually complaining about is not usability, but believability. It may be that the problems of eye strain, privacy, and orientation are so obvious that it takes us out of the story. Breaking immersion is a cardinal sin in narrative. But it’s pretty easy (and fun) to write some simple apologetics to explain away these particular concerns.

eye-strain

Why is eye strain not a problem? Maybe the screens actually do go opaque when seen from a human eye, we just never see them that way because we see them from the POV of the camera.

privacy

Why is privacy not a problem? Maybe the loss of privacy is a feature, not a bug, for the fascist society being depicted; a way to keep citizens in line. Or maybe there is an opaque mode, we just don’t see any scenes where characters send dick pics, or browse porn, and would thereby need it. Or maybe characters have other, opaque devices at home specifically designed for the private stuff.

orientation

Why isn’t orientation a problem? Tech would only require face recognition for such an object to automatically orient itself correctly no matter how it is being picked up or held. The Appel Maman would only present itself downwards to the table if it was broken.

So it’s not a given that transparent screens just won’t work. Admittedly, this is some pretty heavy backworlding. But they could work.

But let’s address the other side of believability. Sci-fi makers are in a continual second-guess dance with their audience’s evolving technological literacy. It may be that Boulet’s cartoon is a bellwether, a signal that non-technological audiences are becoming so familiar with the real-world challenges of this trope that is it time for either some replacement, or some palliative hints as to why the issues he illustrates aren’t actually issues. As audience members—instead of makers—we just have to wait and see.

Sci-fi is not a usability manual.

It never was. If you look to sci-fi for what is “good” design for the real-world, you will cause frustration, maybe suffering, maybe the end of all good in the ’verse. Please see the talk I gave at the Reaktor conference a few years ago for examples, presented in increasing degrees of catastrophe. (Have mercy regarding the presentation, by the way, I was jet lagged.)

I would say—to pointedly use the French—that the “raison d’être” of this site is exactly this. Sci-fi is so pervasive, so spectacular, so “cool,” that designers must build up a skeptical immunity to prevent its undue influence on their work.

I hope you join me on that journey. There’s sci-fi and popcorn in it for everyone.

Report Card: White Christmas

Read all the Black Mirror, “White Christmas” reviews in chronological order.

I love Black Mirror. It’s not always perfect, but uses great story telling to get us to think about the consequences of technology in our lives. It’s a provocateur that invokes the spirit of anthology series like The Twilight Zone, and rarely shies away from following the tech into the darkest places. It’s what thinking about technology in sci-fi formats looks like.

But, as usual, this site is not about the show but the interfaces, and for that we turn to the three criteria for evaluation here on scifiinterfaces.com.

  1. How believable are the interfaces? Can it work this way? (To keep you immersed.)
  2. How well do the interfaces inform the narrative of the story? (To tell a good story.)
  3. How well do the interfaces equip the characters to achieve their goals? (To be a good model for real-world design?)

Report-Card-White-Christmas

Sci: C (2 of 4) How believable are the interfaces?

There are some problems. Yes, there is the transparent-screen trope, but I regularly give that a cinegenics pass. And for reasons explained in the post I’ll give everything in Virtual Greta’s virtual reality a pass.

But on top of that there are missing navigation elements, missing UI elements, and extraneous UI elements in Matt’s interfaces. And ultimately, I think the whole cloned-you home automation is unworkable. These are key to the episode, so it scores pretty low.

It’s the mundane interfaces like pervy Peeping Tom gallery, the Restraining Order, and the pregnancy test that are wholly believable.

Fi: A (4 of 4) How well do the interfaces inform the narrative of the story?

From the Restraining Order that doesn’t tell you what it’s saying until after you’ve signed it, to the creepy home-hacked wingman interfaces, to the Smartelligence slavery and torture obfuscation, the interfaces help paint the picture of a world full of people and institutions that are psychopathically cruel to each other for pathetic, inhumane reasons. It takes a while to see it, but the only character who can be said to be straight-up good in this episode is the not-Joe’s kid.

Interfaces: A (4 of 4)
How well do the interfaces equip the characters to achieve their goals?

Matt wants to secretly help Harry S be more confident and, yeah, “score.” Beth and Claire want to socially block their partners in the real world. Matt needs easy tools to torture virtual Greta into submission. Greta needs to control the house. Joe wants to snoop on what he believes to be his daughter. Matt wants to extract a confession.  All the interfaces are driven by clear character, social, and institutional goals. They are largely goal-focused, even if those goals are shitty.

For reasons discussed in the Sci section of this review (above), there are problems with the details of the interfaces, but if you were a designer working with no ethical base in a society of psychopaths, yes, these would be pretty good models to build from.

Final Grade B (10 of 12), Must-see.

Report-Card-White-Christmas

Special thanks again to Ianus Keller and his students TU Delft who began the analysis of this episode and collected many of the screen shots.

I also want to help them make a shout-out to IDE alumnus Frans van Eedena, whose coffee machine wound up being one of the appliances controlled by virtual Greta. Nice work IDE!

image16.png

Pregnancy Test

Another incidental interface is the pregnancy test that Joe finds in the garbage. We don’t see how the test is taken, which would be critical when considering its design. But we do see the results display in the orange light of Joe and Beth’s kitchen. It’s a cartoon baby with a rattle, swaying back and forth.

pregnancy.gif

Sure it’s cute, but let’s note that the news of a pregnancy is not always good news. If the pregnancy is not welcome, the “Lucky you!” graphic is just going to rip her heart out. Much better is an unambiguous but neutral signal.

That said, Black Mirror is all about ripping our hearts out, so the cuteness of this interface is quite fitting to the world in which this appears. Narratively, it’s instantly recognizable as a pregnancy test, even to audience members who are unfamiliar with such products. It also sets up the following scene where Joe is super happy for the news, but Beth is upset that he’s seen it. So, while it’s awful for the real world; for the show, this is perfect.

Black_Mirror_Pregnancy_Test.png

Restraining Order

After Joe confronts Beth and she calls for help, Joe is taken to a police station where in addition to the block, he now has a GPS-informed restraining order against him.

Black_Mirror_thumbprint.png

To confirm the order, Joe has to sign is name to a paper and then press his thumbprints into rectangles along the bottom. The design of the form is well done, with a clearly indicated spot for his signature, and large touch areas in which he might place his thumbs for his thumbprints to be read.

A scary thing in the interface is that the text of what he’s signing is still appearing while he’s providing his thumbprints. Of course the page could be on a loop that erases and redisplays the text repeatedly for emphasis. But, if it was really downloading and displaying it for the first time to draw his attention, then he has provided his signature and thumbprints too early. He doesn’t yet know what he’s signing.

thumbprint.gif

Government agencies work like this all the time and citizens comply because they have no choice. But ideally, if he tried to sign or place his thumbprints before seeing all the text of what he’s signing, it would be better for the interface to reject his signature with a note that he needs to finish reading the text before he can confirm he has read and understands it. Otherwise, if the data shows that he authenticated it before the text appeared, I’d say he had a pretty good case to challenge the order in court.

The Cookie Console

Black_Mirror_Cookie_12.png

Virtual Greta has a console to perform her slavery duties. Matt explains what this means right after she wakes up by asking her how she likes her toast. She answers, “Slightly underdone.”

He puts slices of bread in a toaster and instructs her, “Think about how you like it, and just press the button.”

She asks, incredulously, “Which one?” and he explains, “It doesn’t matter. You already know you’re making toast. The buttons are symbolic mostly, anyway.”

She cautiously approaches the console and touches a button in the lower left corner. In response, the toaster drops the carriage lever and begins toasting.

Black_Mirror_Cookie_13

“See?” he asks, “This is your job now. You’re in charge of everything here. The temperature. The lighting. The time the alarm clock goes off in the morning. If there’s no food in the refrigerator, you’re in charge of ordering it.” Continue reading

Remote wingman via EYE-LINK

EYE-LINK is an interface used between a person at a desktop who uses support tools to help another person who is live “in the field” using Zed-Eyes. The working relationship between the two is very like Vika and Jack in Oblivion, or like the A.I. in Sight.

In this scene, we see EYE-LINK used by a pick-up artist, Matt, who acts as a remote “wingman” for pick-up student Harry. Matt has a group video chat interface open with paying customers eager to lurk, comment, and learn from the master.

Harry’s interface

Harry wears a hidden camera and microphone. This is the only tech he seems to have on him, only hearing his wingman’s voice, and only able to communicate back to his wingman by talking generally, talking about something he’s looking at, or using pre-arranged signals.

image1.gif

Tap your beer twice if this is more than a little creepy.

Matt’s interface

Matt has a three-screen setup:

  1. A big screen (similar to the Samsung Series 9 displays) which shows a live video image of Harry’s view.
  2. A smaller transparent information panel for automated analysis, research, and advice.
  3. An extra, laptop-like screen where Matt leads a group video chat with a paying audience, who are watching and snarkily commenting on the wingman scenario. It seems likely that this is not an official part of the EYE-LINK software.

image55.png

image47.png Continue reading