The Fritzes award honors the best interfaces in a full-length motion picture in the past year. Interfaces play a special role in our movie-going experience, and are a craft all their own that does not otherwise receive focused recognition.
Today we’ll be covering Best Narrative. These movies’ interfaces blow us away with evocative visuals and the richness of their future vision. They engross us in the story world by being spectacular.
The 2026 Award goes to: Elio
Pixar consistently puts great thought into their animated interfaces, and Elio is no different. The little wearable personal devices that help the different intergalactic species all share a space are so simple, and provide both a bit of worldbuilding as well as moments of comedy. The incomprehensibility of the alien spaceship controls are a plot-critical, candy-colored glowing hoot (and reminiscent of another Pixar short, Lifted.) I loved the lemniscate-shaped AI encyclopedia that Elio consults when preparing for his negotiations. We should be able to talk to Wikipedia and not just its articles. (Though I wish the entries were more than just text and an image.) Also this film has the only example I’ve seen where one character acts as an environmental suit for another character (not pictured, but you know the scene).
Also check out: Mickey 17
It’s a dark world where the hoarding class has made the working class so desperate that some people have to agree to be cloned for critical tasks that are likely death sentences. The interfaces in Mickey 17 help sell that very world, and even the ways that some folks use that same tech to eke out a little naughty joy amongst the drudgery. (With echoes of a similarly flirty interface from Starship Troopers.)
Also check out: Fantastic Four: First Steps
Marvel was once a main-stay for interfaces to study, but they’ve pointed their camera increasingly away from interfaces of late. So I was delighted to see Fantastic Four: First Steps bring to life interfaces from Jack Kirby’s Silver Age Fantastic Four. I don’t know if it was CGI, but I swear the giant, spherical quadrilateral screens are actual giant CRTs right down to the blurriness and chromatic aberration. If that’s CGI, it’s great attention to the detail from the reference material. All the spherical displays!
The “big” award in the Fritzes is Best Interface, but to amp up the anticipation, let’s look at some of the idiosyncratic awards from 2025 first.
The Fritzes award honors the best interfaces in a full-length motion picture in the past year. Interfaces play a special role in our movie-going experience, and are a craft all their own that does not otherwise receive focused recognition.
Today we’ll be covering Best Believable. These movies’ interfaces adhere to solid computer-human-interaction principles and believable interactions. They engage us in the story world by being convincing.
The 2026 Award goes to: The Running Man
This second adaptation of Stephen King’s novel knocks it out of the park for the plot-central interfaces: The runner cuff and R-Cam box, the hideous sousveillance phone app for “fans”, the service design of the “free-v” show, and the in-home snitch interfaces. They lean towards narrative (missing a few things real-world counterparts would need), but all help articulate this dystopian world and the circumstances that drive the action. Moreover, I feel quite certain not making good real-world models of these horrible things is the right thing to do, especially given *gestures vaguely at the kakistocracy*.
On top of that it also has lots of awesome everyday interfaces, and it takes a level of commitment on the part of the filmmakers to go that deep in the worldbuilding. There’s a videophone interface with shades of Blade Runner. There’s a mailbox that signals its readiness and lifts off immediately after receiving a letter. (Though I would have flipped those red and green colors, so red meant “don’t put mail in here” and green meant “ready to receive”, but my invitation was lost in the mail.) The fare interfaces in the taxi. The self-driving interface of the citizen car. The piloting interfaces aboard the network plane. It’s all uncluttered, straightforward, and believable. Really well done, really well presented, and that’s hard to do in intense-action movies.
Also check out: War of the Worlds (2025)
It got universally panned. Fair enough, neither ubiquitous government surveillance nor the current DHS bears valorization. (Also the virus-but-its-digital twist was already done), but I am impressed that this take on the classic Wells story is told almost entirely through interfaces, and each of them is detailed and mostly-realistic. The editing around the interface can be dizzying, and I wondered why William Radford had to do so much digital hunting at the beginning when an assistant should have been guiding his attention. But it’s impressive to bring that tale to life mostly through this unsung medium.
Also check out: Companion
With soft echoes of the interfaces in Westworld (2016), the interfaces in Companion control android and gynoid companions. (Yes, that term is deliberately coy.) They are clean and simple, which underscores the robots’ horror that they are under that much control by their owners.
My hackles are raised from “Intelligence” being a single slider. Intelligence is much more complicated than that, and this notion that it’s a single scalar variable has done a lot of damage over time. Even if they’d had a little expando control, it would have pointed at the idea that we’re looking at a simplification. Also I wish they’d provided a live preview of the eye color, because even with its intended use—of an owner controlling their companion’s eye color—this control has them glancing up to see the effect and then back down again to adjust, which is not a satisfying feedback loop. I use this very control as an example of a “plan” assistant in my new book. Hey, all of Hollywood: Buy it!
As in previous years, in preparation for awarding the Fritzes, I watched as many sci-fi movies as I could find across 2024. One thing that stuck out to me was the number of heads-up displays (HUDs) across these movies. There were a lot to them. So in advance of the awards, lets look and compare these. (Note the movies included here are not necessarily nominees for a Fritz award.)
I usually introduce the plot of every movie before I talk about it. This provides some context to understanding the interface. However, that will happen in the final Fritzes post. I’m going to skip that here. Still, it’s only fair to say there will be some spoilers as I describe these.
If you read Chapter 8 of Make It So: Interaction Lessons from Science Fiction, you’ll recall that I’d identified four categories of augmentation.
Sensor displays
Location awareness
Context awareness (objects, people)
Goal awareness
These four categories are presented in increasing level of sophistication. Let’s use these to investigate and compare five primary examples from 2024, in order of their functional sophistication.
Dune 2
Lady Margot Fenring looks through augmented opera glasses at Feyd-Rautha in the arena. Dune 2 (2024).
True to the minimalism that permeates much of the interfaces film, the AR of this device has a rounded-rectangle frame from which hangs a measure of angular degrees to the right. There are a few ticks across the center of this screen (not visible in this particular screen shot). There is a row of blue characters across the bottom center. I can’t read Harkonnen, and though the characters change, I can’t quite decipher what most of them mean. But it does seem the leftmost character indicates azimuth and the rightmost character angular altitude of the glasses. Given the authoritarian nature of this House, it would make sense to have some augmentation naming the royal figures in view, but I think it’s a sensor display, which leaves the user with a lot of work to figure out how to use that information.
You might think this indicates some failing of the writer’s or FUI designers’ imagination. However, an important part of the history of Dune is a catastrophic conflict known as the Butlerian Jihad. This conflict involved devastating, large-scale wars against intelligent machines. As a result, machines with any degree of intelligence are considered sacrilege. So it’s not an oversight, but as a result, we can’t look to this as a model for how we might handle more sophisticated augmentations.
Alien: Romulus
Tyler teaches Rain how to operate a weapon aboard the Renaissance. Alien: Romulus (2024)
A little past halfway through the movie, the protagonists finally get their hands on some weapons. In a fan-service scene similar to one between Ripley and Hicks from Aliens (1986), Tyler shows Rain how to hold an FAA44 pulse rifle. He also teaches her how to operate it. The “AA” stands for “aiming assist”, a kind of object awareness. (Tyler asserts this is what the colonial marines used, which kind of retroactively saps their badassery, but let’s move on.) Tyler taps a small display on the user-facing rear sight, and a white-on-red display illuminates. It shows a low-res video of motion happening before it. A square reticle with crosshairs shows where the weapon will hit. A label at the top indicates distance. A radar sweep at the bottom indicates movement in 360° plan view, a sensor display.
When Rain pulls the trigger halfway, the weapon quickly swings to aim at the target. There is no indication of how it would differentiate between multiple targets. It’s also unclear how Rain told it that the object in the crosshairs earlier is what she wants it to track now. Or how she might identify a friendly to avoid. Red is a smart choice for low-light situations as red is known to not interfere with night vision. Also it’s elegantly free of flourishes and fuigetry.
I’m not sure the halfway-trigger is the right activation mechanism. Yes, it allows the shooter to maintain a proper hold and remain ready with the weapon, and allows them not have to look at the display to gain its assistance, but also requires them to be in a calm, stable circumstance that allows for fine motor control. Does this mean that in very urgent, chaotic situations, users are just left to their own devices? Seems questionable.
Alien: Romulus is beholden to the handful of movies in the franchise that preceded it. Part of the challenge for its designers is to stay recognizably a part of the body of work that was established in 1979 while offering us something new. This weapon HUD stays visually simple, like the interfaces from the original two movies. It narratively explains how a civilian colonist with no weapons training can successfully defend herself against a full-frontal assault by a dozen of this universe’s most aggressive and effective killers. However, it leaves enough unexplained that it doesn’t really serve as a useful model.
The Wild Robot
Roz examines an abandoned egg she finds. The Wild Robot (2024)
HUD displays of artificially intelligent robots are always difficult to analyze. It’s hard to determine what’s an augmentation, here loosely defined as an overlay on some datastream created for a user’s benefit but explicitly not by that user. It opposes a visualization of the AI’s own thoughts as they are happening. I’d much rather analyze these as augmentation provided for Roz, but it just doesn’t hold up to scrutiny that way. What we see in this film are visualizations of Roz’ thoughts.
Fresh after booting up, Roz searches for a “customer,” and kind of finds one in a crab. The Wild Robot (2024).Roz estimates the height of the wave in terms of her own height and feels urgency.In language-learning mode, small word bubbles appear near speakers, and a progress bar hints that Roz is near completion.
In the HUD, there is an unchanging frame around the outside. Static cyan circuit lines extend to the edge. (In the main image above, the screen-green is an anomaly.) A sphere rotates in the upper left unconnected to anything. A hexagonal grid on the left has some hexes which illuminate and blink unconnected to anything. The grid moves unrelated to anything. These are fuigetry and neither conveys information nor provides utility.
Inside that frame, we see Roz’ visualized thinking across many scenes.
Locus of attention—Many times we see a reticle indicating where she’s focused, oftentimes with additional callout details written in robot-script.
“Customer” recognition—(pictured) Since it happens early in the film, you might think this is a goofy error. The potential customer she has recognized is a crab. But later in the film, Roz learns the language common to the animals of the island. All the animals display a human-like intelligence, so it’s completely within the realm of possibility that this blue little crustacean could be her customer. Though why that customer needed a volumetric wireframe augmentation is very unclear.
X-ray vision—While looking around for a customer, she happens upon an egg. The edge detection indicates her attention. Then she performs scans that reveal the growing chick inside and a vital signs display.
Damage report—After being attacked by a bear, Roz does an internal damage check and she notes the damage on screen.
Escape alert—(pictured) When a big wave approaches the shore on which she is standing, Roz estimates the height of the wave to be five time her height. Her panic expresses itself in a red tint around the outside edge.
Project management—Roz adopts Brightbill and undertakes the mission to mother him—specifically to teach him to eat, swim, and fly. As she successfully teaches him each of these things, she checks it off by updating one of three graphics that represent the topics.
Language acquisition—(pictured) Of all the AR in this movie, this scene frustrates me the most. There is a sequence in which Roz goes torpid to focus on learning the animal language. Her eyes are open the entire time she captures samples and analyzes them. The AR shows word bubbles associated with individual animal utterances. At first those bubbles are filled with cyan-colored robo-ese script. Over the course of processing a year’s worth of samples, individual characters are slowly replaced in the utterances with bold, green, Latin characters. This display kind of conveys the story beat of “she’s figuring out the language), but befits cryptography much more than acquisition of a new language.
If these were augmented reality, I’d have a lot of questions about why it wasn’t helping her more than it does. It might seem odd to think an AI might have another AI helping it, but humans have loads of systems that operate without explicit conscious thought, like preattentive processing, all the functions of our autonomic nervous system, sensory filtering, and recall, just to name a few. So I can imagine it would be a fine model for AI-supporting-AI.
Since it’s not augmented reality, it doesn’t really act as a model for real world designs except perhaps for its visual styling.
Borderlands
Claptrap is a little one-wheel robot that accompanies Lilith though her adventures on and around Pandora. We see things through his POV several times.
Claptrap sizes up Lilith from afar. Borderlands (2024).
When Claptrap first sees Lilith, it’s from his HUD. Like Roz’ POV display in The Wild Robot, the outside edge of this view has a fixed set of lines and greebles that don’t change, not even for a sensor display. I wish those lines had some relationship to his viewport, but that’s just a round lens and the lines are vaguely like the edges of a gear.
Scrolling up from the bottom left is an impressive set of textual data. It shows that a DNA match has been made (remotely‽ What kind of resolution is Claptrap’s CCD?) and some data about Lilith from what I presume is a criminal justice data feed: Name and brief physical description. It’s person awareness.
Below that are readouts for programmed directive and possible directive tasks. They’re funny if you know the character. Tasks include “Supply a never-ending stream of hilarious jokes and one-liners to lighten the mood in tense situations” and “Distract enemies during combat. Prepare the Claptrap dance of confusion!” I also really like the last one “Take the bullets while others focus on being heroic.” It both foreshadows a later scene and touches on the problem raised with Dr. Strange’s Cloak of Levitation: How do our assistants let us be heroes?
At the bottom is the label “HYPERION 09 U1.2” which I think might be location awareness? The suffix changes once they get near the vault. Hyperion a faction in the game. Not certain what it means in this context.
When driving in a chase sequence, his HUD gives him a warning about a column he should avoid. It’s not a great signal. It draws his attention but then essentially says “Good luck with that.” He has to figure out what object it refers to. (The motion tracking, admittedly, is a big clue.) But the label is not under the icon. It’s at the bottom left. If this were for a human, it would add a saccade to what needs to be a near-instantaneous feedback loop. Shouldn’t it be an outline or color overlay to make it wildly clear what and where the obstacle is? And maybe some augmentation on how to avoid it, like an arrow pointing right? As we see in a later scene (below) the HUD does have object detection and object highlighting. There it’s used to find a plot-critical clue. It’s just oddly not used here, you know, when the passengers’ lives are at risk.
When the group goes underground in search of the key to the Vault, Claptrap finds himself face to face with a gang of Psychos. The augmentation includes little animated red icons above the Psychos. Big Red Text summarizes “DANGER LEVEL: HIGH” across the middle, so you might think it’s demonstrating goal and context awareness. But Claptrap happens to be nigh-invulnerable, as we see moments later when he takes a thousand Psycho bullets without a scratch. In context, there’s no real danger. So,…holup. Who’s this interface for, then? Is it really aware of context?
When they visit Lilith’s childhood home, Claptrap finds a scrap of paper with a plot-critical drawing on it. The HUD shows a green outline around the paper. Text in the lower right tracks a “GARBAGE CATALOG” of objects in view with comments, “A PSYCHO WOULDN’T TOUCH THAT”, “LIFE-CHOICE QUESTIONING TRASH”, “VAULT HUNTER THROWBACK TRASH”. This interface gives a bit of comedy and leads to the Big Clue, but raises questions about consistency. It seems the HUDs in this film are narrativist.
In the movie, there are other HUDs like this one, for the Crimson Lance villains. They fly their hover-vehicles using them, but we don’t nearly get enough time to tease the parts apart.
Atlas
The HUD in Atlas happens when the titular character Atlas is strapped into an ARC9 mech suit, which has its own AGI named Smith. Some of the augmentations are communications between Smith and Atlas, but most are augmentations of the view before her. The viewport from the pilot’s seat is wide and the augmentations appear there.
Atlas asks Smith to display the user manuals. Atlas (2024)
On the way to evil android Harlan’s base, we see the frame of the HUD has azimuth and altitude indicators near the edge. There are a few functionless flourishes, like arcs at the left and right edges. Later we see object and person recognition (in this case, an android terrorist, Casca Decius). When Smith confirms they are hostile, the square reticles go from cyan to red, demonstrating context awareness.
Over the course of the movie Atlas has resisted Smith’s call to “sync” with him. At Harlan’s base, she is separated from the ARC9 unit for a while. But once she admits her past connection to Harlan, she and Smith become fully synched. She is reunited with the ARC9 unit and its features fully unlock.
As they tear through the base to stop the launch of some humanity-destroying warheads, they meet resistance from Harlan’s android army. This time the HUD wholly color codes the scene, making it extremely clear where the combatants are amongst the architecture.
Overlays indicate the highest priority combatants that, I suppose, might impede progress. A dashed arrow stretches through the scene indicating the route they must take to get to their goal. It focuses Atlas on their goal and obstacles, helping her decision-making around prioritization. It’s got rich goal awareness and works hard to proactively assist its user.
Despite being contrasting colors, they are well-controlled to not vibrate. You might think that the luminance of the combatants and architecture might be flipped, but the ARC9 is bulletproof, so there’s no real danger from the gunfire. (Contrast Claptrap’s fake danger warning, above.) Saving humanity is the higher priority. So the brightest (yellow) means “do this”, the second brightest (cyan) means “through this” and darkest (red) means “there will be some nuisances en route.” The luminescence is where it should be.
In the climactic fight with Harlan, the HUD even displays a predictive augmentation, illustrating where the fast-moving villain is likely to be when Atlas’ attacks land. This crucial augmentation helps her defeat the villain and save the day. I don’t think I’ve seen predictive augmentation outside of video games before.
If I was giving out an award for best HUD of 2024, Atlas would get it. It is the most fully-imagined HUD assistance across the year, and consistently, engagingly styled. If you are involved with modern design or the design of sci-fi interfaces, I highly recommend you check it out.
Stay tuned for the full Fritz awards, coming later this year.
Superhero shows are a weird subgenre of sci-fi. The super-powers and how the superheroes use them in pursuit of their world-saving goals are often the point, and so often skimp on the sci part of sci-fi. The Amazon original The Boys is no different, where the core novum is a chemical (compound V) that gives people superpowers.
I love the show. Though it’s definitely for adults with its violence and psychopathy and depravity, I think it’s closer to what would happen if humans had superhuman powers in a world of late-stage capitalism, enshittification of everything, and wannabe fascists. I’ve been a fan since it first aired. (And can’t wait to dive into the comics after the show wraps.)
It hasn’t really had many interfaces of note across the series. And the one I’m going to talk about in this post isn’t a “big” interface. But it was bad, so I’m coming out of my hiatus to talk about it, and then to make an appeal similar to what I did when I reviewed Idiocracy in 2019.
In the Season 4 finale—hastily renamed “Season 4 Finale” instead of “Assassination Run” after the alleged July 13 assassination attempt of Donald Trump—co-founders of The Boys, Grace Mallory and Butcher, invite the young supe Ryan to an underground bunker with three goals in mind.
Give him some time with Butcher who, as a kind of stepfather to Ryan, wants to see him before he dies. (Butcher is dying from a “sentient tumor” that developed from his overuse of “Temp V”.)
Convince Ryan to turn against his father, Homelander.
Entrap Ryan if he refuses.
It’s this last goal that involves the interface, because sure enough, Ryan is highly conflicted at the idea of killing his father after Butcher explains “You’re the only one who can stop him.”
“You’re the only one who can stop him.” —Butcher
As Ryan tries to leave to think things through, Grace blocks his way, saying “You can’t leave.” Ryan uses his super vision to observe that the walls of the room they’re in are 6 feet thick. Grace tries to explain, “This is the CIA Hazlet Safehouse, designed to hold people like you. I could seal us in here, flood the room with halothene, and we’d all take a nice, long nap.” As Ryan gets more agitated and threatens to leave anyway, she reaches out to a big, red momentary button mounted to the concrete wall beside her, presumably to release the aerosolized anesthesia.
And that’s it. That’s the interface. Because in a show that is very compellingly written, this is bad design.
It’s obvious
Being a big, red panic button, it might as well have a spotlight on it and a neon sign blinking “Press here to suppress.” Any supe worth their salt will recognize it as a threat and seek to disable it. I trust it would have a Normally Closed circuit, so that ripping the button out of the wall or severing the conduit would trip it, but a supe with Ryan or Homelander’s x-ray vision could just follow the circuit back to discover the nature of the halothane system and work from there. Much better is a system that wouldn’t call attention to itself.
It’s hard to get to
It’s hard to tell the complete room layout from the scene. It looks half hospital recovery room, half storage room, and I suspect is a converted supe prison cell (with windows, though?) The button appears to be just inside…the bathroom? Out of sight of the main part of the room, sure, so kind of hidden unless the supe needs to ever pee, but also harder to get to. A single button at around elbow-height works when a near-average-height person is upright and able to reach out to press it. But if you’ve just been knocked down, or had your arm laser-severed, or I don’t know, been body slammed across the room away from that button, you’re screwed. Even a ceiling-to-floor crash bar doesn’t work because it still requires your being within arms reach of that one spot. Better is a system that does not depend on where anyone is in the room for activation.
It works at human response speed
This is world with fast and mind-control supes. It doesn’t make sense to rely on human response times to activate it. Better is a semi-automated system that monitors everything and can respond in microseconds when data trends suspiciously.
Between its being obvious, hard to get to, and requiring manual activation I think nearly every single supe in the show would find it trivial to stop that button from being pressed if they wanted.
The scene could have been written more smartly—without sacrificing the efficiency of the beat—with something like this…
Grace
This is the CIA Hazlet Safehouse, designed to hold people like you. If you try to leave…
Cut to an arc shot of a supe-monitoring display. On the side, a live transcript of the conversation types out Grace’s words as she speaks them. In the center, infrared video of them in the room with overlays for each of them labeled SUPE or human, live vital signs, and a line showing their AI-predicted movements.
Grace (voiceover)
…or any of our vital signs crash…
Cut back to the actors
Grace
…the room is flooded with halothane and we all take a nice, long nap.
Zoom in to Ryan’s face as his eyes dart around and his breathing intensifies.
Cut to interface reading “escape prediction” and a number rising to 75, 80, 85. At 90 it turns red and a soft alarm goes off.
Cut to an extreme close up of Ryan’s ear to show he hears this alarm.
This isn’t obvious to the supe, works faster than a human could, and doesn’t rely on a human being in a specific spot.
Now instead of this, we could have Ryan brag about what a bad-ass he is and escape before the system can react, but this moment is constructed in the original to show that Ryan isn’t just an arrogant mini-Homelander. He’s a conflicted adolescent with an adolescent’s poor impulse control, and he panicked seeing her reach for the button. Having an alarm sets that same stage for him to panic. Note that I don’t think it’s good design for a system to tip its hand before it enacts control measures—as this does with the alarm—but it would be more forgivable than the dumb button, which just paints the CIA as incompetent and undermines the diegesis.
OK, that said, this next bit goes out to my fellow Americans:
One of the reasons I have wanted to talk about this show is not just the fascism of the villains, but how it illustrates the corrupting effect of power, and that’s directly related to the coming American election.
With Biden dropping out of the race yesterday, and the Democratic National Convention a month away, I can’t yet formally lean on the merits of the Democratic candidate to make a case for weeks to come. (Though, go go go, Kamala!) But the case against the Republican party almost makes itself.
What we are facing as a nation with this election is existential. The Supreme Court has outrageously ruled that a president is unaccountable for his actions while in office. A dictator’s wet dream. And Trump has declared publicly that he will be a dictator “on day one,” but it’s easy to see that he means “as of day one”. What malignant narcissist willingly gives up power once he has it? His many ties to the wretched Heritage Foundation and its deeply, deeply disturbing Project 2025 (see this video and this one where he directly praises this group and their plan) tell us that if he is elected and his cronies have their way, we fall towards an extremist religious-nationalism that puts The Boys to shame and spells the end of the ideals and institutions that were the reason the United States was invented in the first place. The American Experiment is on the brink.
But to quote the ACLU, despair and resignation are not a strategy. We have to America-up and enact a strategy. Please, please…
Expose the Extremism
Get familiar with the extremist plans (the Christianization and militarization of public school, cutting overtime protections for 4.3 million people, banning labor unions, privatizing Medicare, replacing a million experts with loyalist lackies, putting the DOJ under presidential control, close NOAA and end free weather reports, categorizing LGBTQ+ folks as pederasts and instating a death penalty for it, trying to pass a constitutional amendment to make abortion illegal, and much more) and share those often and loudly on your social media platforms of choice. Especially reach out to anyone on the fence, in a swing state (Arizona, Georgia, Michigan, Pennsylvania, and Wisconsin), or who thinks they should just sit this one out because the (current) candidates are so old or not doing enough of what they want. We cannot afford “protest votes.”
Volunteer
If you don’t have money to spare (and with the current income inequality plaguing the nation that’s likely to be most of us) you can donate time and effort. If you’re in a solidly-colored state, you can join texting and letter-writing campaigns to those in swing states. If you’re in a swing state (Arizona, Georgia, Michigan, Pennsylvania, and Wisconsin), you can help canvas directly to voters still deciding. (How they’re still undecided is utterly alien to me, but here we are.) Here are just a few places you can opt to volunteer.
If you do have money to spare, spare it. Give to progressive and Democratic causes that will use that buying power to get ads, get the word out, and support the vote. Dig deep because I know we’ve heard it before, but this one is critical.
Most importantly, have a plan to vote. Register if you’re not. If you are, double-check your voter registration status because they are purged just before elections, often bumping democrats for the most trivial of reasons. Vote by mail if you are overseas or if getting time off on the day of might be a problem. Find your polling location. Make a plan with others to go vote together. Charge your phone and bring water in case there are long lines. (And many bastards have worked very hard to ensure there will be long lines.) Get calendar reminders for voting deadlines sent directly to you.
If everyone gets out there and activates the vote, we can avoid giving the absolutely wrong people the power they should not have. You’re the only one who can stop him.
So I missed synchronizing the Fritzes with the Oscars. By like, a lot. A lot a lot. That hype curve has come and gone. (In my defense, it’s been an intensely busy year.) I don’t think providing nominees and then waiting to reveal winners makes sense now, so I’ll just talk about them. It was another year where there weren’t a lot of noteworthy speculative interfaces, from an interaction design point of view. This is true enough that I didn’t have enough candidates to fill out my usual three categories of Believable, Narrative, and Overall. So, I’m just going to do a round-up of some of the best interfaces as I saw them, and at the end, name an absolute favorite.
The Kitchen
In a dystopian London, the rich have eliminated all public housing but one last block known as The Kitchen. Izi and Benji live there and are drawn together by the death of Benji’s mother, who turns out to be one of Izi’s romantic partners from the past. The film is full of technology, but the one part that really struck me was the Life After Life service where Izi works and where Benji’s mom’s funeral happens. It’s reminiscent of the Soylent Green suicide service, but much better done, better conceived. The film has a sci-fi setting, but don’t expect easy answers and Marvel-esque plot here. This film about relationships amid struggle and ends quite ambiguously.
The funerary interfaces are mostly translucent cyans with pinstripe dividing lines to organize everything. In the non-funerary the cyan is replaced with bits of saturated red. Everything funerary and non- feels as if it has the same art direction, which lends to reading the interfaces extradiegetically, but maybe that’s part of the point?
Pod Generation
This dark movie considers what happens if we gestated babies in technological wombs called pods. The interactions with the pod are all some corporate version of intuitive, as if Apple had designed them. (Though the swipe-down to reveal is exactly backwards. Wouldn’t an eyelid or window shade metaphor be more natural? Maybe they were going for an oven metaphor, like bun in the oven? But cooking a child implications? No, it’s just wrong.)
The design is largely an exaggeration of Apple’s understated aesthetic, except for the insane, giant floral eyeball that is the AI therapist. I love how much it reads like a weirdcore titan and the characters are nonplussed, telegraphing how much the citizens of this world have normalized to inhumanity. I have to give a major ding to the iPad interface by which parents take care of their fetuses, as its art direction is a mismatch to everything else in the film and seems quite rudimentary, like a Flash app circa 1998.
Before I get to the best interfaces of the year, let’s take a moment to appreciate two trends I saw emerging in 2023. That of hyperminimalist interfaces and of interface-related comedy.
Hyperminimalist interfaces
This year I noticed that many movies are telling stories with very minimal interfaces. As in, you can barely call them designed since they’re so very minimalist. This feels like a deliberate contrast to the overwhelming spectacle that permeates, say, the MCU. They certainly reduce the thing down to just the cause and effect that are important to the story. Following are some examples that illustrate this hyperminimalism.
Fingernails—fingernail-tester.No One Will Save You—observation pod.57 Seconds—time ring.Landscape with Invisible Hand—translation device (there on the desk under the alien’s hand)
This could be a cost-saving tactic, but per the default New Criticism stance of this blog, we’ll take it as a design choice and note it’s trending.
Shout-out: Interface Comedy
I want to give a special shout-out to interface-related comedy over the past year.
Smoking Causes Coughing
The first comes from the French gonzo horror sci-fi Smoking Causes Coughing. In a nested story told by a barracuda that is on a grill being cooked, Tony is the harried manager of a log-processing plant whose day is ruined by her nephew’s somehow becoming stuck in an industrial wood shredder. Over the scene she attempts to reverse the motor, failing each time, partly owing to the unlabeled interface and bad documentation. It’s admittedly not sci-fi, just in a sci-fi film, and a very gory, very hilarious bit of interface humor in an schizoid film.
Guardians of the Galaxy 3
The second is Guardians of the Galaxy 3. About a fifth of the way into the movie, the team spacewalks from the Milano to the surface of Orgocorp to infiltrate it. Once on the surface, Peter, who still pines for alternate-timeline Gamora, tries to strike up a private conversation with her. The suits have a forearm interface featuring a single row of colored stay-state buttons that roughly match the colors of the spacesuits they’re wearing. Quill presses the blue one and tries in vain to rekindle the spark between him and Gamora in a private conversation. But then a minute into the conversation, Mantis cuts in…
Mantis
Peter you know this is an open line, right?
Peter
What?
Mantis
We’re listening to everything you’re saying.
Drax
And it is painful.
Quill
And you’re just telling me now‽
Nebula
We were hoping it would stop on its own.
Peter
But I switched it over to private!
Mantis
What color button did you push?
Peter
Blue! For the blue suit!
Drax
Oh no.
Nebula
Blue is the open line for everyone.
Mantis
Orange is for blue.
Peter
What‽
Mantis
Black is for orange. Yellow is for green. Green is for red. And red is for yellow.
Drax
No, yellow is for yellow. Green is for red. Red is for green.
Mantis
I don’t think so.
Drax
Try it then.
Mantis (screaming)
HELLO!
Peter writhes in pain
Mantis
You were right.
Peter
How the hell and I supposed to know all of that?
Drax
Seems intuitive.
The Marvels
A third comedy bit happens in The Marvels, when Kamala Khan is nerding out over Monica Rambeau’s translucent S.H.I.E.L.D. tablet. She says…
Khan
Is this the new iPad? I haven’t seen it yet.
Rambeau
I wish.
Khan
Wait, if this is all top secret information, why is it on a clear case?
Anyway, I want to give a shout-out to the writers for demonstrating with these comedy bits some self-awareness and good-natured self-owning of tropes. I see you and appreciate you. You are so valid.
Best Interfaces of 2023
But my favorite interfaces of 2023 come from Spider-Man: Across the Spider-Verse. The interfaces throughout are highly stylized (so might be tough to perform the detailed analysis, which is this site’s bread-and-butter) but play the plot points perfectly.
In Across the Spider-Verse, while dealing difficulties with his home life and chasing down a new supervillain called The Spot, Miles Morales learns about The Society. The Society is a group of (thousands? Tens of thousands? of) Spider-people of every stripe and sort from across the Multiverse, whose overriding mission is to protect “canon” events in each universe that, no matter how painful, they believe are necessary to keep the fabric of reality from unraveling. It’s full of awesome interfaces.
Lyla is the general artificial intelligence that has a persistent volumetric avatar. She’s sassy and disagreeable and stylish and never runs, just teleports.
The wrist interfaces—called the Multiversal Gizmo—worn by members of The Society all present highly-contextual information with most-likely actions presented as buttons, and, as needed, volumetric alerts. Also note that Miguel’s Gizmo is longer, signaling his higher status within The Society.
Of special note is volumetric display that Spider Gwen uses to reconstruct the events at the Alchemax laboratory. The interface is so smart, telegraphs its complex functioning quickly and effectively, and describes a use that builds on conceivable but far-future applications of inference. The little dial that pops up allowing her to control time of the playback reminds me of Eye of Agamatto (though sadly I didn’t see evidence of the important speculative time-control details I’d provided in that analysis). The in-situ volumetric reconstruction reminds me of some of the speculative interfaces I’d proposed in the review of Deckard’s photo inspector from Blade Runner, and so was a big thrill to see.
All of the interfaces have style, are believable for the diegesis, and contribute to the narrative with efficiency. Congratulations to the team crafting these interfaces, and if you haven’t seen it yet, what are you waiting for? Go see it. It’s in a lot of places and the interfaces are awesome. (For full disclosure, I get no kickback from these referral links.)
Our last 3D file browsing system is from much later and in a different format. It appears in the TV series Community, season 6, episode 2, “Lawnmower Maintenance and Postnatal Care”. Thanks to the scifiinterfaces reader known by the handle djempirical for this recommendation.
Community is a TV sitcom rather than a film, with short, 25-minute episodes. The setting is a small Colorado USA community college at the time of broadcast, the years 2009 to 2015, where the characters are staff and students. The series is usually described as a cult classic rather than mainstream, with lots of geeky references and shout outs (it’s very quotable). While there are plot arcs across seasons, the episodes are largely standalone. I didn’t know anything about Community when I watched this particular episode but still enjoyed it.
There are significant differences in presentation and style from our earlier films. Community is made and set twenty years later, and so both characters and audience are assumed to be familiar with personal computers, smart phones, the Internet; and to at least have some idea of what virtual reality is. The earlier films treated computer systems with respect or even awe, while here the new technology is a target to make fun of.
The characters in Community use technology, but it is not usually central to the story, unlike for example The IT Crowd or Silicon Valley. This episode is one of the exceptions. Another is episode 5.8, “App Development and Condiments”, which I strongly recommend to anyone interested in social media.
This particular episode has two plotlines, only one of which involves computers and interfaces. The easily influenced Dean of Greendale Community College has spent $5,000 (US) on a new virtual reality system called a “VirtuGood 6500”. (That the characters consider this expensive shows how much technology has changed in twenty years. Old timers like myself who remember the price tags on those elegant SGI 3D workstations mutter about kids today not knowing how good they have it.) College administrator Francesca and teacher Jeff first try to persuade Dean Pelton to locate the serial number of the system within the virtual reality world, which they need to return the system for a refund. When that fails, they must try to persuade the Dean to leave VR and return to the real world.
Note to those unfamiliar with the show: Though the Dean has a full name, in the show and amongst the fandom, he is known as “the Dean,” and so we’ll be referring to him as such.
VirtuGood 6500 Virtual Reality World
The first scene with the new virtual reality system shows the Dean entering virtual reality for the first time.
He wears gloves and a very large headset, which are wired to a small computer worn in the middle of the back.
The Dean’s first experience of virtual reality. He is watching his hands rezz up. Community (2016)
There is a ring around the body at waist level, sliding vertically along guide posts. It is not just a barrier to protect against falling off the platform, because the Dean is wearing a seatbelt-style harness that connects him to the ring. He stands, in socks not shoes, on a smooth plastic platform base.
Jeff and Francesca read the instructions and watch the Dean. Community (2016)
While he is fiddling with straps and cables, Francesca and Jeff are reading the instructions in a 20 cm thick binder. The instructions for a new user are “When entering virtual reality you should calibrate the system by looking at your own hands, then turning them over and looking at the backs of them with a sense of wonder.” This is the first of several references to Disclosure and other earlier films.
Externally, the VR system indicates it is active by lighting up red LEDs around the front edge of the headset and around the waist ring. Internally, the system rezzes up the background from grayscale to color, and then rezzes up the hands of the avatar.
Neither the avatar nor the world are photorealistic, but since this is 2015, the graphics are much better than any similar system from the 1990s would be — even when made on a sitcom budget, rather than a feature film.
The Dean, represented by his blue avatar, arrives in the virtual world. Community (2016)
The ground plane is a polished hexagonal grid and the sky is an abstract purple pattern. Classical pillars are scattered around the landscape. A pterosaur flies overhead for no obvious reason, perhaps a reference to the old W Industries Dactyl Nightmare VR game.
Finding the serial number
The sequence we’re interested in happens just after the Dean’s initial forays into setting the timezone and clock, both of which require a complicated full-body gestural interface. Meanwhile, Francesca is reading the gigantic manual and finds that they can’t return the system for a refund without the serial number, which is stored within the virtual world.
Francesca and Jeff know that the Dean won’t want to return the VR system, so ask him to look for the file without revealing why they want it. The conversation highlights how bizarre the metaphors of this virtual world are:
Jeff
Go to…settings.
Dean
Is that in the volcano or the cobbler’s workshop?
Jeff
It’s a monastery.
The Dean turns his body around, which he can do because all the cables are connected to the computer on his back, not to the platform. He “walks” and then “runs” in place like a mime artist, body weight supported by the harness and waist ring. Since there aren’t any sensors attached to his legs or feet, there must be cameras or pressure sensors in the base. The avatar of the Dean runs across the landscape to the Settings monastery.
The Dean reaches the monastery. Community (2016)
The gates automatically open as he approaches. Inside, there is a checkerboard floor rather than hexagons, more pillars around the walls, and a central pool of green water.
The Dean enters the interior of the monastery. Community (2016)
At the far wall is a Disclosure–style filing cabinet, but this one is gigantic. It is so big that the Dean actually has to climb up to the drawer he wants.
The Dean climbs the filing cabinet to find a particular drawer. Community (2016)
At least these cabinets have permanent labels, unlike Disclosure’s. Inside are, again, Disclosure-style individual files.
The Dean opens one drawer in the filing cabinet. Community (2016)
The Dean finds the serial number file and holds it up. Jeff asks him to print it “by dragging it to the accessories and peripherals castle and planting it in the printer garden”. But the Dean has guessed the real reason why Francesca and Jeff want the file, so instead throws the file into the air and tries to delete it. He first makes a pushing gesture, palm out, which casts a beam at the file while he shouts “Delete”.
The Dean shoots a ray at the document. Community (2016)
In response the system pops up a giant text panel and also speaks the response in a slightly artificial voice, saying, “Selected”.
Dean Pelton receives system feedback that is text and speech, rather than graphical. Community (2016)
Since the file wasn’t deleted, we can assume that it can’t process voice input. He next mimes holding a bow and pulling an arrow back. A virtual bow and arrow appear, which he uses to shoot the file.
The Dean shoots an arrow at the document. Community (2016)
The arrow doesn’t do what he wants either, sorting the file. Finally he jumps into the air, catches the file, and drops to the ground. He then holds the file underwater, using both hands, in the central fountain. The file appears to struggle slightly and bubbles appear.
The Dean holds the serial number document under water. Community (2016)
The bubbles stop, the file sinks and disappears, and the system responds “DELETED”.
The Dean has foiled the plan to return the system for a refund, and he stays in virtual reality. Francesca sends Jeff to appeal directly to “the architect” (a shout-out to The Matrix), local VR designer and manufacturer Elroy. There’s more quotable dialogue here, such as this description of a task which we didn’t see:
“In order to copy a file, you have to throw a fireball at it. Then absorb the fire, then drop the flaming file into a crystal lake, then take out both copies and throw them into the side of a mountain.”
Jeff is unsuccessful and returns to Greendale, but Elroy is sufficiently moved to change his mind. Elroy visits Greendale with his own VR system, a more compact and apparently wireless headset and gloves, and enters the virtual world himself, demonstrating that this is also a multi-user system.
Elroy, after summoning a storm and growing to giant size, intimidates the Dean Pelton. Community (2016)
Elroy distracts the Dean in the virtual world, giving Jeff in the real world the opportunity to disconnect him. Elroy refunds the $5,000 and takes the VirtuGood 6500 away since we never see it again. The Dean is apparently cured of his VR addiction, although a closing shot does show him experimenting with one of those cardboard headsets for a phone.
Tagged: 3D rendering, ALL CAPS, HUD, Virtual Reality, addiction, architecture, avatar, big label, blue, direct manipulation, disposal, doorway, failure, furniture, gestural interface, gray, green, grid, hand, identification number, interaction, laser, mental models, mnemonic load, monster, navigating, plastic, point to select, poking fun, purple, sans serif, sense making, storage, touch, touch gesture, voice feedback, weapon, workflow
Analysis
In this episode, virtual reality and the 3D file system are deliberately portrayed as ridiculous for comedic effect. This doesn’t make it unworthy of analysis. For example, there’s this throw away line from Francesca to Jeff after the Dean has been in virtual reality for a few hours:
“He joked about wanting a pee jar earlier, and it’s gradually becoming less of a joke.”
It’s funny but also raises a real issue. Players of online computer games may do so for marathon sessions lasting many hours, and there are stories about the truly dedicated using bottles and buckets rather than getting up and leaving to use a toilet. What will virtual reality participants wearing headsets and gloves do? Wear space-suit style tubing? This is something that the serious VR literature rarely discusses, even when predicting how much time we’ll all be spending in virtual reality in the future.
How believable is the interface?
The VirtuGood 6500 is very believable for 2015. The headset is too large, perhaps because the props maker needed the extra space to keep the glowing lights and any batteries away from the actor’s face. Otherwise the headset and gloves are standard for VR, and using a backpack computer is an excellent design, removing the problem of entanglement as the user moves around.
On first viewing, I assumed that the supporting waist ring and smooth platform base were entirely fictional and built to keep costs down. Then while researching this review I found the Virtuix Omni, a VR treadmill where the user is supported by a waist level ring and walks or runs in place on a smooth surface. The only difference is that the Omni requires special shoes.
The virtual world, or at least the filing system, are also believable. The 3D graphics are well within the capabilities of a 2015 PC. The gestures we see are clear and easily distinguishable from one another. The mapping of gestures to actions may be silly, but not technically difficult.
How well does the interface inform the narrative of the story?
The 3D file browsing interface works very well within the narrative since the objective of this plotline is to make fun of it. The virtual world is full of bizarre visual elements such as the pillars that don’t support anything. The gestures performed by users are dramatic and completely mismatched with the intended tasks.
This particular system was deliberately designed to be bad, but poorly designed visual metaphors and difficult to discover gestural interfaces are not unknown in the real world. It’s a useful reminder that virtual reality systems will not automatically be easier and more intuitive to use simply because they more closely mimic the real world or are more immersive.
How well does the interface equip the character to achieve their goals?
This is another awful file browser. Even the Dean, a virtual reality enthusiast, is thwarted in his first two attempts to delete a file.
However it does succeed in the broader goal of making the user feel good. The Dean enjoys virtual reality and the sensation of power so much that he refuses to leave. It’s usually not recommended for mass market software but there is satisfaction in mastering an obscure interface that other people can’t.
Our next 3D file browsing system is from the 1994 film Disclosure. Thanks to site reader Patrick H Lauke for the suggestion.
Like Jurassic Park, Disclosure is based on a Michael Crichton novel, although this time without any dinosaurs. (Would-be scriptwriters should compare the relative success of these two films when planning a study program.) The plot of the film is corporate infighting within Digicom, manufacturer of high tech CD-ROM drives—it was the 1990s—and also virtual reality systems. Tom Sanders, executive in charge of the CD-ROM production line, is being set up to take the blame for manufacturing failures that are really the fault of cost-cutting measures by rival executive Meredith Johnson.
The Corridor: Hardware Interface
The virtual reality system is introduced at about 40 minutes, using the narrative device of a product demonstration within the company to explain to the attendees what it does. The scene is nicely done, conveying all the important points we need to know in two minutes. (To be clear, some of the images used here come from a later scene in the film, but it’s the same system in both.)
The process of entangling yourself with the necessary hardware and software is quite distinct from interacting with the VR itself, so let’s discuss these separately, starting with the physical interface.
Tom wearing VR headset and one glove, being scanned. Disclosure (1994)
In Disclosure the virtual reality user wears a headset and one glove, all connected by cables to the computer system. Like most virtual reality systems, the headset is responsible for visual display, audio, and head movement tracking; the glove for hand movement and gesture tracking.
There are two “laser scanners” on the walls. These are the planar blue lights, which scan the user’s body at startup. After that they track body motion, although since the user still has to wear a glove, the scanners presumably just track approximate body movement and orientation without fine detail.
Lastly, the user stands on a concave hexagonal plate covered in embedded white balls, which allows the user to “walk” on the spot.
Closeup of user standing on curved surface of white balls. Disclosure (1994)
Searching for Evidence
The scene we’re most interested in takes place later in the film, the evening before a vital presentation which will determine Tom’s future. He needs to search the company computer files for evidence against Meredith, but discovers that his normal account has been blocked from access. He knows though that the virtual reality demonstrator is on display in a nearby hotel suite, and also knows about the demonstrator having unlimited access. He sneaks into the hotel suite to use The Corridor. Tom is under a certain amount of time pressure because a couple of company VIPs and their guests are downstairs in the hotel and might return at any time.
The first step for Tom is to launch the virtual reality system. This is done from an Indy workstation, using the regular Unix command line.
The command line to start the virtual reality system. Disclosure (1994)
Next he moves over to the VR space itself. He puts on the glove but not the headset, presses a key on the keyboard (of the VR computer, not the workstation), and stands still for a moment while he is scanned from top to bottom.
Real world Tom, wearing one VR glove, waits while the scanners map his body. Disclosure (1994)
On the left is the Indy workstation used to start the VR system. In the middle is the external monitor which will, in a moment, show the third person view of the VR user as seen earlier during the product demonstration.
Now that Tom has been scanned into the system, he puts on the headset and enters the virtual space.
The Corridor: Virtual Interface
“The Corridor,” as you’ve no doubt guessed, is a three dimensional file browsing program. It is so named because the user will walk down a corridor in a virtual building, the walls lined with “file cabinets” containing the actual computer files.
Three important aspects of The Corridor were mentioned during the product demonstration earlier in the film. They’ll help structure our tour of this interface, so let’s review them now, as they all come up in our discussion of the interfaces.
There is a voice-activated help system, which will summon a virtual “Angel” assistant.
Since the computers themselves are part of a multi-user network with shared storage, there can be more than one user “inside” The Corridor at a time. Users who do not have access to the virtual reality system will appear as wireframe body shapes with a 2D photo where the head should be.
There are no access controls and so the virtual reality user, despite being a guest or demo account, has unlimited access to all the company files. This is spectacularly bad design, but necessary for the plot.
With those bits of system exposition complete, now we can switch to Tom’s own first person view of the virtual reality environment.
Virtual world Tom watches his hands rezzing up, right hand with glove. Disclosure (1994)
There isn’t a real background yet, just abstract streaks. The avatar hands are rezzing up, and note that the right hand wearing the glove has a different appearance to the left. This mimics the real world, so eases the transition for the user.
Overlaid on the virtual reality view is a Digicom label at the bottom and four corner brackets which are never explained, although they do resemble those used in cameras to indicate the preferred viewing area.
To the left is a small axis indicator, the three green lines labeled X, Y, and Z. These show up in many 3D applications because, silly though it sounds, it is easy in a 3D computer environment to lose track of directions or even which way is up. A common fix for the user being unable to see anything is just to turn 180 degrees around.
We then switch to a third person view of Tom’s avatar in the virtual world.
Tom is fully rezzed up, within cloud of visual static. Disclosure (1994)
This is an almost photographic-quality image. To remind the viewers that this is in the virtual world rather than real, the avatar follows the visual convention described in chapter 4 of Make It So for volumetric projections, with scan lines and occasional flickers. An interesting choice is that the avatar also wears a “headset”, but it is translucent so we can see the face.
Now that he’s in the virtual reality, Tom has one more action needed to enter The Corridor. He pushes a big button floating before him in space.
Tom presses one button on a floating control panel. Disclosure (1994)
This seems unnecessary, but we can assume that in the future of this platform, there will be more programs to choose from.
The Corridor rezzes up, the streaks assembling into wireframe components which then slide together as the surfaces are shaded. Tom doesn’t have to wait for the process to complete before he starts walking, which suggests that this is a Level Of Detail (LOD) implementation where parts of the building are not rendered in detail until the user is close enough for it to be worth doing.
Tom enters The Corridor. Nearby floor and walls are fully rendered, the more distant section is not complete. Disclosure (1994)
The architecture is classical, rendered with the slightly artificial-looking computer shading that is common in 3D computer environments because it needs much less computation than trying for full photorealism.
Instead of a corridor this is an entire multistory building. It is large and empty, and as Tom is walking bits of architecture reshape themselves, rather like the interior of Hogwarts in Harry Potter.
Although there are paintings on some of the walls, there aren’t any signs, labels, or even room numbers. Tom has to wander around looking for the files, at one point nearly “falling” off the edge of the floor down an internal air well. Finally he steps into one archway room entrance and file cabinets appear in the walls.
Tom enters a room full of cabinets. Disclosure (1994)
Unlike the classical architecture around him, these cabinets are very modern looking with glowing blue light lines. Tom has found what he is looking for, so now begins to manipulate files rather than browsing.
Virtual Filing Cabinets
The four nearest cabinets according to the titles above are
Communications
Operations
System Control
Research Data.
There are ten file drawers in each. The drawers are unmarked, but labels only appear when the user looks directly at it, so Tom has to move his head to centre each drawer in turn to find the one he wants.
Tom looks at one particular drawer to make the title appear. Disclosure (1994)
The fourth drawer Tom looks at is labeled “Malaysia”. He touches it with the gloved hand and it slides out from the wall.
Tom withdraws his hand as the drawer slides open. Disclosure (1994)
Inside are five “folders” which, again, are opened by touching. The folder slides up, and then three sheets, each looking like a printed document, slide up and fan out.
Axis indicator on left, pointing down. One document sliding up from a folder. Disclosure (1994)
Note the tilted axis indicator at the left. The Y axis, representing a line extending upwards from the top of Tom’s head, is now leaning towards the horizontal because Tom is looking down at the file drawer. In the shot below, both the folder and then the individual documents are moving up so Tom’s gaze is now back to more or less level.
Close up of three “pages” within a virtual document. Disclosure (1994)
At this point the film cuts away from Tom. Rival executive Meredith, having been foiled in her first attempt at discrediting Tom, has decided to cover her tracks by deleting all the incriminating files. Meredith enters her office and logs on to her Indy workstation. She is using a Command Line Interface (CLI) shell, not the standard SGI Unix shell but a custom Digicom program that also has a graphical menu. (Since it isn’t three dimensional it isn’t interesting enough to show here.)
Tom uses the gloved hand to push the sheets one by one to the side after scanning the content.
Tom scrolling through the pages of one folder by swiping with two fingers. Disclosure (1994)
Quick note: This is harder than it looks in virtual reality. In a 2D GUI moving the mouse over an interface element is obvious. In three dimensions the user also has to move their hand forwards or backwards to get their hand (or finger) in the right place, and unless there is some kind of haptic feedback it isn’t obvious to the user that they’ve made contact.
Tom now receives a nasty surprise.
The shot below shows Tom’s photorealistic avatar at the left, standing in front of the open file cabinet. The green shape on the right is the avatar of Meredith who is logged in to a regular workstation. Without the laser scanners and cameras her avatar is a generic wireframe female humanoid with a face photograph stuck on top. This is excellent design, making The Corridor usable across a range of different hardware capabilities.
Tom sees the Meredith avatar appear. Disclosure (1994)
Why does The Corridor system place her avatar here? A multiuser computer system, or even just a networked file server, obviously has to know who is logged on. Unix systems in general and command line shells also track which directory the user is “in”, the current working directory. Meredith is using her CLI interface to delete files in a particular directory so The Corridor can position her avatar in the corresponding virtual reality location. Or rather, the avatar glides into position rather than suddenly popping into existence: Tom is only surprised because the documents blocked his virtual view.
Quick note: While this is plausible, there are technical complications. Command line users often open more than one shell at a time in different directories. In such a case, what would The Corridor do? Duplicate the wireframe avatar in each location? In the real world we can’t be in more than one place at a time, would doing so contradict the virtual reality metaphor?
There is an asymmetry here in that Tom knows Meredith is “in the system” but not vice versa. Meredith could in theory use CLI commands to find out who else is logged on and whether anyone was running The Corridor, but she would need to actively seek out that information and has no reason to do so. It didn’t occur to Tom either, but he doesn’t need to think about it, the virtual reality environment conveys more information about the system by default.
We briefly cut away to Meredith confirming her CLI delete command. Tom sees this as the file drawer lid emitting beams of light which rotate down. These beams first erase the floating sheets, then the folders in the drawer. The drawer itself now has a red “DELETED” label and slides back into the wall.
Tom watches Meredith deleting the files in an open drawer. Disclosure (1994)
Tom steps further into the room. The same red labels appear on the other file drawers even though they are currently closed.
Tom watches Meredith deleting other, unopened, drawers. Disclosure (1994)
Talking to an Angel
Tom now switches to using the system voice interface, saying “Angel I need help” to bring up the virtual reality assistant. Like everything else we’ve seen in this VR system the “angel” rezzes up from a point cloud, although much more quickly than the architecture: people who need help tend to be more impatient and less interested in pausing to admire special effects.
The voice assistant as it appears within VR. Disclosure (1994)
Just in case the user is now looking in the wrong direction the angel also announces “Help is here” in a very natural sounding voice.
The angel is rendered with white robe, halo, harp, and rapidly beating wings. This is horribly clichéd, but a help system needs to be reassuring in appearance as well as function. An angel appearing as a winged flying serpent or wheel of fire would be more original and authentic (yes, really: Biblically Accurate Angels) but users fleeing in terror would seriously impact the customer satisfaction scores.
Now Tom has a short but interesting conversation with the angel, beginning with a question:
Tom
Is there any way to stop these files from being deleted?
Angel
I’m sorry, you are not level five.
Tom
Angel, you’re supposed to protect the files!
Angel
Access control is restricted to level five.
Tom has made the mistake, as described in chapter 9 Anthropomorphism of the book, of ascribing more agency to this software program than it actually has. He thinks he is engaged in a conversational interface (chapter 6 Sonic Interfaces) with a fully autonomous system, which should therefore be interested in and care about the wellbeing of the entire system. Which it doesn’t, because this is just a limited-command voice interface to a guide.
Even though this is obviously scripted, rather than a genuine error I think this raises an interesting question for real world interface designers: do users expect that an interface with higher visual quality/fidelity will be more realistic in other aspects as well? If a voice interface assistant has a simple polyhedron with no attempt at photorealism (say, like Bit in Tron) or with zoomorphism (say, like the search bear in Until the End of the World) will users adjust their expectations for speech recognition downwards? I’m not aware of any research that might answer this question. Readers?
Despite Tom’s frustration, the angel has given an excellent answer – for a guide. A very simple help program would have recited the command(s) that could be used to protect files against deletion. Which would have frustrated Tom even more when he tried to use one and got some kind of permission denied error. This program has checked whether the user can actually use commands before responding.
This does contradict the earlier VR demonstration where we were told that the user had unlimited access. I would explain this as being “unlimited read access, not write”, but the presenter didn’t think it worthwhile to go into such detail for the mostly non-technical audience.
Tom is now aware that he is under even more time pressure as the Meredith avatar is still moving around the room. Realising his mistake, he uses the voice interface as a query language.
“Show me all communications with Malaysia.” “Telephone or video?” “Video.”
This brings up a more conventional looking GUI window because not everything in virtual reality needs to be three-dimensional. It’s always tempting for a 3D programmer to re-implement everything, but it’s also possible to embed 2D GUI applications into a virtual world.
Tom looks at a conventional 2D display of file icons inside VR. Disclosure (1994)
The window shows a thumbnail icon for each recorded video conference call. This isn’t very helpful, so Tom again decides that a voice query will be much faster than looking at each one in turn.
“Show me, uh, the last transmission involving Meredith.”
There’s a short 2D transition effect swapping the thumbnail icon display for the video call itself, which starts playing at just the right point for plot purposes.
Tom watches a previously recorded video call made by Meredith (right). Disclosure (1994)
While Tom is watching and listening, Meredith is still typing commands. The camera orbits around behind the video conference call window so we can see the Meredith avatar approach, which also shows us that this window is slightly three dimensional, the content floating a short distance in front of the frame. The film then cuts away briefly to show Meredith confirming her “kill all” command. The video conference recordings are deleted, including the one Tom is watching.
Tom is informed that Meredith (seen here in the background as a wireframe avatar) is deleting the video call. Disclosure (1994)
This is also the moment when the downstairs VIPs return to the hotel suite, so the scene ends with Tom managing to sneak out without being detected.
Virtual reality has saved the day for Tom. The documents and video conference calls have been deleted by Meredith, but he knows that they once existed and has a colleague retrieve the files he needs from the backup tapes. (Which is good writing: the majority of companies shown in film and TV never seem to have backups for files, no matter how vital.) Meredith doesn’t know that he knows, so he has the upper hand to expose her plot.
Analysis
How believable is the interface?
I won’t spend much time on the hardware, since our focus is on file browsing in three dimensions. From top to bottom, the virtual reality system starts as believable and becomes less so.
Hardware
The headset and glove look like real VR equipment, believable in 1994 and still so today. Having only one glove is unusual, and makes impossible some of the common gesture actions described in chapter 5 of Make It So, which require both hands.
The “laser scanners” that create the 3D geometry and texture maps for the 3D avatar and perform real time body tracking would more likely be cameras, but that would not sound as cool.
And lastly the walking platform apparently requires our user to stand on large marbles or ball bearings and stay balanced while wearing a headset. Uh…maybe…no. Apologetics fails me. To me it looks like it would be uncomfortable to walk on, almost like deterrent paving.
Software
The Corridor, unlike the 3D file browser used in Jurassic Park, is a special effect created for the film. It was a mostly-plausible, near future system in 1994, except for the photorealistic avatar. Usually this site doesn’t discuss historical context (the “new criticism” stance), but I think in this case it helps to explain how this interface would have appeared to audiences almost two decades ago.
I’ll start with the 3D graphics of the virtual building. My initial impression was that The Corridor could have been created as an interactive program in 1994, but that was my memory compressing the decade. During the 1990s 3D computer graphics, both interactive and CGI, improved at a phenomenal rate. The virtual building would not have been interactive in 1994, was possible on the most powerful systems six years later in 2000, and looks rather old-fashioned compared to what the game consoles of the 21st C can achieve.
For the voice interface I made the opposite mistake. Voice interfaces on phones and home computing appliances have become common in the second decade of the 21st C, but in reality are much older. Apple Macintosh computers in 1994 had text-to-speech synthesis with natural sounding voices and limited vocabulary voice command recognition. (And without needing an Internet connection!) So the voice interface in the scene is believable.
The multi-user aspects of The Corridor were possible in 1994. The wireframe avatars for users not in virtual reality are unflattering or perhaps creepy, but not technically difficult. As a first iteration of a prototype system it’s a good attempt to span a range of hardware capabilities.
The virtual reality avatar, though, is not believable for the 1990s and would be difficult today. Photographs of the body, made during the startup scan, could be used as a texture map for the VR avatar. But live video of the face would be much more difficult, especially when the face is partly obscured by a headset.
How well does the interface inform the narrative of the story?
The virtual reality system in itself is useful to the overall narrative because it makes the Digicom company seem high tech. Even in 1994 CD-ROM drives weren’t very interesting.
The Corridor is essential to the tension of the scene where Tom uses it to find the files, because otherwise the scene would be much shorter and really boring. If we ignore the virtual reality these are the interface actions:
Tom reads an email.
Meredith deletes the folder containing those emails.
Tom finds a folder full of recorded video calls.
Tom watches one recorded video call.
Meredith deletes the folder containing the video calls.
Imagine how this would have looked if both were using a conventional 2D GUI, such as the Macintosh Finder or MS Windows Explorer. Double click, press and drag, double click…done.
The Corridor slows down Tom’s actions and makes them far more visible and understandable. Thanks to the virtual reality avatar we don’t have to watch an actor push a mouse around. We see him moving and swiping, be surprised and react; and the voice interface adds extra emotion and some useful exposition. It also helps with the plot, giving Tom awareness of what Meredith is doing without having to actively spy on her, or look at some kind of logs or recordings later on.
Meredith, though, can’t use the VR system because then she’d be aware of Tom as well. Using a conventional workstation visually distinguishes and separates Meredith from Tom in the scene.
So overall, though the “action” is pretty mundane, it’s crucial to the plot, and the VR interface helps make this interesting and more engaging.
How well does the interface equip the character to achieve their goals?
As described in the film itself, The Corridor is a prototype for demonstrating virtual reality. As a file browser it’s awful, but since Tom has lost all his normal privileges this is the only system available, and he does manage to eventually find the files he needs.
At the start of the scene, Tom spends quite some time wandering around a vast multi-storey building without a map, room numbers, or even coordinates overlaid on his virtual view. Which seems rather pointless because all the files are in one room anyway. As previously discussed for Johnny Mnemonic, walking or flying everywhere in your file system seems like a good idea at first, but often becomes tedious over time. Many actual and some fictional 3D worlds give users the ability to teleport directly to any desired location.
Then the file drawers in each cabinet have no labels either, so Tom has to look carefully at each one in turn. There is so much more the interface could be doing to help him with his task, and even help the users of the VR demo learn and explore its technology as well.
Contrast this with Meredith, who uses her command line interface and 2D GUI to go through files like a chainsaw.
Tom becomes much more efficient with the voice interface. Which is just as well, because if he hadn’t, Meredith would have deleted the video conference recordings while he was still staring at virtual filing cabinets. However neither the voice interface nor the corresponding file display need three dimensional graphics.
There is hope for version 2.0 of The Corridor, even restricting ourselves to 1994 capabilities. The first and most obvious is to copy 2D GUI file browsers, or the 3D file browser from Jurassic Park, and show the corresponding text name next to each graphical file or folder object. The voice interface is so good that it should be turned on by default without requiring the angel. And finally add some kind of map overlay with a you are here moving dot, like the maps that players in 3D games such as Doom could display with a keystroke.
Film making challenge: VR on screen
Virtual reality (or augmented reality systems such as Hololens) provide a better viewing experience for 3D graphics by creating the illusion of real three dimensional space rather than a 2D monitor. But it is always a first person view and unlike conventional 2D monitors nobody else can usually see what the VR user is seeing without a deliberate mirroring/debugging display. This is an important difference from other advanced or speculative technologies that film makers might choose to include. Showing a character wielding a laser pistol instead of a revolver or driving a hover car instead of a wheeled car hardly changes how to stage a scene, but VR does.
So, how can we show virtual reality in film?
There’s the first-person view corresponding to what the virtual reality user is seeing themselves. (Well, half of what they see since it’s not stereographic, but it’s cinema VR, so close enough.) This is like watching a screencast of someone else playing a first person computer game, the original active experience of the user becoming passive viewing by the audience. Most people can imagine themselves in the driving seat of a car and thus make sense of the turns and changes of speed in a first person car chase, but the film audience probably won’t be familiar with the VR system depicted and will therefore have trouble understanding what is happening. There’s also the problem that viewing someone else’s first-person view, shifting and changing in response to their movements rather than your own, can make people disoriented or nauseated.
A third-person view is better for showing the audience the character and the context in which they act. But not the diegetic real-world third-person view, which would be the character wearing a geeky headset and poking at invisible objects. As seen in Disclosure, the third person view should be within the virtual reality.
But in doing that, now there is a new problem: the avatar in virtual reality representing the real character. If the avatar is too simple the audience may not identify it with the real world character and it will be difficult to show body language and emotion. More realistic CGI avatars are increasingly expensive and risk falling into the Uncanny Valley. Since these films are science fiction rather than factual, the easy solution is to declare that virtual reality has achieved the goal of being entirely photorealistic and just film real actors and sets. Adding the occasional ripple or blur to the real world footage to remind the audience that it’s meant to be virtual reality, again as seen in Disclosure, is relatively cheap and quick. So, solving all these problems results in the cinematic trope we can call Extradiegetic Avatars, which are third-person, highly-lifelike “renderings” of characters, with a telltale Hologram Projection Imperfection for audience readability, that may or may not be possible within the world of the film itself.
The thanatorium is a speculative service for assisted suicide in Soylent Green. Suicide and death are not easy topics and I will do my best to address them seriously. Let me first take a moment to direct anyone who is considering or dealing with suicide to please stop reading this and talk to someone about it. I am unqualified to address—and this blog is not the place to work through—such issues.
There are four experiences to look at in the interface and service design of the Thanatorium: The patient, their beneficiaries, the usher to the beneficiaries, and the attendants to the patient. This post is about the patient themselves. Since there aren’t any technological interfaces, this will be a review of the service design from the patient’s and Soylent’s perspectives. If you’re only into this blog for technological interfaces, this is a post to skip, as it’s going to be about set design, lighting, props, signage, and ritual design, among other things.
Sol’s goals
Part of how we measure the efficacy of an experience is by checking whether it helps its user achieve their goals in the ways they would like them achieved. So let’s say that Sol’s goals are to take advantage of the service to have a good death, i.e. to pass painlessly and with dignity, and to have his belongings passed along according to his wishes. He wants psychological comfort as well, which in this case means helping him psychologically transition from the world he is leaving behind by setting up a liminal space for the ceremony, pointing toward notions of eternity and away from the horrible world he is leaving.
“People,” you say? Yeah, screw that. I’m out.
We are going to completely bypass the script question here about why Sol doesn’t bother to communicate to Thorn the Dark Secret in his goodbye note, but then does tell him when he happens to join him at the Thanatorium. That is what it is.
Sol’s experience
After Sol learns that his options are cannibalism or starvation, he makes the decision to die with dignity. To enact this wish, he dresses in his Sunday best, heads to the state-sponsored Thanatorium, officed in a low-rise building at the end of a wide street in downtown New York City.
Authors Islam Abohela and Noel Lavin insightfully note in their 2020 paper, The Height of Future Architecture: Significance of High versus Low Rise Architecture in Science Fiction Films, that the horizontality of this building contrasts earlier, vertical sci-fi visions of the cityscape as lofty and aspirational. In short, the building is in a horizontal repose suitable to its purpose. Further, the bright illumination spilling out from its frosted-glass doors onto the street helps to sell its next-world-ly promise, especially as the terminus of a dark road.
Initial greeting
At Sol’s approach a young worker opens the door and welcomes him. (How did she know of his approach, given the frosted glass? Let’s presume cameras, though we see no hint of this.)
With the door open, Sol feels the air conditioning pouring from inside and says, “It feels good.” She replies, “Yes, sir. Won’t you please come in?” He hesitates a moment with the gravity of it, but proceeds. Inside he walks through a turnstile and the greeter escorts him to one of the intake queues.
Worldbuilding question: The New York City of Soylent Green is oppressively hot and overcrowded. You would imagine that people would want to feel that refreshing cool air themselves, even if they weren’t there to suicide. I would expect people to be laying on the sidewalk there near the doors on the off-chance to feel a cool breeze. But the street leading to the Thanatorium is vacant. Why is this so? You might think well, it’s an authoritarian state, and curfew is probably enforced brutally. But then why is Sol allowed to just amble his way there? It would have been a nice beat to have seen Sol approached by an angry cop and challenged, only to have Sol point up the street to the Thanatorium, to which the cop softens and nods, allowing Sol to continue. This would have signaled that, despite curfew, the Thanatorium is open 24 hours a day, 7 days for “business.”
Intake
Taking a moment to appreciate the set design, the placid blues and non-descript “plop art” backdrops sell this space as a hospital rather than, say, an airport terminal, or church. It could have gone all “heavenly gate” but that would have been too soon in the patient experience, and lacked the personalized immersion that leads to…uh…the ecstasy meat (a gross, backworlded concept introduced in the beneficiaries post). The service keeps its powder dry to maximize that main event and thereby its output. So this design wins for being both familiar to the patients and effective for Soylent.
The film cuts away to show Thorn returning home to find Sol’s goodbye letter, and then running to the Thanatorium. When we cut back to Sol, he is in the middle of answering some questions by the intake staff, i.e. His favorite color and genre of music. Sol responds and the intake personnel marks his answers on a reusable plastic form. Before signing, Sol wants to confirm that the ceremony will last, “A full 20 minutes?”
“Certainly,” comes the reply, “Guaranteed.”
This scriptwriting moment bears a mention. This comes across as a negotiation, but what is being exchanged here? And what could Sol do with a guarantee when he won’t be there in case this mustache reneges on the deal? Nothing, of course, but it really sets up the transactional nature here. One’s death is so cheap in the world of Soylent Green that one can use it as a bargaining chip. Dark.
There’s a lot that we don’t get to examine in this intake experience because the scene is cut, but per Sol’s goals identified above, we have to imagine it would include questions about his beneficiaries and privacy. Additional questions appear in the text below.
Theater 11
The usher comes and retrieves Sol, making small talk and escorting him down halls, past the beneficiaries’ observation room, to “theater 11,” which is the death chamber to which he’s been assigned, with attendants waiting there standing aside a bed in the center of the room. The inclusion of “11” reminds us that there are many such theaters in the Thanatorium. It would have been nice for the beneficiaries only room to have had a similar number, i.e. “Observation 11: beneficiaries only,” linking the two together for the users and the audience.
We’ll get back to Sol’s experience in a moment, but first a note on the floor markings and the architecture.
I first thought the red line on the floor might have been wayfinding lines like you see in some hospitals. If it was a particularly busy day, and the patient ambulatory, the intake personnel could say, “Follow the red line on the floor to theater 11.” But, a glance at the scenes that precede this show that these markings are only present in the antechamber leading into the theater and the theater itself. So it serves as more of a decoration, a red line leading to a red circle in the middle of which is a white gray, and black circle. The end of the line in two senses.
This sense of the terminus is reinforced by the design of the room. The small passageway down which Sol walks joins with the more expansive theater, creating a sort of “reverse womb” implying a balance between the beginning and end of life. It’s not critical that patients pick up on any of this, of course, but all contributes to a sense of liminality; of interest to both Sol and Soylent.
So all good, but I wish the lighting here had echoed the approach to the building. It should have been a glowing pool of light at the end of a dark passageway, rather than the even overhead lighting reminiscent of a school cafeteria that we see in the film. Pools of light in the center combined with many flickering pinpoints of light at the periphery would have increased the sense of other-worldliness and unified the approach to the building with the entrance to the theater, creating a rhythm of self-similar spectacle. It also would have let the scale of the 180° screen become apparent only once the ceremony started, adding to its thrill and overwhelming scale.
The attendant behavior
In service design, the behavior of the frontstage staff is of particular concern, as humans are good at reading other humans for cues about unfamiliar things. In this case, the attendants are silent, wear beatific expressions, and move with a dance-like deliberateness throughout their parts. It is perhaps the most effective cue-of-transition for the patient. The outfits are a little goofy, but borrow semantically from western Christian liturgy, so are kind-of appropriate. If the patient were atheist or from a different religious tradition, other costumes with different signifiers would be more appropriate.
It’s also of note that not everyone is comfortable with being touched by strangers. It signals a warmth in the scene, but might feel threatening to some patients. Another question to add to the intake questionnaire.
Disrobing
Once Sol is in the theater, the attendants greet him with silent handshakes, lead him to the bed, and begin to help him disrobe. This segment bears many questions.
Why does he need to be naked?
I get why he is disrobed here, from Soylent’s perspective. I’ve never been a mortician, but it does seem that getting the clothes off of a living person would be easier than getting it off a dead person, why make the task harder for Soylent employees down the line? Just work it into the ceremony, some product manager says. And from Sol’s perspective, he’d like to see his clothes being taken away in a nice basket with some assurances that the clothes would be washed and given back to the community; an additional assurance that he’s doing a good, selfless thing in this world with dwindling resources.
But then there are the pants. Maybe it’s me, but there is not a dignified way to remove one’s pants around other, clothed, people. Did they help him out of his pants? Did he do that and just hand the clothes to them? Is he just in his underwear? All of it seems awkward.
I think the service could take a privacy clue from hospitals, public pools, and spas: provide a small room where a patient can undress themselves and switch into a robe. This would also be an opportunity to get a shower, which the movie demonstrates is a cherished luxury in the world of Soylent Green, another reward to lure citizens. Water is in short supply in the world of Soylent Green, but the corpses that are sent en masse to The Exchange for processing don’t get otherwise cleaned, so it would be another nice, hygienic worldbuilding hint.
In the scene, the disrobing is taken as a solemn moment, but Sol is distracted from thinking too hard about it by the appearance of an orange floodlight.
That orange floodlight
During the disrobing, a floodlight of Sol’s favorite color illuminates. I complained briefly about this in the prior post, but what’s causing this light to come on? The usher is back at intake, so it’s not him. Maybe the light is on a timer, but that seems hard for the attendants to manage against the other things that need to happen.
Also, why does it come on at this moment in the ceremony? It might be a deliberate distraction for Sol, meant to focus his attention on the meaning of the ceremony rather than the mundane disrobing, but if so, you might think that the light should illuminate before the disrobing begins. But recall that it’s only happenstance that Sol’s favorite color is the warm and flattering orange. If a patient’s favorite color happened to be blue—which is the most popular color around the world—it would grant everything in theater 11 a cool, detached appearance, and give the patient’s own skin a deathly pallor. Not great for the experience.
Even the second most favored colors aren’t much better. Red looks like danger to western audiences, purple is unflattering, and green looks alien and would be little on-the-nose for the theme. Apologies to my colorblind readers.
Much better would be to keep the custom-color flood light off until the overture begins—when the patient’s attention is not drawn to themselves but focused on the chamber around them—and illuminate it with the rise of the music, in response to the usher’s controls. This would maximize the impact of the color on Sol’s emotional state while not making his own skin and the attendants look off-putting.
Getting onto the bed
Once disrobed, the attendants help Sol onto the bed. How they do this is left off-screen, but it’s a non-trivial problem since as you can see in the screen shot, Sol is 5’7″ and the bed height is well above his waist. Hopefully there’s a set of retractable steps under the bed skirt that can make this accessible to Sol without his having to be hoisted up by the attendants, which would be undignified.
Hemlock
Once in bed, the attendants provide the “hemlock,” (which is what I’m calling the deadly draught they provide in homage to the death of Socrates) and Sol drinks.
We don’t see the glass in the room prior to its being handed to him, but I imagine since this is the point of no return, it bears some attention. Should it be waiting already poured, or should he watch it being poured? Should be pour it himself? If poured, should it be from a gold, porcelain, or glass pitcher? Should there be a tray? Where should all this be staged?
For materials, gold is a good funereal symbol for never tarnishing, but might be too tempting a theft target for poverty-stricken citizens. Stoneware has a nice connotation of being of-the-earth, but is a poor choice for being opaque and here implying its contents are something to be hidden. So I’d recommend a simple glass pitcher that emphasizes clarity. The Toyo pitcher shown below has no handle and so requires two hands to operate, granting a ceremonial, human feel to the act of pouring. While we’re at it, ditch the footed highball glass for a stange or zombie glass to match the pitcher’s simplicity. Have them sitting on an end table on a tray at the side of the bed in their own pool of light and have the attendant pour and hand the glass to the patient. When they depart the chamber one attendant can take the tray out with them for cleaning, and the other can push the end table back under the bed.
Another argument for delaying the floodlight until the overture is that light can change the apparent color of the drink. It just so happens that Sol’s orange flatters the amber color of the draught, but if his favorite color had been, say, red, it might have made the drink look like a wicked ink. Keep the floodlight off to keep the apparent color of the drink something pleasant and unthreatening.
Sol makes no expression in response to the taste of the hemlock, so we have no clue how it’s flavored, but it’s in everyone’s interest that it be palatable, if not pleasant. It would have been a nice touch at intake to ask him to select from a menu of favorite flavors as well, especially to hide the taste of whatever other drugs need to be mixed in.
Once Sol has imbibed the draught, he lies back on the wedge pillow and the attendants draw a sheet up to his chest.
As the orange floodlight dims to a candlelight whisper, Sol waits for the overture to begin as the attendants depart.
Overture
Alone at last, Sol is treated to an audio overture as the drugs work through his system. The music is the principal theme from the first movement of Tchaikovsky’s Symphony No. 6, the “Pathétique.” He stares up at the ceiling, bathed in his favorite color, listening to his favorite music unaware that things are about to become even more spectacular.
Cinerama
The overture complete (and, per my ecstasy meat theory, the MDMA and opiates have kicked in) the audio-visual presentation starts. The music changes to the first movement of Beethoven’s “Symphony #6 (The Pastoral),” and a very wide-angle video presentation begins on the wrap-around screen above him, starting with a verdant field of tulips blowing in a breeze.
The tiny angles in the screen edge hint that this is meant to work exactly like Cinerama with multiple projectors and stitched edges, though the lack of deformation and perspective in the images is all wrong.
It later transitions to images of fauna, other flora, wholesome livestock, and sunsets—all romantic scenes of a highly-selective-memory of Earth’s heyday. It’s important to remember that audiences in 1973 may have heard of a Cinerama display like this, but few of them had seen it. And the 180+° screen seen in the film dwarfs the original Cinerama 2.65:1 display ratio. So though folks today may yawn at this in comparison to IMAX or Oculus AR displays, at the time this would have seemed very sci-fi.
From our vantage point, it all seems a little cruel, bathing Sol in scenes of what he cannot have and what for him will never be, but maybe it points at an afterlife where the things you recall fondly will be yours again, in abundance. (Hey that seems like a formula for every afterlife story.) Mixed with the drugs in Sol’s system, it would help flood his mind and body with euphoria and all the pleasant neurotransmitters that entails.
I minimize this gif because it is so freaking distracting, as it would be to users.
At a few minutes into the presentation, the SPEAKING PERMITTED light of the beneficiaries interface begins blinking, and the patient is able to talk to their loved ones. This would interrupt the spectacle of the display, but add a flood of additional emotions (and thereby hormones) from heartfelt declarations of love and farewell. Immediately afterward “Morning Mood” from Grieg’s “Peer Gynt Suite #1” plays as biophilic videos play: Alpine mountainscapes with grazing donkeys, tarns with floral banks. Finally it segues to scenes depicting the end-of-a-day: A sunset over waves crashing on the black rocks of a pristine West Coast beach, another sun sets through gaps in swiftly drifting clouds.
The screen fades to black as “Aase’s Death” plays from the “Peer Gynt Suite.” In the film, this is the point where Sol shares the Dark Secret and tells Thorn he must go the Exchange and provide proof to the elders. (Ugh. Screenwriters, again, if this was so important, why did he wait until this moment—which he was not sure would come—to convey this information? It makes no sense. But I digress.)
Psst…did you know the namesake of the James Webb telescope was a filthy homophobe? Now you do.
The camera is all close up in their faces for this final beat, so we don’t know what is playing on the screen, but I’d like to think it’s images of stars and nebulae to evoke not just the end of a terrestrial day, but a connection to things that by comparison seem eternal, everlasting.
Communication signals
The dialogue makes me realize another signal is missing for Sol, that is, how does he know when the audio channel to the observation room is open? Now, it would be nice if the audio channel were tied to the state of the viewing portal. That is, audio is connected when the portal is open and they can see each other; and off when the portal is closed. But, we know that Soylent wants the usher to have control of the channels to silence either party at will, so in lieu of that, let’s give some signal to Sol near the observation window to let him know when the audio channel is open. It should look akin to the interface on the other side in the observation room, but it would have to be redesigned for a 10-foot rather than 2-foot experience. It would also have to not be distracting to the patient when their attention is on the cinerama, so a dim, backlit visual might be enough for sighted users. Separate and custom-designed rooms should be built for differently abled patients.
After his plea to Thorn, Sol finally passes, marking the end of his experience with the Thanatorium.
All told, Sol’s experience suits his goals fairly well. He wants a sense of dignity, spectacle, importance, connection to his loved one, and otherworldliness that he receives. There are little things to fix throughout, as mentioned in the text.
My biggest criticism is of being physically separated from loved ones, when a held hand might take the edge off of the fear of death and add a nice dose of oxytocin to the result, but Soylent’s interest is more about maximizing control of the end product, so this, full of risk, would not make it into the final design.
The thanatorium is a speculative service for assisted suicide in Soylent Green. Suicide and death are not easy topics and I will do my best to address them seriously. Let me first take a moment to direct anyone who is considering or dealing with suicide to please stop reading this and talk to someone about it. I am unqualified to address—and this blog is not the place to work through—such issues.
There are four experiences to look at in the interface and service design of the Thanatorium: The patient, their beneficiaries, the usher, and the attendants to the patient. This post is about the least complicated of the bunch, the beneficiaries.
Thorn’s experience
We have to do a little extrapolation here because the way we see it in the movie is not the way we imagine it would work normally. What we see is Thorn entering the building and telling staff there to take him to Sol. He is escorted to an observation room labeled “beneficiaries only” by an usher. (Details about the powerful worldbuilding present in this label can be found in the prior post.) Sol has already drunk the “hemlock” drink by the time Thorn enters this room, so Sol is already dying and the robed room attendants have already left.
Aaand I just noticed that the walls are the same color as the Soylent. Ewww.
This room has a window view of the “theater” proper, with an interface mounted just below the window. At the top of this interface is a mounted microphone. Directly below is an intercom speaker beside a large status alert labeled SPEAKING PERMITTED. When we first see the panel this indicator is off. At the bottom is a plug for headphones to the left, a slot for a square authorization key, and in the middle, a row of square, backlit toggle buttons labeled PORTAL, EFFECTS, CHAMBER 2, AUDIO, VISUAL, and CHAMBER 1. When the Sol is mid-show, EFFECTS and VISUAL are the only buttons that are lit.
When the usher closes the viewing window, explaining that it’s against policy for beneficiaries to view the ceremony, Thorn…uh…chokes him in order to persuade him to let him override the policy.
Persuasion.
“Persuaded,” the usher puts his authorization key back in the slot. The window opens again. Thorn observes the ceremony in awe, having never seen the beautiful Earth of Sol’s youth. He mutters “I didn’t know” and “How could I?” as he watches. Sol tries weakly to tell Thorn something, but the speaker starts glitching, with the SPEAKING PERMITTED INDICATOR flashing on and off. Thorn, helpfully, pounds his fist on the panel and demands that the usher do something to fix it. The user gives Thorn wired earbuds and Thorn continues his conversation. (Extradiegetically, is this so they didn’t have to bother with the usher’s overhearing the conversation? I don’t understand this beat.) The SPEAKING PERMITTED light glows a solid red and they finish their conversation.
Yes, that cable jumps back and forth like that in the movie during the glitch. It was a simpler time.
Sol dies, and the lights come up in the chamber. Two assistants come to push the gurney along a track through a hidden door. Some mechanism in the floor catches the gurney, and the cadaver is whisked away from Thorn’s sight.
Regular experience?
So that’s Thorns corrupt, thuggish cop experience of the thanatorium. Let’s now make some educated guesses about what this might imply for the regular, non-thug experience for beneficiaries.
The patient and beneficiaries enter the building and greeted by staff.
They wait in queue in the lobby for their turn.
The patient is taken by attendants to the “theater” and the beneficiaries taken by the usher to the observation room.
Beneficiaries witness the drinking of the hemlock.
The patient has a moment to talk with the beneficiaries and say their final farewells.
The viewing window is closed as the patient watches the “cinerama” display and dies. The beneficiaries wait quietly in the observation room with the usher.
The viewing window is opened as they watch the attendants wheel the body into the portal.
They return to the lobby to sign some documents for benefits and depart.
So, some UX questions/backworlding
We have to backworld some of the design rationales involved to ground critique and design improvements. After all, design is the optimization of a system for a set of effects, and we want to be certain about what effects we’re targeting. So…
Why would beneficiaries be separated from the patient?
I imagine that the patient might take comfort from holding the hands or being near their loved ones (even if that set didn’t perfectly overlap with their beneficiaries). So why is there a separate viewing room? There are a handful of reasons I can imagine, only one of which is really satisfying.
Maybe it’s to prevent the spread of disease? Certainly given our current multiple pandemics, we understand the need for physical separation in a medical setting. But the movie doesn’t make any fuss about disease being a problem (though with 132,000 people crammed into every square mile of the New York City metropolitan area you’d figure it would be), and in Sol’s case, there’s zero evidence in the film that he’s sick. Why does the usher resist the request from Thorn if this was the case? And why wouldn’t the attendants be in some sort of personal protective gear?
Maybe it’s to hide the ugly facts of dying? Real death is more disconcerting to see than most people are familiar with (take the death rattle as one example) and witnessing it might discourage other citizens from opting-in for the same themselves. But, we see that Sol just passes peacefully from the hemlock drink, so this isn’t really at play here.
Maybe it’s to keep the cinerama experience hidden? It’s showing pictures of an old, bountiful earth that—in the diegesis—no longer exists. Thorn says in the movie that he’s too young to know what “old earth” was like, so maybe this society wants to prevent false hope? Or maybe to prevent rioting, should the truth of How Far We’ve Fallen get out? Or maybe it’s considered a reward for patients opting-in to suicide, thereby creating a false scarcity to further incentivize people to opt-in themselves? None of this is super compelling, and we have to ask, why does the usher give in and open the viewport if any of this was the case?
That blue-green in the upper left of this still is the observation booth.
So, maybe it’s to prevent beneficiaries from trying to interfere with the suicide. This society would want impediments against last-minute shouts of, “Wait! Don’t do it!” There’s some slight evidence against this, as when Sol is drinking the Hemlock, the viewing port is wide open, so beneficiaries might have pounded on the window if this was standard operating procedure. But its being open might have been an artifact of Sol’s having walked in without any beneficiaries. Maybe the viewport is ordinarily closed until after the hemlock, opened for final farewells, closed for the cinerama, and opened again to watch as the body is sped away?
Ecstasy Meat
This rationale supports another, more horrible argument. What if the reason is that Soylent (the company) wants the patient to have an uninterrupted dopamine and seratonin hit at the point of dying, so those neurotransmitters are maximally available in the “meat” before processing? (Like how antibiotics get passed along to meat-eaters in industrialized food today.) It would explain why they ask Sol for his favorite color in the lobby. Yes it is for his pleasure, but not for humane reasons. It’s so he can be at his happiest at the point of death. Dopamine and seratonin would make the resulting product, Soylent green, more pleasurable and addictive to consumers. That gives an additional rationale as to why beneficiaries would be prevented from speaking—it would distract from patients’ intense, pleasurable experience of the cinerama.
Now, with more Clarendon.
For my money, the “ecstasy meat” rationale reinforces and makes worse the movie’s Dark Secret, so I’m going to go with that. Without this rationale, I’d say rewrite the scene so beneficiaries are in the room with the patient. But with this rationale, let’s keep the rooms separate.
Beneficiary interfaces
Which leads us to rethinking this interface.
Beneficiary interfaces
A first usability note is that the SPEAKING PERMITTED indicator is very confusing. The white text on a black background looks like speaking is, currently, permitted. But then the light behind it illuminates and I guess, then speaking is permitted? But wait, the light is red, so does that mean it’s not permitted, or is? And then adding to the confusion, it blinks. Is that the glitching, or some third state? Can we send this to its own interface thanatorium? So to make this indicator more usable, we could do a couple of things.
Put a ring of lights around the microphone and grill. When illuminated, speaking is permitted. This presumes that the audience can infer what these lights mean, and isn’t accessible to unsighted users, but I don’t think the audio glitch is a major plot point that needs that much reinforcing; see above. If the execs just have to have it crystal clear, then you could…
Have two indicators, one reading SPEAKING PERMITTED and another reading SILENCE PLEASE, with one or the other always lit. If you had to do it on the cheap, they don’t need to be backlit panels, but just two labeled indicator lamps would do.
And no effing blinking.
Thorn voice: NO EFFING BLINKING!
I think part of the affective purpose of the interface is to show how cold and mechanistic the thanatorium’s treatment of people are. To keep that, you could add another indicator light on the panel labeled somewhat cryptically, PATIENT. Have it illuminated until Sol passes, and then have a close up shot when it fades, indicating his death.
Ah, yes, good to have a reminder that’s why he’s a critic and not a working FUI designer.
A note on art direction. It would be in Soylent’s and our-real-world interest to make this interface feel as humane as possible. Maybe less steel and backlit toggles? Then again, this world is operating on fumes, so they would make do with what’s available. So this should also feel a little more strung together, maybe with some wires sticking out held together with electrical tape and tape holding the audio jack in place.
Last note on the accommodations. What are the beneficiaries supposed to do while the patient is watching the cinerama display? Stand there and look awkward? Let’s get some seats in here and pipe the patient’s selection of music in. That way they can listen and think of the patient in the next room.
If you really want it to feel extradiegetically heartless, put a clock on the wall by the viewing window that beneficiaries can check.
Once we simplify this panel and make the room make design sense, we have to figure out what to do with the usher’s interface elements that we’ve just removed, and that’s the next post.
Whatever it is, it ain’t going to construct, observe, or repair itself. In addition to protection and provision, suits must facilitate the reason the wearer has dared to go out into space in the first place.
One of the most basic tasks of extravehicular activity (EVA) is controlling where the wearer is positioned in space. The survey shows several types of mechanisms for this. First, if your EVA never needs you to leave the surface of the spaceship, you can go with mountaineering gear or sticky feet. (Or sticky hands.) We can think of maneuvering through space as similar to piloting a craft, but the outputs and interfaces have to be made wearable, like wearable control panels. We might also expect to see some tunnel in the sky displays to help with navigation. We’d also want to see some AI safeguard features, to return the spacewalker to safety when things go awry. (Narrator: We don’t.)
Mountaineering gear
In Stowaway (2021) astronauts undertake unplanned EVAs with carabiners and gear akin to mountaineers use. This makes some sense, though even this equipment needs to be modified for use by astronauts’ thick gloves.
Stowaway (2021) Drs Kim and Levinson prepare to scale to the propellant tank.
Sticky feet (and hands)
Though it’s not extravehicular, I have to give a shout out to 2001: A Space Odyssey (1969), where we see a flight attendant manage their position in the microgravity with special shoes that adhere to the floor. It’s a lovely example of a competent Hand Wave. We don’t need to know how it works because it says, right there, “Grip shoes.” Done. Though props to the actress Heather Downham, who had to make up a funny walk to illustrate that it still isn’t like walking on earth.
With magnetic boots, seen in Destination Moon, the wearer simply walks around and manages the slight awkwardness of having to pull a foot up with extra force, and have it snap back down on its own.
Destination Moon (1950): Jim Barnes tests his magnetic boots.
Battlestar Galactica added magnetic handgrips to augment the control provided by magnetized boots. With them, Sergeant Mathias is able to crawl around the outside of an enemy vessel, inspecting it. While crawling, she holds grip bars mounted to circles that contain the magnets. A mechanism for turning the magnet off is not seen, but like these portable electric grabbers, it could be as simple as a thumb button.
Battlestar Galactica (2008, Season 4, Episode 5, “The Road Less Traveled”): Sergeant Erin Mathias inspects the damaged cylon raider for tracking devices.
Iron Man also had his Mark 50 suit form stabilizing suction cups before cutting a hole in the hull of the Q-Ship.
Avengers: Infinity War (2018)
In the electromagnetic version of boots, seen in Star Trek: First Contact, the wearer turns the magnets on with a control strapped to their thigh. Once on, the magnetization seems to be sensitive to the wearer’s walk, automatically lessening when the boot is lifted off. This gives the wearer something of a natural gait. The magnetism can be turned off again to be able to make microgravity maneuvers, such as dramatically leaping away from Borg minions.
Star Trek: First Contact (1996)
Star Trek: Discovery also included this technology, but with what appears to be a gestural activation and a cool glowing red dots on the sides and back of the heel. The back of each heel has a stack of red lights that count down to when they turn off, as, I guess, a warning to anyone around them that they’re about to be “air” borne.
Star Trek: Discovery (2017–) S01E01, “The Vulcan Hello” Ensign Burnham takes a step out onto the hull before lifting off toward the mysterious beacon.
Quick “gotcha” aside: neither Destination Moon nor Star Trek: First Contact bothers to explain how characters are meant to be able to kneel while wearing magnetized boots. Yet this very thing happens in both films.
Destination Moon (1950): Kneeling on the surface of the spaceship.
Star Trek: First Contact (1996): Worf rises from operating the maglock to defend himself.
Controlled Propellant
If your extravehicular task has you leaving the surface of the ship and moving around space, you likely need a controlled propellant. This is seen only a few times in the survey.
In the film Mission to Mars, the manned mobility unit, or MMU, seen in the film is based loosely on NASA’s MMU. A nice thing about the device is that unlike the other controlled propellant interfaces, we can actually see some of the interaction and not just the effect. The interfaces are subtly different in that the Mission to Mars spacewalkers travel forward and backward by angling the handgrips forward and backward rather than with a joystick on an armrest. This seems like a closer mapping, but also seems more prone to error by accidental touching or bumping into something.
Mission to Mars (2000): Woody inspects the craft for the leak.
The plus side is an interface that is much more cinegenic, where the audience is more clearly able to see the cause and effect of the spacewalker’s interactions with the device.
Mission to Mars (2000): The crew performs a daring EVA.
If you have propellent in a Moh’s 4 or 5 film, you might need to acknowledge that propellant is a limited resource. Over the course of the same (heartbreaking) scene shown above, we see an interface where one spacewalker monitors his fuel, and another where a spacewalker realizes that she has traveled as far as she can with her MMU and still return to safety.
Mission to Mars (2000): Woody sees that he’s out of fuel.
Mission to Mars (2000): Terry sees that she cannot continue her rescue of Woody.
For those wondering, Michael Burnham’s flight to the mysterious signal in that pilot uses propellant, but is managed and monitored by controllers on Discovery, so it makes sense that we don’t see any maneuvering interfaces for her. We could dive in and review the interfaces the bridge crew uses (and try to map that onto a spacesuit), but we only get snippets of these screens and see no controls.
Star Trek: Discovery (2017–) S01E01, “The Vulcan Hello”
Iron Man’s suits employ some Phlebotinum propellant that lasts for ever, can fit inside his tailored suit, and are powerful enough to achieve escape velocity.
Avengers: Infinity War (2018)
All-in-all, though sci-fi seems to understand the need for characters to move around in spacesuits, very little attention is given to the interfaces that enable it. The Mission to Mars MMU is the only one with explicit attention paid to it, and that’s quite derived from NASA models. It’s an opportunity for film makers should the needs of the plot allow, to give this topic some attention.
