Make It So: The Clippy Theory of Star Trek Action

11 Apr 2022 by Andrew Dana Hudson

My partner and I spent much of March watching episodes of Star Trek: The Next Generation in mostly random order. I’d seen plenty of Trek before—watching pretty much all of DS9 and Voyager as a teenager, and enjoying the more recent J.J. Abrams reboot—but it’s been years since I really considered the franchise as a piece of science fiction. My big takeaway is…TNG is bonkers, and that’s okay. The show is highly watchable because it’s really just a set of character moments, risk taking, and ethical conundrums strung together with pleasing technobabble, which soothes and hushes the parts of our brain that might object to the plot based on some technicality. It’s a formula that will probably never lose its appeal.

But there is one thing that does bother me: how can the crew respond to Picard’s orders so fast? Like, beyond-the-limits-of-reason fast.

A 2-panel “photonovella.” Above, Picard approaches Data and says, “Data, ask the computer if it can use the Voynich Manuscript and i-propyl cyanide to somehow solve the Goldback Conjecture.” Below, under the caption, “Two taps later…” Data replies, “It says it will have the answer by the commercial break, Captain.”

How are you making that so?

When the Enterprise-D encounters hostile aliens, ship malfunctions, or a mysterious space-time anomaly, we often get dynamic moments on the bridge that work like this. Data, Worf and the other bridge crew, sometimes with input from Geordi in engineering, call out sensor readings and ship functionality metrics. Captain Picard stares toward the viewscreen/camera and gives orders, sometimes intermediated by Commander Riker. Worf or Data will tap once or twice on their consoles and then quickly report the results—i.e. “our phasers have no effect” or “the warp containment field is stabilizing,” that sort of thing. It all moves very quickly, and even though the audience doesn’t quite know the dangers of tachyon radiation or how tricky it is to compensate for subspace interference, we feel a palpable urgency. It’s probably one of the most recognizable scenes-types in television.

Now, extradiegetically, I think there are very good reasons to structure the action this way. It keeps the show moving, keeps the focus on the choices, rather than the tech. And of course, diegetically, their computers would be faster than ours, responding nearly instantaneously. The crew are also highly trained military personnel, whose focus, reaction speed, and knowledge of the ship’s systems are kept sharp by regular drills. The occasional scenes we get of tertiary characters struggling with the controls only drives home how elite the Enterprise senior staff are.

A screen cap from TNG with Wil Wheaton as Wesley in the navigator seat, saying to the bridge crew, “Does…uh…anyone know where the ‘engage’ key is?” — Just kidding, we love ya, Wil.

Nonetheless, it is one thing to shout out the strength of the ship’s shields. No doubt Worf has an indicator at tactical that’s as easy to read as your laptop’s battery level. That’s bound to be routine. But it’s quite another for a crewmember to complete a very specific and unusual request in what seems like one or two taps on a console. There are countless cases of the deflector dish or tractor beam being “reconfigured” to emit this or that kind of force or radiation. Power is constantly being rerouted from one system to another. There’s a great deal of improvisational engineering by all characters.

Just to pick examples in my most recent days of binging: in “Descent, Part 2,” for instance, Beverly Crusher, as acting captain, tells the ensign at ops to launch a probe with the ship’s recent logs on it, as a warning to Starfleet, thus freeing the Enterprise to return through a transwarp conduit to take on The Borg. Or in the DS9 episode “Equilibrium”—yes, we’ve started on the next series now that TNG is off Netflix—while investigating a mysterious figure from Jadzia’s past, Sisko instructs Bashir to “check the enrollment records of all the Trill music academies during Belar’s lifetime.” In both cases, the order is complete in barely a second.

Even for Julian Bashir—a doctor and secretly a mutant genius—there is no way for a human to perform such a narrow and out-of-left-field search without entering a few parameters, perhaps navigating via menus to the correct database. From a UX perspective, we’re talking several clicks at least!

There is a tension in design between…

Interface elements that allow you to perform a handful of very specific operations quickly (if you know where the switch is), and…
Those that let you do almost anything, but slower.

For instance, this blog has big colorful buttons that make it easy to get email updates about new posts or to donate to a tip jar. If you want to find a specific post, however, you have to type something into the search box or perhaps scroll through the list of TV/movie properties on the right. While the 24th Century no doubt has somewhat better design than WordPress, they are still bound by this tension.

Of course it would be boring to wait while Bashir made the clicks required to bring up the Trill equivalent of census records or LexisNexis. With movie magic they simply edit out those seconds. But I think it’s interesting to indulge in a little backworlding and imagine that Starfleet really does have the technology to make complex general computing a breeze. How might they do it?

Enter the Ship’s AI

One possible answer is that the ship’s Computer—a ubiquitous and omnipresent AI—is probably doing most of the heavy lifting. Much like how Iron Man is really Jarvis with a little strategic input from Tony, I suspect that the Computer listens to the captain’s orders and puts the appropriate commands on the relevant crewman’s console the instant the words are out of Picard’s mouth. (With predictive algorithms, maybe even just before.) The crewman then merely has to confirm that the computer correctly interpreted the orders and press execute. Similarly, the Computer must be constantly analyzing sensor data and internal metrics and curating the most important information for the crew to call out. This would be in line with the Active Academy model proposed in relation to Starship Troopers.

Centaurs, Minotaurs, and anticipatory computing

I’ve heard this kind of human-machine relationship called “Centaur Computing.” In chess, for instance, some tournaments have found that human-computer teams outperform either humans or computers working on their own. This is not necessarily intuitive, as one would think that computers, as the undisputed better chess players, would be hindered by having an imperfect human in the mix. But in fact, when humans can offer strategic guidance, choosing between potential lines that the computer games out, they often outmaneuver pure-AIs.

I often contrast Centaur Computing with something I call “Minotaur Computing.” In the Centaur version—head of a man on the body of a beast—the human makes the top-level decision and the computer executes. In Minotaur Computing—head of a beast with the body of a man—the computer calls the shots and leaves it up to human partners to execute. An example of this would be the machine gods in Person of Interest, which have no Skynet Terminator armies but instead recruit and hire human operatives to carry out their cryptic plans.

In some ways this kind of anticipatory computing is simply a hyper-advanced version of AI features we already have today, such as when Gmail offers to complete my sentence when I begin to type “thank you for your time and consideration” at the end of a cover letter.

Hi, it looks like you’re trying to defeat the Borg…

In this formulation, the true spiritual ancestor of the Starfleet Computer is Clippy, the notorious Microsoft Word anthropomorphic paperclip helper, which would pop up and make suggestions like “It looks like you’re writing a letter. Would you like help?” Clippy was much maligned in popular culture for being annoying, distracting, and the face of what was in many ways a clunky, imperfect software product. But the idea of making sense of the user’s intentions and offering relevant options isn’t always a bad one. The Computer in Star Trek performs this task so smoothly, efficiently, and in-the-background, that Starfleet crews are able to work in fast-paced harmony, acting on both instinct and expertise, and staying the heroes of their stories.

Admittedly, this deftness is a bit at odds with the somewhat obtuse behavior the Computer often displays when asked a question directly, such as demanding you specify a temperature when you request a glass of water. Given how often the Computer suffers strange malfunctions that complicate life on the Enterprise for days a time, one wonders if the crew feel as though they are constantly negotiating with a kind of capricious spirit—usually benign but occasionally temperamental and even dangerously creative in its interpretations of one’s wishes, like a djinn. Perhaps they rarely complain about or even mention the Computer’s role in Clippy-ing orders onto their consoles because they know better than to insult the digital fairies that run the turbolifts and replicate their food.

All of which brings a kind of mystical cast to those rapid, chain-of-command-tightened exchanges amongst the bridge crew when shit hits the fan. When Picard gives his crew an order, he’s really talking to the Computer. When Riker offers a sub-order, he’s making a judgment call that the Computer might need a little more guidance. The crew are there to act as QA—a general-intelligence safeguard—confirming with human eyes and brain that the Computer is interpreting Picard correctly. The one or two beeps we often hear as they execute a complex command are them merely dismissing incorrect or confused operation-lines. They report back that the probe is ready or the phasers are locked, as the captain wished, and Picard double confirms with his iconic “make it so.” It’s a multilayered checking and rechecking of intentions and plans, much like the military today uses to prevent miscommunications, but in this case with the added bonus of keeping the reins on a powerful but not always cooperative genie.

There’s a good argument to be made that this is the relationship we want to have with technology. Smooth and effective, but with plenty of oversight, and without the kind of invasive elements that right now make tech the center of so many conversations. We want AI that gives us computational superpowers, but still keeps us the heroes of our stories.

Andrew Dana Hudson is a speculative fiction author, researcher, and theorist. His first book, Our Shared Storm: A Novel of Five Climate Futures, is fresh off the press. Check it out here. And follow his work via his newsletter, solarshades.club.

The Fritzes 2022 Winners

4 Apr 2022 by Christopher Noessel

The Fritzes award honors the best interfaces in a full-length motion picture in the past year. Interfaces play a special role in our movie-going experience, and are a craft all their own that does not otherwise receive focused recognition. Awards are given for Best Believable, Best Narrative, Audience Choice, and Best Interfaces (overall.) This blog’s readership is also polled for Audience Favorite interfaces, and this year, favorite robot. Following are the results.

Best Believable

These movies’ interfaces adhere to solid HCI principles and believable interactions. They engage us in the story world by being convincing. The nominees for Best Believable are Swan Song, Stowaway, and Needle in a Timestack.

The winner of the Best Believable award for 2022 is Swan Song.

Swan Song

Facing a terminal illness, Cameron Turner must make a terrible choice: have his wife and children suffer the grief of losing him, or sign up to be secretly swapped with a healthy clone of himself, and watch from afar as his replacement takes over his life with his unaware loved ones.

The film is full of serene augmented reality and quiet technology. It’s an Apple TV production, and very clearly inspired by Apple’s sensibilities: Slim panes of paper-white slabs that house clean-lined productivity tools, fit-to-purpose assistant wearables, and charming AI characters. Like the iPad’s appearance in The Incredibles, Swan Song’s technologies feel like a well-designed smoke-and-mirrors prototype of an AR world maybe a few years from launch.

Perhaps even more remarkably, the cloning technology that is central to the plot’s film has none of the giant helmets-with-wires that seem to be the go-to trope for such things. That’s handled almost entirely as a service with jacketed frontstage actors and tiny brain-reading dots that go on Cameron’s temples. A minimalist touch in a minimalist world that hides the horrible choices that technology asks of its citizens.

Audience Choice, too!

All of the movies nominated for other awards were presented for an Audience Choice award. Across social media, the readership was invited to vote for their favorite, and the results tallied. The winner of the Audience Choice award for 2022 is Swan Song. Congratulations for being the first film to win two Fritzes in the same year! To celebrate, here’s another screen cap from the film, showing the AR game Cameron plays with his son. Notably the team made the choice to avoid the obvious hot-signaling that almost always accompanies volumetric projections in screen sci-fi.

Best Narrative

These movies’ interfaces blow us away with wonderful visuals and the richness of their future vision. They engross us in the story world by being spectacular. The nominees for Best Narrative are The Mitchells vs The Machines, Reminiscence, and The Matrix: Resurrections.

The winner of the Best Narrative award for 2022 is The Mitchells vs The Machines.

The Mitchells vs The Machines

Katie Mitchell is getting ready to go to college for filmmaking when the world is turned upside down by a robot uprising, which is controlled by an artificial intelligence that has just been made obsolete. Katie and her odd family have to keep themselves safe from capture by the robots and ultimately save all of humanity—all while learning to love each other.

The charming thing about the triangle-heavy and candy-colored interfaces in the film are that they are almost wholly there for the robots doing their humanity-destroying job. Diegetically, they’re not meant for humans, but extradiegetically, they’re there to help tell the audience what’s happening. That’s a delicate balance to manage, and to do it while managing hilarity, lambasting Silicon Valley’s cults of personality, and providing spectacle; is what earns this film its Fritz.

Best Robot: Bubs!

There was a preponderance of interesting robots in sci-fi last year. So 2022 has a new category of Audience Choice, and that’s for Best Robot. The readership was invited to vote for their favorite from…

The unnamed bartender from Cosmic Sin
Jeff from Finch
Eric and Deborahbot 5000 from The Mitchells vs. The Machines
Bubs from Space Sweepers
Steve from the unsettling Settlers

The audience vote is clear: The wisecracking Bubs from Space Sweepers wins! Bubs’ emotions might have been hard to read with the hard plastic shell of a face. But pink blush lights and a display—near where the mouth would be—reinforce the tone of speech with characters like “??” and “!!” and even cartoon mouth expressions. Additionally, near the end of the movie Bubs has enough money to get a body upgrade, and selects a female-presenting humanoid body and voice, making a delightful addition to the Gendered AI finding than when AI selects a gender, it picks female. Congrats, Bubs!

Best Interfaces (best overall)

The movies nominated for Best Interfaces manage the extraordinary challenge of being believable and helping to paint a picture of the world of the story. They advance the state of the art in telling stories with speculative technology. The nominees for Best Narrative are Oxygen, Space Sweepers, and Voyagers.

The winner of the Best Interfaces award for 2022 is Oxygen.

Oxygen

A woman awakes in an airtight cryogenic chamber with no knowledge of who or where she is. In this claustrophobic space, she must work with MILO, an artificial intelligence, to manage the crisis of her dwindling oxygen supply and figure out what’s going on before it’s too late.

Nearly all of the film happens in this coffin-like space between the actress and MILO. The interface shows modes for media searches, schematic searches, general searches, media playback, communication, and health monitoring as the woman tries to work the problem and save her own life. It shows a main screen directly above her, a ring of smaller interfaces placed in a corona around her head, and it also has volumetric display capabilities. The interfaces are lovely with tightly controlled palettes, an old sci-fi standby typeface Eurostyle (or is it some derivative?), and excellent signals for managing attention and conveying urgency.

The interface is critical to the narration, its tension, and the ultimate dark reveal and resolution of the story—a remarkable feat for a sci-fi interface.

I would love to extend my direct congratulations to all the studios who produced this work, but Hollywood is complicated and makes it difficult to identify exactly whom to credit for what. So let me extend my congratulations generally to the nominees and winners for an extraordinary body of work. If you are one of these studios, or can introduce me, please let me know; I’d love to do some interviews for the blog. Here’s looking to the next year of sci-fi cinema.

2022 Audience Choice Ballot

27 Mar 2022 by Christopher Noessel

Next week I’ll be announcing the winners of the 2021 Fritzes. In the meantime, I’m going to make good on my promise to inquire after your choice of winners: Films and robots. Don’t let the Oscars prime you, in the psychological sense. Below is a recap of the candidates as a reminder. To cast your vote, click the link below. To guard against ballot-stuffing, this requires you are logged in with a Google mail account.

2022 Fritzes Audience Choice Ballot

Note that in years past I made supercuts of the interfaces from the film, but YouTube kept taking them down despite clear Fair Use. I could fight it, but it’s not worth the time and effort. So, please see the films and may these trailers act as reminders for the nine candidate films.

Audience choice: Robot

It could be my bias from working on and teaching about AI, but I noticed a preponderance of interesting robots last year. So for this year there’s a new category of Audience Choice, and that’s for Robot! Look for an upcoming post with a link to vote on your favorite. The candidates are the unnamed bartender from Cosmic Sin (who gets maybe seconds of screen time, but is interesting nonetheless), Jeff from Finch, Eric and Deborahbot 5000 from The Mitchells vs. The Machines, Bubs from Space Sweepers, and Steve from the unsettling Settlers.

Cast your vote now at the link below.

2022 Fritzes Audience Choice Ballot

Winners will be announced near the beginning of April. And while I don’t have any idea how I’d find a single address to send physical awards to, I’d like to try for that this year.

As always, please remember that the award looks at the interfaces in the movies rather than the movies overall.

Design fiction in sci-fi

17 Feb 2022 by Christopher Noessel

As so many of my favorite lines of thought have begun, this one was started with a provocative question lobbed at me across social media. Friend and colleague Jonathan Korman tweeted to ask, above a graphic of the Black Mirror logo, “Surely there is another example of pop design fiction?”

Surely there is another example of pop design fiction?@scifiinterfaces? pic.twitter.com/Pzl0gmOFL3
— Jonathan Korman 🟣 (@miniver) February 4, 2022

I replied in Twitter, but my reply there was rambling and unsatisfying, so I’m re-answering here with an eye toward being more coherent.

What’s Design Fiction?

If you’re not familiar, design fiction is a practice that focuses on speculative artifacts to raise issues. While leading the interactions program at The Royal College of Art, Anthony Dunne and Fiona Raby catalyzed the practice.

“It thrives on imagination and aims to open up new perspectives on what are sometimes called wicked problems, to create spaces for discussion and debate about alternative ways of being, and to inspire and encourage people’s imaginations to flow freely. Design speculations can act as a catalyst for collectively redefining our relationship to reality.”
Anthony Dunne and Fiona Raby, Speculative Everything: Design, Dreaming, and Social Dreaming

Dunne & Raby tend to often lean toward provocation more than clarity (“sparking debate” is a stated goal, as opposed to “identifying problems and proposing solutions.”) Where to turn for a less shit-stirring description? Like many related fields there are lots of competing definitions and splintering. John Spicey has listed 26 types of Design Fiction over on Simplicable. But I am drawn to the more practical definition offered by the Making Tomorrow handbook.

Design Fiction proposes speculative scenarios that aim to stimulate commitment concerning existing and future issues.
Nicolas Minvielle et al., Making Tomorrow Collective

To me, that feels like a useful definition and clearly indicates a goal I can get behind. Your mileage may vary. (Hi, Tony! Hi, Fiona!)

Some examples should help.

Dunne & Raby once designed a mask for dogs called Spymaker, so that the lil’ scamps could help lead their owners to unsurveilled locations in an urban environment.

Julijonas Urbonas while at RCA conceived and designed a “euthanasia coaster” which would impart enough Gs on its passengers to kill them through cerebral hypoxia. While he designed its clothoid inversions and even built a simple physical model, the idea has been recapitulated in a number of other media, including the 3D rendering you see below.

This commercial example from Ericsson is a video with mild narrative about appliances having a limited “social life.”

Corporations create design fictions from time to time to illustrate their particular visions of the future. Such examples are on the verge of the space, since we can be sure those would not be released if they ran significantly counter to the corporation’s goals. They’re rarely about the “wicked” problems invoked above and tend more toward gee-whiz-ism, to coin a deroganym.

How does it differ from sci-fi?

Design Fiction often focuses on artifacts rather than narratives. The euthanasia coaster has no narrative beyond what you bring or apply to it, but I don’t think this lack of narrative a requirement. For my money, the point of design fiction is focused on exploring the novum more than a particular narrative around the novum. What are its consequences? What are its causes? What kind of society would need to produce it and why? Who would use it and how? What would change? What would lead there and do we want to do that? Contrast Star Wars, which isn’t about the social implications of lightsabers as much as it is space opera about dynasties, light fascism, and the magic of friendship.

But, I don’t think there’s any need to consider something invalid as design fiction if it includes narrative. Some works, like Black Mirror, are clearly focused on their novae and their implications and raise all the questions above, but are told with characters and plots and all the usual things you’d expect to find.

So what’s “pop” design fiction?

As a point of clarification, in Korman’s original question, he asked after pop design fiction. I’m taking that not to mean the art movement in the 01950–60s, which Black Mirror isn’t, but rather “accessible” and “popular,” which Black Mirror most definitely is.

So not this, even though it’s also adorable. And ravenous.

What would distinguish other sci-fi works as design fiction?

So if sci-fi can be design fiction, what would we look for in a show to classify it is design fiction? It’s a sloppy science, of course, but here’s a first pass. A show can be said to be design fiction if it…

Includes a central novum…
…that is explored via the narrative: What are its consequences, direct and indirect?
Corollary: The story focused on a primary novum, and not a mish-mash of them. (Too many muddle the thought experiment.)
Corollary: The story focuses on characters who are most affected by the novae.
Its explorations include the personal and social.
It goes where the novum leads, avoiding narrative fiats that sully the thought experiment.
Bonus points if it provides illustrative contrasts: Different versions of the novum, characters using it in different ways, or the before and after.

With this stake in the ground, it probably strikes you that some subgenres lend themselves to design fiction and others do not. Anthology series, like Black Mirror, can focus on different characters, novae, and settings each episode. Series and franchises like Star Wars and Star Trek, in contrast, have narrative investments in characters and settings that make it harder to really explore nova on their own terms, but it is not impossible. The most recent season of Black Mirror is pointing at a unified diegesis and recurring characters, which means Brooker may be leaning the series away from design fiction. Meanwhile, I’d posit that the eponymous Game from Star Trek: The Next Generation S05E06 is an episode that acts as a design fiction. So it’s not cut-and-dry.

“It’s your turn. Play the game, Will Wheaton.”

What makes this even more messy is that you are asking a subjective question, i.e. “Is this focused on its novae?”, or even “Does this intend to spur some commitment about the novae?” which is second-guessing whether or not what you think the maker’s intent was. As I mentioned, it’s messy, and against the normal critical stance of this blog. But, there are some examples that lean more toward yes than no.

Jurasic Park

Central novum: What if we use science to bring dinosaurs back to life?

Commitment: Heavy prudence and oversight for genetic sciences, especially if capitalists are doing the thing.

Hey, we’ve reviewed Jurassic Park on this very blog!

This example leads to two observations. First, the franchises that follow successful films are much less likely to be design fiction. I’d argue that every Jurassic X sequel has simply repeated the formula and not asked new questions about that novum. More run-from-the-teeth than do-we-dare?

Second is that big-budget movies are almost required to spend some narrative calories discussing the origin story of novae at the cost of exploring multiple consequences of the same. Anthology series are less likely to need to care about origins, so are a safer bet IMHO.

Minority Report

Central novum: What if we could predict crime? (Presuming Agatha is a stand-in for a regression algorithm and not a psychic drug-baby mutant.)

Commitment: Let’s be cautious about prediction software, especially as it intersects civil rights: It will never be perfect and the consequences are dire.

Blade Runner

Central novum: What if general artificial intelligence was made to look indistinguishable from humans, and kept as an oppressed class?

Commitment: Let’s not do any of that. From the design perspective: Keep AI on the canny rise.

Hey, I reviewed Blade Runner on this very blog!

Ex Machina

Central novum: Will we be able to box a self-interested general intelligence?

Commitment: No. It is folly to think so.

Colossus: The Forbin Project

Central novum: What if we deliberately prevented ourselves from pulling the plug on a superintelligence, and then asked it to end war?

Commitment: We must be extremely careful what we ask a superintelligence to do, how we ask it, and the safeguards we provide ourselves if we find out we messed it up.

Hey, I lovingly reviewed Colossus: The Forbin Project on this very blog!

Person of Interest

Central novum: What if we tried to box a good superintelligence?

Commitment: Heavy prudence and oversight for computer sciences, especially if governments are doing the thing.

Not reviewed, but it won an award for Untold AI

This is probably my favorite example, and even though it is a long-running series with recurring characters, I argue that the leads are all highly derived, narratively, from the novum, and still counts strongly.

But are they pop?

Each of these are more-or-less accessible and mainstream, even if their actual popularity and interpretations vary wildly. So, yes, from that perspective.

Jurassic Park is at the time of writing the 10th highest-grossing sci-fi movie of all time. So if you agree that it is design fiction, it is the most pop of all. Sadly, that is the only property I’d call design fiction on the entire highest-grossing list.

So, depending on a whole lot of things (see…uh…above) the short answer to Mr. Korman’s original question is yes, with lots of if.

What others?

I am not an exhaustive encyclopedia of sci-fi, try though I may. Agree with this list above? What did I miss? If you comment with additions, be sure and list, as I did these, the novum and the challenge.

Fritzes 2022 nominees

30 Jan 2022 by Christopher Noessel

Well, that was a solstice. As noted, I took time off from the blog to make progress on some other things. Those things aren’t done yet (I’m making fine progress on them, thank you for asking), but it’s time for the Fritzes! Following are the candidates for the 2022 Fritz awards, recognizing excellence in sci-fi interfaces across the prior year.

Note: There are some movies that might have been nominated but were only released in cinemas in 2021, and as of the time of this post do not have a home streaming option. I have immunocompromised people in my family, a child too young to be vaccinated, I’m not an accelerationist, I ain’t famous enough for studios to send me Oscar-esque review copies, and the drive-in experience sucks for air. So these films—notably including the MCU’s Spider-Man: No Way Home—were not considered. Sorry, but global pandemic not sorry. Still, I’m happy with what did make the cut.

Best Believable

These movies’ interfaces adhere to solid HCI principles and believable interactions. They engage us in the story world by being convincing. The nominees for Best Believable are Needle in a Timestack, Stowaway, and Swan Song.

Best Narrative

These movies’ interfaces blow us away with wonderful visuals and the richness of their future vision. They engross us in the story world by being spectacular. The nominees for Best Narrative are The Mitchells vs. The Machines, Reminiscence, and The Matrix Resurrections.

Audience choice: Robot

Audience choice: Movie

All of the movies nominated for other awards will be presented for an Audience Choice award. Watch this space for when the ballot is open. In the meantime, if like me you want to see all the candidates so you can be elated or outraged at results, start watching now.

Best Interfaces

The movies nominated for Best Interfaces manage the extraordinary challenge of being believable and helping to paint a picture of the world of the story. They advance the state of the art in telling stories with speculative technology. The nominees for Best Interfaces are Oxygen, Space Sweepers, and Voyagers.

In prior years I’ve done custom edits of the nominees’ interfaces, but those supercuts keep getting yoinked from YouTube despite obvious Fair Use, and I don’t have the time or willpower to fight it, so we’ll all have to make do with trailers (above) that don’t include interfaces plus individual posts with screenshots (coming soon). Thank the IP lawyers for that.

Winners will be announced near the end of March. And while I don’t have any idea how I’d find a single address to send physical awards to, I’d like to try for that this year.

As always, please remember that the award looks at the interfaces in the movies rather than the movies overall.

Spacesuits in Sci-fi: Wrapping up

16 Sep 2021 by Christopher Noessel

If you recall from the first entry in this series of posts, the Spacesuits content was originally drafted as a chapter in the Make It So book, but had to be cut because for length. Now here we are at six posts and 6,700 words later. So it was probably a good call on the part of the publisher. 🙂 But now that we’re here, what have we learned?

Let’s recap. Spacesuit interfaces have to…

Protect the wearer from the perils of space
Accommodate and provide for the wearer’s biological needs
Help them move around
Allow them to communicate
Identify the wearer

Spacesuits are a particularly interesting example of the relationship of sci-fi and design because a tiny fraction of sci-fi audiences will ever experience being in one, but many people have seen them being used in real-world circumstances. This gives them a unique representational anchor in sci-fi, and the survey reveals this. Sci-fi makers base their designs on the surface style with occasional additions or extensions, depending on the fashionable technology of the time. These additions rarely make it to the real world because they’re often made without consideration of the real constraints of keeping a human alive in space. But are still cool.

And the winner is…?

If I had to name the franchise that gets it right the most it’s probably Star Trek. Keep in mind that this has been far from an exhaustive survey (“Yeah like where is The Expanse?,” I hear me cry), and the Star Trek franchise is vast and decades old, with most of its stories set on spacecraft. Extravehicular activity in space is a natural fit to the show and there’s been lots of it. I’m not dismissing it. The work done on Star Trek: Discovery has been beautiful. But if it was just a numbers game rather than a question of quality design, we would expect it to win. And lucky for us, it’s been consistently showcasing the most inspiring examples and most(ly) functional interfaces as well. If you’re looking for inspiration, maybe start there.

What lessons can we learn?

As a particular kind of wearables, spacesuit interfaces reinforce all the principles I originally outlined for Ideal Wearables way back in 2014. They must be…

Sartorial
Social
Easy to access and use
Tough to accidentally activate
Have apposite inputs and outputs

…all pushed through the harder constraints of listed at the top of the article. We have some additional lessons about where to put interfaces on spacesuits given those constraints, but it seems pretty well tied to this domain and difficult to generalize. That is, unless climate change has us all donning environmental suits just to enjoy our own planet in a few degrees Centigrade. Wait, I did not mean to go that dark. _{Even though climate change is a massive crisis and we should commit to halting it and reversing it if possible.} (Hey check out these cool tree-planting drones.)

Let’s instead focus on a mild prognostication. I expect that we’ll be seeing more sci-fi spacesuits in the near future, partly because space travel has been on a kick lately with the high-profile and branding-conscious missions of SpaceX. Just this week Crew Dragon flew has taken the first commercial flight of four civilians into space. (Not the first civilians into space, according to Harvard professor Jonathan McDowell, that honor belongs to the Soyuz TMA-3 mission in 2003, but that was still a government operation.) For better or for worse, part of how SpaceX is making its name is by bringing a new, cool aesthetic to space travel.

So people are seeing spacesuits again (though am I right…no extravehicular activities?) and that means it will be on the minds of studios and writers, and they will give it their own fantastic spin, which will in turn inspire real-world designers, etc. etc. Illustrators and industrial designers are already posting some amazing speculative designs of late, and I look forward to more inspiring designs to come.

I think my spaceship knows which way to go

You may have noticed that this post comes an uncommonly long time after the prior post. I had cut down my publishing cadence at the start of the pandemic to once every other week because stress, and even that has been difficult to keep up. But now we are heading into fall and the winter holidays and a cluster of family birthdays and whatnot usually keep me busy through March. Plus I’m about to start hosting a regular session with Ambition Group about AI Mastery for Design Leaders, and as a first time curriculum, it’s going to demand much of me on top of my full time job. (You didn’t think I did scifiinterfaces professionally, did you? This is a hobby.) And I’m making some baby steps in publishing my own sci-fi short stories. Keep an eye on Escape Pod and Dark Matter Magazine over the fall if you want to catch those. (I’ll almost certainly tweet about them, too.) I want to work on others.

Which is all to say that I’m on the verge of being overcommitted and burnt out, and so going to do myself a favor and take a break from posting here for a while. Sadly, I don’t have any guest posts in the work. Who would be crazy enough to critique sci-fi interfaces during a climate crisis, ongoing fascist movements, and a global pandemic?

I do have big plans for a major study of the narrative uses of sci-fi interfaces, which I hope to use time off in the winter holiday to conduct. That will probably be as huge as the Untold AI and the Gendered AI series. I have nascent notions of using that study as a last bit of material to collect into a 10-year retrospective follow-up to Make It So (let me know if that sounds appealing). And I’m committed to another round of Fritz awards for 2022. So more is coming, and I’ll be back before you know it.

But for a while, over and out, readers. And don’t forget while I’m gone…

Stop watching sci-fi. Start using it.
—Me

Sci-fi Spacesuits: Identification

15 Aug 2021 by Christopher Noessel

Spacesuits are functional items, built largely identically to each other, adhering to engineering specifications rather than individualized fashion. A resulting problem is that it might be difficult to distinguish between multiple, similarly-sized individuals wearing the same suits. This visual identification problem might be small in routine situations:

(Inside the vehicle:) Which of these suits it mine?
What’s the body language of the person currently speaking on comms?
(With a large team performing a manual hull inspection:) Who is that approaching me? If it’s the Fleet Admiral I may need to stand and salute.

But it could quickly become vital in others:

Who’s body is that floating away into space?
Ensign Smith just announced they have a tachyon bomb in their suit. Which one is Ensign Smith?
Who is this on the security footage cutting the phlebotinum conduit?

There a number of ways sci-fi has solved this problem.

Name tags

Especially in harder sci-fi shows, spacewalkers have a name tag on the suit. The type is often so small that you’d need to be quite close to read it, and weird convention has these tags in all-capital letters even though lower-case is easier to read, especially in low light and especially at a distance. And the tags are placed near the breast of the suit, so the spacewalker would also have to be facing you. So all told, not that useful on actual extravehicular missions.

Faces

Screen sci-fi usually gets around the identification problem by having transparent visors. In B-movies and sci-fi illustrations from the 1950s and 60s, the fishbowl helmet was popular, but of course offering little protection, little light control, and weird audio effects for the wearer. Blockbuster movies were mostly a little smarter about it.

1950s Sci-Fi illustration by Ed Emshwiller
c/o Diane Doniol-Valcroze

Seeing faces allows other spacewalkers/characters (and the audience) to recognize individuals and, to a lesser extent, how their faces synch with their voice and movement. People are generally good at reading the kinesics of faces, so there’s a solid rationale for trying to make transparency work.

Armageddon (1998), The Martian (2015), Prospect (2018)

Face + illumination

As of the 1970s, filmmakers began to add interior lights that illuminate the wearer’s face. This makes lighting them easier, but face illumination is problematic in the real world. If you illuminate the whole face including the eyes, then the spacewalker is partially blinded. If you illuminate the whole face but not the eyes, they get that whole eyeless-skull effect that makes them look super spooky. (Played to effect by director Scott and cinematographer Vanlint in Alien, see below.)

Firefly (2002), Battlestar Galactica (2004), Stargate Universe (2009–2011)

Identification aside: Transparent visors are problematic for other reasons. Permanently-and-perfectly transparent glass risks the spacewalker getting damage from infrared lights or blinded from sudden exposure to nearby suns, or explosions, or engine exhaust ports, etc. etc. This is why NASA helmets have the gold layer on their visors: it lets in visible light and blocks nearly all infrared.

Astronaut Buzz Aldrin walks on the surface of the moon near the leg of the lunar module Eagle during the Apollo 11 mission.

*Image Credit: NASA* (cropped)

Only in 2001 does the survey show a visor with a manually-adjustable translucency. You can imagine that this would be more safe if it was automatic. Electronics can respond much faster than people, changing in near-real time to keep sudden environmental illumination within safe human ranges.

You can even imagine smarter visors that selectively dim regions (rather than the whole thing), to just block out, say, the nearby solar flare, or to expose the faces of two spacewalkers talking to each other, but I don’t see this in the survey. It’s mostly just transparency and hope nobody realizes these eyeballs would get fried.

So, though seeing faces helps solve some of the identification problem, transparent enclosures don’t make a lot of sense from a real-world perspective. But it’s immediate and emotionally rewarding for audiences to see the actors’ faces, and with easy cinegenic workarounds, I suspect identification-by-face is here in sci-fi for the long haul, at least until a majority of audiences experience spacewalking for themselves and realize how much of an artistic convention this is.

Color

Other shows have taken the notion of identification further, and distinguished wearers by color. Mission to Mars, Interstellar, and Stowaway did this similar to the way NASA does it, i.e. with colored bands around upper arms and sometimes thighs.

Mission to Mars (2000), Interstellar (2014), Stowaway (2021)

Destination Moon, 2001: A Space Odyssey, and Star Trek (2009) provided spacesuits in entirely different colors. (Star Trek even equipped the suits with matching parachutes, though for the pedantic, let’s acknowledge these were “just” upper-atmosphere suits.)The full-suit color certainly makes identification easier at a distance, but seems like it would be more expensive and introduce albedo differences between the suits.

Destination Moon (1950), 2001: A Space Odyssey (1968), Star Trek (2009)

One other note: if the visor is opaque and characters are only relying on the color for identification, it becomes easier for someone to don the suit and “impersonate” its usual wearer to commit spacewalking crimes. Oh. My. Zod. The phlebotinum conduit!

According to the Colour Blind Awareness organisation, blindness (color vision deficiency) affects approximately 1 in 12 men and 1 in 200 women in the world, so is not without its problems, and might need to be combined with bold patterns to be more broadly accessible.

What we don’t see

Heraldry

Blog from another Mog Project Rho tells us that books have suggested heraldry as space suit identifiers. And while it could be a device placed on the chest like medieval suits of armor, it might be made larger, higher contrast, and wraparound to be distinguishable from farther away.

Directional audio

Indirect, but if the soundscape inside the helmet can be directional (like a personal Surround Sound) then different voices can come from the direction of the speaker, helping uniquely identify them by position. If there are two close together and none others to be concerned about, their directions can be shifted to increase their spatial distinction. When no one is speaking leitmotifs assigned to each other spacewalker, with volumes corresponding to distance, could help maintain field awareness.

HUD Map

Gamers might expect a map in a HUD that showed the environment and icons for people with labeled names.

Search

If the spacewalker can have private audio, shouldn’t she just be able to ask, “Who’s that?” while looking at someone and hear a reply or see a label on a HUD? It would also be very useful if I’ve spacewalker could ask for lights to be illuminated on the exterior of another’s suit. Very useful if that other someone is floating unconscious in space.

Mediated Reality Identification

Lastly I didn’t see any mediated reality assists: augmented or virtual reality. Imagine a context-aware and person-aware heads-up display that labeled the people in sight. Technological identification could also incorporate in-suit biometrics to avoid the spacesuit-as-disguise problem. The helmet camera confirms that the face inside Sargeant McBeef’s suit is actually that dastardly Dr. Antagonist!

We could also imagine that the helmet could be completely enclosed, but be virtually transparent. Retinal projectors would provide the appearance of other spacewalkers—from live cameras in their helmets—as if they had fishbowl helmets. Other information would fit the HUD depending on the context, but such labels would enable identification in a way that is more technology-forward and cinegenic. But, of course, all mediated solutions introduce layers of technology that also introduces more potential points of failure, so not a simple choice for the real-world.

Oh, that’s right, he doesn’t do this professionally.

So, as you can read, there’s no slam-dunk solution that meets both cinegenic and real-world needs. Given that so much of our emotional experience is informed by the faces of actors, I expect to see transparent visors in sci-fi for the foreseeable future. But it’s ripe for innovation.

Sci-fi Spacesuits: Audio Comms

3 Aug 2021 by Christopher Noessel

A special subset of spacesuit interfaces is the communication subsystems. I wrote a whole chapter about Communications in Make It So, but spacesuit comms bear special mention, since they’re usually used in close physical proximity but still must be mediated by technology, the channels for detailed control are clumsy and packed, and these communicators are often being overseen by a mission control center of some sort. You’d think this is rich territory, but spoiler: There’s not a lot of variation to study.

Every single spacesuit in the survey has audio. This is so ubiquitous and accepted that, after 1950, no filmmaker has thought the need to explain it or show an interface for it. So you’d think that we’d see a lot of interactions.

*Destination Moon* (1950): Woody learns from the narrator that without air, he needs to extend his radio antenna in order to communicate in space. (Note: You’re not missing something, this live action film had an animated explanatory sequence starring Woody Woodpecker.)

Spacesuit communications in sci-fi tend to be many-to-many with no apparent means of control. Not even a push-to-mute if you sneezed into your mic. It’s as if the spacewalkers were in a group, merely standing near each other in air, chatting. No push-to-talk or volume control is seen. Communication with Mission Control is automatic. No audio cues are given to indicate distance, direction, or source of the sound, or to select a subset of recipients.

The one seeming exception to the many-to-many communication is seen in the reboot of Battlestar Galactica. As Boomer is operating a ship above a ground crew, shining a light down on them for visibility, she has the following conversation with Tyrol.

*Battlestar Galactica* (Season 1, Episode 2, “Water” 2004): Boomer and Tyrol confirm contact with each other.

Tyrol
Raptor 478, this is DC-1, I have you in my sights.
Boomer
Copy that, DC-1. I have you in sight.
Tyrol
Understood.
Boomer
How’s it looking there? Can you tell what happened?
Tyrol
Lieutenant, don’t worry…about my team. I got things under control.
Boomer
Copy that, DC-1. I feel better knowing you’re on it.

Then, when her copilot gives her a look about what she has just said, she says curtly to him, “Watch the light, you’re off target.” In this exchange there is clear evidence that the copilot has heard the first conversation, but it appears that her comment to him is addressed to him and not for the others to hear. Additionally, we do not hear chatter going on between the ground grew during this exchange. Unfortunately, we do not see any of the conversationalists touch a control to give us an idea about how they switch between these modes. So, you know, still nothing.

More recent films, especially in the MCU, has seen all sorts of communication controlled by voice with the magic of General AI…pause for gif…

…but as I mention more and more, once you have a General AI in the picture, we leave the realm of critique-able interactions. Because an AI did it.

In short, sci-fi just doesn’t care about showing audio controls in sci-fi spacesuits, and isn’t likely to start caring anytime soon. As always, if you know of something outside my survey, please mention it.

For reference, in the real world, a NASA astronaut has direct control over the volume of audio that she hears, using potentiometer volume controls. (Curiously the numbers on them are not backwards, unlike the rest of the controls.)

A spacewalker uses the COMM dial switch mode selector at the top of the DCM to select between three different frequencies of wireless communication, each of which broadcasts to each other and the vehicle. When an astronaut is on one of the first two channels, transmission is voice-activated. But a backup, “party line” channel requires push-to-talk, and this is what the push-to-talk control is for.

By default, all audio is broadcast to all other spacewalkers, the vehicle, and Mission Control. To speak privately, without Mission Control hearing, spacewalkers don’t have an engineered option. But if one of the radio frequency bands happens to be suffering a loss of signal to Mission Control, she can use this technological blind spot to talk with some degree of privacy.

Sci-fi Spacesuits: Moving around

20 Jul 2021 by Christopher Noessel

Whatever it is, it ain’t going to construct, observe, or repair itself. In addition to protection and provision, suits must facilitate the reason the wearer has dared to go out into space in the first place.

One of the most basic tasks of extravehicular activity (EVA) is controlling where the wearer is positioned in space. The survey shows several types of mechanisms for this. First, if your EVA never needs you to leave the surface of the spaceship, you can go with mountaineering gear or sticky feet. (Or sticky hands.) We can think of maneuvering through space as similar to piloting a craft, but the outputs and interfaces have to be made wearable, like wearable control panels. We might also expect to see some tunnel in the sky displays to help with navigation. We’d also want to see some AI safeguard features, to return the spacewalker to safety when things go awry. (Narrator: We don’t.)

Mountaineering gear

In Stowaway (2021) astronauts undertake unplanned EVAs with carabiners and gear akin to mountaineers use. This makes some sense, though even this equipment needs to be modified for use by astronauts’ thick gloves.

Stowaway (2021) Drs Kim and Levinson prepare to scale to the propellant tank.

Sticky feet (and hands)

Though it’s not extravehicular, I have to give a shout out to 2001: A Space Odyssey (1969), where we see a flight attendant manage their position in the microgravity with special shoes that adhere to the floor. It’s a lovely example of a competent Hand Wave. We don’t need to know how it works because it says, right there, “Grip shoes.” Done. Though props to the actress Heather Downham, who had to make up a funny walk to illustrate that it still isn’t like walking on earth.

*2001: A Space Odyssey* (1969)
Pan Am: “Thank god we invented the…you know, whatever shoes.”

With magnetic boots, seen in Destination Moon, the wearer simply walks around and manages the slight awkwardness of having to pull a foot up with extra force, and have it snap back down on its own.

*Destination Moon* (1950): Jim Barnes tests his magnetic boots.

Battlestar Galactica added magnetic handgrips to augment the control provided by magnetized boots. With them, Sergeant Mathias is able to crawl around the outside of an enemy vessel, inspecting it. While crawling, she holds grip bars mounted to circles that contain the magnets. A mechanism for turning the magnet off is not seen, but like these portable electric grabbers, it could be as simple as a thumb button.

*Battlestar Galactica* (2008, Season 4, Episode 5, “The Road Less Traveled”): Sergeant Erin Mathias inspects the damaged cylon raider for tracking devices.

Iron Man also had his Mark 50 suit form stabilizing suction cups before cutting a hole in the hull of the Q-Ship.

In the electromagnetic version of boots, seen in Star Trek: First Contact, the wearer turns the magnets on with a control strapped to their thigh. Once on, the magnetization seems to be sensitive to the wearer’s walk, automatically lessening when the boot is lifted off. This gives the wearer something of a natural gait. The magnetism can be turned off again to be able to make microgravity maneuvers, such as dramatically leaping away from Borg minions.

Star Trek: Discovery also included this technology, but with what appears to be a gestural activation and a cool glowing red dots on the sides and back of the heel. The back of each heel has a stack of red lights that count down to when they turn off, as, I guess, a warning to anyone around them that they’re about to be “air” borne.

*Star Trek: Discovery* (2017–) S01E01, “The Vulcan Hello”
Ensign Burnham takes a step out onto the hull before lifting off toward the mysterious beacon.

Quick “gotcha” aside: neither Destination Moon nor Star Trek: First Contact bothers to explain how characters are meant to be able to kneel while wearing magnetized boots. Yet this very thing happens in both films.

*Destination Moon* (1950): Kneeling on the surface of the spaceship.

*Star Trek: First Contact* (1996): Worf rises from operating the maglock to defend himself.

Controlled Propellant

If your extravehicular task has you leaving the surface of the ship and moving around space, you likely need a controlled propellant. This is seen only a few times in the survey.

In the film Mission to Mars, the manned mobility unit, or MMU, seen in the film is based loosely on NASA’s MMU. A nice thing about the device is that unlike the other controlled propellant interfaces, we can actually see some of the interaction and not just the effect. The interfaces are subtly different in that the Mission to Mars spacewalkers travel forward and backward by angling the handgrips forward and backward rather than with a joystick on an armrest. This seems like a closer mapping, but also seems more prone to error by accidental touching or bumping into something.

*Mission to Mars* (2000): Woody inspects the craft for the leak.

The plus side is an interface that is much more cinegenic, where the audience is more clearly able to see the cause and effect of the spacewalker’s interactions with the device.

*Mission to Mars* (2000): The crew performs a daring EVA.

If you have propellent in a Moh’s 4 or 5 film, you might need to acknowledge that propellant is a limited resource. Over the course of the same (heartbreaking) scene shown above, we see an interface where one spacewalker monitors his fuel, and another where a spacewalker realizes that she has traveled as far as she can with her MMU and still return to safety.

*Mission to Mars* (2000): Woody sees that he’s out of fuel.

*Mission to Mars* (2000): Terry sees that she cannot continue her rescue of Woody.

For those wondering, Michael Burnham’s flight to the mysterious signal in that pilot uses propellant, but is managed and monitored by controllers on Discovery, so it makes sense that we don’t see any maneuvering interfaces for her. We could dive in and review the interfaces the bridge crew uses (and try to map that onto a spacesuit), but we only get snippets of these screens and see no controls.

*Star Trek: Discovery* (2017–) S01E01, “The Vulcan Hello”

Iron Man’s suits employ some Phlebotinum propellant that lasts for ever, can fit inside his tailored suit, and are powerful enough to achieve escape velocity.

All-in-all, though sci-fi seems to understand the need for characters to move around in spacesuits, very little attention is given to the interfaces that enable it. The Mission to Mars MMU is the only one with explicit attention paid to it, and that’s quite derived from NASA models. It’s an opportunity for film makers should the needs of the plot allow, to give this topic some attention.

Sci-fi Spacesuits: Interface Locations

6 Jul 2021 by Christopher Noessel

A major concern of the design of spacesuits is basic usability and ergonomics. Given the heavy material needed in the suit for protection and the fact that the user is wearing a helmet, where does a designer put an interface so that it is usable?

Chest panels

Chest panels are those that require that the wearer only look down to manipulate. These are in easy range of motion for the wearer’s hands. The main problem with this location is that there is a hard trade off between visibility and bulkiness.

Arm panels

Arm panels are those that are—brace yourself—mounted to the forearm. This placement is within easy reach, but does mean that the arm on which the panel sits cannot be otherwise engaged, and it seems like it would be prone to accidental activation. This is a greater technological challenge than a chest panel to keep components small and thin enough to be unobtrusive. It also provides some interface challenges to squeeze information and controls into a very small, horizontal format. The survey shows only three arm panels.

The first is the numerical panel seen in 2001: A Space Odyssey (thanks for the catch, Josh!). It provides discrete and easy input, but no feedback. There are inter-button ridges to kind of prevent accidental activation, but they’re quite subtle and I’m not sure how effective they’d be.

The second is an oversimplified control panel seen in Star Trek: First Contact, where the output is simply the unlabeled lights underneath the buttons indicating system status.

The third is the mission computers seen on the forearms of the astronauts in Mission to Mars. These full color and nonrectangular displays feature rich, graphic mission information in real time, with textual information on the left and graphic information on the right. Input happens via hard buttons located around the periphery.

*Mission to Mars* (2000): Phil sees that Woody is likely to overshoot

Side note: One nifty analog interface is the forearm mirror. This isn’t an invention of sci-fi, as it is actually on real world EVAs. It costs a lot of propellant or energy to turn a body around in space, but spacewalkers occasionally need to see what’s behind them and the interface on the chest. So spacesuits have mirrors on the forearm to enable a quick view with just arm movement. This was showcased twice in the movie Mission to Mars.

*Mission to Mars* (2000): Phil looks for Earth with his “rear view mirror.” It’s that tiny white dot.

HUDs

The easiest place to see something is directly in front of your eyes, i.e. in a heads-up display, or HUD. HUDs are seen frequently in sci-fi, and increasingly in sc-fi spacesuits as well. One is Sunshine. This HUD provides a real-time view of each other individual to whom the wearer is talking while out on an EVA, and a real-time visualization of dangerous solar winds.

These particular spacesuits are optimized for protection very close to the sun, and the visor is limited to a transparent band set near eye level. These spacewalkers couldn’t look down to see the top of a any interfaces on the suit itself, so the HUD makes a great deal of sense here.

Star Trek: Discovery’s pilot episode included a sequence that found Michael Burnham flying 2000 meters away from the U.S.S. Discovery to investigate a mysterious Macguffin. The HUD helped her with wayfinding, navigating, tracking time before lethal radiation exposure (a biological concern, see the prior post), and even doing a scan of things in her surroundings, most notably a Klingon warrior who appears wearing unfamiliar armor. Reference information sits on the periphery of Michael’s vision, but the augmentations occur mapped to her view. (Noting this raises the same issues of binocular parallax seen in the Iron HUD.)

Iron Man’s Mark L armor was able to fly in space, and the Iron HUD came right along with it. Though not designed/built for space, it’s a general AI HUD assisting its spacewalker, so worth including in the sample.

Aside from HUDs, what we see in the survey is similar to what exists in existing real-world extravehicular mobility units (EMUs), i.e. chest panels and arm panels.

Inputs illustrate paradigms

Physical controls range from the provincial switches and dials on the cigarette-girl foldout control panels of Destination Moon to the simple and restrained numerical button panel of 2001, to strangely unlabeled buttons of Star Trek: First Contact’s arm panels (above), and the ham-handed touch screens of Mission to Mars.

*Mission to Mars* (2000): Jim tests the atmosphere and learns it is Earth-like.

As the pictures above reveal, the input panels reflect the familiar technology of the time of the creation of the movie or television show. The 1950s were still rooted in mechanistic paradigms, the late 1960s interfaces were electronic pushbutton, the 2000s had touch screens and miniaturized displays.

Real world interfaces

For comparison and reference, the controls for NASA’s EMU has a control panel on the front, called the Display and Control Module, where most of the controls for the EMU sit.

The image shows that inputs are very different than what we see as inputs in film and television. The controls are large for easy manipulation even with thick gloves, distinct in type and location for confident identification, analog to allow for a minimum of failure points and in-field debugging and maintenance, and well-protected from accidental actuation with guards and deep recesses. The digital display faces up for the convenience of the spacewalker. The interface text is printed backwards so it can be read with the wrist mirror.

The outputs are fairly minimal. They consist of the pressure suit gauge, audio warnings, and the 12-character alphanumeric LCD panel at the top of the DCM. No HUD.

The gauge is mechanical and standard for its type. The audio warnings are a simple warbling tone when something’s awry. The LCD panel provides information about 16 different values that the spacewalker might need, including estimated time of oxygen remaining, actual volume of oxygen remaining, pressure (redundant to the gauge), battery voltage or amperage, and water temperature. To cycle up and down the list, she presses the Mode Selector Switch forward and backward. She can adjust the contrast using the Display Intensity Control potentiometer on the front of the DCM.

The DCMs referenced in the post are from older NASA documents. In more recent images on NASA’s social media, it looks like there have been significant redesigns to the DCM, but so far I haven’t seen details about the new suit’s controls. (Or about how that tiny thing can house all the displays and controls it needs to.)