Tag Archives: black

The “spectacular” suicide experience from Soylent Green

by

4

The thanatorium is a speculative service for assisted suicide in Soylent Green. Suicide and death are not easy topics and I will do my best to address them seriously. Let me first take a moment to direct anyone who is considering or dealing with suicide to please stop reading this and talk to someone about it. I am unqualified to address—and this blog is not the place to work through—such issues.

There are four experiences to look at in the interface and service design of the Thanatorium: The patient, their beneficiaries, the usher to the beneficiaries, and the attendants to the patient. This post is about the patient themselves. Since there aren’t any technological interfaces, this will be a review of the service design from the patient’s and Soylent’s perspectives. If you’re only into this blog for technological interfaces, this is a post to skip, as it’s going to be about set design, lighting, props, signage, and ritual design, among other things.

Sol’s goals

Part of how we measure the efficacy of an experience is by checking whether it helps its user achieve their goals in the ways they would like them achieved. So let’s say that Sol’s goals are to take advantage of the service to have a good death, i.e. to pass painlessly and with dignity, and to have his belongings passed along according to his wishes. He wants psychological comfort as well, which in this case means helping him psychologically transition from the world he is leaving behind by setting up a liminal space for the ceremony, pointing toward notions of eternity and away from the horrible world he is leaving.

“People,” you say? Yeah, screw that. I’m out.

We are going to completely bypass the script question here about why Sol doesn’t bother to communicate to Thorn the Dark Secret in his goodbye note, but then does tell him when he happens to join him at the Thanatorium. That is what it is.

Sol’s experience

After Sol learns that his options are cannibalism or starvation, he makes the decision to die with dignity. To enact this wish, he dresses in his Sunday best, heads to the state-sponsored Thanatorium, officed in a low-rise building at the end of a wide street in downtown New York City.

Authors Islam Abohela and Noel Lavin insightfully note in their 2020 paper, The Height of Future Architecture: Significance of High versus Low Rise Architecture in Science Fiction Films, that the horizontality of this building contrasts earlier, vertical sci-fi visions of the cityscape as lofty and aspirational. In short, the building is in a horizontal repose suitable to its purpose. Further, the bright illumination spilling out from its frosted-glass doors onto the street helps to sell its next-world-ly promise, especially as the terminus of a dark road.

Initial greeting

At Sol’s approach a young worker opens the door and welcomes him. (How did she know of his approach, given the frosted glass? Let’s presume cameras, though we see no hint of this.)

With the door open, Sol feels the air conditioning pouring from inside and says, “It feels good.” She replies, “Yes, sir. Won’t you please come in?” He hesitates a moment with the gravity of it, but proceeds. Inside he walks through a turnstile and the greeter escorts him to one of the intake queues.

Worldbuilding question: The New York City of Soylent Green is oppressively hot and overcrowded. You would imagine that people would want to feel that refreshing cool air themselves, even if they weren’t there to suicide. I would expect people to be laying on the sidewalk there near the doors on the off-chance to feel a cool breeze. But the street leading to the Thanatorium is vacant. Why is this so? You might think well, it’s an authoritarian state, and curfew is probably enforced brutally. But then why is Sol allowed to just amble his way there? It would have been a nice beat to have seen Sol approached by an angry cop and challenged, only to have Sol point up the street to the Thanatorium, to which the cop softens and nods, allowing Sol to continue. This would have signaled that, despite curfew, the Thanatorium is open 24 hours a day, 7 days for “business.”

Intake

Taking a moment to appreciate the set design, the placid blues and non-descript “plop art” backdrops sell this space as a hospital rather than, say, an airport terminal, or church. It could have gone all “heavenly gate” but that would have been too soon in the patient experience, and lacked the personalized immersion that leads to…uh…the ecstasy meat (a gross, backworlded concept introduced in the beneficiaries post). The service keeps its powder dry to maximize that main event and thereby its output. So this design wins for being both familiar to the patients and effective for Soylent.

The film cuts away to show Thorn returning home to find Sol’s goodbye letter, and then running to the Thanatorium. When we cut back to Sol, he is in the middle of answering some questions by the intake staff, i.e. His favorite color and genre of music. Sol responds and the intake personnel marks his answers on a reusable plastic form. Before signing, Sol wants to confirm that the ceremony will last, “A full 20 minutes?”

“Certainly,” comes the reply, “Guaranteed.”

This scriptwriting moment bears a mention. This comes across as a negotiation, but what is being exchanged here? And what could Sol do with a guarantee when he won’t be there in case this mustache reneges on the deal? Nothing, of course, but it really sets up the transactional nature here. One’s death is so cheap in the world of Soylent Green that one can use it as a bargaining chip. Dark.

There’s a lot that we don’t get to examine in this intake experience because the scene is cut, but per Sol’s goals identified above, we have to imagine it would include questions about his beneficiaries and privacy. Additional questions appear in the text below.

Theater 11

The usher comes and retrieves Sol, making small talk and escorting him down halls, past the beneficiaries’ observation room, to “theater 11,” which is the death chamber to which he’s been assigned, with attendants waiting there standing aside a bed in the center of the room. The inclusion of “11” reminds us that there are many such theaters in the Thanatorium. It would have been nice for the beneficiaries only room to have had a similar number, i.e. “Observation 11: beneficiaries only,” linking the two together for the users and the audience.

We’ll get back to Sol’s experience in a moment, but first a note on the floor markings and the architecture.

I first thought the red line on the floor might have been wayfinding lines like you see in some hospitals. If it was a particularly busy day, and the patient ambulatory, the intake personnel could say, “Follow the red line on the floor to theater 11.” But, a glance at the scenes that precede this show that these markings are only present in the antechamber leading into the theater and the theater itself. So it serves as more of a decoration, a red line leading to a red circle in the middle of which is a white gray, and black circle. The end of the line in two senses.

This sense of the terminus is reinforced by the design of the room. The small passageway down which Sol walks joins with the more expansive theater, creating a sort of “reverse womb” implying a balance between the beginning and end of life. It’s not critical that patients pick up on any of this, of course, but all contributes to a sense of liminality; of interest to both Sol and Soylent.

So all good, but I wish the lighting here had echoed the approach to the building. It should have been a glowing pool of light at the end of a dark passageway, rather than the even overhead lighting reminiscent of a school cafeteria that we see in the film. Pools of light in the center combined with many flickering pinpoints of light at the periphery would have increased the sense of other-worldliness and unified the approach to the building with the entrance to the theater, creating a rhythm of self-similar spectacle. It also would have let the scale of the 180° screen become apparent only once the ceremony started, adding to its thrill and overwhelming scale.

The attendant behavior

In service design, the behavior of the frontstage staff is of particular concern, as humans are good at reading other humans for cues about unfamiliar things. In this case, the attendants are silent, wear beatific expressions, and move with a dance-like deliberateness throughout their parts. It is perhaps the most effective cue-of-transition for the patient. The outfits are a little goofy, but borrow semantically from western Christian liturgy, so are kind-of appropriate. If the patient were atheist or from a different religious tradition, other costumes with different signifiers would be more appropriate.

It’s also of note that not everyone is comfortable with being touched by strangers. It signals a warmth in the scene, but might feel threatening to some patients. Another question to add to the intake questionnaire.

Disrobing

Once Sol is in the theater, the attendants greet him with silent handshakes, lead him to the bed, and begin to help him disrobe. This segment bears many questions.

Why does he need to be naked?

I get why he is disrobed here, from Soylent’s perspective. I’ve never been a mortician, but it does seem that getting the clothes off of a living person would be easier than getting it off a dead person, why make the task harder for Soylent employees down the line? Just work it into the ceremony, some product manager says. And from Sol’s perspective, he’d like to see his clothes being taken away in a nice basket with some assurances that the clothes would be washed and given back to the community; an additional assurance that he’s doing a good, selfless thing in this world with dwindling resources.

But then there are the pants. Maybe it’s me, but there is not a dignified way to remove one’s pants around other, clothed, people. Did they help him out of his pants? Did he do that and just hand the clothes to them? Is he just in his underwear? All of it seems awkward.

I think the service could take a privacy clue from hospitals, public pools, and spas: provide a small room where a patient can undress themselves and switch into a robe. This would also be an opportunity to get a shower, which the movie demonstrates is a cherished luxury in the world of Soylent Green, another reward to lure citizens. Water is in short supply in the world of Soylent Green, but the corpses that are sent en masse to The Exchange for processing don’t get otherwise cleaned, so it would be another nice, hygienic worldbuilding hint.

In the scene, the disrobing is taken as a solemn moment, but Sol is distracted from thinking too hard about it by the appearance of an orange floodlight.

That orange floodlight

During the disrobing, a floodlight of Sol’s favorite color illuminates. I complained briefly about this in the prior post, but what’s causing this light to come on? The usher is back at intake, so it’s not him. Maybe the light is on a timer, but that seems hard for the attendants to manage against the other things that need to happen.

Also, why does it come on at this moment in the ceremony? It might be a deliberate distraction for Sol, meant to focus his attention on the meaning of the ceremony rather than the mundane disrobing, but if so, you might think that the light should illuminate before the disrobing begins. But recall that it’s only happenstance that Sol’s favorite color is the warm and flattering orange. If a patient’s favorite color happened to be blue—which is the most popular color around the world—it would grant everything in theater 11 a cool, detached appearance, and give the patient’s own skin a deathly pallor. Not great for the experience.

Even the second most favored colors aren’t much better. Red looks like danger to western audiences, purple is unflattering, and green looks alien and would be little on-the-nose for the theme. Apologies to my colorblind readers.

Much better would be to keep the custom-color flood light off until the overture begins—when the patient’s attention is not drawn to themselves but focused on the chamber around them—and illuminate it with the rise of the music, in response to the usher’s controls. This would maximize the impact of the color on Sol’s emotional state while not making his own skin and the attendants look off-putting.

Getting onto the bed

Once disrobed, the attendants help Sol onto the bed. How they do this is left off-screen, but it’s a non-trivial problem since as you can see in the screen shot, Sol is 5’7″ and the bed height is well above his waist. Hopefully there’s a set of retractable steps under the bed skirt that can make this accessible to Sol without his having to be hoisted up by the attendants, which would be undignified.

Hemlock

Once in bed, the attendants provide the “hemlock,” (which is what I’m calling the deadly draught they provide in homage to the death of Socrates) and Sol drinks.

We don’t see the glass in the room prior to its being handed to him, but I imagine since this is the point of no return, it bears some attention. Should it be waiting already poured, or should he watch it being poured? Should be pour it himself? If poured, should it be from a gold, porcelain, or glass pitcher? Should there be a tray? Where should all this be staged?

For materials, gold is a good funereal symbol for never tarnishing, but might be too tempting a theft target for poverty-stricken citizens. Stoneware has a nice connotation of being of-the-earth, but is a poor choice for being opaque and here implying its contents are something to be hidden. So I’d recommend a simple glass pitcher that emphasizes clarity. The Toyo pitcher shown below has no handle and so requires two hands to operate, granting a ceremonial, human feel to the act of pouring. While we’re at it, ditch the footed highball glass for a stange or zombie glass to match the pitcher’s simplicity. Have them sitting on an end table on a tray at the side of the bed in their own pool of light and have the attendant pour and hand the glass to the patient. When they depart the chamber one attendant can take the tray out with them for cleaning, and the other can push the end table back under the bed.

Another argument for delaying the floodlight until the overture is that light can change the apparent color of the drink. It just so happens that Sol’s orange flatters the amber color of the draught, but if his favorite color had been, say, red, it might have made the drink look like a wicked ink. Keep the floodlight off to keep the apparent color of the drink something pleasant and unthreatening.

Sol makes no expression in response to the taste of the hemlock, so we have no clue how it’s flavored, but it’s in everyone’s interest that it be palatable, if not pleasant. It would have been a nice touch at intake to ask him to select from a menu of favorite flavors as well, especially to hide the taste of whatever other drugs need to be mixed in.

Once Sol has imbibed the draught, he lies back on the wedge pillow and the attendants draw a sheet up to his chest.

As the orange floodlight dims to a candlelight whisper, Sol waits for the overture to begin as the attendants depart.

Overture

Alone at last, Sol is treated to an audio overture as the drugs work through his system. The music is the principal theme from the first movement of Tchaikovsky’s Symphony No. 6, the “Pathétique.” He stares up at the ceiling, bathed in his favorite color, listening to his favorite music unaware that things are about to become even more spectacular.

Cinerama

The overture complete (and, per my ecstasy meat theory, the MDMA and opiates have kicked in) the audio-visual presentation starts. The music changes to the first movement of Beethoven’s “Symphony #6 (The Pastoral),” and a very wide-angle video presentation begins on the wrap-around screen above him, starting with a verdant field of tulips blowing in a breeze.

The tiny angles in the screen edge hint that this is meant to work exactly like Cinerama with multiple projectors and stitched edges, though the lack of deformation and perspective in the images is all wrong.

It later transitions to images of fauna, other flora, wholesome livestock, and sunsets—all romantic scenes of a highly-selective-memory of Earth’s heyday. It’s important to remember that audiences in 1973 may have heard of a Cinerama display like this, but few of them had seen it. And the 180+° screen seen in the film dwarfs the original Cinerama 2.65:1 display ratio. So though folks today may yawn at this in comparison to IMAX or Oculus AR displays, at the time this would have seemed very sci-fi.

From our vantage point, it all seems a little cruel, bathing Sol in scenes of what he cannot have and what for him will never be, but maybe it points at an afterlife where the things you recall fondly will be yours again, in abundance. (Hey that seems like a formula for every afterlife story.) Mixed with the drugs in Sol’s system, it would help flood his mind and body with euphoria and all the pleasant neurotransmitters that entails.

I minimize this gif because it is so freaking distracting, as it would be to users.

At a few minutes into the presentation, the SPEAKING PERMITTED light of the beneficiaries interface begins blinking, and the patient is able to talk to their loved ones. This would interrupt the spectacle of the display, but add a flood of additional emotions (and thereby hormones) from heartfelt declarations of love and farewell. Immediately afterward “Morning Mood” from Grieg’s “Peer Gynt Suite #1” plays as biophilic videos play: Alpine mountainscapes with grazing donkeys, tarns with floral banks. Finally it segues to scenes depicting the end-of-a-day: A sunset over waves crashing on the black rocks of a pristine West Coast beach, another sun sets through gaps in swiftly drifting clouds.

The screen fades to black as “Aase’s Death” plays from the “Peer Gynt Suite.” In the film, this is the point where Sol shares the Dark Secret and tells Thorn he must go the Exchange and provide proof to the elders. (Ugh. Screenwriters, again, if this was so important, why did he wait until this moment—which he was not sure would come—to convey this information? It makes no sense. But I digress.)

Psst…did you know the namesake of the James Webb telescope was a filthy homophobe? Now you do.

The camera is all close up in their faces for this final beat, so we don’t know what is playing on the screen, but I’d like to think it’s images of stars and nebulae to evoke not just the end of a terrestrial day, but a connection to things that by comparison seem eternal, everlasting.

Communication signals

The dialogue makes me realize another signal is missing for Sol, that is, how does he know when the audio channel to the observation room is open? Now, it would be nice if the audio channel were tied to the state of the viewing portal. That is, audio is connected when the portal is open and they can see each other; and off when the portal is closed. But, we know that Soylent wants the usher to have control of the channels to silence either party at will, so in lieu of that, let’s give some signal to Sol near the observation window to let him know when the audio channel is open. It should look akin to the interface on the other side in the observation room, but it would have to be redesigned for a 10-foot rather than 2-foot experience. It would also have to not be distracting to the patient when their attention is on the cinerama, so a dim, backlit visual might be enough for sighted users. Separate and custom-designed rooms should be built for differently abled patients.

After his plea to Thorn, Sol finally passes, marking the end of his experience with the Thanatorium.

All told, Sol’s experience suits his goals fairly well. He wants a sense of dignity, spectacle, importance, connection to his loved one, and otherworldliness that he receives. There are little things to fix throughout, as mentioned in the text.

My biggest criticism is of being physically separated from loved ones, when a held hand might take the edge off of the fear of death and add a nice dose of oxytocin to the result, but Soylent’s interest is more about maximizing control of the end product, so this, full of risk, would not make it into the final design.

Panther Glove Guns

by

1

As I rule I don’t review lethal weapons on scifiinterfaces.com. The Panther Glove Guns appear to be remote-bludgeoning beams, so this kind of sneaks by. Also, I’ll confess in advance that there’s not a lot that affords critique.

We first see the glove guns in the 3D printer output with the kimoyo beads for Agent Ross and the Dora Milaje outfit for Nakia. They are thick weapons that fit over Shuri’s hands and wrists. I imagine they would be very useful to block blades and even disarm an opponent in melee combat, but we don’t see them in use this way.

The next time we see them, Shuri is activating them. (Though we don’t see how) The panther heads thrust forward, their mouths open wide, and the “neck” glows a hot blue. When the door before her opens, she immediately raises them at the guards (who are loyal to usurper Killmonger) and fires.

A light-blue beam shoots out of the mouths of the weapons, knocking the guards off the platform. Interestingly, one guard is lifted up and thrown to his 4-o-clock. The other is lifted up and thrown to his 7-o-clock. It’s not clear how Shuri instructs the weapons to have different and particular knock-down effects. But we’ve seen all over Black Panther that brain-computer interfaces (BCI) are a thing, so it’s diegetically possible she’s simply imagining where she wants them to be thrown, and then pulling a trigger or clenching her fist around a rod or just thinking “BAM!” to activate. The force-bolt strikes them right where they need to so that, like a billiard ball, they get knocked in the desired direction. As with all(?) brain-computer interfaces, there is not an interaction to critique.

After she dispatches the two guards, still wearing the gloves, she throws a control bead onto the Talon. The scene is fast and blurry, but it’s unclear how she holds and releases the bead from the glove. Was it in the panther’s jaw the whole time? Could be another BCI, of course. She just thought about where she wanted it, flung her arm, and let the AI decide when to release it for perfect targeting. The Talon is large and she doesn’t seem to need a great deal of accuracy with the bead, but for more precise operations, the AI targeting would make more sense than, say, letting the panther heads disintegrate on command so she would have freedom of her hands. 

Later, after Killmonger dispatches the Dora Milaje, Shuri and Nakia confront him by themselves. Nakia gets in a few good hits, but is thrown from the walkway. Shuri throws some more bolts his way though he doesn’t appear to even notice. I note that the panther gloves would be very difficult to aim since there’s no continuous beam providing feedback, and she doesn’t have a gun sight to help her. So, again—and I’m sorry because it feels like cheating—I have to fall back to an AI assist here. Otherwise it doesn’t make sense. 

Then Shuri switches from one blast at a time to a continuous beam. It seems to be working, as Killmonger kneels from the onslaught.

This is working! How can I eff it up?

But then for some reason she—with a projectile weapon that is actively subduing the enemy and keeping her safe at a distance—decides to close ranks, allowing Killmonger to knock the glove guns with a spear tip, thereby free himself, and destroy the gloves with a clutch of his Panther claws. I mean, I get she was furious, but I expected better tactics from the chief nerd of Wakanda. Thereafter, they spark when she tries to fire them. So ends this print of the Panther Guns.

As with all combat gear, it looks cool for it to glow, but we don’t want coolness to help an enemy target the weapon. So if it was possible to suppress the glow, that would be advisable. It might be glowing just for the intimidation factor, but for a projectile weapon that seems strange.

The panther head shapes remind an opponent that she is royalty (note no other Wakandan combatants have ranged weapons) and fighting in Bast’s name, which I suppose if you’re in the business of theocratic warfare is fine, I guess.

It’s worked so well in the past. More on this aspect later.

So, if you buy the brain-computer interface interpretation, AI targeting assist, and theocratic design, these are fine, with the cinegenic exception of the attention-drawing glow.

Black History Matters

Each post in the Black Panther review is followed by actions that you can take to support black lives.

When The Watchmen series opened with the Tulsa Race Massacre, many people were shocked to learn that this event was not fiction, reminding us just how much of black history is erased and whitewashed for the comfort of white supremacy (and fuck that). Today marks the beginning of Black History Month, and it’s a good opportunity to look back and (re)learn of the heroic figures and stories of both terror and triumph that fill black struggles to have their citizenship and lives fully recognized.

Library of Congress, American National Red Cross Photograph Collection

There are lots of events across the month. The African American History Month site is a collaboration of several government organizations (and it feels so much safer to share such a thing now that the explicitly racist administration is out of office and facing a second impeachment):

  • The Library of Congress
  • National Archives and Records Administration
  • National Endowment for the Humanities
  • National Gallery of Art
  • National Park Service
  • Smithsonian Institution and United States Holocaust Memorial Museum

The site, https://www.africanamericanhistorymonth.gov/, has a number of resources, including images, video, and calendar of events for you.

Today we can take a moment to remember and honor the Greensboro Four.

On this day, February 1, 1960: Through careful planning and enlisting the help of a local white businessman named Ralph Johns, four Black college students—Ezell A. Blair, Jr., Franklin E. McCain, Joseph A. McNeil, David L. Richmond—sat down at a segregated lunch counter at Woolworth’s in Greensboro, North Carolina, and politely asked for service. Their request was refused. When asked to leave, they remained in their seats.

Police arrived on the scene, but were unable to take action due to the lack of provocation. By that time, Ralph Johns had already alerted the local media, who had arrived in full force to cover the events on television. The Greensboro Four stayed put until the store closed, then returned the next day with more students from local colleges.

Their passive resistance and peaceful sit-down demand helped ignite a youth-led movement to challenge racial inequality throughout the South.

A last bit of amazing news to share today is that Black Lives Matter has been nominated for the Nobel Peace Prize! The movement was co-founded by Alicia Garza, Patrisse Cullors and Opal Tometi in response to the acquittal of Trayvon Martin’s murderer, got a major boost with the outrage following and has grown to a global movement working to improve the lives of the entire black diaspora. May it win!

Kimoyo Beads

by

3

One of the ubiquitous technologies seen in Black Panther is the kimoyo bead. They’re liberally scattered all over the movie like tasty, high-tech croutons. These marble-sized beads are made of vibranium and are more core to Wakandan’s lives than cell phones are to ours. Let’s review the 6 uses seen in the film.

1. Contact-EMP bombs

We first see kimoyo beads when Okoye equips T’Challa with a handful to drop on the kidnapper caravan in the Sambisa forest. As he leaps from the Royal Talon, he flings these, which flatten as they fall, and guide themselves to land on the hoods of the caravan. There they emit an electromagnetic pulse that stops the vehicles in their tracks. It is a nice interaction that does not require much precision or attention from T’Challa.

2. Comms

Wakandans wear bracelets made of 11 kimoyo beads around their wrists. If they pull the comms bead and place it in the palm, it can project very lifelike volumetric displays as part of realtime communication. It is unclear why the bead can’t just stay on the wrist and project at an angle to be facing the user’s line of sight, as it does when Okoye presents to tribal leaders (below.)

We see a fascinating interaction when T’Challa and W’Kabi receive a call at the same time, and put their bracelets together to create a conference call with Okoye.

The scaled-down version of the projection introduces many of the gaze matching problems identified in the book. Similarly to those scenes in Star Wars, we don’t see the conversation from the other side. Is Okoye looking up at giant heads of T’Challa and W’Kabi? Unlikely. Wakanda is advanced enough to manage gaze correction in such displays.

Let me take a moment to appreciate how clever this interaction is from a movie maker’s perspective. It’s easy to imagine each of them holding their own bead separately and talking to individual instances of Okoye’s projection. (Imagine being in a room with a friend and both of you are on a group call with a third party.) But in the scene, she turns to address both T’Challa and W’Kabi. Since the system is doing body-and-face gaze correction, the two VP displays would look slightly different, possibly confusing the audience into thinking these were two separate people on the call. Wakandans would be used to understanding these nuances, but us poor non-Wakandan’s are not.

Identical Okoyes ensures (at least) one of the displays is looking at something weird. It’s confusing.
This is confusing.
Having gaze correction so both Okoyes are looking at T’Challa when she’s talking to him makes it look like there are two different characters. It’s confusing.
This is also confusing.

The shared-display interaction helps bypass these problems and make the technology immediately understandable and seamless.

Later Shuri also speaks with Okoye via communication bead. During this conversation, Shuri removes another bead, and tosses it into a display to show an image and dossier of Killmonger. Given that she’s in her lab, it’s unclear why this gesture is necessary rather than, say, just looking toward a display and thinking, “Show me,” letting the AI Griot interpret from the context what to display.

A final communication happens immediately after as Shuri summons T’Challa to the the lab to learn about Killmonger. In this screenshot, it’s clear that the symbol for the comms bead is an asterisk or star, which mimics the projection rats of the display, and so has some nice semantics to help users learning which symbols do what.

3. Presentation

 In one scene, Okoye gives the tribe rulers a sitrep using her kimoyo beads as a projector. Here she is showing the stolen Wakandan artifact. Readers of the book will note the appearance of projection rays that are standard sci-fi signals that what is seen is a display. A lovely detail in the scene is how Okoye uses a finger on her free hand to change the “slide” to display Klawe. (It’s hard to see the exact gesture, but looks like she presses the projection bead.) We know from other scenes in the movie that the beads are operated by thought-command. But that would not prevent a user from including gestures as part of the brain pattern that triggers an event, and would make a nice second-channel confirmation as discussed in UX of Speculative Brain-Computer Inputs post.

4. Remote piloting

When T’Challa tours Shuri’s lab, she introduces him to remote access kimoyo beads. They are a little bigger than regular beads and have a flared, articulated base. (Why they can’t just morph mid-air like the ones we see in the kidnapper scene?) These play out in the following scene when the strike team needs to commandeer a car to chase Klawe’s Karavan. Oyoke tosses one on the hood on a parked car, its base glows purple, and thereafter Shuri hops into a vibranium-shaped simulacrum of the car in her lab, and remotely operates it.

A quick note: I know that the purple glow is there for the benefit of the audience, but it certainly draws attention to itself, which it might not want to do in the real world.

In the climactic battle of the tribes with Killmonger, Shuri prints a new bracelet and remote control bead for Agent Ross. She places the bracelet on him to enable him to remote pilot the Royal Talon. It goes by very quickly, and the scene is lit quite sparsely, but the moment she puts it on him, you can see that the beads are held together magnetically.

5. Eavesdropping

When Agent Ross is interrogating the captured Klawe, we get a half-second shot to let us know that a kimoyo bead has been placed on his shoulder, allowing T’Challa, Okoye, and Nakia to eavesdrop on the conversation. The output is deliveredby a flattened bone-conducting speaker bead behind their left hears.

6. Healing

Later in the scene, when Killmonger’s bomb grievously wounds Agent Ross in his spine, T’Challa places one of Nakia’s kimoyo beads onto the wound, stabilizing Ross long enough to ferry him to Wakanda where Shuri can fully tend to him. The wound conveniently happens to be kimoyo-bead sized, but I expect that given its shape-shifting powers, it could morph to form a second-skin over larger wounds.

I wondered if kimoyo beads were just given to Wakandan royalty, but it’s made clear in the scene where T’Challa and Nakia walk through the streets of Birnin Zana that every citizen has a bracelet. There is no direct evidence in the film, but given the pro-social-ness throughout, I want to believe that all citizens have free access to the beads, equipping each of them to participate equitably in the culture.

So, most of the interaction is handled through thought-command with gestural augmentation. This means that most of our usual concerns of affordances and constraints are moot. The one thing that bears some comment is the fact that there are multiple beads on the bracelet with different capabilities. How does a user know which bead does what?

As long as the beads can do their job in place on the wrist, I don’t think it matters. As long as all of the beads are reading the user’s thoughts, only the one that can respond need respond. The others can disregard the input. In the real world you’d need to make sure that one thought isn’t interpretable as multiple things, a problem discussed on my team at IBM as disambiguation. Or if they are you must design an interaction where the user can help disambiguate the input, or tell the system which meaning they intend. We never this edge case in Black Panther. 

It seems that some of the beads have specialized functions that cannot be performed by another, each has several symbols engraved into it, the indentions of which glow white for easy identification. The glow is not persistent across all uses, so it must be either context-aware and/or a setting that users can think to change. But even when not lit, the symbols are clear, and clearly distinguishable, so once the user learns the symbols, the labeling should help.

Black Votes Matter

Today is an important day in the United States. It’s election day 2020. Among one of the most important days in U.S. politics, ever. Among Trump’s litany of outrageous lies across his presidency is this whopper: “I have done more for Black Americans than anybody, except for the possible exception of Abraham Lincoln.” (Pause for your spit take and cleaning your screen.)

As infuriating and insulting as this statement is emotionally (like, fuck you for adding “possible” in there, like it’s somehow possible that you’ve done more than freed our black citizens from slavery, you maggot-brained, racist, malignant narccicist) let’s let the Brookings institute break down why, if you believe Black Lives Matter, you need to get out there and vote blue all the way down the ticket.

https://www.cnn.com/2020/11/02/us/ocoee-massacre-100th-anniversary-trnd/index.html

You should read that whole article, but some highlights/reminders

  • Trump ended racial sensitivity training, and put a ban on trainings that utilize critical race theory
  • Hate crimes increased over 200% in places where Trump held a campaign rally in 2016
  • He dismissed the Black Lives Matters movement, said there were “fine people” among white supremacist groups, and rather than condemning the (racist, not gay) Proud Boys, told them to “stand by.”
  • Not a single one of his 53 confirmed appeals court judges circuit justices is black.
  • The criminal mishandling of the COVID-19 pandemic has killed twice as many black Americans as it has white Americans. (Don’t forget he fired the pandemic response team.)

If you are reading this on election day, and have not already done so, please go vote blue. Know that if you are in line even when the polls officially closed, they have to stay open for the entire line to vote. If you have voted, please help others in need. More information is below.

https://www.vote.org/

If you are reading this just after election day, we have every evidence that Trump is going to try and declare the election rigged if he loses (please, please let it be when he loses to a massive blue waver). You can help set the expectation among your circle of friends, family, and work colleagues that we won’t know the final results today. We won’t know it tomorrow. We may have a better picture at the end of the week, but it will more likely take until late November to count everyone’s vote, and possibly until mid December to certify everyone’s vote.

And that’s what we do in a liberal democracy. We count everyone’s vote, however long that takes. To demand it in one day during a pandemic is worse than a toddler throwing a “I want it now” tantrum. And we are so very sick of having a toddler in this position.

By Christian Bloom

Vibranium sand tables

by

1

There are a number of vibranium sand tables seen in Black Panther.

  1. The horseshoe-shaped shelf in which Okoye sits as she pilots the Royal Talon. (We never see it activated.)
  2. The small sand table in the center of the Royal Talon.
  3. The big sand tables in Shuri’s lab.

You can see the Royal Talon one in the post about piloting that craft. The other two are described below.

All of these build on the given that vibranium is a very powerful substance and that Wakanda’s scientists have managed to gain a very, very sophisticated control over it.

In the Talon

This table is about a meter square, and raised off the floor around knee-height. As Okoye and T’Challa approach the traffickers in the Sambisa Forest, T’Challa approaches the table and it springs to life, showing him real-time model of the traffickers’ vehicle train. T’Challa picks up the model of the small transport truck and with a finger, wipes off its roof, revealing that there are over a dozen people huddled within. One of the figures glows amber. (It’s Nakia.) He places the truck back into the display, and the display collapses back to inert sand.

A quick critique of this interaction. The sand highlights Nakia for T’Challa, but why did it wait for him to find her truck and wipe off the top of it to look inside? It knew his goals (find Nakia), can clearly conduct a scan into the vehicle, and understood the context (she’s in one of those trucks), it should not wait for him to pick up each car and scrape off its roof to check and see which one she was in. The interface should have drawn his attention to the truck it knew she was in. This is a “stoic guru” mistake that I’ve critiqued before. You know, the computer knows all, but only tells you when you ask it. It is much more sensible for the transport truck to be glowing from the moment the table goes live, as in the comp below.

Designers: Don’t wait for users to ask just the the right thing at the right time.

Otherwise, this is a good high-tech use of the sand table for the more common meaning of “sand table,” which is a 3-dimensional surface for understanding a theatre of conflict. It doesn’t really help him run through scenarios, testing various tactics, but T’Challa is a warrior king, he can do all that in his head.

The interaction also nicely blurs the line between display and gestural interactive tool, in the same way that the Prometheus astrometrics display did. Like that other example, it would be useful for the display to distinguish when it is representing reality, and when the display is being interrupted or modified. Also, T’Challa is nice enough to put the truck back where it “belongs,” but a design would also need to handle how to respond when T’Challa put the truck back in the wrong place, or, say, crushed the truck model with his hand in fury.

In Prometheus it was an Earth, not a truck, but still focused on Africa.

Shuri’s lab

The largest table we see in the movie is in Shuri’s lab. After Black Panther challenges Killmonger and engages in battle outside the capital city, Shuri, Nakia, and Agent Ross rush down to the lab. As they approach an edge-lit hexagonal table, the vibranium sand lowers to reveal 3D-printed armor and weaponry for Shuri and Nakia to join the fight. (Though it’s not like modern 3D printing, these are powered weapons and kimoyo beads, items with very sophisticated functionality.)

Shuri outfits Ross with kimoyo beads from the print and takes off to join the fight. In the lab, the table creates a seat for Ross to remote-pilot the Royal Talon. Up on the flight deck, Shuri throws a control bead onto the Talon, and an AI in the lab named Griot announces to Agent Ross, “Remote piloting system activated.” (Hey, Trevor Noah, we hear you there!)

Around the seat, a volumetric projection of the Talon appears around him, including a 360° display just beyond the windshield that gives him a very immersive remote flying experience. We hear Shuri’s voice explain to Ross “I made it American Style for you. Get in!”

Ross sits down, grabs joystick controls, and begins remote-chasing down the cargo ships that are carrying munitions to Killmonger’s War Dogs around the world. (The piloting controls and HUD for Ross are a separate issue, and will be handled in their own post.)

The moment that Ross pilots the Talon through the last cargo ship, the volumetric projection disappears and the piloting seat returns to sand, ungraciously plopping Ross down the floor level of the lab.

It is in this shot that we realize that the dark tiles of the lab’s floor are all recessed vibranium sand tables. I can count seven in the shot. So the lab is full of them.

Display material

Let’s talk for a bit about the display choices. Vibranium can change to display any color and a shape down to a fine level of detail. See the screen cap below for an example of perfectly lifelike (if scaled) representation.

This is a vibranium-powered volumetric display.
It raises the gaze matching issues we’ve seen before.

So why would it be designed so that in most cases, the display is sparkly and black like black tourmaline? Wouldn’t the truck that T’Challa picks up be most useful if it was photographically rendered? Wouldn’t the remote piloting chair be more comfortable if it had pleather- and silicone-like surfaces?

Extradiegetically, I understand the reason is because art direction. We want Wakandan tech to be visibly different than other tech in the MCU, and having it look like vibranium dust ties it back to that key plot element.

But, per the stance of this blog, I try to look for a diegetic reason. It might be a deliberate reminder of the resource on which their technological fortunes are built. And as the Okoye VP above shows, they aren’t purists about it. When detail is needed, it’s included. So perhaps this is it. That implies a great deal of sophistication on the part of the displays to know when photorealism is needed and when it is not, but the presence of Griot there tells us that they have something approaching general AI.

Missing interactions

So, just like I had to do for the Royal Talon, I have to throw my hands up about reviewing the interactions with the sand tables, because we don’t see the interactions that would give these results.

How were the mission goals communicated to the Royal Talon table? Is it programmed to activate when someone approaches it, or did T’Challa issue a mental command? How did Shuri specify those weapons and that armor? What did she do to make the ship “American style” for Ross? Is that a template? Was it Griot’s interpretation of her intention? Why did the remote piloting seat vanish the moment the mission was complete? Was this something Shuri set up in advance, or Griot’s way of telling Agent Ross to GTFO for his own safety? How does someone in the lab instruct a floor tile to leap up and become a table and do stuff? It’s almost certainly via mental commands through the kimoyo beads, but that’s conjecture. The film really provides little evidence.

On the one hand, this is appropriate for us mere non-Wakandans observing the most technologically advanced society on earth. Much of it would feel like inexplicable magic to us.

On the other, sci-fi routinely introduces us to advanced technologies, and doesn’t always eschew the explanatory interactions, so the absence is notable here. It’s magic.

Black Lives Matter

Each post in the Black Panther review is followed by actions that you can take to support black lives.

In the last post we grieved Chadwick Boseman’s passing. This week we’re grieving the loss of Ruth Bader Ginsburg. May her memory be a blessing. With her loss, the GOP is ratcheting up its outrageous hypocrisy by reversing a precedent that they themselves established when Obama was president. The “Moscow Mitch Rule” (oh, oops, sorry) “McConnell Rule” was that new Justices should not be appointed within a year of a general election, so the people’s voice can be taken into account. Of course, the bastards are just ignoring that now and trying to ram through one of their own before election day. This Justice will certainly be a conservative, and we know with this administration that means reactionary, loyal to tiny-hand Twittler, and racist as a Jim Crow law.

There are a few arrows in citizen’s quivers to stop this. One is to convince at least 4 Republican Senators to reject this outright hypocrisy, put country over party, and adhere to the McConnell rule.

Brilliant image by Jesse Duquette

To help put pressure where it might work, you can leave voicemails with Republican Senators who may be mulling whether to put country over party. Those 6 Senators’ names and numbers are below. Here’s a script for your message:

Hello, my name is ______. In 2016, Mitch McConnell created the principle of not confirming a Supreme Court Justice in an election year until after the next inauguration. For the legitimacy of the Court in the eyes of the people, I’m asking Senator ________ to uphold that principle by refusing to confirm a new Justice until after a new President is installed. Thank you.

—You, hopefully
  • Lisa Murkowski, Alaska; (202) 224-6665
  • Mitt Romney, Utah: (202) 224-5251
  • Susan Collins, Maine: (202) 224-2523
  • Martha McSally, Arizona: (202) 224-2235
  • Cory Gardner, Colorado: (202) 224-5941
  • Chuck Grassley, Iowa: (202) 224-3744

I’ve made my calls and left my messages. Can you do the same to stop the hypocritical Trumpian power grab that would tip the Supreme Court for generations?

UPDATE: Nevermind. Romney caved.

Panther Suit 2.0

by

2

The suit that the Black Panther wears is critical to success. At the beginning of the movie, this is “just” a skintight bulletproof suit with homages to its namesake. But, after T’Challa is enthroned, Shuri takes him to her lab and outfits him with a new one with some nifty new features. This write-up is about Shuri’s 2.0 Panther Suit.

Authorizing

At the demonstration of the new suit, Shuri first takes a moment to hold up a bracelet of black Kimoyo beads (more on these in a later post) to his neck. With a bubbly computer sound, the glyphs on the beads begin to glow vibranium-purple, projecting two particular symbols on his neck. (The one that looks kind of like a reflective A, and the other that looks like a ligature of a T and a U.)

This is done without explanation, so we have to make some assumptions here, which is always shaky ground for critique.

I think she’s authorizing him to use the suit. At first I thought the interaction was her “pairing” him with the suit, but I can’t imagine that the bead would need to project something onto his skin to read his identity or DNA. So my updated guess is this is a dermal mark that, like the Wakandan tattoos, the suit will check for with a “intra-skin scan,” like the HAN/BAN concepts from the early aughts. This would enable her to authorize many people, which is, perhaps, not as secure.

This interpretation is complicated by Killmonger’s wearing one of the other Black Panther suits when he usurps T’Challa. Shuri had fled with Queen Romonda to the Jibari stronghold, so Shuri couldn’t have authorized him. Maybe some lab tech who stayed behind? If there was some hint of what’s supposed to be happening here we would have more grounds to evaluate this interaction.

There might be some hint if there was an online reference to these particular symbols, but they are not part of the Wakandan typeface, or the Andinkra symbols, or the Nsibidi symbols that are seen elsewhere in the film. (I have emails out to the creator of the above image to see if I can learn more there. Will update if I get a response.)

Activation

When she finishes whatever the bead did, she says, “Now tell it to go on.” T’Challa looks at it intensely, and the suit spreads from the “teeth” in the necklace with an insectoid computer sound, over the course of about 6 seconds.

We see him activate the suit several more times over the course of the movie, but learn nothing new about activation beyond this. How does he mentally tell it to turn it on? I presume it’s the same mental skill he’s built up across his lifetime with kimoyo beads, but it’s not made explicit in the movie.

A fun detail is that while the suit activates in 6 seconds in the lab—far too slow for action in the field considering Shuri’s sardonic critique of the old suit (“People are shooting at me! Wait! Let me put on my helmet!”)—when T’Challa uses it in Korea, it happens in under 3. Shuri must have slowed it down to be more intelligible and impressive in the lab.

Another nifty detail that is seen but not discussed is that the nanites will also shred any clothes being worn at the time of transformation, as seen at the beginning of the chase sequence outside the casino and when Killmonger is threatened by the Dora Milaje.

Hopefully they weren’t royal…oh. Oh well?

Deactivation

T’Challa thinks the helmet off a lot over the course of the movie, even in some circumstances where I am not sure it was wise. We don’t see the mechanism. I expect it’s akin to kimoyo communication, again. He thinks it, and it’s done. (n.b. “It’s mental” is about as satisfying from a designer’s critique as “a wizard did it”, because it’s almost like a free pass, but *sigh* perfectly justifiable given precedent in the movie.)

Kinetic storage & release

At the demonstration in her lab, Shuri tells T’Challa to, “Strike it.” He performs a turning kick to the mannequin’s ribcage and it goes flying. When she fetches it from across the lab, he marvels at the purple light emanating from Nsibidi symbols that fill channels in the suit where his strike made contact. She explains “The nanites have absorbed the kinetic energy. They hold it in place for redistribution.”

He then strikes it again in the same spot, and the nanites release the energy, knocking him back across the lab, like all those nanites had become a million microscopic bigclaw snapping shrimp all acting in explosive concert. Cool as it is, this is my main critique of the suit.

First, the good. As a point of illustration of how cool their mastery of tech is, and how it works, this is pretty sweet. Even the choice of purple is smart because it is a hard color to match in older chemical film processes, and can only happen well in a modern, digital film. So extradiegetically, the color is new and showing off a bit.

Tactically though, I have to note that it broadcasts his threat level to his adversaries. Learning this might take a couple of beatings, but word would get around. Faithful readers will know we’ve looked at aposematic signaling before, but those kinds of markings are permanent. The suit changes as he gets technologically beefier. Wouldn’t people just avoid him when he was more glowy, or throw something heavy at him to force him to expend it, and then attack when he was weaker? More tactical I think to hold those cards close to the chest, and hide the glow.

Now it is quite useful for him to know the level of charge. Maybe some tactile feedback like a warmth or or a vibration at the medial edge of his wrists. Cinegenics win for actual movie-making of course, but designers take note. What looks cool is not always smart design.

Not really a question for me: Can he control how much he releases? If he’s trying to just knock someone out, it would be crappy if he accidentally killed them, or expected to knock out the big bad with a punch, only to find it just tickled him like a joy buzzer. But if he already knows how to mentally activate the suit, I’m sure he has the skill down to mentally clench a bit to control the output. Wizards.

Regarding Shuri’s description, I think she’s dumbing things down for her brother. If the suit actually absorbed the kinetic energy, the suit would not have moved when he kicked it. (Right?) But let’s presume if she were talking to someone with more science background, she would have been more specific to say, “absorbed some of the kinetic energy.”

Explosive release

When the suit has absorbed enough kinetic energy, T’Challa can release it all at once as a concussive blast. He punches the ground to trigger it, but it’s not clear how he signals to the suit that he wants to blast everyone around him back rather than, say, create a crater, but again, I think we can assume it’s another mental command. Wizards.

Claws

To activate the suit’s claws, T’Challa quickly extends curved fingers and holds them there, and they pop out.

This gesture is awesome, and completely fit for purpose. Shaping the fingers like claws make claws. It’s also when fingers are best positioned to withstand the raking motion. The second of hold ensures it’s not accidental activation. Easy to convey, easy to remember, easy to intuit. Kids playing Black Panther on the sidewalk would probably do the same without even seeing the movie.

We have an unanswered question about how those claws retract. Certainly the suit is smart enough to retract automatically so he doesn’t damage himself. Probably more mental commands, but whatever. I wouldn’t change a thing here.

Black Lives Matter

Each post in the Black Panther review is followed by actions that you can take to support black lives. I had something else planned for this post, but just before publication another infuriating incident has happened.

While the GOP rallies to the cause of the racist-in-chief in Charlotte, right thinking people are taking to the streets in Kenosha, Wisconsin, to protest the unjust shooting of a black man, Jacob Blake. The video is hard to watch. Watch it. It’s especially tragic, especially infuriating, because Kenosha had gone through “police reform” initiatives in 2014 meant to prevent exactly this sort of thing. It didn’t prevent this sort of thing. As a friend of mine says, it’s almost enough to make you an abolitionist.

Raysean White via TMX.news

Information is still coming in as to what happened, but here’s the narrative we understand right now: It seems that Blake had pulled over his car to stop a fight in progress. When the police arrived, he figured they had control of the situation, and he walked back to his car to leave. That’s when officers shot him in the back multiple times, while his family—who were still waiting for him in the car—watched. He’s out of surgery and stable, but rather than some big-picture to-do tonight, please donate to support his family. They have witnessed unconscionable trauma.

Blake and kids, in happier times

Several fundraisers posted to support Blake’s family have been taken down by GoFundMe for being fake, but “Justice for Jacob Blake” remains active as of Monday evening. Please donate.

8 Reasons The Voight-Kampff Machine is shit (and a redesign to fix it)

by

9

Distinguishing replicants from humans is a tricky business. Since they are indistinguishable biologically, it requires an empathy test, during which the subject hears empathy-eliciting scenarios and watched carefully for telltale signs such as, “capillary dilation—the so-called blush response…fluctuation of the pupil…involuntary dilation of the iris.” To aid the blade runner in this examination, they use a portable machine called the Voight-Kampff machine, named, presumably, for its inventors.

The device is the size of a thick laptop computer, and rests flat on the table between the blade runner and subject. When the blade runner prepares the machine for the test, they turn it on, and a small adjustable armature rises from the machine, the end of which is an intricate piece of hardware, housing a powerful camera, glowing red.

The blade runner trains this camera on one of the subject’s eyes. Then, while reading from the playbook book of scenarios, they keep watch on a large monitor, which shows an magnified image of the subject’s eye. (Ostensibly, anyway. More on this below.) A small bellows on the subject’s side of the machine raises and lowers. On the blade runner’s side of the machine, a row of lights reflect the volume of the subject’s speech. Three square, white buttons sit to the right of the main monitor. In Leon’s test we see Holden press the leftmost of the three, and the iris in the monitor becomes brighter, illuminated from some unseen light source. The purpose of the other two square buttons is unknown. Two smaller monochrome monitors sit to the left of the main monitor, showing moving but otherwise inscrutable forms of information.

In theory, the system allows the blade runner to more easily watch for the minute telltale changes in the eye and blush response, while keeping a comfortable social distance from the subject. Substandard responses reveal a lack of empathy and thereby a high probability that the subject is a replicant. Simple! But on review, it’s shit. I know this is going to upset fans, so let me enumerate the reasons, and then propose a better solution.

-2. Wouldn’t a genetic test make more sense?

If the replicants are genetically engineered for short lives, wouldn’t a genetic test make more sense? Take a drop of blood and look for markers of incredibly short telomeres or something.

-1. Wouldn’t an fMRI make more sense?

An fMRI would reveal empathic responses in the inferior frontal gyrus, or cognitive responses in the ventromedial prefrontal gyrus. (The brain structures responsible for these responses.) Certinaly more expensive, but more certain.

0. Wouldn’t a metal detector make more sense?

If you are testing employees to detect which ones are the murdery ones and which ones aren’t, you might want to test whether they are bringing a tool of murder with them. Because once they’re found out, they might want to murder you. This scene should be rewritten such that Leon leaps across the desk and strangles Holden, IMHO. It would make him, and other blade runners, seem much more feral and unpredictable.

(OK, those aren’t interface issues but seriously wtf. Onward.)

1. Labels, people

Controls needs labels. Especially when the buttons have no natural affordance and the costs of experimentation to discover the function are high. Remembering the functions of unlabeled controls adds to the cognitive load for a user who should be focusing on the person across the table. At least an illuminated button helps signal the state, so that, at least, is something.

 2. It should be less intimidating

The physical design is quite intimidating: The way it puts a barrier in between the blade runner and subject. The fact that all the displays point away from the subject. The weird intricacy of the camera, its ominous HAL-like red glow. Regular readers may note that the eyepiece is red-on-black and pointy. That is to say, it is aposematic. That is to say, it looks evil. That is to say, intimidating.

I’m no emotion-scientist, but I’m pretty sure that if you’re testing for empathy, you don’t want to complicate things by introducing intimidation into the equation. Yes, yes, yes, the machine works by making the subject feel like they have to defend themselves from the accusations in the ethical dilemmas, but that stress should come from the content, not the machine.

2a. Holden should be less intimidating and not tip his hand

While we’re on this point, let me add that Holden should be less intimidating, too. When Holden tells Leon that a tortoise and a turtle are the same thing, (Narrator: They aren’t) he happens to glance down at the machine. At that moment, Leon says, “I’ve never seen a turtle,” a light shines on the pupil and the iris contracts. Holden sees this and then gets all “ok, replicant” and becomes hostile toward Leon.

In case it needs saying: If you are trying to tell whether the person across from you is a murderous replicant, and you suddenly think the answer is yes, you do not tip your hand and let them know what you know. Because they will no longer have a reason to hide their murderyness. Because they will murder you, and then escape, to murder again. That’s like, blade runner 101, HOLDEN.

3. It should display history 

The glance moment points out another flaw in the interface. Holden happens to be looking down at the machine at that moment. If he wasn’t paying attention, he would have missed the signal. The machine needs to display the interview over time, and draw his attention to troublesome moments. That way, when his attention returns to the machine, he can see that something important happened, even if it’s not happening now, and tell at a glance what the thing was.

4. It should track the subject’s eyes

Holden asks Leon to stay very still. But people are bound to involuntarily move as their attention drifts to the content of the empathy dilemmas. Are we going to add noncompliance-guilt to the list of emotional complications? Use visual recognition algorithms and high-resolution cameras to just track the subject’s eyes no matter how they shift in their seat.

5. Really? A bellows?

The bellows doesn’t make much sense either. I don’t believe it could, at the distance it sits from the subject, help detect “capillary dilation” or “ophthalmological measurements”. But it’s certainly creepy and Terry Gilliam-esque. It adds to the pointless intimidation.

6. It should show the actual subject’s eye

The eye color that appears on the monitor (hazel) matches neither Leon’s (a striking blue) or Rachel’s (a rich brown). Hat tip to Typeset in the Future for this observation. His is a great review.

7. It should visualize things in ways that make it easy to detect differences in key measurements

Even if the inky, dancing black blob is meant to convey some sort of information, the shape is too organic for anyone to make meaningful readings from it. Like seriously, what is this meant to convey?

The spectrograph to the left looks a little more convincing, but it still requires the blade runner to do all the work of recognizing when things are out of expected ranges.

8. The machine should, you know, help them

The machine asks its blade runner to do a lot of work to use it. This is visual work and memory work and even work estimating when things are out of norms. But this is all something the machine could help them with. Fortunately, this is a tractable problem, using the mighty powers of logic and design.

Pupillary diameter

People are notoriously bad at estimating the sizes of things by sight. Computers, however, are good at it. Help the blade runner by providing a measurement of the thing they are watching for: pupillary diameter. (n.b. The script speaks of both iris constriction and pupillary diameter, but these are the same thing.) Keep it convincing and looking cool by having this be an overlay on the live video of the subject’s eye.

So now there’s some precision to work with. But as noted above, we don’t want to burden the user’s memory with having to remember stuff, and we don’t want them to just be glued to the screen, hoping they don’t miss something important. People are terrible at vigilance tasks. Computers are great at them. The machine should track and display the information from the whole session.

Note that the display illustrates radius, but displays diameter. That buys some efficiencies in the final interface.

Now, with the data-over-time, the user can glance to see what’s been happening and a precise comparison of that measurement over time. But, tracking in detail, we quickly run out of screen real estate. So let’s break the display into increments with differing scales.

There may be more useful increments, but microseconds and seconds feel pretty convincing, with the leftmost column compressing gradually over time to show everything from the beginning of the interview. Now the user has a whole picture to look at. But this still burdens them into noticing when these measurements are out of normal human ranges. So, let’s plot the threshold, and note when measurements fall outside of that. In this case, it feels right that replicants display less that normal pupillary dilation, so it’s a lower-boundary threshold. The interface should highlight when the measurement dips below this.

Blush

I think that covers everything for the pupillary diameter. The other measurement mentioned in the dialogue is capillary dilation of the face, or the “so-called blush response.” As we did for pupillary diameter, let’s also show a measurement of the subject’s skin temperature over time as a line chart. (You might think skin color is a more natural measurement, but for replicants with a darker skin tone than our two pasty examples Leon and Rachel, temperature via infrared is a more reliable metric.) For visual interest, let’s show thumbnails from the video. We can augment the image with degree-of-blush. Reduce the image to high contrast grayscale, use visual recognition to isolate the face, and then provide an overlay to the face that illustrates the degree of blush.

But again, we’re not just looking for blush changes. No, we’re looking for blush compared to human norms for the test. It would look different if we were looking for more blushing in our subject than humans, but since the replicants are less empathetic than humans, we would want to compare and highlight measurements below a threshold. In the thumbnails, the background can be colored to show the median for expected norms, to make comparisons to the face easy. (Shown in the drawing to the right, below.) If the face looks too pale compared to the norm, that’s an indication that we might be looking at a replicant. Or a psychopath.

So now we have solid displays that help the blade runner detect pupillary diameter and blush over time. But it’s not that any diameter changes or blushing is bad. The idea is to detect whether the subject has less of a reaction than norms to what the blade runner is saying. The display should be annotating what the blade runner has said at each moment in time. And since human psychology is a complex thing, it should also track video of the blade runner’s expressions as well, since, as we see above, not all blade runners are able to maintain a poker face. HOLDEN.

Anyway, we can use the same thumbnail display of the face, without augmentation. Below that we can display the waveform (because they look cool), and speech-to-text the words that are being spoken. To ensure that the blade runner’s administration of the text is not unduly influencing the results, let’s add an overlay to the ideal intonation targets. Despite evidence in the film, let’s presume Holden is a trained professional, and he does not stray from those targets, so let’s skip designing the highlight and recourse-for-infraction for now.

Finally, since they’re working from a structured script, we can provide a “chapter” marker at the bottom for easy reference later.

Now we can put it all together, and it looks like this. One last thing we can do to help the blade runner is to highlight when all the signals indicate replicant-ness at once. This signal can’t be too much, or replicants being tested would know from the light on the blade runner’s face when their jig is up, and try to flee. Or murder. HOLDEN.

For this comp, I added a gray overlay to the column where pupillary and blush responses both indicated trouble. A visual designer would find some more elegant treatment.

If we were redesigning this from scratch, we could specify a wide display to accomodate this width. But if we are trying to squeeze this display into the existing prop from the movie, here’s how we could do it.

Note the added labels for the white squares. I picked some labels that would make sense in the context. “Calibrate” and “record” should be obvious. The idea behind “mark” is an easy button for the blade runner to press when they see something that looks weird, like when doctors manually annotate cardiograph output.

Lying to Leon

There’s one more thing we can add to the machine that would help out, and that’s a display for the subject. Recall the machine is meant to test for replicant-ness, which happens to equate to murdery-ness. A positive result from the machine needs to be handled carefully so what happens to Holden in the movie doesn’t happen. I mentioned making the positive-overlay subtle above, but we can also make a placebo display on the subject’s side of the interface.

The visual hierarchy of this should make the subject feel like its purpose is to help them, but the real purpose is to make them think that everything’s fine. Given the script, I’d say a teleprompt of the empathy dilemma should take up the majority of this display. Oh, they think, this is to help me understand what’s being said, like a closed caption. Below the teleprompt, at a much smaller scale, a bar at the bottom is the real point.

On the left of this bar, a live waveform of the audio in the room helps the subject know that the machine is testing things live. In the middle, we can put one of those bouncy fuiget displays that clutters so many sci-fi interfaces. It’s there to be inscrutable, but convince the subject that the machine is really sophisticated. (Hey, a diegetic fuiget!) Lastly—and this is the important part—An area shows that everything is “within range.” This tells the subject that they can be at ease. This is good for the human subject, because they know they’re innocent. And if it’s a replicant subject, this false comfort protects the blade runner from sudden murder. This test might flicker or change occasionally to something ambiguous like “at range,” to convey that it is responding to real world input, but it would never change to something incriminating.

This way, once the blade runner has the data to confirm that the subject is a replicant, they can continue to the end of the module as if everything was normal, thank the replicant for their time, and let them leave the room believing they passed the test. Then the results can be sent to the precinct and authorizations returned so retirement can be planned with the added benefit of the element of surprise.

OK

Look, I’m sad about this, too. The Voight-Kampff machine is cool. It fits very well within the art direction of the Blade Runner universe. This coolness burned the machine into my memory when I saw this film the first dozen times, but despite that, it just doesn’t stand up to inspection. It’s not hopeless, but does need a lot of thinkwork and design to make it really fit to task, and convincing to us in the audience.

Routing Board

by

10

When the two AIs Colossus and Guardian are disconnected from communicating with each other, they try and ignore the spirit of the human intervention and reconnect on their own. We see the humans monitoring Colossus’ progress in this task on big board in the U.S. situation room. It shows a translucent projection map of the globe with white dots representing data centers and red icons representing missiles. Beneath it, glowing arced lines illustrate the connection routes Colossus is currently testing. When it finds that a current segment is ineffective, that line goes dark, and another segment extending from the same node illuminates.

For a smaller file size, the animated gif has been stilled between state changes, but the timing is as close as possible to what is seen in the film.

Forbin explains to the President, “It’s trying to find an alternate route.”

A first in sci-fi: Routing display 🏆

First, props to Colossus: The Forbin Project for being the first show in the survey to display something like a routing board, that is, a network of nodes through which connections are visible, variable, and important to stakeholders.

Paul Baran and Donald Davies had published their notion of a network that could, in real-time, route information dynamically around partial destruction of the network in the early 1960s, and this packet switching had been established as part of ARPAnet in the late 1960s, so Colossus was visualizing cutting edge tech of the time.

This may even be the first depiction of a routing display in all of screen sci-fi or even cinema, though I don’t have a historical perspective on other genres, like the spy genre, which is another place you might expect to see something like this. As always, if you know of an earlier one, let me know so I can keep this record up to date and honest.

A nice bit: curvy lines

Should the lines be straight or curvy? From Colossus’ point of view, the network is a simple graph. Straight lines between its nodes would suffice. But from the humans’ point of view, the literal shape of the transmission lines are important, in case they need to scramble teams to a location to manually cut the lines. Presuming these arcs mean that (and not just the way neon in a prop could bend), then the arcs are the right display. So this is good.

But, it breaks some world logic

The board presents some challenges with the logic of what’s happening in the story. If Colossus exists as a node in a network, and its managers want to cut it off from communication along that network, where is the most efficient place to “cut” communications? It is not at many points along the network. It is at the source.

Imagine painting one knot in a fishing net red and another one green. If you were trying to ensure that none of the strings that touch the red knot could trace a line to the green one, do you trim a bunch of strings in the middle, or do you cut the few that connect directly to the knot? Presuming that it’s as easy to cut any one segment as any other, the fewer number of cuts, the better. In this case that means more secure.

The network in Colossus looks to be about 40 nodes, so it’s less complicated than the fishing net. Still, it raises the question, what did the computer scientists in Colossus do to sever communications? Three lines disappear after they cut communications, but even if they disabled those lines, the rest of the network still exists. The display just makes no sense.

Before, happy / After, I will cut a Prez

Per the logic above, they would cut it off at its source. But the board shows it reaching out across the globe. You might think maybe they just cut Guardian off, leaving Colossus to flail around the network, but that’s not explicitly said in the communications between the Americans and the Russians, and the U.S. President is genuinely concerned about the AIs at this point, not trying to pull one over on the “pinkos.” So there’s not a satisfying answer.

It’s true that at this point in the story, the humans are still letting Colossus do its primary job, so it may be looking at every alternate communication network to which it has access: telephony, radio, television, and telegraph. It would be ringing every “phone” it thought Guardian might pick up, and leaving messages behind for possible asynchronous communications. I wish a script doctor had added in a line or three to clarify this.

  • FORBIN
  • We’ve cut off its direct lines to Guardian. Now it’s trying to find an indirect line. We’re confident there isn’t one, but the trouble will come when Colossus realizes it, too.

Too slow

Another thing that seems troubling is the slow speed of the shifting route. The segments stay illuminated for nearly a full second at a time. Even with 1960s copper undersea cables and switches, electronic signals should not take that long. Telephony around the world was switched from manual to automatic switching by the 1930s, so it’s not like it’s waiting on a human operating a switchboard.

You’re too slow!

Even if it was just scribbling its phone number on each network node and the words “CALL ME” in computerese, it should go much faster than this. Cinematically, you can’t go too fast or the sense of anticipation and wonder is lost, but it would be better to have it zooming through a much more complicated network to buy time. It should feel just a little too fast to focus on—frenetic, even.

This screen gets 15 seconds of screen time, and if you showed one new node per frame, that’s only 360 states you need to account for, a paltry sum compared to the number of possible paths it could test across a 38 node graph between two points.

Plus the speed would help underscore the frightening intelligence and capabilities of the thing. And yes I understand that that is a lot easier said than done nowadays with digital tools than with this analog prop.

Realistic-looking search strategies

Again, I know this was a neon, analog prop, but let’s just note that it’s not testing the network in anything that looks like a computery way. It even retraces some routes. A brute force algorithm would just test every possibility sequentially. In larger networks there are pathfinding algorithms that are optimized in different ways to find routes faster, but they don’t look like this. They look more like what you see in the video below. (Hat tip to YouTuber gray utopia.)

This would need a lot of art direction and the aforementioned speed, but it would be more believable than what we see.

What’s the right projection?

Is this the right projection to use? Of course the most accurate representation of the earth is a globe, but it has many challenges in presenting a phenomenon that could happen anywhere in the world. Not the least of these is that it occludes about half of itself, a problem that is not well-solved by making it transparent. So, a projection it must be. There are many, many ways to transform a spherical surface into a 2D image, so the question becomes which projection and why.

The map uses what looks like a hand-drawn version of Peirce quincuncial projection. (But n.b. none of the projection types I compared against it matched exactly, which is why I say it was hand-drawn.) Also those longitude and latitude lines don’t make any sense; though again, a prop. I like that it’s a non standard projection because screw Mercator, but still, why Peirce? Why at this angle?

Also, why place time zone clocks across the top as if they corresponded to the map in some meaningful way? Move those clocks.

I have no idea why the Peirce map would be the right choice here, when its principle virtue is that it can be tessellated. That’s kind of interesting if you’re scrolling and can’t dynamically re-project the coastlines. But I am pretty sure the Colossus map does not scroll. And if the map is meant to act as a quick visual reference, having it dynamic means time is wasted when users look to the map and have to orient themselves.

If this map was only for tracking issues relating to Colossus, it should be an azimuthal map, but not over the north pole. The center should be the Colossus complex in Colorado. That might be right for a monitoring map in the Colossus Programming Office. This map is over the north pole, which certainly highlights the fact that the core concern of this system is the Cold War tensions between Moscow and D.C. But when you consider that, it points out another failing. 

Later in the film the map tracks missiles (not with projected paths, sadly, but with Mattel Classic Football style yellow rectangles). But missiles could conceivably come from places not on this map. What is this office to do with a ballistic-missile submarine off of the Baja peninsula, for example? Just wait until it makes its way on screen? That’s a failure. Which takes us to the crop.

Crop

The map isn’t just about missiles. Colossus can look anywhere on the planet to test network connections. (Even nowadays, near-earth orbit and outer space.) Unless the entire network was contained just within the area described on the map, it’s excluding potentially vital information. If Colossus routed itself through through Mexico, South Africa, and Uzbekistan before finally reconnecting to Guardian, users would be flat out of luck using that map to determine the leak route. And I’m pretty sure they had a functioning telephone network in Mexico, South Africa, and the Balkan countries in the 1960s.

This needs a complete picture

SInce the missiles and networks with which Colossus is concerned are potentially global, this should be a global map. Here I will offer my usual fanboy shout-outs to the Dymaxion and Pacific-focused Waterman projection for showing connectedness and physical flow, but there would be no shame in showing the complete Peirce quincuncial. Just show the whole thing.

Maybe fill in some of the Pacific “wasted space” with a globe depiction turned to points of interest, or some other fuigetry. Which gives us a new comp something like this.

I created this proof of concept manually. With more time, I would comp it up in Processing or Python and it would be even more convincing. (And might have reached London.)

All told, this display was probably eye-opening for its original audience. Golly jeepers! This thing can draw upon resources around the globe! It has intent, and a method! And they must have cool technological maps in D.C.! But from our modern-day vantage point, it has a lot to learn. If they ever remake the film, this would be a juicy thing to fully redesign.

Control Room Power Board

by

3

image00

Once Dr. Sattler restores power to the park, Arnold needs to reboot the computer systems. To do this, he must switch off the circuits (C1–C3 in the screenshot above), and then switch off-and-on a circuit labeled “Main”.

image01

It’s a good thing Arnold knows what he’s doing, since these switches are only labeled C1-3, and we don’t see any documentation in the camera frame.  As he turns off each circuit, different parts of the computer terminals in the Control Room shut down.  This implies that different computer banks are tied to the same power circuits as the systems they control.

So, since this is a major interface for the park, let’s make this bit explicit: When designing infrequently-used but mission-critical interfaces, take great care to explain use, using clear affordances and constraints so that mistakes are very, very difficult to make. 

It might look like a mistake to have all the little electrical labeling to the sides, since this cover would have to be removed to get the components where this information would be of use. But that’s perfect. A user needing to remove this panel must encounter this reference information to get to those components, and so would know where to find them. This is a brilliant example of the pattern Put the Signal in the Path. Let’s hope there are similar signs on other access panels.

image02

Wait…where are the backups?

These are the central computer terminals that run Jurassic Park, and keep visitors safe from the “attractions.”  And there is no backup power.

When Arnold turns off the main circuit breaker, the computers (and servers behind them) turn off immediately.  The purpose and effect of the power switch deactivates all the systems in Jurassic Park, without any kind of warning or backup system.

For something as dangerous as deadly deadly dinosaurs—raised from the 65 million-year deep grave of extinction—the system deactivation should at least trigger some kind of warning.

Tornado sirens have backup batteries in case the city power goes out.  They are a solid example of a backup system that should exist, at minimum, to warn park-goers to move quickly towards shelter.  A better backup system would be a duplicate server system that automatically activates all the fences in the park.

Redundant Systems

When Arnold cycles the visitor center’s power system, it also trips the breakers for all of the other power systems in the park.  Primary safety systems like that should be on their own circuit.  It’s ok if the fridges turn off and melt the ice cream (though it may be an inconvenience), but that same event shouldn’t also deactivate the velociraptor pen security.  Especially when the ‘raptor pen is right next to the visitor center and is a known, aforementioned, deadly deadly threat.

Shadowy videoconferencing room

by

4

After Loki gets away with the crazy-powerful tesseract and a handful of S.H.I.E.L.D. (seriously that’s a pain to type) agents, Fury has a virtual meeting with members of the World Security Council—which is shadowy in appearance and details. To conduct this furtive conference Fury walks into a room custom-built for such purposes.

Avengers-Shadowy-Videoconference02

A bank of large vertically-mounted monitors forms a semicircle in the small room, each mounted above a workstation with keyboard and multiple screens overlit for maximum eyestrain. It’s quite unclear what the agents who normally work here are currently doing, or what those vertically mounted screens normally display, since they’d be a shoo-in for an OSHA lawsuit, given the amount a user would need to crane. Ergonomics, Nick, look it up.

Avengers-Shadowy-Videoconference03

 

Each screen dedicates most of its real estate to a waist-up view of the speaker. Overlays near the bottom assure us that DATA [is] SECURE and confirms it with a 16-character alphanumeric CYPHER KEY that is frequently changing and unique to each speaker. This is similar to an HMAC-based One-time Password Algorithm (HOTP) password algorithm, so is well-grounded in reality. It’s convincing.

The screens adhere to the trope that every screen is a camera. Nick looks at their eyes and they look right back. Ordinarily that would be a big problem, but with the translucent displays and the edge lighting of the participants, it could actually work.

There is no indication of controls for these screens, but that’s cool if the room is dedicated to this purpose. Someone else would set the call up for him, and all he has to do is walk in. He should be able to just walk out to end it. And let them know how he feels about them.

The SandPhone

by

6

LogansRun037

Not everyone is comfortable giving over to the flimsy promise of Carrousel [sic]. Some citizens run, and Sandmen find and terminate these cultural heretics.

Sandmen carry a device with them that has many different uses. It goes unnamed in the movie, so let’s just call it the SandPhone. It is a thick black rectangle about 20cm at its long edge, about the size of a very large cell phone. Near the earpiece on one broad side is a small screen for displaying text and images. Below that is a white line. The lower half of this face is metallic grill that covers a microphone. On the left edge is a momentary button that allows talking. Just above this is a small red button. When not in use, the device is holstered on the sandman’s belt.

The SandPhone lets the Sandman receive information through a display that can show both image and text. The Sandman sends back information and requests by voice in a CB radio metaphor.

Notifications

The first time we see the device is when Logan and Francis are attending Carrousel. Somehow, on his belt it catches his attention. With the crowd too loud for sound, and no evidence it’s light, my bet’s on haptics. Realizing he’s got a message, he picks it up, presses the edge button and the screen displays two lines of text:

RUNNER: GREAT HALL
ENTRANCE WEST.

He then puts the device to his face as we would a cell phone and shouts, “Affirmative!” as loud as he can.

LogansRun038

Perp wayfinding

Running with the device outside the Great Hall, Logan uses the SandPhone as a detector. By holding it flat out in front of him he hears a rhythmic pulse. Turning it this way and that, he listens for the change in pitch. It rises when he is pointing towards the targeted runner.

Bio identification

LogansRun046
LogansRun050

When he and Francis have terminated the runner, he snaps the device off his belt, and pressing the edge button, he reports back to dispatch, “Runner terminated, 0.31. Ready for cleanup.” Then by placing the device near the head of the dead runner, the device displays on the screen the last photographic image of him on file. Since the face on the SandPhone screen does not match the face he sees before him, Logan lifts the device to his face and, holding the edge button, requests an identity check of dispatch. Instantly he pulls the device away from his face to show the text:

IDENT. AFFIRM
NEW YOU #483
FACE CHANGE.

LogansRun182

Send backup

Much later in the film we see Logan alert dispatch to the location of the underground hideout by reaching down to the holstered device and pressing the white line button on its face. Its screen pulses green, and his position is highlight on the runner board (see below) at dispatch. Minutes later the location is raided by Sandmen.

Analysis

The first thing to note is that this is pretty close to a modern smart phone. He receives images and text messages, can talk to dispatch, and it has a biometric capability for identifying citizens. It’s tempting to paint this as visionary, but keep in mind that the first mobile phone was demonstrated in 1973, three years earlier, so it’s likely that the film makers were riffing off of the demo technology they’d heard about or maybe even seen in person.

We evaluate an interface’s design by how well it helps its user achieves his goals. (Even if those goals are anethma. That’s how we judge an interface.) In this case, the SandPhone helps Logan get the information he needs, when he needs it, across multiple channels. It doesn’t distract him with other functions. It’s context aware and doesn’t apparently have battery issues.

There are improvements of course.

We should make sure his hands are free by making the information available as an augmented reality display instead of a handheld device. This would also give him the information privately rather than display it for anyone (notably members of the resistance) to see it. Wayfinding would be more sensible as an overlay to his vision through this device.

Some surface tweaks might also be made, such as giving him a means of text input so he wouldn’t have to shout above the roar of Carrousel. Some silent means of input would help for when he needs to provide silent input as well. First I thought optical inputs might be ideal, given the augmented reality, but we don’t want his eyes distracted like that, even for the duration of glances. Instead some other gestural input—perhaps a face twitch or subvocal input—that lets him keep the rest of his body tense and ready for action.

Citizen biometrics should be a background fact, given the penopticon of Dome City. The information would come to him when he gets his assignement. But turn those same biometrics around on Logan, and his body could request reinforcements before he even thought to do so manually. When his heart rate elevates and galvanic skin response lowers, dispatch would know something was up, and route backup immediately.

A strategic interaction designer would even ask why he has to chase runners at all, when predictive algorithms could guess which citizens were likely to run and take action to forestall their rebellion. But then we’re into Minority Report, and this needs to stay Logan’s Run.