Sci-fi Spacesuits: Interface Locations

6 Jul 2021 by Christopher Noessel

A major concern of the design of spacesuits is basic usability and ergonomics. Given the heavy material needed in the suit for protection and the fact that the user is wearing a helmet, where does a designer put an interface so that it is usable?

Chest panels

Chest panels are those that require that the wearer only look down to manipulate. These are in easy range of motion for the wearer’s hands. The main problem with this location is that there is a hard trade off between visibility and bulkiness.

Arm panels

Arm panels are those that are—brace yourself—mounted to the forearm. This placement is within easy reach, but does mean that the arm on which the panel sits cannot be otherwise engaged, and it seems like it would be prone to accidental activation. This is a greater technological challenge than a chest panel to keep components small and thin enough to be unobtrusive. It also provides some interface challenges to squeeze information and controls into a very small, horizontal format. The survey shows only three arm panels.

The first is the numerical panel seen in 2001: A Space Odyssey (thanks for the catch, Josh!). It provides discrete and easy input, but no feedback. There are inter-button ridges to kind of prevent accidental activation, but they’re quite subtle and I’m not sure how effective they’d be.

The second is an oversimplified control panel seen in Star Trek: First Contact, where the output is simply the unlabeled lights underneath the buttons indicating system status.

The third is the mission computers seen on the forearms of the astronauts in Mission to Mars. These full color and nonrectangular displays feature rich, graphic mission information in real time, with textual information on the left and graphic information on the right. Input happens via hard buttons located around the periphery.

*Mission to Mars* (2000): Phil sees that Woody is likely to overshoot

Side note: One nifty analog interface is the forearm mirror. This isn’t an invention of sci-fi, as it is actually on real world EVAs. It costs a lot of propellant or energy to turn a body around in space, but spacewalkers occasionally need to see what’s behind them and the interface on the chest. So spacesuits have mirrors on the forearm to enable a quick view with just arm movement. This was showcased twice in the movie Mission to Mars.

*Mission to Mars* (2000): Phil looks for Earth with his “rear view mirror.” It’s that tiny white dot.

HUDs

The easiest place to see something is directly in front of your eyes, i.e. in a heads-up display, or HUD. HUDs are seen frequently in sci-fi, and increasingly in sc-fi spacesuits as well. One is Sunshine. This HUD provides a real-time view of each other individual to whom the wearer is talking while out on an EVA, and a real-time visualization of dangerous solar winds.

These particular spacesuits are optimized for protection very close to the sun, and the visor is limited to a transparent band set near eye level. These spacewalkers couldn’t look down to see the top of a any interfaces on the suit itself, so the HUD makes a great deal of sense here.

Star Trek: Discovery’s pilot episode included a sequence that found Michael Burnham flying 2000 meters away from the U.S.S. Discovery to investigate a mysterious Macguffin. The HUD helped her with wayfinding, navigating, tracking time before lethal radiation exposure (a biological concern, see the prior post), and even doing a scan of things in her surroundings, most notably a Klingon warrior who appears wearing unfamiliar armor. Reference information sits on the periphery of Michael’s vision, but the augmentations occur mapped to her view. (Noting this raises the same issues of binocular parallax seen in the Iron HUD.)

Star Trek: Discovery (2017–) S01E01, “The Vulcan Hello”

Iron Man’s Mark L armor was able to fly in space, and the Iron HUD came right along with it. Though not designed/built for space, it’s a general AI HUD assisting its spacewalker, so worth including in the sample.

Aside from HUDs, what we see in the survey is similar to what exists in existing real-world extravehicular mobility units (EMUs), i.e. chest panels and arm panels.

Inputs illustrate paradigms

Physical controls range from the provincial switches and dials on the cigarette-girl foldout control panels of Destination Moon to the simple and restrained numerical button panel of 2001, to strangely unlabeled buttons of Star Trek: First Contact’s arm panels (above), and the ham-handed touch screens of Mission to Mars.

*Mission to Mars* (2000): Jim tests the atmosphere and learns it is Earth-like.

As the pictures above reveal, the input panels reflect the familiar technology of the time of the creation of the movie or television show. The 1950s were still rooted in mechanistic paradigms, the late 1960s interfaces were electronic pushbutton, the 2000s had touch screens and miniaturized displays.

Real world interfaces

For comparison and reference, the controls for NASA’s EMU has a control panel on the front, called the Display and Control Module, where most of the controls for the EMU sit.

The image shows that inputs are very different than what we see as inputs in film and television. The controls are large for easy manipulation even with thick gloves, distinct in type and location for confident identification, analog to allow for a minimum of failure points and in-field debugging and maintenance, and well-protected from accidental actuation with guards and deep recesses. The digital display faces up for the convenience of the spacewalker. The interface text is printed backwards so it can be read with the wrist mirror.

The outputs are fairly minimal. They consist of the pressure suit gauge, audio warnings, and the 12-character alphanumeric LCD panel at the top of the DCM. No HUD.

The gauge is mechanical and standard for its type. The audio warnings are a simple warbling tone when something’s awry. The LCD panel provides information about 16 different values that the spacewalker might need, including estimated time of oxygen remaining, actual volume of oxygen remaining, pressure (redundant to the gauge), battery voltage or amperage, and water temperature. To cycle up and down the list, she presses the Mode Selector Switch forward and backward. She can adjust the contrast using the Display Intensity Control potentiometer on the front of the DCM.

The DCMs referenced in the post are from older NASA documents. In more recent images on NASA’s social media, it looks like there have been significant redesigns to the DCM, but so far I haven’t seen details about the new suit’s controls. (Or about how that tiny thing can house all the displays and controls it needs to.)

Sci-fi Spacesuits: Biological needs

24 Jun 2021 by Christopher Noessel

Spacesuits must support the biological functioning of the astronaut. There are probably damned fine psychological reasons to not show astronauts their own biometric data while on stressful extravehicular missions, but there is the issue of comfort. Even if temperature, pressure, humidity, and oxygen levels are kept within safe ranges by automatic features of the suit, there is still a need for comfort and control inside of that range. If the suit is to be warn a long time, there must be some accommodation for food, water, urination, and defecation. Additionally, the medical and psychological status of the wearer should be monitored to warn of stress states and emergencies.

Unfortunately, the survey doesn’t reveal any interfaces being used to control temperature, pressure, or oxygen levels. There are some for low oxygen level warnings and testing conditions outside the suit, but these are more outputs than interfaces where interactions take place.

Mission to Mars (2000), McConnell verifies that the team can remove their helmets.

There are also no nods to toilet necessities, though in fairness Hollywood eschews this topic a lot.

The one example of sustenance seen in the survey appears in Sunshine, we see Captain Kaneda take a sip from his drinking tube while performing a dangerous repair of the solar shields. This is the only food or drink seen in the survey, and it is a simple mechanical interface, held in place by material strength in such a way that he needs only to tilt his head to take a drink.

*Sunshine* (2007): Truman asks spacewalker Shelby to calm down since his vital signs are stressed.

Similarly, in Sunshine, when Capa and Kaneda perform EVA to repair broken solar shields, Cassie tells Capa to relax because he is using up too much oxygen. We see a brief view of her bank of screens that include his biometrics.

*Sunshine* (2007): Cassie warns Capa that he’s using a lot of oxygen.

Remote monitoring of people in spacesuits is common enough to be a trope, but has been discussed already in the Medical chapter in Make It So, for more on biometrics in sci-fi.

Crowe’s medical monitor in *Aliens* (1986).

There are some non-interface biological signals for observers. In the movie Alien, as the landing party investigates the xenomorph eggs, we can see that the suit outgases something like steam—slower than exhalations, but regular. Though not presented as such, the suit certainly confirms for any onlooker that the wearer is breathing and the suit functioning.

*Alien* (1979): The away team’s suit exhales as they walk the alien wreckage.
Look for the white plume in the left image and a dark plume on the right.

Given that sci-fi technology glows, it is no surprise to see that lots and lots of spacesuits have glowing bits on the exterior. Though nothing yet in the survey tells us what these lights might be for, it stands to reason that one purpose might be as a simple and immediate line-of-sight status indicator. When things are glowing steadily, it means the life support functions are working smoothly. A blinking red alert on the surface of a spacesuit could draw attention to the individual with the problem, and make finding them easier.

*The Fifth Element* (1997): Mondoshawan spacesuits have tiny lights along the exterior.

Emergency deployment

One nifty thing that sci-fi can do (but we can’t yet in the real world) is deploy biology-protecting tech at the touch of a button. We see this in the Marvel Cinematic Universe with Starlord’s helmet.

*Guardians of the Galaxy* (2012) ~~Peter~~ Starlord puts his Helmet on Gamora in space outside the Kyln.

If such tech was available, you’d imagine that it would have some smart sensors to know when it must automatically deploy (sudden loss of oxygen or dangerous impurities in the air), but we don’t see it. But given this speculative tech, one can imagine it working for a whole spacesuit and not just a helmet. It might speed up scenes like this.

What do we see in the real world?

Are there real-world controls that sci-fi is missing? Let’s turn to NASA’s space suits to compare.

The Primary Life-Support System (PLSS) is the complex spacesuit subsystem that provides the life support to the astronaut, and biomedical telemetry back to control. Its main components are the closed-loop oxygen-ventilation system for cycling and recycling oxygen, the moisture (sweat and breath) removal system, and the feedwater system for cooling.

The only “biology” controls that the spacewalker has for these systems are a few on the Display and Control Module (DCM) on the front of the suit. They are the cooling control valve, the oxygen actuator slider, and the fan switch. Only the first is explicitly to control comfort. Other systems, such as pressure, are designed to maintain ideal conditions automatically. Other controls are used for contingency systems for when the automatic systems fail.

Hey, isn’t the text on this thing backwards? Yes, because astronauts can’t look down from inside their helmets, and must view these controls via a wrist mirror. More on this later.

The suit is insulated thoroughly enough that the astronaut’s own body heats the interior, even in complete shade. Because the astronaut’s body constantly adds heat, the suit must be cooled. To do this, the suit cycles water through a Liquid Cooling and Ventilation Garment, which has a fine network of tubes held closely to the astronaut’s skin. Water flows through these tubes and past a sublimator that cools the water with exposure to space. The astronaut can increase or decrease the speed of this flow and thereby the amount to which his body is cooled, by the cooling control valve, a recessed radial valve with fixed positions between 0 (the hottest) and 10 (the coolest), located on the front of the Display Control Module.

The spacewalker does not have EVA access to her biometric data. Sensors measure oxygen consumption and electrocardiograph data and broadcast it to the Mission Control surgeon, who monitors it on her behalf. So whatever the reason is, if it’s good enough for NASA, it’s good enough for the movies.

Back to sci-fi

So, we do see temperature and pressure controls on suits in the real world, which underscores their absence in sci-fi. But, if there hasn’t been any narrative or plot reason for such things to appear in a story, we should not expect them.

Vibranium-based Cape Shields

16 Mar 2021 by Christopher Noessel

Editor’s Note: Today’s guest post is penned by Lonny Brooks. Be sure and read his introduction post if you missed it when it was published.

The Black Panther film represents one of the most ubiquitous statements of Afrofuturist fashion and fashionable digital wearables to celebrate the Africana and Black imagination. The wearable criteria under Director Ryan Cooglar’s lead and that of the formidable talent of costume designer Ruth E. Carter took into account African tribal symbolism. The adinkra symbol, for “cooperation,” emblazoned across W’Kabi’s (played by Daniel Kaluuya) blanket embodies the role of the Border tribe where they lived in a small village tucked into the mountainous borderlands of Wakanda, disguised as farmers and hunters.

Beautiful interaction

Chris’ blog looks at the interactions with speculative technology, and here the interactions are marvelously subtle. They do not have buttons or levers, which might give away their true nature. To activate them, a user does what would come naturally, which is to hold the fabric before them, like a shield. (There might be a mental command as well, but of course we can’t perceive that.) The shield-like gesture activates the shield technology. It’s quick. It fits the material of the technology. You barely even have to be trained to use it. We never see the use case for when a wearer is incapacitated and can’t lift the cape into position, but there’s enough evidence in the rest of the film to expect it might act like Dr. Strange’s cape and activate its shield automatically.

But, for me, the Capes are more powerful not as models of interaction, but for what they symbolize.

The Dual Role of the Capes

The role of the Border Tribe is to create the illusion of agrarian ruggedness as a deception for outsiders that only tells of a placid, developing nation rather than the secret technologically advanced splendor of Wakanda’s lands. The Border Tribe is the keeper of Wakanda’s cloaking technology that hides the vast utopian advancement of Wakandan advantage.

The Border Tribe’s role is built into the fabric of their illustrious and enviably fashionable capes. The adinkra symbol of cooperation embedded into the cape reveals, by the final scenes of the Black Panther film, how the Border Tribe defenders wield their capes into a force field wall of energy to repel enemies.

Ironically we only see them at their most effective when Wakanda is undergoing a civil war between those loyal to Kilmonger who is determined to avenge his father’s murder and his own erasure from Wakandan collective memory, and those supporting King T’Challa. Whereas each Black Panther King has selected to keep Wakanda’s presence hidden literally under the cooperative shields of the Border Tribe, Kilmonger—an Oakland native and a potential heir to Wakandan monarchy—was orphaned and left in the U.S.

If this sounds familiar, consider the film as a grand allusion to the millions of Africans kidnapped and ripped from their tribal lineages and taken across the Atlantic as slaves. Their cultural heritage was purposefully erased, languages and tribal customs, memories lost to the colonial thirst for their unpaid and forced labor.

Kilmonger represents the Black Diaspora, former descendants of African homelands similarly deprived of their birthrights. Kilmonger wants the Black Diaspora to rise up in global rebellion with the assistance of Wakandan technical superiority. In opposition, King T’Challa aspires for a less vengeful solution. He wantsWakanda to come out to the world, and lead by example. We can empathize with both. T’Challa’s plan is fueled by virtue. Kilmonger’s is fueled by justice—redeploy these shields to protect Black people against the onslaught of ongoing police and state violence.

W. E. B. Du Bois in 1918
(image in the public domain)

Double Consciousness and the Big Metaphor

The cape shields powered by the precious secret meteorite called Vibranium embodies what the scholar W.E.B. Dubois referred to as a double consciousness, where members of the Black Diaspora inhabit two selves.

Their own identity as individuals
The external perception of themselves as a members of an oppressed people incessantly facing potential erasure and brutality.

The cape shields and their cloaking technology cover the secret utopic algorithms that power Wakanda, while playing on the petty stereotypes of African nations as less-advanced collectives.

The final battle scene symbolizes this grand debate—between Kilmonger’s claims on Wakanda and assertion of Africana power, and King T’Challa’s more cooperative and, indeed, compliant approach working with the CIA. Recall that in its subterfuge and cloaking tactics, the CIA has undermined and toppled numerous freely-elected African and Latin American governments for decades. In this final showdown, we see W’Kabi’s cloaked soldiers run down the hill towards King T’Challa and stop to raise their shields cooperatively into defensive formation to prevent King T’Challa’s advance. King T’Challa jumps over the shields and the force of his movement causes the soldier’s shields to bounce away while simultaneously revealing their potent energy.

The flowing blue capes of the Border Tribe are deceptively enticing, while holding the key to Wakanda’s survival as metaphors for cloaking their entire civilization from being attacked, plundered, and erased. Wakanda and these capes represent an alternative history: What if African peoples had not experienced colonization or undergone the brutal Middle Passage to the Americas? What if the prosperous Black Greenwood neighborhood of Tulsa, Oklahoma had developed cape shield technology to defend themselves against a genocidal white mob in 1921? Or if the Black Panther Party had harnessed the power of invisible cloaking technology as part of their black beret ensemble?

Gallery Images: World Building with the Afrofuturist Podcast—Afro-Rithms From The Future game, Neuehouse, Hollywood, May 22, 2019 [Co-Game Designers, Eli Kosminsky and Lonny Avi Brooks, Afro-Rithms Librarian; Co-Game Designer and Seer Ahmed Best]

In the forecasting imagination game, Afro-Rithms From The Future, and the game event we played in 2019 in Los Angeles based on the future universe we created, we generated the question:

What would be an article of fashion that would give you more Black Feminist leadership and more social justice?

One participant responded with: “I was thinking of the notion of the invisibility cloak but also to have it be reversed. It could make you invisible and also more visible, amplifying what you normally” have as strengths and recognizing their value. Or as another player, states “what about a bodysuit that protects you from any kind of harm” or as the game facilitator adds “how about a bodysuit that repels emotional damage?!” In our final analysis, the cape shields have steadfastly protected Wakanda against the emotional trauma of colonization and partial erasure.

In this way the cape shields guard against emotional damage as well. Imagine how it might feel to wear a fashionable cloak that displays images of your ancestral, ethnic, and gender memories reminding you of your inherent lovability as multi-dimensional human being—and that can technologically protect you and those you love as well.

Black Lives Matter

Chris: Each post in the Black Panther review is followed by actions that support black lives.

To thank Lonny for his guest post, I offered to donate money in his name to the charity of his choice. He has selected Museum of Children’s Arts in Oakland. The mission of MOCHA is to ensure that the arts are a fundamental part of our community and to create opportunities for all children to experience the arts to develop creativity, promote a sense of belonging, and to realize their potential.

And, since it’s important to show the receipts, the receipt:

Thank you, Lonny, for helping to celebrate Black Panther and your continued excellent work in speculative futures and Afrofuturism. Wakanda forever!

Okoye’s grip shoes

5 Jan 2021 by Christopher Noessel

Like so much of the tech in Black Panther, this wearable battle gear is quite subtle, but critical to the scene, and much more than it seems at first. When Okoye and Nakia are chasing Klaue through the streets of Busan, South Korea, she realizes she would be better positioned on top of their car than within it.

She holds one of her spears out of the window, stabs it into the roof, and uses it to pull herself out on top of the swerving, speeding car. Once there, she places her feet into position, and the moment the sole of her foot touches the roof, it glows cyan for a moment.

She then holds onto the stuck spear to stabilize herself, rears back with her other spear, and throws it forward through the rear-window and windshield of some minions’ car, where it sticks in the road before them. Their car strikes the spear and get crushed. It’s a kickass moment in a film of kickass moments. But by all means let’s talk about the footwear.

Now, it’s not explicit, the effect the shoe has in the world of the story. But we can guess, given the context, that we are meant to believe the shoes grip the car roof, giving her a firm enough anchor to stay on top of the car and not tumble off when it swerves.

She can’t just be stuck

I have never thrown a javelin or a hyper-technological vibranium spear. But Mike Barber, PhD scholar in Biomechanics at Victoria University and Australian Institute of Sport, wrote this article about the mechanics of javelin throwing, and it seems that achieving throwing force is not just by sheer strength of the rotator cuff. Rather, the thrower builds force across their entire body and whips the momentum around their shoulder joint.

Ilgar Jafarov, CC BY-SA 4.0, via Wikimedia Commons

Okoye is a world-class warrior, but doesn’t have superpowers, so…while I understand she does not want the car to yank itself from underneath her with a swerve, it seems that being anchored in place, like some Wakandan air tube dancer, will not help her with her mighty spear throwing. She needs to move.

It can’t just be manual

Imagine being on a mechanical bull jerking side to side—being stuck might help you stay upright. But imagine it jerking forward suddenly, and you’d wind up on your butt. If it jerked backwards, you’d be thrown forward, and it might be much worse. All are possibilities in the car chase scenario.

If those jerking motions happened to Okoye faster than she could react and release her shoes, it could be disastrous. So it can’t be a thing she needs to manually control. Which means it needs to some blend of manual, agentive, and assistant. Autonomic, maybe, to borrow the term from physiology?

So…

To really be of help, it has to…

monitor the car’s motion
monitor her center of balance
monitor her intentions
predict the future motions of the cars
handle all the cybernetics math (in the Norbert Wiener sense, not the sci-fi sense)
know when it should just hold her feet in place, and when it should signal for her to take action
know what action she should ideally take, so it knows what to nudge her to do

These are no mean feats, especially in real-time. So, I don’t see any explanation except…

AGI is in the Wakandan arsenal (c.f. Griot helping Ross), so this is credible given the diegesis, but I did not expect to find it in shoes.

An interesting design question is how it might deliver warning signals about predicted motions. Is it tangible, like vibration? Or a mild electrical buzz? Or a writing-to-the-brain urge to move? The movie gives us no clues, but if you’re up for a design challenge, give it a speculative design pass.

Wearable heuristics

As part of my 2014 series about wearable technologies in sci-fi, I identified a set of heuristics we can use to evaluate such things. A quick check against those show that they fare well. The shoes are quite sartorial, and look like shoes so are social as well. As a brain interface, it is supremely easy to access and use. Two of the heuristics raise questions though.

Wearables must be designed so they are difficult to accidentally activate. It would have been very inconvenient for Okoye to find herself stuck to the surface of Wakanda while trying to chase Killmonger later in the film, for example. It would be safer to ensure deliberateness with some mode-confirming physical gesture, but there’s no evidence of it in the movie.
Wearables should have apposite I/O. The soles glow. Okoye doesn’t need that information. I’d say in a combat situation it’s genuinely bad design to require her to look down to confirm any modes of the shoes. They’re worn. She will immediately feel whether her shoes are fixed in place. While I can’t name exactly how an enemy might use the knowledge about whether she is stuck in place or not, but on general principle, the less information we give to the enemy, the safer you’ll be. So if this was real-world, we would seek to eliminate the glow. That said, we know that undetectable interactions are not cinegenic in the slightest, so for the film this is a nice “throwaway” addition to the cache of amazing Wakandan technology.

Black Georgia Matters and Today is the Day

Each post in the Black Panther review is followed by actions that you can take to support black lives.

Today is the last day in the Georgia runoff elections. It’s hard to overstate how important this is. If Ossoff and Warnock win, the future of the country has a much better likelihood of taking Black Lives Matter (and lots of other issues) more seriously. Actual progress might be made. Without it, the obstructionist and increasingly-frankly-racist Republican party (and Moscow Mitch) will hold much of the Biden-Harris administration back. If you know of any Georgians, please check with them today to see if they voted in the runoff election. If not—and they’re going to vote Democrat—see what encouragement and help you can give them.

Some ideas…

Pay for a ride there and back remotely.
Buy a meal to be delivered for their family.
Make sure they are protected and well-masked.
Encourage them to check their absentee ballot, if they cast one, here. https://georgia.ballottrax.net/voter/
If their absentee ballot has not been registered, they can go to the polls and tell the workers there that they want to cancel their absentee ballot and vote in person. Help them know their poll at My Voter Page: https://www.mvp.sos.ga.gov/MVP/mvp.do

This vote matters, matters, matters.

Kimoyo Beads

3 Nov 2020 by Christopher Noessel

One of the ubiquitous technologies seen in Black Panther is the kimoyo bead. They’re liberally scattered all over the movie like tasty, high-tech croutons. These marble-sized beads are made of vibranium and are more core to Wakandan’s lives than cell phones are to ours. Let’s review the 6 uses seen in the film.

1. Contact-EMP bombs

We first see kimoyo beads when Okoye equips T’Challa with a handful to drop on the kidnapper caravan in the Sambisa forest. As he leaps from the Royal Talon, he flings these, which flatten as they fall, and guide themselves to land on the hoods of the caravan. There they emit an electromagnetic pulse that stops the vehicles in their tracks. It is a nice interaction that does not require much precision or attention from T’Challa.

2. Comms

Wakandans wear bracelets made of 11 kimoyo beads around their wrists. If they pull the comms bead and place it in the palm, it can project very lifelike volumetric displays as part of realtime communication. It is unclear why the bead can’t just stay on the wrist and project at an angle to be facing the user’s line of sight, as it does when Okoye presents to tribal leaders (below.)

We see a fascinating interaction when T’Challa and W’Kabi receive a call at the same time, and put their bracelets together to create a conference call with Okoye.

The scaled-down version of the projection introduces many of the gaze matching problems identified in the book. Similarly to those scenes in Star Wars, we don’t see the conversation from the other side. Is Okoye looking up at giant heads of T’Challa and W’Kabi? Unlikely. Wakanda is advanced enough to manage gaze correction in such displays.

Let me take a moment to appreciate how clever this interaction is from a movie maker’s perspective. It’s easy to imagine each of them holding their own bead separately and talking to individual instances of Okoye’s projection. (Imagine being in a room with a friend and both of you are on a group call with a third party.) But in the scene, she turns to address both T’Challa and W’Kabi. Since the system is doing body-and-face gaze correction, the two VP displays would look slightly different, possibly confusing the audience into thinking these were two separate people on the call. Wakandans would be used to understanding these nuances, but us poor non-Wakandan’s are not.

Identical Okoyes ensures (at least) one of the displays is looking at something weird. It’s confusing. — This is confusing.

Having gaze correction so both Okoyes are looking at T’Challa when she’s talking to him makes it look like there are two different characters. It’s confusing. — This is also confusing.

The shared-display interaction helps bypass these problems and make the technology immediately understandable and seamless.

Later Shuri also speaks with Okoye via communication bead. During this conversation, Shuri removes another bead, and tosses it into a display to show an image and dossier of Killmonger. Given that she’s in her lab, it’s unclear why this gesture is necessary rather than, say, just looking toward a display and thinking, “Show me,” letting the AI Griot interpret from the context what to display.

A final communication happens immediately after as Shuri summons T’Challa to the the lab to learn about Killmonger. In this screenshot, it’s clear that the symbol for the comms bead is an asterisk or star, which mimics the projection rats of the display, and so has some nice semantics to help users learning which symbols do what.

3. Presentation

In one scene, Okoye gives the tribe rulers a sitrep using her kimoyo beads as a projector. Here she is showing the stolen Wakandan artifact. Readers of the book will note the appearance of projection rays that are standard sci-fi signals that what is seen is a display. A lovely detail in the scene is how Okoye uses a finger on her free hand to change the “slide” to display Klawe. (It’s hard to see the exact gesture, but looks like she presses the projection bead.) We know from other scenes in the movie that the beads are operated by thought-command. But that would not prevent a user from including gestures as part of the brain pattern that triggers an event, and would make a nice second-channel confirmation as discussed in UX of Speculative Brain-Computer Inputs post.

4. Remote piloting

When T’Challa tours Shuri’s lab, she introduces him to remote access kimoyo beads. They are a little bigger than regular beads and have a flared, articulated base. (Why they can’t just morph mid-air like the ones we see in the kidnapper scene?) These play out in the following scene when the strike team needs to commandeer a car to chase Klawe’s Karavan. Oyoke tosses one on the hood on a parked car, its base glows purple, and thereafter Shuri hops into a vibranium-shaped simulacrum of the car in her lab, and remotely operates it.

A quick note: I know that the purple glow is there for the benefit of the audience, but it certainly draws attention to itself, which it might not want to do in the real world.

In the climactic battle of the tribes with Killmonger, Shuri prints a new bracelet and remote control bead for Agent Ross. She places the bracelet on him to enable him to remote pilot the Royal Talon. It goes by very quickly, and the scene is lit quite sparsely, but the moment she puts it on him, you can see that the beads are held together magnetically.

5. Eavesdropping

When Agent Ross is interrogating the captured Klawe, we get a half-second shot to let us know that a kimoyo bead has been placed on his shoulder, allowing T’Challa, Okoye, and Nakia to eavesdrop on the conversation. The output is deliveredby a flattened bone-conducting speaker bead behind their left hears.

6. Healing

Later in the scene, when Killmonger’s bomb grievously wounds Agent Ross in his spine, T’Challa places one of Nakia’s kimoyo beads onto the wound, stabilizing Ross long enough to ferry him to Wakanda where Shuri can fully tend to him. The wound conveniently happens to be kimoyo-bead sized, but I expect that given its shape-shifting powers, it could morph to form a second-skin over larger wounds.

I wondered if kimoyo beads were just given to Wakandan royalty, but it’s made clear in the scene where T’Challa and Nakia walk through the streets of Birnin Zana that every citizen has a bracelet. There is no direct evidence in the film, but given the pro-social-ness throughout, I want to believe that all citizens have free access to the beads, equipping each of them to participate equitably in the culture.

So, most of the interaction is handled through thought-command with gestural augmentation. This means that most of our usual concerns of affordances and constraints are moot. The one thing that bears some comment is the fact that there are multiple beads on the bracelet with different capabilities. How does a user know which bead does what?

As long as the beads can do their job in place on the wrist, I don’t think it matters. As long as all of the beads are reading the user’s thoughts, only the one that can respond need respond. The others can disregard the input. In the real world you’d need to make sure that one thought isn’t interpretable as multiple things, a problem discussed on my team at IBM as disambiguation. Or if they are you must design an interaction where the user can help disambiguate the input, or tell the system which meaning they intend. We never this edge case in Black Panther.

It seems that some of the beads have specialized functions that cannot be performed by another, each has several symbols engraved into it, the indentions of which glow white for easy identification. The glow is not persistent across all uses, so it must be either context-aware and/or a setting that users can think to change. But even when not lit, the symbols are clear, and clearly distinguishable, so once the user learns the symbols, the labeling should help.

Black Votes Matter

Today is an important day in the United States. It’s election day 2020. Among one of the most important days in U.S. politics, ever. Among Trump’s litany of outrageous lies across his presidency is this whopper: “I have done more for Black Americans than anybody, except for the possible exception of Abraham Lincoln.” (Pause for your spit take and cleaning your screen.)

As infuriating and insulting as this statement is emotionally (like, fuck you for adding “possible” in there, like it’s somehow possible that you’ve done more than freed our black citizens from slavery, you maggot-brained, racist, malignant narccicist) let’s let the Brookings institute break down why, if you believe Black Lives Matter, you need to get out there and vote blue all the way down the ticket.

https://www.cnn.com/2020/11/02/us/ocoee-massacre-100th-anniversary-trnd/index.html

You should read that whole article, but some highlights/reminders

Trump ended racial sensitivity training, and put a ban on trainings that utilize critical race theory
Hate crimes increased over 200% in places where Trump held a campaign rally in 2016
He dismissed the Black Lives Matters movement, said there were “fine people” among white supremacist groups, and rather than condemning the (racist, not gay) Proud Boys, told them to “stand by.”
Not a single one of his 53 confirmed appeals court judges circuit justices is black.
The criminal mishandling of the COVID-19 pandemic has killed twice as many black Americans as it has white Americans. (Don’t forget he fired the pandemic response team.)

If you are reading this on election day, and have not already done so, please go vote blue. Know that if you are in line even when the polls officially closed, they have to stay open for the entire line to vote. If you have voted, please help others in need. More information is below.

If you are reading this just after election day, we have every evidence that Trump is going to try and declare the election rigged if he loses (please, please let it be when he loses to a massive blue waver). You can help set the expectation among your circle of friends, family, and work colleagues that we won’t know the final results today. We won’t know it tomorrow. We may have a better picture at the end of the week, but it will more likely take until late November to count everyone’s vote, and possibly until mid December to certify everyone’s vote.

And that’s what we do in a liberal democracy. We count everyone’s vote, however long that takes. To demand it in one day during a pandemic is worse than a toddler throwing a “I want it now” tantrum. And we are so very sick of having a toddler in this position.

Trivium Bracelet

12 Feb 2019 by Christopher Noessel

The control token in Las Luchadras is a bracelet that slaps on and instantly renders its wearer an automaton, subject to the remote control.

Here’s something to note about this speculative technology. Orlak could have sold this, just this, to law enforcement around the world and made himself a very rich and powerful person. But the movie makes clear he is a mad engineer, not a mad businessperson, so we have to move on.

From Orlak’s point of view, getting the bracelet on its victim should be very easy. Fortunately, it does just that. Orlak can slap it on in a flick. But it’s also trivially easy for a bystander to remove, which seems like…a design oversight. It should work more like a handcuff, that requires a key to remove. It can’t look like a handcuff, of course, since Orlak wants it to go unnoticed. But in addition to the security, the handcuff function would enable the device to fit wrists of many sizes. As it is, it appears to be tailor-made to an individual.

As the diagram illustrates, not all wrists are made the same, and it would not help Orlak to have to carry around a sizing set when he hasn’t had time to secretly get the victim’s measurements.

From http://oai.dtic.mil/oai/oai?verb=getRecord&metadataPrefix=html&identifier=ADA209600

Lastly, the audience might have benefited from seeing some visual connection between the bracelet and the remote, like a shared material that had an unusual color or glow, but Orlak would not want this connection since it could help someone identify him as the controller.

The Cloak of Levitation, Part 2: Could it ever work?

6 Jul 2017 by Christopher Noessel

How could this work as technology instead of magic?

In the prior post I looked at the Cloak as a bit of wearable technology. Today let’s ask ourselves how possible this is in the real world.

The abilities of the Cloak listed in the first post imply a great deal of functionality: Situational awareness, lightning fast thinking, precision actuators throughout its fabric, gravity controls for itself and its wearer, goal awareness, knowledge of the world. Some of these aren’t going to happen, but some are conceivable over time.

Parts of it are conceivable over time

Continue reading →

The Cloak of Levitation, Part 1: An overview

27 Jun 2017 by Christopher Noessel

When Dr. Strange visits the New York Sanctum for the first time, he passes by a vitrine in which a lush red cape hovers in midair. It’s the Cloak of Levitation, and in this moment it chooses Strange. We see many of its functions throughout the movie.

Functions

When the glass of the vitrine is broken and Kaecilius stabs at Strange with a Soul Sword, the Cloak reaches out with a corner and stays Kaecilius’ hand to save Strange.
When Kaecilius knocks Strange down a stairwell, the Cloak chases him, catches him, and floats him back up to the fight. (See above.)
Attached by two fibulae to his surcoat, it can pull him, physically, and does so several times for different reasons:
- to get him out of the first fight with Kaecilius
- to help him dodge the soul sword
- to keep him from grabbing ineffective weapons, pointing him instead to the more effective Crimson Bands of Cyttorak
Unbidden, the Cloak wraps itself around the head of one of Kaecilius’ zealots, drags him around, and slams his head into the walls and floor until the zealot is dead. (Even though, for the entire end of the fight, Strange is across town getting medical attention.) After the combat, the Cloak hovers next to the dead zealot, perhaps keeping watch.
After Strange tells Christine goodbye in the surgical prep room, the Cloak gently floats itself into place and uses the corner of its popped collar to remove blood from Strange’s face, to his annoyance. He tells it to, “Stop!” and it relaxes.
It pulls him out of the path of some flying debris while time is reversed before the Hong Kong Sanctum, and defends him from a punch later in the same sequence.
He uses it to fly through the portal into the Dark Dimension to face Dormammu.
It dons itself in the Kamar-Taj, brusquely enough to cause Strange to catch his balance.

The Cloak is like a guardian angel. Or maybe a super-familiar, in the wizard sense. It keeps an eye out for Strange. It is able to predict, protect, crudely inform, and, not least, fly. It acts as both an assistant and an agent. (More on this later) Continue reading →

Night Vision Goggles

6 Jul 2015 by claytonbeese

Genarro: “Are they heavy?”
Excited Kid: “Yeah!”
Genarro: “Then they’re expensive, put them back”
Excited Kid: [nope]

The Night Vision Goggles are large binoculars that are sized to fit on an adult head. They are stored in a padded case in the Tour Jeep’s trunk. When activated, a single red light illuminated in the “forehead” of the device, and four green lights appear on the rim of each lens. The green lights rotate around the lens as the user zooms the binoculars in and out. On a styling point, the goggles are painted in a very traditional and very adorable green and yellow striped dinosaur pattern.

Tim holds the goggles up as he plays with them, and it looks like they are too large for his head (although we don’t see him adjust the head support at all, so he might not have known they were adjustable). He adjusts the zoom using two hidden controls—one on each side. It isn’t obvious how these work. It could be that…

There are no controls, and it automatically focuses on the thing in the center of the view or on the thing moving.
One side zooms in, and the other zooms out.
Both controls have a zoom in/zoom out ability.
Each side control powers its own lens.
Admittedly, the last option is the least likely.

Unfortunately the movie just doesn’t give us enough information, leaving it as an exercise for us to consider.