Trivium remotes

Once a victim is wearing a Trivium Bracelet, any of Orlak’s henchmen can control the wearer’s actions. The victim’s expression is blank, suggesting that their consciousness is either comatose, twilit, or in some sort of locked in state. Their actions are controlled via a handheld remote control.

We see the remote control in use in four places in Las Luchadoras vs El Robot Asesino.

  1. One gets clapped on Dr. Chavez to test it.
  2. One goes on Gemma to demonstrate it.
  3. One is removed from the robot.
  4. One goes on Berthe to transform her to Black Electra.
Continue reading

The Cookie: Matt’s controls

When using the Cookie to train the AI, Matt has a portable translucent touchscreen by which he controls some of virtual Greta’s environment. (Sharp-eyed viewers of the show will note this translucent panel is the same one he uses at home in his revolting virtual wingman hobby, but the interface is completely different.)

Black_Mirror_Cookie_18.png

The left side of the screen shows a hamburger menu, the Set Time control, a head, some gears, a star, and a bulleted list. (They’re unlabeled.) The main part of the screen is a scrolling stack of controls including Simulated Body, Control System, and Time Adjustment. Each has an large icon, a header with “Full screen” to the right, a subheader, and a time indicator. This could be redesigned to be much more compact and context-rich for expert users like Matt. It’s seen for maybe half a second, though, and it’s not the new, interesting thing, so we’ll skip it.

The right side of the screen has a stack of Smartelligence logos which are alternately used for confirmation and to put the interface to sleep.

Mute

When virtual Greta first freaks out about her circumstance and begins to scream in existential terror, Matt reaches to the panel and mutes her. (To put a fine point on it: He’s a charming monster.) In this mode she cannot make a sound, but can hear him just fine. We do not see the interface he uses to enact this. He uses it to assert conversational control over her. Later he reaches out to the same interface to unmute her.

The control he touches is the one on his panel with a head and some gears reversed out of it. The icon doesn’t make sense for that. The animation showing the unmuting shows it flipping from right to left, so does provide a bit of feedback for Matt, but it should be a more fitting icon and be labeled.

Cookie_mute
Also it’s teeny tiny, but note that the animation starts before he touches it. Is it anticipatory?

It’s not clear though, while she is muted, how he knows that she is trying to speak. Recall that she (and we) see her mouthing words silently, but from his perspective, she’s just an egg with a blue eye. The system would need some very obvious MUTE status display, that increases in intensity when the AI is trying to communicate. Depending on how smart the monitoring feature was, it could even enable some high-intensity alert system for her when she needs to communicate something vital. Cinegenically, this could have been a simple blinking of the blue camera light, though this is currently used to indicate the passage of time during the Time Adjustment (see below.)

Simulated Body

Matt can turn on a Simulated Body for her. This allows the AI to perceive herself as if she had her source’s body. In this mode she perceives herself as existing inside a room with large, wall-sized displays and a control console (more on this below), but is otherwise a featureless white.

Black_Mirror_Cookie_White_Room.png

I presume the Simulated Body is a transitional model—part of a literal desktop metaphor—meant to make it easy for the AI (and the audience) to understand things. But it would introduce a slight lag as the AI imagines reaching and manipulating the console. Presuming she can build competence in directly controlling the technologies in the house, the interface should “scaffold” away and help her gain the more efficient skills of direct control, letting go of the outmoded notion of having a body. (This, it should be noted, would not be as cinegenic since the story would just feature the egg rather than the actor’s expressive face.)

Neuropsychology nerds may be interested to know that the mind’s camera does, in fact, have spatial lags. Several experiments have been run where subjects are asked to imagine animals as seen from the side and then timed how long it took them to imagine zooming into the eye. It takes longer, usually, for us to imagine the zoom to a elephant’s eye than a mouse’s because the “distance” is farther. Even though there’s no physicality to the mind’s camera to impose this limit, our brain is tied to its experience in the real world.

Black_Mirror_Cookie_Simulated_Body.png

The interface Matt has to turn on her virtual reality is confusing. We hear 7 beeps while the camera is on his face. He sees a 3D rendering of a woman’s body in profile and silhouette. He taps the front view and it fills with red. Then he taps the side view and it fills with red. Then he taps some Smartelligence logos on the side with a thumb and then *poof* she’s got a body. While I suspect this is a post-actor interface, (i.e. Jon Hamm just tapped some things on an empty screen while on camera and then the designers had to later retrofit an interface that fit his gestures) this multi-button setup and three-tap initialization just makes no sense. It should be a simple toggle with access to optional controls like scaffolding settings (discussed above.)

Time “Adjustment”

The main tool Matt has to force compliance is a time control. When Greta initially says she won’t comply, (specifically and delightfully, she asserts, “I’m not some sort of push-button toaster monkey!”) Then he uses his interface to make it seem like 3 weeks pass for her inside her featureless white room. Then again for 6 months. The solitary confinement makes her crazy and eventually forces compliance.

Cookie_settime.gif

The interface to set the time is a two-layer virtual dial: Two chapter rings with wide blue arcs for touch targets. The first time we see him use it, he spins the outer one about 360° (before the camera cuts away) to set the time for three weeks. While he does it, the inner ring spins around the same center but at a slower rate. I presume it’s months, though the spatial relationship doesn’t make sense. Then he presses the button in the center of the control. He sees an animation of a sun and moon arcing over an illustrated house to indicate her passage of time, and then the display. Aside: Hamm plays this beat marvelously by callously chomping on the toast she has just help make.

Toast.gif

Improvements?

Ordinarily I wouldn’t speak to improvements on an interface that is used for torture, but as this could only affect a general AI that is as yet speculative, and it couldn’t be co-opted to torture real people since time travel doesn’t exist, so I think this time it’s OK. Discussing it as a general time-setting control, I can see three immediate improvements.

1. Use fast forward models

It makes most sense for her time sentence to end automatically and automatically return to real-world speed. But each time we see the time controls used, the following interaction happens near the end of the time sentence:

  • Matt reaches up to the console
  • He taps the center button of the time dial
  • He taps the stylized house illustration. In response it gets a dark overlay with a circle inside of it reading “SET TIME.” This is the same icon seen 2nd down  in the left panel.
  • He taps the center button of the time dial again. The dark overlay reads “Reset” with a new icon.
  • He taps the overlay.

Please tell me this is more post-actor interface design. Because that interaction is bonkers.

Cookie_stop.gif

If the stop function really needs a manual control, well, we have models for that that are very readily understandable by users and audiences. Have the whole thing work and look like a fast forward control rather than this confusing mess. If he does need to end it early, as he does in the 6 months sentence, let him just press a control labeled PLAY or REALTIME.

2. Add calendar controls

A dial makes sense when a user is setting minutes or hours, but a calendar-like display should be used for weeks or months. It would be immediately recognizable and usable by the user and understandable to the audience. If Hamm had touched the interface twice, I would design the first tap to set the start date and the second tap to set the end date. The third is the commit.

3. Add microinteraction feedback

Also note that as he spins the dials, he sees no feedback showing the current time setting. At 370° is it 21 or 28 days? The interface doesn’t tell him. If he’s really having to push the AI to its limits, the precision will be important. Better would be to show the time value he’s set so he could tweak it as needed, and then let that count down as time remaining while the animation progresses.

Cookie_settime.gif

Effectiveness subtlety: Why not just make the solitary confinement pass instantly for Matt? Well, recall he is trying to ride a line of torture without having the AI wig out, so he should have some feedback as to the duration of what he’s putting her through. If it was always instant, he couldn’t tell the difference between three weeks and three millennia, if he had accidentally entered the wrong value. But if real-world time is passing, and it’s taking longer than he thinks it should be, he can intervene and stop the fast-forwarding.

That, or of course, show feedback while he’s dialing.

Near the end of the episode we learn that a police officer is whimsically torturing another Cookie, and sets the time-ratio to “1000 years per minute” and then just lets it run while he leaves for Christmas break. The current time ratio should also be displayed and a control provided. It is absent from the screen.

Black_Mirror_Cookie_31.png

Add psychological state feedback

There is one “improvement” that does not pertain to real world time controls, and that’s the invisible effect of what’s happening to the AI during the fast forward. In the episode Matt explains that, like any good torturer, “The trick of it is to break them without letting them snap completely,” but while time is passing he has no indicators as to the mental state of the sentience within. Has she gone mad? (Or “wigged out” as he says.) Does he need to ease off? Give her a break?

I would add trendline indicators or sparklines showing things like:

  • Stress
  • Agitation
  • Valence of speech

I would have these trendlines highlight when any of the variables are getting close to known psychological limits. Then as time passes, he can watch the trends to know if he’s pushing things too far and ease off.

Tibet mode: Display for interestingness (2 of 5)

Without a display, the Eye asks Strange to do all the work of exploring the range of values available through it to discover what is of interest. (I am constantly surprised at how many interfaces in the real world repeat this mistake.) We can help by doing a bit of “pre-processing” of the information and provide Strange a key to what he will find, and where, and ways to recover exactly where interesting things happen.

watch.png
The watch from the film, for reasons that will shortly become clear.

To do this, we’ll add a ring outside the saucer that will stay fixed relative to the saucer’s rotation and contain this display. Since we need to call this ring something, and we’re in the domain of time, let’s crib some vocabulary from clocks. The fixed ring of a clock that contains the numbers and minute graduations is called a chapter ring. So we’ll use that for our ring, too.

chapter-rings.png

What chapter ring content would most help Strange?

Good: A time-focused chapter ring

Both the controlled-extents and the auto-extents shown in the prior post presume a smooth display of time. But the tome and the speculative meteorite simply don’t change much over the course of their existence. I mean, of course they do, with the book being pulled on and off shelves and pages flipped, and the meteorite arcing around the sun in the cold vacuum of space for countless millennia, but the Eye only displays the material changes to an object, not position. So as far as the Eye is concerned, the meteoroid formed, then it stays the same for most of its existence, then it has a lot of activity as it hits Earth’s atmosphere and slams into the planet.

A continuous display of the book shows little of interest for most of its existence, with a few key moments of change interspersed. To illustrate this, lets make up some change events for the tome.

Eye-of-Agamotto-event-view.png

Now let’s place those along an imaginary timeline. Given the Doctor Strange storyline, Page Torn would more likely be right next to Now, but making this change helps us explore a common boredom problem, see below. OK. Placing those events along a timeline…

Eye-of-Agamotto-time-view.png

And then, wrapping that timeline around the saucer. Much more art direction would have to happen to make this look thematically like the rest of the MCU magic geometries, but following is a conceptual diagram of how it might look.

Eye-of-Agamoto-dial.png
With time flowing smoothly, though at different speeds for the past and the future.

On the outside of the saucer is the chapter ring with the salient moments of change called out with icons (and labels). At a glance Strange would know where the fruitful moments of change occur. He can see he only has to turn his hand about 5° to the left to get to the spot where the page was ripped out.

Already easier on him, right? Some things to note.

  1. The chapter ring must stay fixed relative to the saucer to work as a reference. Imagine how useless a clock would be if its chapter ring spun in concert with any of its hands. The center can still move with his palm as the saucer does.
  2. The graduations to the left and right of “now” are of a different density, helping Strange to understand that past and future are mapped differently to accommodate the limits of his wrist and the differing time frames described.
  3. When several events occur close together in time, they could be stacked.
  4. Having the graduations evenly spaced across the range helps answer roughly when each change happened relative to the whole.
  5. The tome in front of him should automatically flip to spreads where scrubbed changes occur, so Strange doesn’t have to hunt for them. Without this feature, if Strange was trying to figure out what changed, he would have to flip through the whole book with each degree of twist to see if anything unknown had changed.

Better: A changes-focused chapter ring

If, as in this scene, the primary task of using the Eye is to look for changes, a smooth display of time on the chapter ring is less optimal than a smooth display of change. (Strange doesn’t really care when the pages were torn. He just wants to see the state of the tome before that moment.) Distribute the changes evenly around the chapter ring, and you get something like the following.

Eye-of-Agamoto-event.png

This display optimizes for easy access to the major states of the book. The now point is problematic since the even distribution puts it at the three o’clock point rather than the noon, but what we buy in exchange is that the exact same precision is required to access any of the changes and compare them. There’s no extra precision needed to scrub between the book made and the first stuff added moments. The act of comparison is made simpler. Additionally, the logarithmic time graduations help him scrub detail near known changes and quickly bypass the great stretches of time when nothing happens. By orienting our display around the changes, the interesting bits are made more easy to explore, and the boring bits are more easy to bypass.

In my comp, more white areas equal more time. Unfortunately, this visual design kind of draws attention to the empty stretches of time rather than the moments of change, so would need more attention; see the note above about needing a visual designer involved.

So…the smooth time and the distributed events display each has its advantages over the other, but for the Tibet scene, in which he’s looking to restore the lost pages of the tome, the events-focused chapter ring gets Strange to the interesting parts more confidently.


Note that all the events Strange might be scrubbing through are in the past, but that’s not all the Eye can do in the Tibet mode. So next up, let’s talk a little about the future.

R. S. Revenge Comms

Note: In honor of the season, Rogue One opening this week, and the reviews of Battlestar Galactica: The Mini-Series behind us, I’m reopening the Star Wars Holiday Special reviews, starting with the show-within-a-show, The Faithful Wookie. Refresh yourself of the plot if it’s been a while.

Faithful-Wookiee-02

On board the R.S. Revenge, the purple-skinned communications officer announces he’s picked up something. (Genders are a goofy thing to ascribe to alien physiology, but the voice actor speaks in a masculine register, so I’m going with it.)

faithful-wookiee-01-surrounds

He attends a monitor, below which are several dials and controls in a panel. On the right of the monitor screen there are five physical controls.

  • A stay-state toggle switch
  • A stay-state rocker switch
  • Three dials

The lower two dials have rings under them on the panel that accentuate their color.

Map View

The screen is a dark purple overhead map of the impossibly dense asteroid field in which the Revenge sits. A light purple grid divides the space into 48 squares. This screen has text all over it, but written in a constructed orthography unmentioned in the Wookieepedia. In the upper center and upper right are unchanging labels. Some triangular label sits in the lower-left. In the lower right corner, text appears and disappears too fast for (human) reading. The middle right side of the screen is labeled in large characters, but they also change too rapidly to make much sense of it.

revengescreen Continue reading

Lumpy’s Brilliant Cartoon Player

I am pleased to report that with this post, we are over 50% of the way through this wretched, wretched Holiday Special.

SWHS-Cartoon-Player-07

Description

After Lumpy tries to stop stormtroopers from going upstairs, an Imperial Officer commands Malla to keep him quiet. To do so, she does what any self-respecting mother of a pre-teen in the age of technology does, and sits him down to watch cartoons. The player is a small, yellow device that sits flat on an angled tabletop, like a writing desk.

Two small silver buttons stack vertically on the left, and an upside down plug hole strainer on the right. A video screen sits above these controls. Since no one in the rest of his family wants to hear the cartoon introduction of Boba Fett, he dons a pair of headphones, which are actually kind of stylish in that the earpieces are square and perforated, but not beveled. There are some pointless animations that start up, but then the cartoon starts and Lumpy is, in fact, quiet for the duration. So, OK, point one Malla.

SWHS-Cartoon-Player-08

Why no budding DJ has glommed onto this for an album cover is beyond me.

Analysis

Continue reading

Is serial presentation a problem in The Circuit?

serial

In the prior post I described the wonky sex teleporter known as The Circuit and began a critique. Today I go deep into a particular issue to finish the critque.

We only see Logan encounter two riders when using The Circuit, but we can presume that there are a lot of people on there. Why does it only show Logan a single choice at a time? If he actually has, say, 12 candidates that are a match, a serial presentation like this puts a significant burden on his memory. Once he gets to #12 and thinks he’s seen enough candidates, was it #3 or #5 he liked best?

The serial presentation also looks like it might make extra work. If he gets to #12 and decides he was most fond of #2, does he have to jump back through 10 people to get there? What does he say to each of them in turn? Does he have to reject them each again? How awkward is that? If not, and he can jump back to #2, what’s the control for that? Does he have to remember what station they were on and retune them in again? Continue reading

The Circuit

LogansRun073

One of my favorite interfaces in Logan’s Run is one of the worst in the survey. It’s called The Circuit, and it’s a system for teleporting partners for casual sex right into your living room. ZOMGEVERYBODYSIGNUP.

Credit where it’s due: I first explored this interface in Issue 04 of Raymond Cha’s awesome print zine FAQNP in 2012. I’m going to go into even more nerdly depth on some of the topics here, but it was in that publication that I first got riled up about it. If you want to read those thoughts, you’ll need to go find a back issue and you totally should because the whole zine rocks.

Anyway, this interface is such a hot, hot mess that I have to break it up into a couple of posts. This first one is a description and the first part of a critique. Continue reading

Mangalore Bomb

TheFifthElement-MangaloreBomb-005

Sadly for Zorg, just after he deactivates his bomb, a fallen Mangalore warrior remotely activates his own bomb in Plavalaguna’s suite. The remote control is made from a combination lock. The Mangalore twists the dial to the right numbers, and on reaching the last number, a red LED lights in the center. In the diva’s suite, the box that secretly housed the bomb opens, and the bomb rises like a small metallic ziggurat, accentuated in places with red LEDs. A red, 7-segment countdown timer begins ticking down its final 5 seconds.

Aggression

Mangalores are warlike, as in they really like war. They breathe war. They sleep war. They eat war for breakfast, then poop war, then root around in their couches for war scraps and snack on that. The detonation device isn’t very sophisticated, and that’s just fine by Mangalores. If a Mangalore declared a Design major instead of War in college, they’d have been killed on the spot. This device is perfect for a species that just wants to grab something cheap and convenient, make a few modifications, and get to the boom.

We don’t see a deactivation mechanism. And while you can imagine that a nice safety would be to deactivate if the dial drifted more than, say, 5 clicks from the final activation number, Mangalores wouldn’t have it. They’d “liberate” your mother’s homeland merely for having suggesting it.

If I had to improve it in any way, it’s that it places a burden on memory, and there’s not a lot of indication that Mangalores excel in the thinking skills department, c.f. warlike. Do they have the capacity to memorize a series of numbers in order? And it is easy to recall the series in the middle of a war zone? If not, what would be better? They have their weapons with them nearly at all times, so how about a little glowing, red button on the forestock?

Ha. Joke’s on you, Mangalores. As we know from earlier in the movie, you couldn’t resist pressing it, long before you made it to ocean liners. I think if you’re that warlike and stupid, this would be best for everyone.

TheFifthElement-MangaloreBomb-007

The Positronic Ray

Barbarella-136

To combat the Resistance uprising, Durand-Durand unleashes his dread Positronic Ray. To control it, he approaches a high backed chair and touches a spot on the back. The curved tip of the chair extends upwards a bit allowing him to sit down. As soon as he sits, the tip retracts to rest just above his head and the video panel slides close to him. The ray itself is mounted on a two-axis swivel just behind him, with the barrel pointing out of a horizontal window.

The interface consists of a complex array of transparent knobs mounted on a glowing flat panel, set beneath a large rectangular video screen. While he is using the weapon, we see his hands twiddling some of the shapes clockwise and counterclockwise.

Barbarella-139

The chair interface seems fine, if technically unnecessary, giving the gunner a small ritual feeling of power. The weapons interface, on the other hand, is a disaster. It has around 50 visible controls, none labeled for what they control or their extents, none have the slightest ergonomic consideration, and few are differentiated from the others in shape or placement. Also they’re all transparent, so add a lot of visual noise to the difficultly of use.

From his video screen we can tell that there are only a number of things to control: target (coupled to the camera), beam size (coupled to the camera zoom), and a trigger. Control for these simple variables could be accomplished with a joystick for targeting, a thumb button for triggering, and a slider at his left hand for zoom/beam size. Three controls which Durand-Durand could really think of as two.

Additionally, the screen only shows him what he’s currently focused on, failing to grant any of the field awareness that he’d need to keep the enemy at bay. Ultimately it’s a weapons interface that only a pacifist could love. Admittedly, he’s a mad engineer, and not a mad interaction designer, so maybe it’s just his insanity that explains this fiddly spread of extraneous controls with poor mapping and myopic feedback.

I’d love to credit this bad interface with saving the people of the city of SoGo, but unfortunately if its destruction hadn’t come from the Positronic Ray, it would have come from being swallowed by the Mathmos. Ultimately, they were doomed.

SoGo, destroyed

The Queen’s TV

Barbarella-123 Barbarella-125

As soon as the Black Queen hears of Durand-Durand’’s betrayal, she reveals a panel that is hidden by furs. It is vertical with a handful of transparent, organically-shaped knobs. She clicks the top one out of its off position and rotates it back and forth a few times, and the panel begins to glow as a video image appears on the high walls of the chamber, showing the events happening inside the throne room.

Barbarella-127Barbarella-128

Later the Queen turns the top knob counterclockwise to click it back into its stop position to stop the video feed. Then she turns another one the same direction to reveal a different video feed of the labyrinth, indicating that each knob is connected to a particular view. There’s indirect evidence that the degree of rotation controls the volume of audio.

Typically remotes have separate controls for power, channel selection, and volume. Coupling them like this adds extra work to the task of switching channels. The Dark Queen has to turn one off before turning the next one on, and readjust the volume each time. If switching channels is something she does regularly, that’s going to be a pain. But if the large screen can display more than one video feed at a time, automatically diving the screen real estate equally to accomodate the multiple views, these controls make a lot of sense, even allowing her to set the volume per feed to a sensible level.

Multiple-feeds

The only thing that might improve the interface is some label to know which control displays which video feed. Seeing as how they’re translucent, I’d suggest coating them with a rear projection film and piping the video feed directly onto the button from beneath. That provides a direct mapping from the control to the display, and a glanceable preview to let the Dark Queen what might be interesting to watch in the first place.

Control