Zed-Eyes: Block

A function that is very related to the plot of the episode is the ability to block someone. To do this, the user looks at them, sees a face-detection square appear (confirming the person to be blocked), selects BLOCK from the Zed-Eyes menu, and clicks.

In one scene Matt and his wife Claire get into a spat. When Claire has enough, she decides to block Matt. Now Matt gets blurred and muted for Claire, but also the other way around: Claire is blurred and muted for Matt.

WhiteChristmas.gif

The blur is of the live image of the person within their own silhouette. (The silhouettes sometimes display a lovely warm-to-the-left and cool-to-the-right fringe effects, like subpixel antialiasing or chromatic aberration from optical lenses, I note, but it appears inconsistently.) The colors in the blur are completely desaturated to tones of gray.  The human behind it is barely recognizable. His or her voice is also muffled, so only the vaguest sense of the volume and emotional tone of what they are saying is audible. Joe explains in the episode that once blocked, the blocked person can’t message or call the blocker, but the blocker can message the blocked person, and undo the block.

Black_Mirror_Eye_HUD_Blocking_04

Late in the episode, we see that people can be excommunicated from society for crimes. When this happens, everyone in the criminal’s sight is blocked.

Black_Mirror_Eye_HUD_Blocking_13
But where is the fringe tint, Painting Practice?

In turn, the criminal is not only blocked for other members of society, but also tinted red, like a scarlet letter silhouette.

Black_Mirror_Eye_HUD_red.png

The block affects more than just the direct observation of the person. When Beth blocks Joe we see that the blocking includes reflections in mirrors and even, retroactively, photos from the past.

Joe subsequently stalks Beth at her Dad’s home for several years just before Christmas day, where he learns that the block extends to offspring as well, as he cannot see the child. (This has fundamental plot implications, btw.)

Later when Joe is watching the news he learns that Beth has died in a rail crash, and the legal block is instantly lifted for both her and the child.

Black_Mirror_Eye_HUD_Blocking_17

Analysis

There’s not much to say about the interface. It’s pretty clean, with clear affordances and feedback. Most of the critique belongs to that of the platform. So instead, let’s talk about the interaction.

On the surface, the ability to block seems to positively give the user control of their lives. Block out a toxic person who is a negative influence your life, and have more happiness. After all, similar features are available on most social media today, c.f. Facebook and Twitter. (Full disclosure: I’ve used them more than once.) But social media are virtual spaces. The White Christmas block primarily plays out in meat space. This has some harsh consequences.

Black_Mirror_Eye_HUD_Blocking_beg.png

Beth blocks Joe partly out of her guilt for cheating on him (it’s complicated: also because she no longer loves him, he’s ham-handed in his interactions at times and arguably abusive). But when he tries to earnestly apologize and make up to her after their fight, she simply can’t hear it. She’s blocked him.

He thinks to talk to some of her coworkers to pass a message to her, but she has left her job and no one knows where she is. He sees her one day and can tell by silhouette that she’s pregnant. He believes the child is his. It’s not, but because he cannot contact her to learn any differently (and she doesn’t bother to tell him)—and the same block prevents him from observing the child—he spends literally years pining for the child as if she was his own.

Black_Mirror_Eye_HUD_Blocking_preggers.png

So to block someone online means they might just disappear from your consciousness. But to block someone in meat space means that they’re still there, you’re still aware of each other. It’s a constant reminder of the broken relationship, and only stops immediate layers of communication. It does not stop indirect communications, like writing, or speaking through friends, or even sign language. And as we see in the episode (and the screen cap above) since it’s so different than anything else in the visual field, it instantly draws attention to the blocked person. So it’s ultimately ineffective for the blocker’s intent (the person can still communicate with them, attention is drawn to them) and adds this weird layer of technological talk-to-the-hand dismissal. It’s a childish way to address disagreement.

Also is there no request for override, in case, you know, a blocked person needs to convey life-or-death information?

And then there’s Matt’s case.

After Matt gets excommunicated, he becomes nothing but a red object in people’s sight. No way for him to reassure people around him, to put them at ease. He is just a red shape subject to people’s worst prejudices about red shape people, and he has no way to practice reintegration into society, no easy rehabilitation. He just has to walk around in the world aware of people, but not able to participate, and subject to their worst fears about him. It’s pure punishment. It’s cruel and unusual.

And lastly, the rush of emotions that Joe feels when Beth and his daughter are suddenly unblocked upon her death work for the story, but are also just cruel for the blocked. They have to deal with both the flood of emotions from seeing the blocker and their death simultaneously. Better would be to separate out those issues. Share a somber message that a blocker has passed, and give the blocked the option to release the block. The blocked can enact the lift immediately or sit on the message until their grief permits.

***

Black Mirror is an investigation and critique of the impact of technology on our lives. Let’s remember that. A tech that was a net positive might not even make it to this series. Still, the design for the block doesn’t really achieve what might seem to be a presumed set of goals for the blocker. This draws critical attention back to the core idea in the first place: Would meatspace blocking be a positive?

I think the answer is clearly no. Better would be for Zed-Eyes to summon a private assistant to help you de-escalate and deal with a conflict in healthy ways, or maybe invoke a shared AI mediator, like a just-in-time therapist. If the assistant or mediatior fails, then blocking might become available, but with a shared understanding and agreement of why, and what, if anything, could be done to earn back trust.

Black_Mirror_Eye_HUD_Blocking_comp
Lovely “mediation” icon by Luis Prado, from The Noun Project.

And then, if a block is actually needed, then the two should have overlays that change their appearance to look like other people, not draw attention through the gray blur. This, it should be noted, would not be cinegenic. It would not work to tell this excellent story.

And if it needs to be said, any criminal sentence that merely punishes, and does not foster rehabilitation is counter-productive and inhumane.

Zed-Eyes

In the world of “White Christmas”, everyone has a networked brain implant called Zed-Eyes that enables heads-up overlays onto vision, personalized audio, and modifications to environmental sounds. The control hardware is a thin metal circle around a metal click button, separated by a black rubber ring. People can buy the device with different color rings, as we see alternately see metal, blue, and black versions across the episode.

To control the implant, a person slides a finger (thumb is easiest) around the rim of a tiny touch device. Because it responds to sliding across its surface, let’s say the device must use a sensor similar to the one used in The Entire History of You (2011) or the IBM Trackpoint,

A thumb slide cycles through a carousel menu. Sliding can happen both clockwise and counterclockwise. It even works through gloves.

HUD_menu.gif

The button selects or executes the selected action. The complete list of carousel menu options we see in the episode are: SearchCameraMusicMailCallMagnifyBlockMapThe particular options change across scenes, so it is context-aware or customizable. We will look at some of the particular functions in later posts. For now, let’s discuss the “platform” that is Zed-eyes.

Analysis

There’s not much to discuss about the user interface. The carousel a mature, if constrained, interface model familiar to anyone who has used an iPod. We know the constraints and benefits of such a system, and the Zed-Eyes content seems to fit this kind of interface well.

Hardware

The main question about the hardware is that is must be very very easy to lose or misplace. It would make sense for the Zed-Eyes to help you locate it when you need help, but we don’t see a hint of this in the show.

I think the little watch-battery form factor is a bad design. It’s easy to lose and hard to find and requires a lot of precision to use. Since this exists in a world with very high fidelity image recognition and visual processing, better would be to get rid of input hardware altogether.

Let the user swipe with their thumb across their index finger (or really, any available surface) and have the HUD read that as input. To distinguish real-world interactions that should not have consequence—like swiping dust off a computer—from input meant for the HUD, it could track the user’s visual focal point. When the user’s eyes focus on the empty space in the air right above where they’re swiping, the system knows swiping is meant to affect the interface.

With this kind of interaction there would be no object to lose, and of course save whatever entity provides this service the costs of the hardware and maintenance.

We must note that such a design might not play well cinematically, as viewers might not understand what was happening at first, but understanding the hardware is not critical to understanding the plot-critical effects of using the technology.

Cyborgs in social space

A last question is about the invisibility of the technology. This can cause problems when a user is known to be hearing, but functionally deaf because they are listening to music loudly, and the people around them can’t tell that. Someone could be speaking to the user and believe their non-response is disrespect. It could cause safety problems as, say, a bicyclist barrels towards them on a sidewalk, ringing their bell, expecting the user to move. This can allow privacy abuse as a user can take pictures in circumstances that should be private.

Joe, the moment he is taking a picture of Beth.

One solution would be to make the presence of the tech and interactions quite visible. Glowing pupils and large, obvious gestural control, for example. But in a world where everyone has the technology, the Zed-Eyes can simply limit the behavior of photographs to permitted places, times, and according to the preferences of the people in the photograph. If someone is listening to music and functionally deaf, a real time overlay could inform people around them. This guy is listening to music. If a place is private, the picture option could be disabled with feedback to the user of this. Sorry, pictures are not allowed here.

The visibility we want for ubiquitous technology can be virtual, and provide feedback to everyone involved.

Remote wingman via EYE-LINK

EYE-LINK is an interface used between a person at a desktop who uses support tools to help another person who is live “in the field” using Zed-Eyes. The working relationship between the two is very like Vika and Jack in Oblivion, or like the A.I. in Sight.

In this scene, we see EYE-LINK used by a pick-up artist, Matt, who acts as a remote “wingman” for pick-up student Harry. Matt has a group video chat interface open with paying customers eager to lurk, comment, and learn from the master.

Harry’s interface

Harry wears a hidden camera and microphone. This is the only tech he seems to have on him, only hearing his wingman’s voice, and only able to communicate back to his wingman by talking generally, talking about something he’s looking at, or using pre-arranged signals.

image1.gif
Tap your beer twice if this is more than a little creepy.

Matt’s interface

Matt has a three-screen setup:

  1. A big screen (similar to the Samsung Series 9 displays) which shows a live video image of Harry’s view.
  2. A smaller transparent information panel for automated analysis, research, and advice.
  3. An extra, laptop-like screen where Matt leads a group video chat with a paying audience, who are watching and snarkily commenting on the wingman scenario. It seems likely that this is not an official part of the EYE-LINK software.
image55.png
image47.png
image28.png
Please make a note of the hilarious and condemning screen names of the peanut gallery: Pie Ape, Popkorn, El Nino, Nixon, Fappucino [sic], Stingray, I_AM_WALDO, and Wigwam.

Harry communicates to Matt by speaking or enacting a crude sign language for the video camera. Matt communicates back to Harry using an audiolink through a headset. Setting up the connection is similar to Skype/Hangouts (even featuring an icon of an archaic laptop.) Every first-person EYE-LINK view is characterized by a pixelated gradient at the sides of the screen.

Matt’s wingman support tools

We see that Matt has a number of tools to help him act as a remote wingman for Harry, evident through six main navigation items on his side screen…A home icon, Web, News, Image, Video, and Social Media. The home icon is always bright white, but the section he’s currently viewing is a bolded gray.  

In the Image mode, it runs a face recognition on a still image from Matt’s video feed, and provides its best match for further research.

image20.png

Somehow he can also get information on the event that Harry is attending. In this view, there’s a floor plan of the venue, which Matt can use to instruct Harry.

image11.png

OK. This is of course a creepy use of this interface, but it’s easy to imagine scenarios where something like the EYE-LINK is used virtuously:

  • A nurse practitioner needing to call on the expertise of a remote, more senior caregiver.
  • An airplane maintenance worker needing to speak to the aircraft engineers about a problem she’s encountering.
  • Paintball players coordinating their game through a centralized team captain.

So with that in mind, let’s review this with the caveat that of course the specific wingman scenario is super creepy.

Analysis: Harry’s feedback

The communication channel back from Harry to Matt doesn’t need to be too rich for these purposes, but there are ways that it could be richer. Of course Harry could pick up his phone and simply type something that Matt could see. But if the communication needed to be undetectable to a casual observer, there are other options. Subvocalization is nascent, but a possibility and mostly-natural for the speaker.

78105main_ACD04-0024-001.jpg
Image courtesy of the NASA Ames Research demo of subvocalization.

If the remote user has time for training, subgestural detection might be another option. This is like subvocal detection, but instead of detecting throat movements used in speech, it would be an armband (like the Myo) that could detect gentle finger presses allowing the user chorded keyboard input which he could use while, say, gripping the beer bottle.

tw_hand.png

Either way, richer “undetectable” communication mechanisms exist, and could be incorporated.

Analysis: Graphics

One of the refreshing things about the interfaces in Black Mirror generally—and these screens in particular—is how understated they are, especially compared to the Roccoco interfaces that populate much of sci-fi. (Compare the two below.)

The color palette is spartan grayscale. The typeface is Helvetica (or adjacent). Nothing 3D, nothing swoopy, no complexity for complexity’s sake.

Analysis: Navigation and layout

The navigation for the information panel is a little confusing. Sure, it looks like lots of websites. But this chunking of information into separate screens requires that Matt hunt for information that’s of interest. Better would be to have a single, dynamic screen, and have the system do real-time parsing, providing suggestions and notifications in the context of the event. If he needed to dive down into some full-screen mode, let it fill the screen with some easy way to return to context.

Also, how did he get to the event view? Is that just a web view? What bar puts its floorplan on its site? There is no primary navigation element that would on first glance explain how he got there, or once there, how he might get back to other screens. The home icon is obscured. (Maybe this is designed by Apple, though, and has some entirely hidden swipe gesture or long press to request the event screen or force a return to home?) It’s really hard to say, and so fails affordance.

Analysis: Group chat

A quick look at any modern group video chat software shows that this is too pared down, with lots of controls for audio and video controls missing, as well as controls for the “meeting.” It’s possible that these appear only if Matt interacts with the cursor on that laptop, but again, affordances.

Analysis: More wingman tools?

There are more tools that would be useful to a wingman’s job, which could be built even now—without the strong AI that this diegesis has. They could be more virtuous, like…

  • Ways to keep Harry calm, focused, and feeling confident.
  • Reminders of general best practices for making a good impression.
  • Automatic privacy blackout when Harry approaches people for conversation.
thegame

Or they could be…uh…more questionable. (Here I’ll confess to referencing The Game: Penetrating the Secret Society of Pickup Artists by Neil Strauss, for how a real PUA might handle it.)

  • A transcript of the conversation with key phrases highlit, indicating the “target’s” attitudes and levels of interest.
  • Personality analysis on social media, listing derived topics that these particular “targets” would find engaging.
  • A list of Harry’s practiced “routines” for Matt to quickly review, and suggest. The AI could even highlight its best-guess suggestion.
  • Counts of “indicators of interest.”
  • An overview of Matt’s favored stages of pickup, with an indicator of where Harry is and how well he performed on the prior stages.

Either way, the support that these tools are offering are pretty minimal compared to what could be done, but then again, that kind of fits the story. Yes, the creepiness of the remote wingman support tools is part of the point. But the whole reason the peanut gallery pays for the honor of watching Matt coach Harry is (yes, voyeurism, but also) to witness a master wingman at his work. If the system was too much of a support, the peanut gallery would be less incentivized to pay to see him in action.