R. S. Revenge Comms

13 Dec 2016 by Christopher Noessel

Note: In honor of the season, Rogue One opening this week, and the reviews of Battlestar Galactica: The Mini-Series behind us, I’m reopening the Star Wars Holiday Special reviews, starting with the show-within-a-show, The Faithful Wookie. Refresh yourself of the plot if it’s been a while.

On board the R.S. Revenge, the purple-skinned communications officer announces he’s picked up something. (Genders are a goofy thing to ascribe to alien physiology, but the voice actor speaks in a masculine register, so I’m going with it.)

He attends a monitor, below which are several dials and controls in a panel. On the right of the monitor screen there are five physical controls.

A stay-state toggle switch
A stay-state rocker switch
Three dials

The lower two dials have rings under them on the panel that accentuate their color.

Map View

The screen is a dark purple overhead map of the impossibly dense asteroid field in which the Revenge sits. A light purple grid divides the space into 48 squares. This screen has text all over it, but written in a constructed orthography unmentioned in the Wookieepedia. In the upper center and upper right are unchanging labels. Some triangular label sits in the lower-left. In the lower right corner, text appears and disappears too fast for (human) reading. The middle right side of the screen is labeled in large characters, but they also change too rapidly to make much sense of it.

Luke, looking over the shoulder of the comms officer at the same monitor, exclaims, “It’s the Millennium Falcon!”

faithful-wookiee-12 — Seriously, Luke, how can you tell this?

Watching the glowing dot and crosshairs blink and change position several times, the comms officer says, “They’re coming out of light speed. I can’t make contact.” An off-screen voice tells him to “Try a lower channel.” Something causes the channel to change (the comms officer’s hands do not touch anything that we can see), and then the monitor shows a video feed from the Falcon.

Video Feed

The video feed has an overlay to the upper left hand side, consisting of lines of text which appear from top to bottom in a palimpsest formation, even though the copy is left-aligned. At the top is a label with changing characters, looking something like a time stamp.

Analysis of the Map View

Since we can’t read the video overlay in the video feed, and it doesn’t interfere with the image, there’s not much to say about it. Instead I’ll focus on the map view.

Hand-drawn Inconsistency

In the side angle shot, which we see first, we see the dial colors go from top to bottom, as beige, red, yellow. In the facing shot of this interface, which immediately follows the side shot, the dials go beige, yellow, red. The red and yellow are transposed. Itʼs of course possible that the dials have a variable hue, and changed at exactly the same time the camera switches. But then we have to explain where his hand went, and why we don’t see any of the other elements changing color, and so on…

A purple character with a space suit interacts with a technological device, while a group of characters, including one dressed in yellow and one in a white gown, observe the scene in a futuristic setting.

A futuristic monitor displaying a purple grid with various cosmic elements and symbols, featuring graphical data and navigation controls on the right side.

This illustrates one of the problems with reviewing hand-drawn animation (and why scifiinterfaces generally frowns upon it.) It takes a hand-drawing animator extra work to keep things consistent from screen to screen. She must have a reference when drawing the interface from any new angle, and this extra work is on top of all the other things she has to manage like color and timing. Fewer people will notice transposed dial colors than, say, the comms officer turning orange instead of purple, so the interface is low on that priority stack.

Contrast that with live-action and computer-animated interfaces. In these modes of working, it takes extra work to change interfaces from shot to shot, so you run into consistency problems much less frequently.

I’ve written about this before in the abstract, but it’s nice to have a simple and easily shown example in the blog to point to.

2Dness

Another problem with the interface is that it is 2-D, but space is 3-D.

When picking a projection to display, we have to keep in mind that it is more immediate to understand an impending collision when presented as 2-D information: Constant bearing, decreasing range = Trouble. So, perhaps the view has automatically aligned itself to be perpendicular to the Falcon’s approach, which makes it easier to monitor the decreasing distance.

If so, he would need to see that automatically-aligned status reflected somewhere in the interface, and have access to controls that let him change the view and snap back to this Most Useful View. Admittedly, this is a lot of apologetics to apply, when really, it’s most likely the old trope 2-D Space.

Attention and memory

There are some nicely designed attention cues. The crosshairs, glowing dot, and motion graphics makes it so that—even though we can’t read the language—we can tell what’s of interest on the screen. One dot moving towards another, stationary dot. We’re set up for the Falcon’s buzzing the base.

That’s probably the best thing that can be said for it.

The text is terrible, changing too fast for a human reader. (Yes, yes, put down that emerging comment. Purple-face isnʼt human, but we must evaluate interfaces considering what is useful to us, and right now that means us humans.) The text changes so much faster than the blinking, in fact, that it’s pulling attention away from it. Narratively, the rapid-fire text helps convey a sense of urgency, but it greatly costs readability. It’s not a good model for real world design.

The blinking crosshair might most accurately reflect the actual position of the detected object within the radar sweep. But it could help the officer more. As with medical signals, data points are not as interesting as information trends. As it is, it relies on his memory to piece together the information, which means he has to constantly monitor the screen to make sense. If instead the view featured an evaporating trail of data points, not only could he look away without missing too much information, but he would also notice that the speed and direction are slightly erratic, which would prove quite interesting to anyone trying to ascertain the status of the ship. One glance shows things are not as they should be. The Falcon is clearly careening.

tracking_assistance — Actual points from the animation.

Mysterious Control

When we first see the comms officer, he has his unmoving hand on one of the dials. But when we see the map switch to the video feed, none of the controls we can see are touched. This raises a possibility and a question.

The possibility is that there is control by some other mechanism. My best guess is that it is voice control, since the Rebel General says “try a lower channel” just before it switches. Maybe he was not speaking to the comms officer, but to the machine itself. And given C3PO, they clearly have the technology to recognize and act on natural language, though it’s usually associated with a full general artificial intelligence. A Rebel Siri (33 years before it came out in Apple’s iOS) makes sense from an apologetics sense.

If so, there are some aspects of the UI missing to signal to an operator that the machine is listening, and hearing, and understanding what is being said, as well as whether the speaker is authorized to control. After all, the comms officer is wearing the headset, but it was the red-bearded general who issued the command. I imagine it’s not OK for anyone on the bridge to just shout out controls.

faithful-wookiee-13 — Just General Burnside, here.

The question then, is if the channel is controlled by voice, what are the physical controls for? They’re lacking labels of any kind. Perhaps they’re there as a backup, should voice control fail. Perhaps they are vestigial, left over from before voice control was installed. Maybe only the general has a voice override and the comms officer must use the physical controls. Any of these would be fine backworlding explanations, but my favorite idea is that the dials are for controlling nuanced variables in very fluid ways with instant feedback.

It’s easier to twiddle a dial to change the frequency of a radio to find a low-power signal than to keep saying “back…forward…no, back just a bit.” That would help explain what the comms officer was doing with his hands on the dials when he got something but not when the general voice-controls the channel.

In general

The interface shows some sophistication in styling and visual hierarchy, and if we give it lots of benefit of the doubt, might even be handling some presentation variables for the user in sophisticated ways. But the distractions of the rapid-fire text, the lack of trend lines, the lack of labels for the physical controls, and the missing affordances for projection control and voice control feedback make it a poor model for any real world design.

Brain Upload

7 Dec 2016 by scifihughf

Once Johnny has installed his motion detector on the door, the brain upload can begin.

3. Building it

Johnny starts by opening his briefcase and removing various components, which he connects together into the complete upload system. Some of the parts are disguised, and the whole sequence is similar to an assassin in a thriller film assembling a gun out of harmless looking pieces.

It looks strange today to see a computer system with so many external devices connected by cables. We’ve become accustomed to one piece computing devices with integrated functionality, and keyboards, mice, cameras, printers, and headphones that connect wirelessly.

Cables and other connections are not always considered as interfaces, but “all parts of a thing which enable its use” is the definition according to Chris. In the early to mid 1990s most computer user were well aware of the potential for confusion and frustration in such interfaces. A personal computer could have connections to monitor, keyboard, mouse, modem, CD drive, and joystick – and every single device would use a different type of cable. USB, while not perfect, is one of the greatest ever improvements in user interfaces.

Why not go wireless? Wireless devices remove the need for a physical connection, but this means that anyone, not just you, could potentially connect. So instead of worrying about whether we have the right kind of cable, we now worry about the right kind of Bluetooth pairing and WiFi encryption password scheme. Mobile wireless devices also need their own batteries, which have to be charged. So wireless may seem visually cleaner, but comes with its own set of problems.

As of early 2016 we have two new standards, Lightning and USB-C, that are orientation-independent (only fifty years after audio cables), high bandwidth, and able to transmit power to peripherals as well. Perhaps by 2021 cables will have made a comeback as the usual way to connect devices.

2. Explaining it

Johnny explains the process to the scientists. He needs them to begin the upload by pushing a button, helpfully labelled “start”, on the gadget that resembles an optical disk drive. There’s a big red button as well, which is not explained but would make an excellent “cancel” button.

It would be simpler if Johnny just did this himself. But we will shortly discover that the upload process is apparently very painful. If Johnny had his hands near the system, he might involuntarily push another button or disturb a cable. So for them, having a single, easily differentiated button to press minimizes their chance of messing it up.

1. Making codes

He also sticks a small black disk on the hotel room’s silver remote control. The small disk is evidently is a wireless controller or camera of some kind. The scientists must watch the upload progress counter, and as it approaches the end, use this modified remote to grab three frames from the TV display, which will become the “access code” for the data. (More on this below.)

None of the buttons on this remote have markings or labels, but neither Johnny nor the scientist who will be using it are bothered. Perhaps this hotel chain tries to please every possible guest by not favouring any particular language? But even in that case, I’d expect there to be some kind of symbols on the buttons and a multilingual manual to explain the meaning of each. Maybe Johnny spends so much time in hotel suites that he has memorised the button layout?

Short of a mind reading remote that can translate any button press into “what the user intended”, I have to admit this is a terrible interface.

(There is a label on the black disk, but I have no idea what it means or even which script that is. Anyone?)

0. Go go go

Johnny plugs in his implant, puts on a headset with more cables, and bites down on a mouthguard. He’s ready.

The scientist pushes the start button and the upload begins. Johnny sees the data stream in his headset as a flood of graphics and text.

Why does he need the headset when there is a direct cable connection to the implant? The movie doesn’t make it explicit. It could be related to the images used as the access code. (More on this below.) Perhaps the images need to be processed by the recipient’s own optic nerve system for more reliable storage?

Still, in the spirit of apologetics we should try to find a better explanation than “an opportunity for 1995 cutting edge computer generated graphics.” Perhaps it is a very flashy progress indicator? Older computer systems had blinking lights on disk drives to indicate activity, copied on some of today’s USB sticks. Current-day file upload or download GUIs have progress bars. As processing and graphics capabilities increase, it will be possible for software to display thumbnails or previews of the actual data being transferred without slowing down.

Unfortunately there is an argument against this, which is that the obvious upload progress indicator is a numeric display counting gigabytes down to zero, and it makes a fast chirping sound as a sonic indicator as well. The counter shows the data flowing at gigabytes per second, the entire upload lasting about a minute. There’s also the problem that it’s not Johnny who is interested in knowing whether the upload is scientific data rather than, say, a video collection; but the scientists, and they can’t see it.

As the counter drops below one hundred, the scientist points the remote with black disk at the TV display, currently showing a cartoon, and presses the middle button. The image from the TV appears overlaid on the data stream to Johnny. This is a little odd, because Johnny assured the scientists that he wouldn’t know what the access codes were himself. Maybe these brief flashes are not enough time for him to remember these particular images among the gigabytes of visual content. But the way they’re shown to us, I’ll bet you can remember them when they come up again later in the plot.

Two more images are grabbed before the counter stops. When the upload finishes, the three images are printed out. (In the original film this is shown upside down, so I have rotated the image.)

Tagged:

So what are the images for? The script isn’t clear. I suggest that the images are being used as the equivalents of very large random numbers for whatever cryptography scheme protects the data against unauthorised access. Some current day systems use the timing of key presses and mouse movements as a source of randomness because humans simply can’t move their fingers with microsecond precision. Here, the human element makes it impossible to predict exactly which frame is chosen.

Humans also find images much easier to recognise than hundred digit numbers. Anyone who has seen the printout will be able to say whether a particular image is part of the access code or not with a high degree of confidence. In computer systems today, Secure Shell, or ssh, is a widely used encrypted terminal program for secure access to servers. Recent versions of ssh have a ‘randomart’ capability which shows a small ASCII icon generated from the current cryptographic key to everyone who logs on. If this ASCII icon appears different, this alerts everyone that the server key has been changed.

There’s one potential usability problem with the whole “pick three random images” mechanism. The last frame was grabbed when the counter was very close to zero. What would have happened if he had been too slow and missed altogether? Wouldn’t it be more reliable to have the upload system automatically grab the images rather than rely on a human? Chris suggests that maybe it secretly did grab three images that could have used without human input, but privileged the human input since it was more reliably random.

Quick aside: You may be asking, if images would be so wonderful, why aren’t we using them in this way already? It’s because our current security systems need not just very large random numbers, but very large random numbers with particular mathematical properties such as being prime. But let’s cut Johnny Mnemonic some slack, saying that by 2021 we may have new algorithms.

OK, back to the plot.

-1. Sharing the codes

The access codes are to be faxed from Beijing to Newark, although this gets interrupted by the Yakuza intruders. This is yet another device with unmarked buttons.

This device makes the same beeps and screeches as a 1990s analog fax machine. Since we’ll later learn that all the fax messages and phone calls are stored digitally in cyberspace, this must be a skeuomorphism, the old familiar audio tones now serving just as progress indicators.

As with other audio output, the tones allow the user to know that the transmission is proceeding and when it ends without having to pay full attention to the device. On the other hand, there is potential for confusion here as the digital upload is (presumably) much faster. Most current day computer systems could upload three photos, even in high resolution, well before the sequence of tones would complete. Users would most likely wait longer than actually necessary before moving on to their next task.

-2. Washing up

During the upload Johnny clenches his fists and bites his mouthguard. When the upload finishes, he retreats to the bathroom in considerable pain. At one point blood flows from his nose, and he swipes his hand over the tap to wash it down the drain. The bathroom announces that the water temperature is 17 degrees. We’ll come back to this later.

As Make It So emphasises in the chapter on brain interfaces, there is nothing in our current knowledge to suggest that writing or reading memories to or from a human brain would be painful. On the other hand, we know that information in the brain isthe shape of the neurons in the brain. Who knows what side effects will happen as those neurons are disconnected and reconnected as they need to be? We don’t know, so can’t really say whether it would hurt or not.

-3. Escaping the Yakuza

As mentioned in a prior post, while he is in the bathroom, the motion detector Johnny installed on the hotel door isn’t very effective and the Yakuza break in, kill everyone else, and acquire the second of the three access code images. Johnny escapes with the first image and flies to Newark, North America.

Hotel Remote

9 Nov 2016 by scifihughf

The Internet 2021 shot that begins the film ends in a hotel suite, where it wakes up lead character Johnny. This is where we see the first real interface in the film. It’s also where this discussion gets more complicated.

A note on my review strategy

As a 3D graphics enthusiast, I’d be happy just to analyze the cyberspace scenes, but when you write for Sci Fi Interfaces, there is a strict rule that every interface in a film must be subjected to inspection. And there are a lot of interfaces in Johnny Mnemonic. (Curse your exhaustive standards, Chris!)

A purely chronological approach which would spend too much time looking at trees and not enough at the forest. So I’ll be jumping back and forth a bit, starting with the gadgets and interfaces that appear only once, then moving on to the recurring elements, variations on a style or idea that are repeated during the film.

Description

The wakeup call arrives in the hotel room as a voice announcement—a sensible if obvious choice for someone who is asleep—and also as text on a wall screen, giving the date, time, and temperature. The voice is artificial sounding but pleasant rather than grating, letting you know that it’s a computer and not some hotel employee who let himself in. The wall display functions as both a passive television and an interactive computer monitor. Johnny picks up a small remote control to silence the wake up call.

This remote is a small black box like most current-day equivalents, but with a glowing red light at one end. At the time of writing blue lights and indicators are popular for consumer electronics, apparently following the preference set by science fiction films and noted in Make It So. Johnny Mnemonic is an outlier in using red lights, as we’ll see more of these as the film progresses. Here the glow might be some kind of infrared or laser beam that sends a signal, or it might simply indicate the right way to orient the control in the hand for the controls to make sense.

First thing every morning: Messages

After silencing the alarm, Johnny, like so many of us today, checks his email. (In 1995 doing so before even getting out of bed might have been intended to show his detachment from humanity. Today, it seems perfectly natural!) He uses the remote to switch the display to the hotel “Message Centre”. We see his thumb move around, so the remote must have multiple buttons, but can’t tell whether this is a simple arrow keypad or something more complicated.

The message centre of the New Darwin Inn system both displays the text message visually and also speaks it aloud in the same synthesized voice that woke him up. Voiceovers are common in films so the audience doesn’t have to try to read the cinema screen, but in this case it would be genuinely useful. Guests could start doing something else without needing to pay full attention to the display.

Is it necessary for Johnny to explicitly switch to the Message Center? The system could have displayed this message automatically after the wakeup call, or shown the 2021 equivalent of his InBox. On the other hand, this is a giant, clearly visible screen and Johnny was not alone in the suite. Johnny, and other guests, might wish to keep their communications private.

As Johnny has no messages, he uses the remote to switch the display to a TV channel.

The hotel room “phone” call

Next he uses the remote to make a phone call. He starts by using the remote to dial the number, which appears on the display. We can’t see whether he is typing numbers directly, or using arrow keys and an Enter or OK button to navigate around the onscreen keypad. It’s certainly convenient for guests to be able to make a call without getting out of bed, but a voice recognition interface might be even easier. We’ll see a phone system that accepts voice commands later on, so perhaps using the remote is just a preference.

What is the strange blue window to the right of the keypad? It’s there because all phone calls in 2021 are in fact video calls. The equivalent to a busy waiting tone in this world is a video splash screen. These can be customized by the recipient, here showing the company name, Dataflow.

And finally both parties can see and hear each other. Note also the graphical reverse, stop, and play buttons at the bottom right of the keypad. These imply some sort of recording capability, but we never see them used.

I’ll discuss the 2021 phone system in more detail later on, so for now we just need to know that this phone call is the setup that sends Johnny to Beijing for his next, and hopefully last, job.

Lumpy’s Brilliant Cartoon Player

26 Jan 2016 by Christopher Noessel

I am pleased to report that with this post, we are over 50% of the way through this wretched, wretched Holiday Special.

Description

After Lumpy tries to stop stormtroopers from going upstairs, an Imperial Officer commands Malla to keep him quiet. To do so, she does what any self-respecting mother of a pre-teen in the age of technology does, and sits him down to watch cartoons. The player is a small, yellow device that sits flat on an angled tabletop, like a writing desk.

Two small silver buttons stack vertically on the left, and an upside down plug hole strainer on the right. A video screen sits above these controls. Since no one in the rest of his family wants to hear the cartoon introduction of Boba Fett, he dons a pair of headphones, which are actually kind of stylish in that the earpieces are square and perforated, but not beveled. There are some pointless animations that start up, but then the cartoon starts and Lumpy is, in fact, quiet for the duration. So, OK, point one Malla.

SWHS-Cartoon-Player-08 — Why no budding DJ has glommed onto this for an album cover is beyond me.

Analysis

We only see Lumpy press down onto the surface of the device from the far side, so it’s mostly conjecture about how the interface works. The same goes for the media. But we do know the basic needs of video: Start, stop, and volume. And a single click-stop dial could handle all that, even if kind of poorly.

We also don’t know whether the device has media inserts—like a Blu-Ray player—or is more like a television with fixed streams of ongoing content to pick from, or like a Netflix requiring a search of a practically infinite on-demand catalogue. But that sink drain thing looks like it’s meant to be a channel selector, and this was 1978, so let’s presume it was a television model with a few-year prescient Walkman personal-media bent. In fact, there’s a handle visible in the shot posted below, so let’s give this thing some credit for presaging miniaturization to the point of mobility. It must have blown some kids minds back then.

And, sure, this interface could manage the task at hand, even if it’s missing some feedback for exactly which channel is being watched, and what the current volume is or what that second click-stop dial does, or why it has an affordance for turning when Lumpy clearly pushes it.

Apology

What I’m most interested in though is the crappy, crappy production quality of the thing. While it’s easy and admittedly fun to decry this as rushed through the prop department in about 30 minutes, I’m going to use my old friend apologetics to wonder if maybe Lumpy himself put this together. Not like a science fair project, but as an off-the shelf product. Wouldn’t it be awesome to give a kid a blank box with a video screen, let him take any object he found on top of it to use as a control device? A thimble could become the on-off switch. A jack could become the channel selector. A Matchbox car could become the volume control. This would diegetically explain the dopey sink strainer, and give Lumpy an awesome opportunity to think about the affordances of the things around him and the relationships-of-parts he could use to control abstract variables like volume, power, playback speed, etc. Maybe he could even assign objects to favorite videos. This stone in that crayon circle means that video. It would be a dream to foster interaction design thinking.

Sure, you might be thinking, but this would take cameras of an eye-like quality, and perfect image recognition attached to a near general artificial intelligence. Too bad they don’t have anything like that in Star Wars, yeah?

Of course one imagines such a device might be prohibitively expensive for a smuggler’s Life Day budget, and moreover this is giving the Star Wars Holiday Special waaaaay too much credit, but these are the truffles I actually do hope to find in rooting around all this muck for you.

Also to drop this. Contact me with demos.

Itchy’s SFW Masturbation Chair

13 Jan 2016 by Christopher Noessel

With the salacious introduction, “Itchy, I know what you’d like,” Saun Dann reveals himself as a peddler of not just booby trapped curling irons, but also softcore erotica! The Life Day gift he gives to the old Wookie is a sexy music video for his immersive media chair.

The chair sits in the family living room, and has a sort of helmet fixed in place such that Itchy can sit down and rest his head within it. On the outside of the helmet are lights that continuously blink out of sync with each other and seem unrelated to the actual function of the chair. Maybe a fairy-lights power indicator?

Saun first powers the device by inserting a “proton pack” into the back of the chair. This is kind of strange since none of the other devices seen in the home require batteries or charging. Are they lower power so batteries last longer? Is there an unseen electrical infrastructure but that monitors any plugged in object for illegal-device signatures? Whatever the reason, the battery pack plugs in and the chair comes to life.

An elderly man stands beside a creature resembling a Wookiee, seated under a hair dryer, in a cozy room filled with various objects.

Close-up of a hand operating a vintage camera, with a focus on the camera's recording mechanism and a blurred background.

When Itchy sits down, he rests his head in the helmet, and Saun puts a media cartridge into a tray sticking out of the armrest. There is a single red button on the forward edge. He then engages the cartridge by slapping it on edge so the tray slides into a recess. Then he lowers the forehead plate of the helmet over Itchy, who sits back to enjoy the show. Saun wishes him, “Happy Life Day!” and then with a nudge-nudge-wink-wink-you-know-seeeeexxxxx tone in his voice, leans in to reiterate, “And I do mean Happy Life Day!”

Itchy punches the top of the armrest with his hairy finger, and the media plays, full of theremin meanderings, stage lights and spandex dancers shot through a kaleidoscope-refraction lens, and a scantily-feathered singer (IMDB tells me the character name is Mermeia Holographic Wow, played by the diva Diahann Carroll) who purrs out a full 5 minutes of mind-numbing introduction before a 4-minute musical number. You can almost hear the director saying over a soggily-chewed stogie, “Sorry, Diahann, but we don’t have a lot to work with, here, you’re really going to have to stretch this out.”

I know you’re searching for me
Searching
Searching
I am here
My voice is for you alone
I am found in your eyes only
I exist for you
I am in your mind
As you create me
Oh yes
I can feel my creation
{Giggle}
I’m getting your message
Are you getting mine?

Itchy growls and spasms in his chair enthusiastically.

Oh, oh! We are excited aren’t we?
Well just relax
Just relax
Yes

{More Itchy grunting}

Now
We can have a good time
Can’t we?

{spasming, panting}

I’ll tell you a secret
I find you adorable

Itchy loves this assertion so much that he punches a control on the armrest, and the playback jumps back to replay the line again. And again. And again. Four times in total.

(I find you adorable)
(I find you adorable)
(I find you adorable)
I don’t need to ask how you found me
You see, I am your fantasy
I am your experience
So experience me
I am your pleasure
So enjoy me
This is our moment together in time
That we might turn this moment an eternity

{Music mercifully begins}

SWHS-Chair-07 — I’m sorry to have to remind people about this low point in your career, Diahann.

So…Exactly what is this machine?

So, if the words of the recording are to be believed, this machine automatically reads the mind (or stored preferences) of its user to create a custom, on-the-fly immersive video.

Here you should note that Itchy’s species of sexual preference is human, not Wookie, and then note with sadness that Chewie is not mixed-species. Itchy is living an unfulfilled life.

If it constructs its visions on-the-fly, then what is the cartridge for? It can’t be Itchy’s preferences. Why would Saun have them? My best guess is that the cartridge contains the template of the song, This Minute Now, and the device reads the wearer’s in-the-moment preferences to pick the avatar that sings it. That template isn’t neutral, though. It has to be a sexy template, because Saun does all the nod’s as good as a wink to a blind bat routine. Aww, yeah, sexy template for Life Day.

Knowing that this might be a privately-observed sexytime moment, I’d recommend the designers add a curtain or perhaps situate the chair inside a private chamber to make the user less exposed. Otherwise it might be awkward—for a human user at least—for other members of the family to observe him becoming visibly and audibly aroused (the panting), much less do…uh…anything about it. Of course I don’t know Wookie social rules, so this might be well within their social norms. Kinda makes you wonder about how Chewie spends his idle time on the Falcon in front of Han. “Chewie. Do you mind? Take it into your berth!”

Controls

The instant replay feature is useful to the task. And it’s quite well executed, since it’s a quick-to-press button to replay the last moment, and that moment is of unspecified length. The media must have very sophisticated and detailed markup for a “repeat that bit” to work, and it does. Of course, it also can read Itchy’s mind, so maybe it just knows to play across the most-recent high-excitement part. It’s a self-administered dopamine hit.

A better tool might monitor the user’s brainwaves for a perfect combination of tension and release to ensure a perfectly satisfying experience. No button needed. That would also alleviate the problem that the user’s hand might be otherwise engaged during the exciting part to try and target a button. The (prolly NSFW text, even if it’s WebMD) sexual response cycle of humans is a known thing, so surely a Wookie’s is too. Let me disturb you by visualizing the combination of concepts so implied.

But we also have to ask after the placement and purpose of that sole red button. Saun slapped the cartridge edge-on to lodge the tray in place. But that’s where the button is. Did the lodging activate the play, or did pressing the button?

If the cartridge, what does the button do? (Not replay, Itchy clearly presses the top of the armrest for that.) And how does it avoid accidental activation while being slapped in?

If the button, why have the tray slide in and out? To keep it private? Sorry, you lost that battle with the living room masturbatorium. To protect the media? Then why have it in the armrest where it’s sure to be subject to the bangings of Wookie demands for again!?

A man with long hair and a mustache is lying in the backseat of a car. He is wearing a shiny, dark outfit and has wires attached to his head, appearing disoriented.

A man in a white lab coat is reclined, eyes closed, under a red-lit medical apparatus with a tube extending toward him.

With the commercial release of Oculus Rift just about to ship post-CES, let’s not turn to this device for any immersive-media lessons. There is better blind-use masturbation VR in Strange Days, more dystopic ones in THX-1138 (yes, I now realize, it’s a recurring Lucas theme), more private ones in Sleeper, and less creepy things almost anywhere you turn.

Let’s just let Itchy have his personalized-avatar, happy Life Day, there, in the middle of the astroturfed family room.

Stay classy, Star Wars Holiday Special.

Chef Gormaand

6 Jan 2016 by Christopher Noessel

Hello, readers. Hope your Life Days went well. The blog is kicking off 2016 by continuing to take the Star Wars universe down another peg, here, at this heady time of its revival. Yes, yes, I’ll get back to The Avengers soon. But for now, someone’s in the kitchen with Malla.

After she loses 03:37 of her life calmly eavesviewing a transaction at a local variety shop, she sets her sights on dinner. She walks to the kitchen and rifles through some translucent cards on the counter. She holds a few up to the light to read something on them, doesn’t like what she sees, and picks up another one. Finding something she likes, she inserts the card into a large flat panel display on the kitchen counter. (Don’t get too excited about this being too prescient. WP tells me models existed back in the 1950s.)

In response, a prerecorded video comes up on the screen from a cooking show, in which the quirky and four-armed Chef Gourmaand shows how to prepare the succulent “Bantha Surprise.”

And that’s it for the interaction. None of the four dials on the base of the screen are touched throughout the five minutes of the cooking show. It’s quite nice that she didn’t have to press play at all, but that’s a minor note.

The main thing to talk about is how nice the physical tokens are as a means of finding a recipe. We don’t know exactly what’s printed on them, but we can tell it’s enough for her to pick through, consider, and make a decision. This is nice for the very physical environment of the kitchen.

This sort of tangible user interface, card-as-media-command hasn’t seen a lot of play in the scifiinterfaces survey, and the only other example that comes to mind is from Aliens, when Ripley uses Carter Burke’s calling card to instantly call him AND I JUST CONNECTED ALIENS TO THE STAR WARS HOLIDAY SPECIAL.

Of course an augmented reality kitchen might have done even more for her, like…

Cross-referencing ingredients on hand (say it with me: slab of tender Bantha loin) with food preferences, family and general ratings, budget, recent meals to avoid repeats, health concerns, and time constraints to populate the tangible cards with choices that fit the needs of the moment, saving her from even having to consider recipes that won’t work;
Make the material of the cards opaque so she can read them without holding them up to a light source;
Augmenting the surfaces with instructional graphics (or even air around her with volumetric projections) to show her how to do things in situ rather than having to keep an eye on an arbitrary point in her kitchen;
Slowed down when it was clear Malla wasn’t keeping up, or automatically translated from a four-armed to a two-armed description;
Shown a visual representation of the whole process and the current point within it;

…but then Harvey wouldn’t have had his moment. And for your commitment to the bit, Harvey, we thank you.

Rebel videoscope

23 Dec 2015 by Christopher Noessel

Talking to Luke

Hidden behind a bookshelf console is the family’s other comm device. When they first use it in the show, Malla and Itchy have a quick discussion and approach the console and slide two panels aside.

The device is small and rectangular, like an oscilloscope, sitting on a shelf about eye level. It has a small, palm sized color cathode ray tube on the left. On the right is an LED display strip and an array of red buttons over an array of yellow buttons. Along the bottom are two dials.

Without any other interaction, the screen goes from static to a direct connection to a hangar where Luke Skywalker is working with R2-D2 to repair some mechanical part. He simply looks up to the camera, sees Malla and Itchy, and starts talking. He does nothing to accept the call or end it. Neither do they.

We also see the conversation from Luke’s perspective as well. It’s even more oscillioscopey, with lots of dials, switches, and sliders to either side.

So this all might be intriguing (and right in line with agentive design) but before we start to investigate, we need to look at another instance of its use. Just like the Imperial-issie Media Console, this functions differently later in the same show.

Talking to Leia

After Itchy’s SFW living room masturbation chair sequence, the camera cuts to Leia and C-3PO in an unspecified office somewhere. The droid works at a console for a moment and finally turns a dial. In the Wookie household, a loud dee-DEEP dee-DEEP sounds until Malla rushes to the console, and slides the panels aside. C-3PO sees Malla’s face, and turns to Leia saying, “Ah. I have made the connection. You may speak now if you wish.”

They do, and when the conversation is over, the feed just shuts off, with neither party doing anything to make it happen.

So. Yeaaaaah.

Activation

How is it turned on? One possibility is an architectural switch activated by sliding the panels. It would be a good design decision, as it is an action that needs to be undertaken anyway to use it. But that doesn’t explain Luke’s use.

Connection

How does Malla’s device know to call Luke once it’s on? It could be that it’s a fixed connection, like an intercom, that only calls that one other device. But it’s a Rebel garage. That doesn’t make sense. Why would Malla need to only call there? And of course they receive a call from Leia, who isn’t in that same garage, so it’s not exactly fixed.

Security

The device contains incriminating evidence, i.e. the direct connection to the Rebel base, and so it needs some sort of security. Why is that not in evidence?

Secret agent?

One technological concept that would answer a lot of these questions is that of agentive technology, i.e. artificial narrow intelligence that does things on behalf of its users.

It could explain how the device turns on and (some of) the security: the camera has hairy face recognition and persistently watches for authorized users, turning on when it sees one of them. Conceptually that would be far beyond common sci-fi tropes of the time, but in keeping with the New Criticism stance of the blog, should be considered.

It could explain how it knew to call Luke: It understands Shyriiwook and listened to the conversation that Itchy and Malla had before they opened the panel, knew they wanted to call Luke, and found him in the garage.

It could explain how it turns off: It’s smart enough to understand the linguistic, social, and physical cues that the conversation has ended.

The world of Star Wars even has this technology in evidence. The droids all exhibit artificial general intelligence, and it is only a failure of imagination that this intelligence should not be incorporated into important devices, or spaceships, or architecture.

This would also explain why c-3PO is managing the interface on his end but nobody else has to bother: An AI does not need another AI, just an API.

It would even explain why the damned thing rings. Take a moment to appreciate that. This is an illegal device on the Empire-controlled Kazook. We know this because it’s deliberately hidden, and our protagonists really work to avoid the Empire’s finding it. Yet when an unexpected call comes in, it shrilly announces the fact of itself to everyone within screeching range. The only way this is not the most moronic feature possible of an illegal object is if it can scan the surroundings and verify that it’s OK to ring. Because otherwise, it would be the most stupid feature of a stupidly stupid technology made in haste for a stupid show slopped together in haste and without any respect for a logical or consistent diegesis.

Whew.

Thank The Maker for apologetics.

Imperial-issue Media Console

22 Dec 2015 by Christopher Noessel

When she wonders about Chewbacca’s whereabouts, Malla first turns to the Imperial-issue Media Console. The device sits in the living space, and consists of a personal console and a large wall display. The wall display mirrors the CRT on the console. The console has a QWERTY keyboard, four dials, two gauges, a sliding card reader, a few red and green lights on the side, and a row of randomly-blinking white lights along the front.

Public Service Requests

As Malla approaches it, it is displaying an 8-bit kaleidoscope pattern and playing a standard-issue “electronics” sound. Malla presses a handful of buttons—here it’s important to note the difficulty of knowing what is being pressed when the hand we’re watching is covered in a mop—and then moves through a confusing workflow, where…

She presses five buttons
She waits a few seconds
As she is pressing four more buttons…
…the screen displays a 22-character string (a password? A channel designation?) ↑***3- ↓3&39÷ ↑%63&-:::↓
A screen flashes YOU HAVE REACHED TRAFFIC CONTROL in black letters on a yellow background
She presses a few more buttons, and another 23-character string appears on screen ↑***3- XOXOO OXOOX XOOXO-↑ (Note that the first six characters are identical to the first six characters of the prior code. What’s that mean? And what’s with all the Xs and Os? Kisses and hugs? A binary? I checked. It seems meaningless.)
An op-art psychedelic screen of orange waves on black for a few seconds
A screen flashes NO STARSHIPS IN AREA
Malla punches the air in frustration.

So the first string is, what, a channel? And how do the five buttons she pressed map to that 22 character string? A macro? Why drop to a semi-binary for one command? And are the hugs-and-kisses an instruction? Is that how you write Shyriiwook? Why would it be Latin letters and Unicode characters rather than, say, Aurebesh? Who designed this command language? This orthography? This interface? Maybe it was what this guy was assigned to do after he was relieved of duty.

Video calls

When technology fails to find her sweetheart, Malla turns to her social network. She first uses her Illegal Rebel Comms device to talk to Luke and R2-D2 (next post), and afterwards, returns to the Media Console, which is back to its crappy TSR-80 BASIC-coded screen saver mode.

She taps a few keys (a macro?)
A new code appears: ↑***C- ↓&&&0- 446B°- TP%C↓
The display reads: SUB TERMINAL 4468 (or 446E or maybe 446B. It’s a square font and Malla’s hairy arm is in the way.)
She presses a few more keys
The screen displays STAND BY for a few seconds
Then the word CONNECT flashes a few times
She presses a single button
TRADING POST WOOKIE PLANET C flashes
A live camera feed displays of the trading post

So it’s actually nice to see the first 5 characters of the string be different since this is a different mode: public function (↑***3-) versus video phone (↑***C-). It made me wonder if the codes were some sort of four part IP address, but then I saw the traffic control command is only three lines, so it’s not a consistent enough pattern. So I was hoping to find some secret awesomeness, but no.

Here’s the flow chart as completed by the demoted Stormtrooper designer (translated from the Aurebesh).

Public Addresses

Not only is the interaction terrible, but it’s not really your device anyway. The Empire can take control of these screens for government business, like paging errant Stormtroopers. In these cases, an alarm sounds in the house, and then the Empire Video Feed comes online. No bizarre character strings. No flashing text. No arbitrary key presses.

After all that, an Easy Mode

As if that wasn’t enough, the thing works differently later in the show. After he returns to the tree house, Saun uses the system to call the Imperial Officer to cover Han and Chewie’s murderous tracks with a lie. To make the call, all Saun has to do is insert an identification card, press the same key on the keyboard six times, and with no weird codes or substation identification interstitials, he is connected immediately to the Imperial officer. After the officer terminates their call, Saun presses another button a few times and removes his card. That’s it. It was almost easy.

This tells us that the system can work fairly simply. If you’re calling the Empire. Or if you’re high enough social status and have the card to prove it. This technology just sucks. Maybe this is why the rebellion started.

Abidjan Operation

25 Jun 2015 by Christopher Noessel

After Hawkeye is enthralled by Loki, agent Coulson has to call agent Romanoff in from the field, mid-mission. While he awaits her to extract herself from a situation, he idly glances at case file 242-56 which consists of a large video of Barton and Romanoff mid-combat, and overview profiles of the two agents. A legend in the upper right identifies this as STRIKE TEAM: DELTA, and a label at the top reads ABIDJAN OPERATION. There is some animated fuigetry on the periphery of the video, and some other fuigetry in windows that are occluded by the case file.

Some things to note.

The four windows seem to be connected by content and by case file designation. But each has separate window controls in the upper right hand corner. (Not an aberration, we saw the same thing in Carrier Control.) If it’s a single case file, the layout ought to be handled automatically to save Coulson (or agent Stephen Morton, who appears per the text in the upper left to be the one actually logged in), from all that file management. It would even avoid the “error” of Barton’s profile being obscured by Romanoff’s, as in the image.
There are bar codes displayed on the agent profiles. Why would a computer operator need barcodes on a computer screen?
There is a miniature 3D rendering of a screw to the right of each of their portraits.
There are also three hexagrams from the I Ching on Romanoff’s profile. Each one of these is Ch’ien The Creative, which makes sense, she’s total Yang. Barton’s hexagrams are obscured by an overlap of her profile, but I really think it would be a lovely compliment if his were K’un The Receptive, or Yin. Also, OK, kind of weird that SHIELD would use the I Ching as part of official policy, but hey, crazier things have happened.
There is a snippet of text from a document about the fundamentals of lossy image compression in the background. It kind of makes sense given that there is clearly some face recognition going on in the video.
It must be hi-tech, as the container rule lines jog about semi-randomly. Nurnies to be sure.
The video controls along the bottom of the actual video are repeated in miniature along the bottom of the profile pictures, even though these profile images do not move. (Though if they were more like looping photographs in Harry Potter, that would have been cooler.)
Abidjan, you might know, is a large city on the Ivory Coast but the coordinates on the screen put this scene in the middle of the Gulf of Guinea. Which, though it’s 894 km east of Abidjan, is actually closer that I would have guessed it to be.

Carrier Control

11 Jun 2015 by Christopher Noessel

The second instantiation of videochat with the World Security Council that we see is when Fury receives their order to bomb the site of the Chitauri portal. (Here’s the first.) He takes this call on the bridge, and rather than a custom hardware setup, this is a series of windows that overlay an ominous-red map of the world in an app called CARRIER CONTROL. These windows represent a built-in chat feature for discussing this very topic. There is some fuigetry on the periphery, but our focus is on these windows and the conversation happening through them.

In this version of the chat, we are assured that it is a SECURE TRANSMISSION by a legend across the top of each, but there is not the same level of assurance as in the videoconference room. If it’s still HOTP, Fury isn’t notified of it. There’s a tiny 01_AZ in the upper right of every screen, but it never changes and is the same for each participant. (An homage to Arizona? Lighter Andrew Zink? Cameraman Arthur Zajac?) Though this is a more desperate situation, you imagine that the need for security is no less dire. Having that same cypher key would be comforting if it is in fact a policy.

Different sizes of windows in the app seem to indicate a hierarchy, since the largest window is the fellow who does most of the talking in both conferences, and it does not change as others speak. Such an automated layout would spare Fury the hassle of having to manage multiple windows, though visually these look more like individual objects he’s meant to manipulate. Poor affordances.

The only control we see is when Fury dismisses them, and to do this he just taps at the middle of the screen. The teleconference window is “push wiped” by a satellite view of New York City. Fine, he feels like punching them. But…

a) How does he actually select something in that interface without a tap?

b) A swipe would have been more meaningful, and in line with the gestural pidgin I identified in the gestural chapter of the book.

And of course, if this was the real world, you’d hope for better affordances for what can be done on this window across the board.

So though mostly effective, narratively, could use some polish.