The hospital doesn’t have the equipment to decrypt and download the actual data. But Jane knows that the LoTeks can, so they drive to the ruined bridge that is the LoTek home base. As mentioned earlier under Door Bombs and Safety Catches the bridge guards nearly kill them due to a poorly designed defensive system. Once again Johnny is not impressed by the people who are supposed to help him.
When Johnny has calmed down, he is introduced to Jones, the LoTek codebreaker who decrypts corporate video broadcasts. Jones is a cyborg dolphin.Continue reading →
Once Johnny has installed his motion detector on the door, the brain upload can begin.
3. Building it
Johnny starts by opening his briefcase and removing various components, which he connects together into the complete upload system. Some of the parts are disguised, and the whole sequence is similar to an assassin in a thriller film assembling a gun out of harmless looking pieces.
It looks strange today to see a computer system with so many external devices connected by cables. We’ve become accustomed to one piece computing devices with integrated functionality, and keyboards, mice, cameras, printers, and headphones that connect wirelessly.
Cables and other connections are not always considered as interfaces, but “all parts of a thing which enable its use” is the definition according to Chris. In the early to mid 1990s most computer user were well aware of the potential for confusion and frustration in such interfaces. A personal computer could have connections to monitor, keyboard, mouse, modem, CD drive, and joystick – and every single device would use a different type of cable. USB, while not perfect, is one of the greatest ever improvements in user interfaces.Continue reading →
The groomer is a device for sale at the Wookie Planet Trading Post C by local proprietor Saun Dann. It looks like a dust brush with an OXO designed, black, easy-grip handle, with a handful of small silver pushbuttons on one side (maybe…three?), and a handful of black buttons on the other (again, maybe three). It’s kind of hard to call it exactly, since this is lower-res than a recompressed I Can Haz Cheezburger jpg.
Let’s hear Saun describe it to the vaguely menacing Imperial shopper in his store.
Besides shaving and hair trimming, it’s guaranteed to lift stains off clothing, faces, and hands. Cleans teeth, fingers and toenails, washes eyes, pierces ears, calculates, modulates, syncopates life rhythms, and can repeat the Imperial Penal Code—all 17 volumes— in half the time of the old XP-21. Just the thing to keep you squeaky clean.
There are so many, many problems with this thing. On every level it’s wretched. Continue reading →
When Coulson hands Tony a case file, it turns out to be an exciting kind of file. For carrying, it’s a large black slab. After Tony grabs it, he grabs the long edges and pulls in opposite directions. One part is a thin translucent screen that fits into an angled slot in the other part, in a laptop-like configuration, right down to a built-in keyboard.
The grip edge
The grip edge of the screen is thicker than the display, so it has a clear, physical affordance as to what part is meant to be gripped and how to pull it free from its casing, and simultaneously what end goes into the base. It’s simple and obvious. The ribbing on the grip unfortunately runs parallel to the direction of pull. It would make for a better grip and a better affordance if the grip was perpendicular to the direction of pull. Minor quibble.
I’d be worried about the ergonomics of an unadjustable display. I’d be worried about the display being easily unseated or dislodged. I’d also be worried about the strength of the join. Since there’s no give, enough force on the display might snap it clean off. But then again this is a world where “vibrium steel” exists, so material critiques may not be diegetically meaningful.
Login
Once he pulls the display from the base, the screen boops and animated amber arcs spin around the screen, signalling him to login via a rectangular panel on the right hand side of the screen. Tony puts his four fingers in the spot and drags down. A small white graphic confirms his biometrics. As a result, a WIMP display appears in grays and amber colors.
Briefing materials
One window on the left hand side shows a keypad, and he enters 1-8-5-4. The keypad disappears and a series of thumbnail images—portraits of members of the Avengers initiative—appear in its place. Pepper asks Tony, “What is all this?” Tony replies, saying, “This is, uh…” and in a quick gesture, places his ten fingertips on the screen at the portraits, and then throws his hands outward, off the display.
The portraits slide offscreen to become ceiling-height volumetric windows filled with rich media dossiers on Thor, Steve Rogers, and David Banner. There are videos, portraits, schematics, tables of data, cellular graphics, and maps. There’s a smaller display near the desktop where the “file” rests about the tesseract. (More on this bit in the next post.)
Insert standard complaint here about the eye strain that a translucent display causes, and the apology that yes, I understand it’s an effective and seemingly high-tech way to show actors and screens simultaneously. But I’d be remiss if I didn’t mention it.
The two-part login shows an understanding of multifactor authentication—a first in the survey, so props for that. Tony must provide something he “is”, i.e. his fingerprints, and something he knows, i.e. the passcode. Only then does the top secret information become available.
I have another standard grouse about the screen providing no affordances that content has an alternate view available, and that a secret gesture summons that view. I’d also ordinarily critique the displays for having nearly no visual hierarchy, i.e. no way for your eyes to begin making sense of it, and a lot of pointless-motion noise that pulls your attention in every which way.
But, this beat is about the wonder of the technology, the breadth of information SHIELD in its arsenal, and the surprise of familiar tech becoming epic, so I’m giving it a narrative pass.
Also, OK, Tony’s a universe-class hacker, so maybe he’s just knowledgeable/cocky enough to not need the affordances and turned them off. All that said, in my due diligence: Affordances still matter, people.
On each of the sleep pods in which the Odyssey crew sleep, there is a display for monitoring the health of the sleeper. It includes some biometric charts, measurements, a body location indicator, and a countdown timer. This post focuses on that timer.
To show the remaining time of until waking Julia, the pod’s display prompts a countdown that shows hours, minutes and seconds. It shows in red the final seconds while also beeping for every second. It pops-up over the monitoring interface.
Julia’s timer reaches 0:00:01.
The thing with pop-ups
We all know how it goes with pop-ups—pop-ups are bad and you should feel bad for using them. Well, in this case it could actually be not that bad.
The viewer
Although the sleep pod display’s main function is to show biometric data of the sleeper, the system prompts a popup to show the remaining time until the sleeper wakes up. And while the display has some degree of redundancy to show the data—i.e. heart rate in graphics and numbers— the design of the countdown brings two downsides for the viewer.
Position: it’s placed right in the middle of the screen.
Size: it’s roughly a quarter of the whole size of the display
Between the two, it partially covers both the pulse graphics and the numbers, which can be vital, i.e. life threatening—information of use to the viewer. Continue reading →
Yes I did…I did not, however, invite you to sit, Lieutenant.
WOODS
Sorry, sir.
ORTEGA
Are you aware that we have just lost contact with the Rodger Young?
WOODS
Everyone’s talking about it, sir.
ORTEGA
Well, I have the video feed from the bridge here. I understand you are the designer of the emergency evasion panel, and the footage raises some fundamental questions about that design. Watch with me now, Lieutenant.
ORTEGA PRESSES A BUTTON ON A CONSOLE ON HIS DESK. F/X: VIDEO WALL
ORTEGA
As you can see, immediately after Captain Deladier issues her order, your panel slides up from a recess in the dash.
(He pauses the video)
WOODS
(After a silence)
Is there a question, sir?
ORTEGA
Why is this panel recessed?
WOODS
To prevent accidental activation, sir.
ORTEGA
But it’s an emergency panel. For crisis situations. It takes two incredibly valuable seconds for this thing to dramatically rise up. What else do you imagine that pilot might have done with those extra two seconds?
WOODS
I…
ORTEGA
Don’t answer that. It’s rhetorical. Next I need you to not explain this layout. Why aren’t the buttons labeled? What does that second one do, and why does it look exactly the same as the emergency evasion button? Are you deliberately trying to confuse our pilots?
(Stares.)
OK, now I actually do want you to explain something.
(Resuming the video)
Why did you cover the panel in glass? Ibanez—and I can’t believe I’m saying this—punches it.
WOODS
The glass is there also to prevent accidental activation, sir.
ORTEGA
But you already covered that with the time-wasting recession. You know she’s likely to have tendon, nerve, and arterial damage now, right? And she’s a pilot, Lieutenant. Without her hands, she’s almost useless to us. And now, in addition to having a giant, peanut-shaped boulder in their face, they’ve got a bridge full of loose glass shards scattered about. Let’s hope the artificial gravity lasts long enough for them to get a broom, or they’re going to be in for some floating laceration ballet.
WOODS
That would be unfortunate, sir.
ORTEGA
Damn right. Now honestly I might be of a mind to simply court martial you and treat you to some good old Federation-approved public flogging for Failure to Design. But today may be your lucky day. I believe your elegant design decisions were exacerbated by the pilot’s being something of a drama queen.
WOODS
The glass was designed to be lifted off, sir.
ORTEGA
(Resuming the video)
Fair enough. My last question…
ORTEGA
Did I see correctly that all of the lights underneath the engine boost light up all at once? The ones labeled POWER ON? AUTO HOME? NOSE RAM? The ones that don’t have anything to do with the engine boost?
WOODS
And…and the adjacent green LED, sir.
ORTEGA
All at once.
WOODS
Sir.
ORTEGA
(Sighs)
Well, as you might not be able to imagine, we’re moving you. After you collect your belongings you are to report to the Reassignment Office.
(He scrubs back and forth over the drone video of the communication tower ripping off.)
ORTEGA
Out of curiosity, WOODS, what was the last thing you designed as part of my department?
After logging in to her station, Ibanez shares a bit of flirty dialog with mushroom-quaffed Zander Barcalow, and Captain Deladier says, “All right, Ibanez. Take her out.” Ibanez grasps the yoke, pulls back, and the ship begins to pull back from the docking station while still attached by two massive cables. Daladier and Barcalow keep silent but watch as the cables grow dangerously taut. At the last minute Ibanez flips a toggle switch on her panel from 0 to 1 and the cables release.
There’s a lot of wrong in just this sequence. I mean, I get narratively what’s happening here: Check her out, she’s a badass maverick (we’re meant to think). But, come on…
Where is the wisdom of letting a Pilot Trainee take the helm on her first time ever aboard a vessel? OK. Sorry. This is an interface blog. Ignore that one.
The 1 and 0 symbols are International Electrotechnical Commission 60417 standards for on and off, respectively. How is the cable’s detachment caused by something turning on? If it was magnetic, shouldn’t you turn the magnetism off to release the cables?
Why use the symbols for ON and OFF for an infrequent, specific task? Shouldn’t this be reserved for a kill switch or power to the station or something major? Or shouldn’t it bear a label reading “Power Cable Magnets” or something to make it more intelligible?
Why is there no safety mechanism for this switch? A cover? A two-person rule? A timed activation? It’s fairly consequential. The countersink doesn’t feel like it’s enough.
Where is the warning klaxon to alert everyone to this potentially disastrous situation?
Why isn’t she dishonorably discharged the moment she started to maneuver the ship while it was still attached to the dock? Oh, shit. Sorry. Interfaces. Right. Interfaces.
The jack mechanism in the intercept van is worth noting for its industrial design. Kusanagi has four jacks on the back of her neck in a square pattern. Four plugs sit on the headrest of her seat. To jack in, she simply leans back, and they seat perfectly. She leans forward, and the cables extend from the seat. Given the simple back and forward motion, it takes all of a second. Seems simple enough. But I’ve committed a blog post to it, so of course you can guess it’s not really that simple. I can see two issues with this interface.
How do the jacks and plugs meet so perfectly?
Of course, she’s a super cyborg, so we can presume she can be quite precise in her movements. But does she have eyes/cameras on the back of her head, or precision kinesthetics and a perfect body memory for position? Even if she does, it would be better would be to accommodate some margin of error to account for bumpy roads or action-packed driving maneuvers.
How to do this? One way would be a countersink so that a sloppy approach is corrected by shape. The popular (and difficult-to-source) keyhole for drunk people uses this same principle. Unfortunately, in the case of this headrest jack, the base object is Kusanagi’s neck, which is functionally a cylinder. The cones on the back of her neck would have to be unsightly large or a miss would splay the plugs and force her to retry. Fortunately, the second issue leads us to another solution.
How does she genuinely rest against the seat when she doesn’t want to jack in?
Is that even an option here? How does she simply lean back for a road trip nap without being blasted awake by a neon green 3D Google Map?
If it was a magnetic connection, like Apple’s MagSafe power connectors, the jacks and plugs could be designed such that magnetic forces pull them together. But unlike MagSafe, these jacks could be electromagnets controlled by Kusanagi. This would not only ensure intended connections, but also help deal with the precision issues raised above. The electromagnets would snap the plugs into place even if they were misaligned.
An electromagnetic interface would also answer the question of how this works for taller or shorter cyborgs hoping to use the same headrest jack.
An automated solution
This solution does require complex mechanics in the body of the rider. That’s no problem for the Ghost in the Shell diegesis, but if we were facing a challenge like this in the real world, implanting users with tech isn’t a viable solution. Instead, we could push the technology back on the van by letting it do the aiming. In the half a second she leans back, the van itself can look through a camera in the headrest to gauge the fit, and position the plugs correctly with, say, linear actuators. This solution lets human users stay human, but would ensure a precision fit where it was needed.
When David is exploring the ancient alien navigation interfaces, he surveys a panel, and presses three buttons whose bulbous tops have the appearance of soft-boiled eggs. As he presses them in order, electronic clucks echo in in the cavern. After a beat, one of the eggs flickers, and glows from an internal light. He presses this one, and a seat glides out for a user to sit in. He does so, and a glowing pollen volumetric projection of several aliens appears. The one before David takes a seat in the chair, which repositions itself in the semicircular indentation of the large circular table.
The material selection of the egg buttons could not be a better example of affordance. The part that’s meant to be touched looks soft and pliable, smooth and cool to the touch. The part that’s not meant to be touched looks rough, like immovable stone. At a glance, it’s clear what is interactive and what isn’t. Among the egg buttons there are some variations in orientation, size, and even surface texture. It is the bumpy-surfaced one that draws David’s attention to touch first that ultimately activates the seat.
The VP alien picks up and blows a few notes on a simple flute, which brings that seat’s interface fully to life. The eggs glow green and emit green glowing plasma arcs between certain of them. David is able to place his hand in the path of one of the arcs and change its shape as the plasma steers around him, but it does not appear to affect the display. The arcs themselves appear to be a status display, but not a control.
After the alien manipulates these controls for a bit, a massive, cyan volumetric projection appears and fills the chamber. It depicts a fluid node network mapped to the outside of a sphere. Other node network clouds appear floating everywhere in the room along with objects that look like old Bohr models of atoms, but with galaxies at their center. Within the sphere three-dimensional astronomical charts appear. Additionally huge rings appear and surround the main sphere, rotating slowly. After a few inputs from the VP alien at the interface, the whole display reconfigures, putting one of the small orbiting Bohr models at the center, illuminating emerald green lines that point to it and a faint sphere of emerald green lines that surround it. The total effect of this display is beautiful and spectacular, even for David, who is an unfeeling replicant cyborg.
At the center of the display, David observes that the green-highlighted sphere is the planet Earth. He reaches out towards it, and it falls to his hand. When it is within reach, he plucks it from its orbit, at which point the green highlights disappear with an electronic glitch sound. He marvels at it for a bit, turning it in his hands, looking at Africa. Then after he opens his hands, the VP Earth gently returns to its rightful position in the display, where it is once again highlighted with emerald, volumetric graphics.
Finally, in a blinding flash, the display suddenly quits, leaving David back in the darkness of the abandoned room, with the exception of the small Earth display, which is floating over a small pyramid-shaped protrusion before flickering away.
After the Earth fades, david notices the stasis chambers around the outside of the room. He realizes that what he has just seen (and interacted with) is a memory from one of the aliens still present.
Hilarious and insightful Youtube poster CinemaSins asks in the video “Everything Wrong with Prometheus in 4 minutes or Less,” “How the f*ck is he holding the memory of a hologram?” Fair question, but not unanswerable. The critique only stands if you presume that the display must be passive and must play uninterrupted like a television show or movie. But it certainly doesn’t have to be that way.
Imagine if this is less like a YouTube video, and more like a playback through a game engine like a holodeck StarCraft. Of course it’s entirely possible to pause the action in the middle of playback and investigate parts of the display, before pressing play again and letting it resume its course. But that playback is a live system. It would be possible to run it afresh from the paused point with changed parameters as well. This sort of interrupt-and-play model would be a fantastic learning tool for sensemaking of 4D information. Want to pause playback of the signing of the Magna Carta and pick up the document to read it? That’s a “learning moment” and one that a system should take advantage of. I’d be surprised if—once such a display were possible—it wouldn’t be the norm.
The only thing I see that’s missing in the scene is a clear signal about the different state of the playback:
As it happened
Paused for investigation
Playing with new parameters (if it was actually available)
David moves from 1 to 2, but the only change of state is the appearance and disappearance of the green highlight VP graphics around the Earth. This is a signal that could easily be missed, and wasn’t present at the start of the display. Better would be some global change, like a global shift in color to indicate the different state. A separate signal might compare As it Happened with the results of Playing with new parameters, but that’s a speculative requirement of a speculative technology. Best to put it down for now and return to what this interface is: One of the most rich, lovely, and promising examples of sensemaking interactions seen on screen. (See what I did there?)
For more about how VP might be more than a passive playback, see the lesson in Chapter 4 of Make It So, page 84, VP Systems Should Interpret, Not Just Report.
