In their forecasting workshops, the Institute for the Future trains practitioners to sensitize themselves to “signals,” something that may seem banal but on reflection foretells great change or deep meaning. That story about the arctic penguins who accepted a furry remote controlled camera as a chick is one of mine. Still wrestling with its implications. This interface is another.
After Joe walks past the FloorMaster and Insurance Slot Machines, he finally makes it up to the triage desk. It’s labeled CHECK-IN, and the sign devotes a large portion of its space to advertising. He speaks to the employee there, named Biggiez, who blankly listens to him talk about how he’s feeling. As he talks, she looks down at a wide panel of buttons, floating her pointing finger above the unlabeled icons that kind-of describe common ailments.
When Joe says, “I don’t even know where I am,” she finally pushes an icon featuring a stick figure, shrugging, with two question marks floating in the space beside its sad face. In response, it lights up, we hear a ding, and a SMARTSPEEK device on Biggiez’ blouse says, “Please proceed to the diagnostic area on the right…and have a healthy day.” Joe moves on to the diagnosis bay, which I’ll discuss in the next post.
After selecting its location from a map, Johnny is now in front of the virtual entrance to the hotel. The virtual Beijing has a new color scheme, mostly orange with some red.
The “entrance” is another tetrahedral shape made from geometric blocks. It is actually another numeric keypad. Johnny taps the blocks to enter a sequence of numbers.
The tetrahedral keypad
Note that there can be more than one digit within a block. I mentioned earlier that it can be difficult to “press” with precision in virtual reality due to the lack of tactile feedback. Looking closely, here the fingers of Johnny’s “hands” cast a shadow on the pyramid, making depth perception easier.Continue reading →
Cyberspace is usually considered to be a 3D spatial representation of the Internet, an expansion of the successful 2D desktop metaphor. The representation of cyberspace used in books such as Neuromancer and Snow Crash, and by the film Hackers released in the same year, is an abstract cityscape where buildings represent organisations or individual computers, and this what we see in Johnny Mnemonic. How does Johnny navigate through this virtual city?
Gestures and words for flying
Once everything is connected up, Johnny starts his journey with an unfolding gesture. He then points both fingers forward. From his point of view, he is flying through cyberspace. He then holds up both hands to stop.
Both these gestures were commonly used in the prototype VR systems of 1995. They do however conflict with the more common gestures for manipulating objects in volumetric projections that are described in Make It So chapter 5. It will be interesting to see which set of gestures is eventually adopted, or whether they can co-exist.
Later we will see Johnny turn and bank by moving his hands independently.
The android David tends to the ship and the hypersleping crew during the two-year journey.
The first part of the interface for checking in on the crew is a cyan-blue touch screen labeled “HYP.SL” in the upper left hand corner. The bulk of this screen is taken up with three bands of waveforms. A “pulse” of magnification flows across the moving waveforms from left to right every second or so, but its meaning is unclear. Each waveform appears to show a great deal of data, being two dozen or so similar waveforms overlaid onto a single graph. (Careful observers will note that these bear a striking resemblance to the green plasma-arc alien interface seen later in the film, and so their appearance may have been driven stylistically.)
To the right of each waveform is a medium-sized number (in Eurostile) indicating the current state of the index. They are color-coded for easy differentiation. In contrast, the lines making up the waveform are undifferentiated, so it’s hard to tell if the graph shows multiple data points plotted to a single graph, or a single datapoint across multiple times. Whatever the case, the more complex graph would make identifying a recent trend more complicated. If it’s useful to summarize the information with a single number on the right, it would be good to show what’s happening to that single number across the length of the graph. Otherwise, you’re pushing that trendspotting off to the user’s short term memory and risking missing opportunities for preventative measures.
Another, small diagram in the lower left is a force-directed, circular edge bundling diagram, but as this and the other controls on the screen are inscrutable, we cannot evaluate their usefulness in context.
After observing the screen for a few seconds, David touches the middle of the screen, a wave of distortion spreads from his finger for a half a second, and we hear a “fuzz” sound. The purpose of the touch is unclear. Since it makes no discernable change in the interface, it could be what I’ve called one free interaction, but this seems unlikely since such cinematic attention was given to it. My only other guess is to register David’s presence there like a guard tour patrol system or watchclock that ensures he’s doing his rounds.