Phone System Analysis

27 Feb 2017 by scifihughf

Note to readers: The author and editor of this series of posts would like to be Matrix-style cool, competent, stylishly-dressed world-changers with superhuman abilities. In reality we are much closer to the protagonists of Johnny Mnemonic: always frantically improvising to stay one step ahead of disaster with a mix of clunky technology. (And we don’t even have a cybernetic dolphin helping out.) So, um, yeah. This post is out of order. Sorry. Please pretend you haven’t read Cyberspace: the Hardware yet. OK. On to an analysis of the phone system.

The video phones in Johnny Mnemonic all seem easy to use and reliable, but this is generally true of all phones in film and TV, video or otherwise. The audience want to see the characters communicate, not struggle with technology – unless difficulty or failure is necessary for the plot!

Rather than look at individual devices, I think it is more interesting to consider the video phone system as a whole. In Johnny Mnemonic the user experience of the phone system is more a software service than a hardware device.

In the film, phones range in size from the giant wall-mount screens to Shinji’s tiny handheld device, and from fixed locations to moving vehicles or handheld. Any computing and display device, wired or wireless, can act as a phone. The system has followed the same evolution as the web-based applications such as Facebook and GMail we use today that are available anywhere there is a web browser. The Internet makes ubiquitous software services possible.

The alternative path, which with the benefit of hindsight we can see is what happened with our current day phones, is personal devices. Instead of expecting computing devices running software to be available everywhere, we have one hardware device with our software on it that we carry everywhere instead. (Obviously this is over-simplifying a bit: the mobile phone system does require cell towers and/or base stations!) It’s an interesting choice for designers.

The two are not necessarily mutually exclusive. Within the film we see Takahashi using a hand tracker, a specialised piece of hardware built into his desk, to control a puppet avatar, a real time photorealistic avatar. Nobody else seems to have such capability, nor does Johnny consider the possibility that the person he is talking to might not be real. This gives Takahashi an advantage over others – but only while he makes all phone calls from his desk.

Why does the phone system still exist?

Current day phones, including the few remaining public phone booths, are all dedicated devices. Even though our mobile phones have become portable computers, the phone capability is still restricted to a manufacturer-installed application. In Johnny Mnemonic the phone system is more like the Ethernet jacks in a hotel room or convention centre, allowing users to connect their own devices. Since every call appears to be digital and is recorded in cyberspace, why have a phone network with numbers instead of, say, email addresses?

While the phone system in Johnny Mnemonic is very flexible in how numbers can be dialed and what can be used as video and audio sources, we only see it used for video phone calls, nothing else. Convergence of the phone system and Internet is often predicted but hasn’t happened because the one advantage that phone networks have is low latency and guaranteed resource allocation. Current day phone calls don’t have the occasional stuttering or delays that occasionally affect Skype sessions. (Your non-Internet phone call may be cut off entirely, but it won’t slow down.) In 2021, the phone system may be entirely digital and with video added, but still carrying traffic on separate, dedicated links to ensure quality.

At the time of writing WebRTC, a collection of standards for Web Real-Time Communication including audio and video, is starting to appear in prototype form in widely available browser software. Perhaps by 2021 the future phone system of Johnny Mnemonic will seem much more realistic.

Cyberspace: the hardware

21 Feb 2017 by scifihughf

And finally we come to the often-promised cyberspace search sequence, my favourite interface in the film. It starts at 36:30 and continues, with brief interruptions to the outside world, to 41:00. I’ll admit there are good reasons not to watch the entire film, but if you are interested in interface design, this will be five minutes well spent. Included here are the relevant clips, lightly edited to focus on the user interfaces.

Click to see video of The cyberspace search.

Click to see Board conversation, with Pharmakom tracker and virus

First, what hardware is required?

Johnny and Jane have broken into a neighbourhood computer shop, which in 2021 will have virtual reality gear just as today even the smallest retailer has computer mice. Johnny clears miscellaneous parts off a table and then sits down, donning a headset and datagloves.

Headset

Headsets haven’t really changed much since 1995 when this film was made. Barring some breakthrough in neural interfaces, they remain the best way to block off the real world and immerse a user into the virtual world of the computer. It’s mildly confusing to a current day audience to hear Johnny ask for “eyephones”, which in 1995 was the name of a particular VR headset rather than the popular “iPhone” of today.

Throughout this cyberspace sequence the virtual reality system Johnny uses gives vocal feedback, usually just confirming what has happened or repeating information visible in cyberspace. Johnny will also use voice commands himself. Jane seemingly can’t hear this feedback, as she has no idea what is happening other than what Johnny tells her. No earbuds or headphones are visible, but nearly all headsets then and now incorporate audio output as well as visual display so presumably sound is the function of the silver bulges at the back of the headset.

Dataglove

Datagloves are less common today. These track the position and orientation of the hands as they move, in this particular case to the bending of individual fingers. In 1995 this was done with magnetic or ultrasonic trackers on each hand and various fibre optic or potentiometer bend sensors on the finger joints, all built into a rather bulky glove. Today this can be done passively by a video camera, for example the Microsoft Kinect or Leap Motion Controller. With these technologies it’s not even necessary to paint dots on the fingers, which unlike faces have convenient gaps in between the points of interest.

Johnny mostly keeps his arms horizontal just above the table surface, but we will occasionally see him reach up. As chapter 5 of Make It So points out, trying to operate a vertical touch screen or gesture interface for any length of time is exhausting, and the same would be true if the VR system required him to frequently lift his hands and arms above the conventional keyboard height.

System status

There is also a system status display on the table.

Various indicators light up as Johnny gets ready. It would be helpful if this were mirrored to the headset, so Johnny could at least see which components are working or not without removing it.

My first impression was that the grid on the table might be some kind of optical tracking aid. Then I remembered that this is a worktable, and protective table mats with a grid pattern printed on them are sold in craft and hardware shops. Not everything in the future needs to be advanced technology.

Voice feedback

As Johnny performs his various actions in cyberspace, another synthesized voice gives him constant feedback, most often telling him which actions and objects have been selected. I suggest this is for new users, who may be confused about exactly what they can and cannot do in virtual reality. (Of course, it is also very useful for telling us the audience what is happening.) Johnny himself is not a new VR users, but since this is a system assembled straight out of the box he gets the default setting. Over time a voice constantly telling you what you’ve done probably becomes irritating, which is why earlier systems were not so chatty.

The tracker

We see a second person in cyberspace during this sequence, although only briefly. This is the Pharmakom tracker, who is trying to locate Johnny and Jane for the Yakuza.

He too wears a headset and gloves, but also has a one piece earphone and microphone. He uses this not for voice commands, but for a phone connection to Shinji, the Yakuza leader in a car.

He is standing in front of a lectern type display.

This shows a street map, with the red cross hairs presumably the location being examined. Current day VR systems often mirror what the headset is showing to a more conventional display as this is very useful in testing and debugging. Note also the rows of unmarked buttons on either side. I’ll discuss these and similar buttons below.

Having him stand is an interesting choice. The advantage of standing in VR is that it allows the participant to bend and turn more freely, using body motion as an input as well as hands and head. The disadvantages are that this is more tiring, and that with the headset blocking the real world, it’s very easy to bump into things. The first commercial VR game, “Dactyl Nightmare” by W Industries, had a waist-high padded fence around the player to stop them falling over or walking too far and breaking the cables.

VR1000 restored by Simon Marston

Here the tracker is risking a painful bruised knee. Perhaps he is a standing desk enthusiast who believes the other health benefits make it worthwhile.

The Curious Unmarked Buttons…

A recurring hardware interface in Johnny Mnemonic is the grid of unmarked buttons. There were two in the upload hotel suite, the image grabber, and the fax machine. And here the lectern display used by the tracker has more of the same.

I can’t recall any others like this, with one exception: the Pixar animated short “Lifted”, which has a vast array of unmarked identical switches. But that was a deliberate caricature, making fun of terribly designed and confusing interfaces.

Research tells us that labelled buttons and keys are the best for learning and use, from computers and phones to their software equivalents on modern touchscreen phones. Even the buttons on consumer remote controls are marked, however cryptic the symbols may be. The only unmarked buttons in current day regular use are those used around the edges of displays for ATMs and in aircraft cockpits. Here the meaning of these “soft buttons” will be shown by the text or graphic displayed nearby.

But this isn’t possible for the unmarked buttons in Johnny Mnemonic, which either don’t have screens or don’t have buttons next to the screen.

…Are a platform for virtual buttons

Perhaps the buttons on the lectern are unmarked because they’re intended for use in cyberspace. If the computer system generating the virtual reality is aware of the lectern’s location in relation to the user, it could generate labels within the virtual reality that the user would perceive as exactly where the physical buttons are. The buttons would then provide actual tactile feedback for location and when pressed.

Talking to a Puppet

16 Feb 2017 by scifihughf

As mentioned, Johnny in the last phone conversation in the van is not talking to the person he thinks he is. The film reveals Takahashi at his desk, using his hand as if he were a sock puppeteer—but there is no puppet. His desk is emitting a grid of green light to track the movement of his hand and arm.

The Make It So chapter on gestural interfaces suggests Takahashi is using his hand to control the mouth movements of the avatar. I’d clarify this a bit. Lip synching by human animators is difficult even when not done in real time, and while it might be possible to control the upper lip with four fingers, one thumb is not enough to provide realistic motion of the lower lip.

Instead I suggest that the same computer modifying his voice is also providing the fine mouth movements, using the same camera that must be present for the video phone calls. So what are the hand motions for? They provide cues as to how fast or slow Takahashi wants his puppet to speak, further disguising his own speech patterns. And the arm position could provide different body language for the avatar as a whole, to ensure for example that the puppet avatar does not react with surprise or anger even if Takahashi himself expresses those emotions.

We saw this avatar in a phone call once before, when Johnny dialed into an internal phone number from the phone booth. But we’ve also seen the video image of Takahashi himself when he called Street Preacher. Perhaps the avatar is an option for incoming calls, just as today we can assign custom ringtones to individual callers on our mobiles. For outgoing calls, an important person such as Takahashi would be more likely to use his true face to impress the callee.

Video phones have been predicted in science fiction fiction and film for a very long time now, but have never achieved wide scale usage. Human communication is richer and more expressive when we can see each other, so why are we resistant? One reason is that in the real world we don’t have makeup artists following us around to ensure we look our best at all times. Donald Norman suggested in chapter 8 of his book Things That Make Us Smart that real time video enhancement would solve this problem, but then if we’re all going to be presenting false avatars to each other, why bother?

A Cringing Computer

After the call ends, Anna, a personality uploaded into a mainframe, appears on the screen. Takahashi is annoyed by this and makes a sweeping arm gesture to get rid of her, detected by the green light grid. The computer screen actually sinks into the desk in response.

This is discussed in chapter 10 of the book as an interface handling emotional input. I’d like to add that this is also an emotional output, the computer seeming to hide itself from an angry user. Given how often current day users express the wish to beat their computers with heavy blunt objects, perhaps that is exactly what it is doing.

Computers in film and TV often have annoying personalities, which is surprising for (presumably) commercial products. Another cringing computer, emphasised by being named “Slave”, made regular appearances in season 4 of Blake’s 7. Would users feel more comfortable if their computer systems gave the appearance of being afraid every time they had to report an error? It’s worth considering.

Quietus

10 Feb 2017 by Christopher Noessel

This post is about the speculative suicide kit called Quietus that appears in Children of Men.

Suicide is not an easy topic and I will do my best to address it seriously. Let me first take a moment to direct anyone who is considering or dealing with suicide to please stop reading this and talk to someone about it. I am unqualified to address—and this blog is not the place to work through—such issues.

In fact because this is a serious life-and-death issue, I’m going against my usual scifiinterfaces tack of thinking through this as a real-world product. While I believe in our right to self-direct our deaths with dignity in the face of terminal illness or longterm suffering, I also believe that it should be handled by caring, informed, and professional people rather than a kit. So, instead, I’m only going to address the design in the context of the film. It would take much more research, time, and the input of many professionals to confidently design for such a product in the real world.

So, on to Quietus, as part of the movie.

The booklet

When Theo visits his friend Jasper’s home, we are introduced to the blue kit, open on the coffee table between them. Theo reads out of a booklet that comes with it, “Is there a chance it will not work for me? There have been no cases of anyone surviving who has taken the preparation.” Afterward their conversation quickly veers off in another direction.

In the subsequent scene, when Theo is woken up by an alarm on his television, an ad for Quietus is playing. In it we read the tagline, “You Decide When,” and read three benefits being sold by the ad.

Up to £2,000 to your next of kin.
Painless transition guaranteed.
Illegals welcome.

The visuals include a man determinately drinking some clear blue liquid in a glass with a Quietus logo, before standing up and walking across a beach toward the surf, only to fade away.

Later, when Theo runs after one of London’s double-decker busses, we see the video ad again on the side of the bus, repeating the tag line and the benefit, “Up to £2,000 to your next of kin.”

In use

In a deeply moving scene (among many in this film) Jasper eventually uses the kit to kill his longtime-unresponsive wife Janice, before the Fishes extremist group comes to their house to kill them.

Evaluation

Quietus is not central to the plot. There are other ways Jasper could have spared his wife a terrible death or mistreatment at the hands of the Fishes.

Rather, Quietus is a narrative, worldbuilding prop that helps us understand the world of the story. It helps us to understand that people are so desperate and depressed they are willing, at mass scale, to consider suicide. It helps us to understand that the government is facing such a terrible lack of resources that it has to incentivize this suicide to keep its population to some manageable level, to those who can still press on. It helps to underscore how important the sound of children’s voices are to most of the world’s sense of hope and purpose.

Given that narrative purpose, the design of the kit is sublime.

The name frames the kit as a positive, peaceful thing. It’s an existing word that means “final thing.” Even the “–us” suffix helps tell the story by appealing to a collective sense. It’s to “quiet us.” The word sounds Latinate and thereby educated, medical, trustworthy. It focuses on a result, i.e. quiet, and distracts from its morbidness.
The logotype looks like it is set in a modified Times New Roman or Garamond (can anyone identify it?), and the letter spacing is wide; signaling familiarity, trust and serenity.
The kit comes with a glass with the logo to give a sense of ritual and importance, reinforce the brand promise, and help the participants get the measurements right.
The repeated use of sky-blue color and white beams in the ad, the box, and the liquid speak to freedom, spirituality, and something greater than ourselves.
The professional design of the kit (its advertisement, the printed graphics on the box) and its high production quality (a glass, a little bottle for the drug, the glossy cardboard of the 4-color printed box, the vacuum-formed plastic that holds these and the booklet) helps us understand the scope of the initiative. This is not something a ragtag group has cobbled together, but an expensive, professional offering.
The reimbursement helps us infer that the reasons the government is offering it are financial.
Welcoming “illegals” reinforces that politically, this world is defined by the refugee crisis, which points to the larger infertility world crisis that gave it rise.

I can imagine two improvements that might increase believability for the story.

The logotype on the glass should be the same one as everywhere else. (We see a closeup of the different logo in the TV ad, see above.) I suspect this is a production error, but the angles of the Futura-like typeface seem cold and precise, off-brand from what we see elsewhere. It doesn’t add anything to have them mismatched, and detracts a bit from the professional, trustworthy veneer.
The organization promises a financial incentive to participants’ next of kin. This adds a believability complication. How would the organization confirm deaths while protecting against fraud?

1. Someone contacts Quietus and says, “I’m about to kill myself with Quietus. Send the money to my cousin John at the following account.” (1a. Doesn’t actually kill themselves. 1b. May actually be the John in question.)

2. Someone contacts Quietus and says, “I’ve just found the body of my cousin John, and a note reading I am to receive money from Quietus.” (2a. John may not be dead. 2b. John may not even be aware of this scam. 2c. Or the cousin may have killed John.)

Presuming that the government still seeks to process cadavers rather than let them decay at the place of death, the local coroner would still be involved in processing the body, and could be used as the source of confirmation of actual death, identity of the body, and relationship to the recipient. To embody this, there would need to be some easy way (and incentive) for the coroner to report the death back to Quietus. This points at a missing artifact in the movie.

I’d recommend a bracelet or necklace in the kit with a blue Quietus background, the logo, and a QR code or large ID number, meant to be worn by the participant prior to taking the drink and later noticed and used by the coroner. Medicalert would be a good, recognizable model for production. In the scene, Jasper would glance at it briefly and discard it, but it would be a nice rounding out of the logic of the service.

Sci-fi Interfaces and Decipher SciFi go to the movies

4 Feb 2017 by Christopher Noessel

OMG y’all. We totally got asked on a date and we should totally go.

So I happen to be in NYC for the Interaction17 conference this week, and agreed with the guys from the Decipher SciFi podcast that we should hang out. So it’s late notice, but we have a plan: Join us at 7:25 P.M. to watch The Space Between Us, and then hangout and chat about it afterward? There may even be podcast recording and interface redesigning, it’s hard to say. Providing you’re not into The Big Game.

Here’s a link to the event details.

https://www.facebook.com/events/1302970839741111/1304373202934208/?notif_t=like&notif_id=1486263480732356

Luke’s predictive HUD

3 Feb 2017 by Christopher Noessel

When Luke is driving Kee and Theo to a boat on the coast, the car’s heads-up-display shows him the car’s speed with a translucent red number and speed gauge. There are also two broken, blurry gauges showing unknown information.

Suddenly the road becomes blocked by a flaming car rolled onto the road by a then unknown gang. In response, an IMPACT warning triangle zooms in several times to warn the driver of the danger, accompanied by a persistent dinging sound.

It commands attention effectively

Props to this attention-commanding signal. Neuroscience tells us that symmetrical expansion like this triggers something called a startle response. (I first learned this in the awesome and highly recommended book Mind Hacks.) Any time we see symmetrical expansion in our field of vision, within milliseconds our sympathetic nervous system takes over, fixes our attention to that spot, and prompts us to avoid the thing that our brains believe is coming right at us. It all happens way before conscious processing, and that’s a good thing. It’s evolutionarily designed to keep us safe from falling rocks, flying fists, and pouncing tigers, and scenarios like that don’t have time for the relatively slow conscious processes.

Well visualized

The startle response varies in strength depending on several things.

The anxiety of the person (an anxious person will react to a slighter signal)
The driver’s habituation to the signal
The strength of the signal, in this case…
- Contrast of the shape against its background
- The speed of the expansion
The presence of a prepulse stimulus

We want the signal to be strong enough to grab the attention of a possibly-distracted driver, but not strong enough to cause them to overreact and risk control of car. While anything this critical to safety needs to be thoroughly tested, the size of the IMPACT triangle seems to sit in the golden mean between these two.

And while the effect is strongest in the lab with a dark shape expanding over a light background, I suspect given habituation to the moving background of the roadscape and a comparatively static HUD, the sympathetic nervous system would have no problem processing this light-on-dark shape.

Well placed

We only see it in action once, so we don’t know if the placement is dynamic. But it appears to be positioned on the HUD such that it draws Luke’s attention directly to the point in his field of vision where the flaming car is. (It looks offset to us because the camera is positioned in the middle of the back seat rather than the driver’s seat.) This dynamic positioning is great since it saves the driver critical bits of time. If the signal was fixed, then the driver would have his attention pulled between the IMPACT triangle and the actual thing. Much better to have the display say, “LOOK HERE!”

Readers of the book will recall this nuance from the lesson from Chapter 8, Augment the Periphery of Vision: “Objects should be placed at the edge of the user’s view when they are not needed, and adjacent to the locus of attention when they are.”

Improvements

There are a few improvements that could be made.

It could synchronize the audio to the visual. The dinging is dissociated from the motion of the triangle, and even sounds a bit like a seat belt warning rather than something trying to warn you of a possible, life-threatening collision. Having the sound and visual in sync would strengthen the signal. It could even increase volume with the probability and severity of impact.
It could increase the strength of the audio signal by suppressing competing audio, by pausing any audio entertainment and even canceling ambient sounds.
It could predict farther into the future. The triangle only appears once the flaming car actually stops in the road a few meters ahead. But there is clearly a burning car rolling down to the road for seconds before that. We see it. The passengers see it. Better sensors and prediction models would have drawn Luke’s attention to the problem earlier and helped him react sooner.
It could also know when the driver is actually focused on the problem and than fade the signal to the periphery so that it does not cover up any vital visual information. It can then fade completely when the risk has passed.
An even smarter system might be able to adjust the strength of the signal based on real-time variables, like the anxiety of the driver, his or her current level of distraction, ambient noise and light, and of course the degree of risk (a tumbleweed vs. a small child on the road).
It could of course go full agentive and apply the brakes or swerve if the driver fails to take appropriate action in time.

Despite these improvements, I believe Luke’s HUD to be well designed that gets underplayed in the drama and disorientation of the scene.

Video Phone Calls

1 Feb 2017 by scifihughf

The characters in Johnny Mnemonic make quite a few video phone calls throughout the film, enough to be grouped in their own section on interfaces.

The first thing a modern viewer will note is that only one of the phones resembles a current day handheld mobile. This looks very strange today and it’s hard to imagine why we would ever give up our beloved iPhones and Androids. I’ll just observe that accurately predicting the future is difficult (and not really the point) and move on.

More interesting is the variety of phones used. In films from the 1950s to the 1990s, everyone uses a desk phone with a handset. (For younger readers: that is the piece you picked up and held next to your ear and mouth. There’s probably one in your parents’ house.) The only changes were the gradual replacement of rotary dials by keypads, and some cordless handsets. In 21st century films everyone uses a small sleek handheld box. But in Johnny Mnemonic every phone call uses a different interface.

New Darwin

First is the phone call Johnny makes from the New Darwin hotel.

As previously discussed, Johnny is lying in bed using a remote control to select numbers on the onscreen keypad. He is facing a large wall mounted TV/display screen, with what looks like a camera at the top. The camera is realistic but unusual: as Chapter 10 of Make It So notes, films very rarely show the cameras used in visual communication.

Taxi

The second phone call takes place in Newark, as Johnny rides in a taxi from the airport. Since this is a moving vehicle rather than a room, it shows that wireless videophones also exist. We don’t see how the call is made, just the conversation. Johnny is looking at and speaking into a small screen in front of his seat.

Quick aside: The blue lines at the bottom of the screen are a street map, with the glowing dot being the taxi. While it’s not the focus of this particular interface, it’s interesting that this map seems to be fixed with the indicator moving sideways. Aircraft and now car navigators use a moving map with the indicator moving up for forward. But this is for the passenger rather than the driver so doesn’t need to be particularly useful. And it’s blue, so must be advanced.

At the other end is Ralphie, who is using a desk screen with a keyboard.

We get to see things from Ralphie’s end. His keyboard only has ten keys in two rows of five. Ralphie touches the middle key in the bottom row to end the call.

Is this a dedicated phone rather than a computer? The only full-sized keyboards we see in Johnny Mnemonic are part of systems implied to be outdated or salvaged. Perhaps by 2021 voice recognition is good enough to handle most input. Or perhaps by 2021 status indicators have changed and once again nobody who considers themselves important would have a QWERTY keyboard on their desk, leaving others to do the more “menial” typing.

Shinji’s mobile

There is a cyberspace sequence (discussed in a separate post) during which there is a conversation between a Pharmakom tracker and Shinji, the leader of the Yakuza searching for Johnny, who is in en route by car. Shinji’s phone seems to be just like a current day mobile, if perhaps a little smaller than we’re used to.

Takahashi’s desk phone

Takahashi, head of Pharmakom in Newark, has a desktop screen too. This is a general purpose computer which at various times displays video of his daughter and a corporate database entry about Anna, the Pharmakom founder.

There is no keyboard, but later we will see that the desk surface has hand gesture tracking capability. Here the screen displays an onscreen video phone window and numeric keypad, similar to what we saw in the New Darwin sequence, but Takahashi doesn’t use that interface. Instead he just says “Get me Karl” and the phone dials the recipient automatically.

Takahashi doesn’t prefix his command with a control phrase such as“Siri” or “Computer” which would imply that the computer is always listening. For an executive with a private office this would be reasonable: who else could he be addressing? A second possibility is that the computer does voice recognition and would not respond to commands from anyone else.

Street Preacher’s Phone

As before, the recipient has chosen to show a video splash screen on connection instead of a live video feed.

“Karl” is more commonly known as Street Preacher and works within a church of sorts. We don’t know whether this is genuine religion belief on his part or a cover operation. His phone system is built into a large book, which I thought was intended to be a Bible but Chris identifies as a 16th century ecclesiastical history. There are no controls visible, but we see Karl “pick up” by opening the book so perhaps he “hangs up” by closing it again. Otherwise it could be operated purely by voice.

Public phone

Earlier in the film, Johnny picked up an “Infobahn 3000” handset with built in phone keypad.

His next phone call is from a public phone booth. On screen we see the now familiar videophone keypad. (Apparently this time in cyan, although it’s a very minor color shift.). To the right of the screen are physical buttons, some of which are labelled “start” “stop” and “pause” so perhaps duplicate the onscreen controls. Johnny begins by borrowing Jane’s phone card and swiping it through the payment slot.

The red Infobahn handset is connected to Jane’s card by a cable, although we don’t see Johnny doing this. Johnny types on the handset keypad rather than using the onscreen controls, presumably doing some hacking through the interface.

At first sight it seems unlikely that the phone system could be hacked through an EFTPOS card reader. However there is a long and unhappy history of programmers leaving backdoors and unused functionality in products, often excused with “Well, nobody else knows about it”, which are then exploited. Payment cards themselves often have embedded integrated circuits. This particular hack is not completely implausible.

When the Pharmakom splash screen appears, Johnny types again on the handset. He is manipulating the internal company phone system to gain access to a number that normally would not be available to the public.

The new number connects Johnny to a surprised corporate type who wants to know how Johnny got through.

We’ll learn later on that this gentleman is not at all who he seems to be. For now, note that Johnny talks and listens directly to the screen and speakers in the phone booth, not the handset he is holding.

Spider phone

Just before his brain is scanned by Spider, Johnny tries to make another call. This time he uses a typical 1990s computer CRT display and keyboard. He wears a conventional looking earpiece and microphone, and there is a small camera mounted on top of the display. He types the number on the keyboard and reaches a Pharmakom receptionist, but Johnny is interrupted.

Van call

The last phone call is made by Johnny to Pharmakom again. This time he is in Spider’s van, which doesn’t have a built in phone like the taxi we saw earlier. He uses the handset for audio and a small portable screen for video. There must be a wireless transmitter and receiver somewhere, but it isn’t obvious.

Johnny doesn’t realise that he is actually talking to Takahashi, the head of Pharmakom, through a puppet avatar, which I’ll talk about in the next post.

Sci-fi interfaces

Stop watching sci-fi. Start using it.

Monthly Archives: February 2017