(Other) wearable communications

The prior posts discussed the Star Trek combadge and the Minority Report forearm-comm. In the same of completeness, there are other wearable communications in the survey.

There are tons of communication headsets, such as those found in Aliens. These are mostly off-the-shelf varieties and don’t bear a deep investigation. (Though readers interested in the biometric display should check out the Medical Chapter in the book.)

Besides these there are three unusual ones in the survey worth noting. (Here we should give a shout out to Star Wars’ Lobot, who might count except given the short scenes where he appears in Empire it appears he cannot remove these implants, so they’re more cybernetic enhancements than wearable technology.)

Gattaca-159

In Gattaca, Vincent and his brother Anton use wrist telephony. These are notable for their push-while-talking activation. Though it’s a pain for long conversations, it’s certainly a clear social signal that a microphone is on, it telegraphs the status of the speaker, and would make it somewhat difficult to accidentally activate.

Firefly_E11_036

In the Firefly episode “Trash”, the one-shot character Durran summons the police by pressing the side of a ring he wears on his finger. Though this exact mechanism is not given screen time, it has some challenging constraints. It’s a panic button and meant to be hidden-in-plain-sight most of the time. This is how it’s social. How does he avoid accidental activation? There could be some complicated tap or gesture, but I’d design it to require contact from the thumb for some duration, say three seconds. This would prevent accidental activation most of the time, and still not draw attention to itself. Adding an increasingly intense haptic feedback after a second of hold would confirm the process in intended activations and signal him to move his thumbs in unintended activations.

BttF_066

In Back to the Future, one member the gang of bullies that Marty encounters wears a plastic soundboard vest. (That’s him on the left, officer. His character name was Data.) To use the vest, he presses buttons to play prerecorded sounds. He emphasizes Future-Biff’s accusation of “chicken” with a quick cluck. Though this fails the sartorial criteria, being hard plastic, as a fashion choice it does fit the punk character type for being arresting and even uncomfortable, per the Handicap Principle.

There are certainly other wearable communications in the deep waters of sci-fi, so any additional examples are welcome.

Next up we’ll take a look at control panels on wearables.

2nd Edition

composite

What you see pictured is photographic evidence. Sharp-eyed readers have, since the publication of the book, identified several Errata where we’d gotten a fact wrong, or misspelled something, or misattributed a picture.

With the printing of our brand-spanking-new 2nd Edition, these mistakes have been corrected. If you’re the OCD type who really wants their sci-fi interface analysis books to be perfect, now’s your chance for an upgrade. If you were an early purchaser, keep those old copies on hand. Maybe they’ll be like 1969-S Lincoln Cent With a Doubled Die Obverse: crazy valuable exactly because of the mistakes. Maybe not. But in any case, now’s your chance to sift through and find any additional errata everyone else has missed.

And of course thanks to all the fans who got us to a second edition. Here’s to a third. 🙂

Precrime forearm-comm

MinRep-068

Though most everyone in the audience left Minority Report with the precrime scrubber interface burned into their minds (see Chapter 5 of the book for more on that interface), the film was loaded with lots of other interfaces to consider, not the least of which were the wearable devices.

Precrime forearm devices

These devices are worn when Anderton is in his field uniform while on duty, and are built into the material across the left forearm. On the anterior side just at the wrist is a microphone for communications with dispatch and other officers. By simply raising that side of his forearm near his mouth, Anderton opens the channel for communication. (See the image above.)

MinRep-080

There is also a basic circular display in the middle of the posterior left forearm that displays a countdown for the current mission: The time remaining before the crime that was predicted to occur should take place. The text is large white characters against a dark background. Although the translucency provides some visual challenge to the noisy background of the watch (what is that in there, a Joule heating coil?), the jump-cut transitions of the seconds ticking by commands the user’s visual attention.

On the anterior forearm there are two visual output devices: one rectangular perpetrator information (and general display?) and one amber-colored circular one we never see up close. In the beginning of the film Anderton has a man pinned to the ground and scans his eyes with a handheld Eyedentiscan device. Through retinal biometrics, the pre-offender’s identity is confirmed and sent to the rectangular display, where Anderton can confirm that the man is a citizen named Howard Marks.

Wearable analysis

Checking these devices against the criteria established in the combadge writeup, it fares well. This is partially because it builds on a century of product evolution for the wristwatch.

It is sartorial, bearing displays that lay flat against the skin connected to soft parts that hold them in place.

They are social, being in a location other people are used to seeing similar technology.

It is easy to access and use for being along the forearm. Placing different kinds of information at different spots of the body means the officer can count on body memory to access particular data, e.g. Perp info is anterior middle forearm. That saves him the cognitive load of managing modes on the device.

The display size for this rectangle is smallish considering the amount of data being displayed, but being on the forearm means that Anderton can adjust its apparent size by bringing it closer or farther from his face. (Though we see no evidence of this in the film, it would be cool if the amount of information changed based on distance-to-the-observer’s face. Writing that distanceFromFace() algorithm might be tricky though.)

There might be some question about accidental activation, since Anderton could be shooting the breeze with his buddies while scratching his nose and mistakenly send a dirty joke to a dispatcher, but this seems like an unlikely and uncommon enough occurrence to simply not worry about it.

Using voice as the input is cinemagenic, but especially in his line of work a subvocalization input would keep him more quiet—and therefore safer— in the field. Still, voice inputs are fast and intuitive, making for fairly apposite I/O. Ideally he might have some haptic augmentation of the countdown, and audio augmentation of the info so Anderton wouldn’t have to pull his arm and attention away from the perpetrator, but as long as the information is glanceable and Anderton is merely confirming data (rather than new information), recognition is a fast enough cognitive process that this isn’t too much of a problem.

All in all, not bad for a “throwaway” wearable technology.

The combadge & ideal wearables

There’s one wearable technology that, for sheer amount of time on screen and number of uses, eclipses all others, so let’s start with that. Star Trek: The Next Generation introduced a technology called a combadge. This communication device is a badge designed with the Starfleet insignia, roughly 10cm wide and tall, that affixes to the left breast of Starfleet uniforms. It grants its wearer a voice communication channel to other personnel as well as the ship’s computer. (And as Memory Alpha details, the device can also do so much more.)

Chapter 10 of Make It So: Interaction Design Lessons from Science Fiction covers the combadge as a communication device. But in this writeup we’ll consider it as a wearable technology.

Enterprise-This-is-Riker Continue reading

Wearable technologies in sci-fi

IMG_8951_

Recently I was interviewed for The Creators Project about wearable technologies for the Intel Make It Wearable Challenge, both for my (old) role as a designer and managing director at Cooper and in relation to sci-fi interfaces. In that interview I referenced a few technologies from the survey relevant to our conversation. Video is a medium constrained by time, so here on scifiinterfaces.com I hope to give the topic a more thorough consideration.

This is a different sort of post than I’ve put to the blog before, more akin to the chapters from the book. This won’t be about a single movie or television show as much as it is a cross-section from many shows.

Image courtesy of Creative Applications Network

Image courtesy of Creative Applications Network

Defining wearable

What counts? Fortunately we don’t have to work too hard on this definition. The name makes it pretty clear that these are technologies worn on the body, either directly or incorporated into clothing. But there’s two edge cases that might count, but I’ll call out as specifically not wearable.

TheFifthElement-Rhod-002

Carryable technologies—like cell phones, most weapons, or even Ruby Rhod’s staff from The Fifth Element—aren’t quite the same thing. When in use, these technologies occupy one or both of the hands of its user. They also have to be holstered or manually put away when not in use. That introduces some different constraints, microinteractions, and ergonomic considerations. In contrast, wearable technologies don’t need to be fetched from storage. They’re just…there, usable at a moment’s notice. So for purposes of the sci-fi interfaces from the survey, I’m only looking at wearable technologies and not these carryable ones.

IronMan_186

Perhaps more controversially, exosuits lie outside the definition. Certainly by definition exosuits are worn. Tony Stark’s Iron Man suit, the loader that Ripley wears in Aliens, or the APUs used to defend Zion in The Matrix: Revolutions are all worn by their users. But these technologies can’t really be donned or removed casually. Users climb into them and strap in, or as with Iron Man, are mechanically sealed inside. That breaks a connotation of the term “wearable” as its used today, and that is that wearable technology fits into our everyday lives. It’s thin, light, and flexible enough to let us ride the bus, have coffee with a friend, or attend to our jobs with little to no disruption. I can’t really see trying to use Ripley’s loader to grab hold of my espresso cup and ask someone about how their day’s gone, so exosuits are out. (Attentive readers note that exosuits are also called out as excluded from of gestural technologies in Chapter 5 of the book. Fans of these cool interfaces must still wait, but someday these devices will get their due attention.)

Catch me soon if I’m wrong in excluding these two categories of tech from wearables, because the remainder of the writeups are based on this boundary.

Even excluding these two, we’re left with quite a bit to consider, reaching almost back to the beginning of cinema. The first sci-fi film, La Voyage Dans La Lune, had nothing we’d recognize as an interface, so of course that’s off the hook. The second, Metropolis, for all of its prescience, puts technology in the furniture and walls of its Upper City, as monstrous edifices in the Lower City, or as the wicked robot Maria.

But the next thing in the survey is the Buck Rogers serials from the 1930s, and there we see a few technologies that are worn. Since then, we’ve seen devices for communication, mind control, biometrics, fashion, gaming, tracking, plus a few nifty one-offs. Of course the survey is just that, the catalog of interfaces captured and documented so far. Sci-fi is vast and has continued since the book was published. If you see any missing by the time I wrap these up, please let me know.

With this introduction complete, the next several posts we’ll look at several examples in details. But the first one is the big one, and that’s the Star Trek combadge.

The HoverChair Social Network

WallE-SocialNetwork03

The other major benefit to the users of the chair (besides the ease of travel and lifestyle) is the total integration of the occupant’s virtual social life, personal life, fashion (or lack-thereof), and basic needs in one device. Passengers are seen talking with friends remotely, not-so-remotely, playing games, getting updated on news, and receiving basic status updates. The device also serves as a source of advertising (try blue! it’s the new red!).

A slight digression: What are the ads there for? Considering that the Axiom appears to be an all-inclusive permanent resort model, the ads could be an attempt to steer passengers to using resources that the ship knows it has a lot of. This would allow a reprieve for heavily used activities/supplies to be replenished for the next wave of guests, instead of an upsell maneuver to draw more money from them. We see no evidence of exchange of money or other economic activity while on-board the Axiom

OK, back to the social network.

Security?

It isn’t obvious what the form of authentication is for the chairs. We know that the chairs have information about who the passenger prefers to talk to, what they like to eat, where they like to be aboard the ship, and what their hobbies are. With that much information, if there was no constant authentication, an unscrupulous passenger could easily hop in another person’s chair, “impersonate” them on their social network, and play havoc with their network. That’s not right.

It’s possible that the chair only works for the person using it, or only accesses the current passenger’s information from a central computer in the Axiom, but it’s never shown. What we do know is that the chair activates when a person is sitting on it and paying attention to the display, and that it deactivates as soon as that display is cut or the passenger leaves the chair.

We aren’t shown what happens when the passenger’s attention is drawn away from the screen, since they are constantly focused on it while the chair is functioning properly.

If it doesn’t already exist, the hologram should have an easy to push button or gesture that can dismiss the picture. This would allow the passenger to quickly interact with the environment when needed, then switch back to the social network afterwards.

And, for added security in case it doesn’t already exist, biometrics would be easy for the Axiom. Tracking the chair user’s voice, near-field chip, fingerprint on the control arm, or retina scan would provide strong security for what is a very personal activity and device. This system should also have strong protection on the back end to prevent personal information from getting out through the Axiom itself.

Social networks hold a lot of very personal information, and the network should have protections against the wrong person manipulating that data. Strong authentication can prevent both identity theft and social humiliation.

Taking the occupant’s complete attention

While the total immersion of social network and advertising seems dystopian to us (and that’s without mentioning the creepy way the chair removes a passenger’s need for most physical activity), the chair looks genuinely pleasing to its users.

They enjoy it.

But like a drug, their enjoyment comes at the detriment of almost everything else in their lives. There seem to be plenty of outlets on the ship for active people to participate in their favorite activities: Tennis courts, golf tees, pools, and large expanses for running or biking are available but unused by the passengers of the Axiom.

Work with the human need

In an ideal world a citizen is happy, has a mixture of leisure activities, and produces something of benefit to the civilization. In the case of this social network, the design has ignored every aspect of a person’s life except moment-to-moment happiness.

This has parallels in goal driven design, where distinct goals (BNL wants to keep people occupied on the ship, keep them focused on the network, and collect as much information as possible about what everyone is doing) direct the design of an interface. When goal-driven means data driven, then the data being collected instantly becomes the determining factor of whether a design will succeed or fail. The right data goals means the right design. Wrong data goals mean the wrong design.

Instead of just occupying a person’s attention, this interface could have instead been used to draw people out and introduce them to new activities at intervals driven by user testing and data. The Axiom has the information and power, perhaps even the responsibility, to direct people to activities that they might find interesting. Even though the person wouldn’t be looking at the screen constantly, it would still be a continuous element of their day. The social network could have been their assistant instead of their jailer.

One of the characters even exclaims that she “didn’t even know they had a pool!”. Indicating that she would have loved to try it, but the closed nature of the chair’s social network kept her from learning about it and enjoying it. By directing people to ‘test’ new experiences aboard the Axiom and releasing them from its grip occasionally, the social network could have acted as an assistant instead of an attention sink.

WallE-SocialNetwork05

Moment-to-moment happiness might have declined, but overall happiness would have gone way up.

The best way for designers to affect the outcome of these situations is to help shape the business goals and metrics of a project. In a situation like this, after the project had launched a designer could step in and point out those moments were a passenger was pleasantly surprised, or clearly in need of something to do, and help build a business case around serving those needs.

The obvious moments of happiness (that this system solves for so well) could then be augmented by serendipitous moments of pleasure and reward-driven workouts.

We must build products for more than just fleeting pleasure

WallE-SocialNetwork09

As soon as the Axiom lands back on Earth, the entire passenger complement leaves the ship (and the social network) behind.

It was such a superficial pleasure that people abandoned it without hesitation when they realized that there was something more rewarding to do. That’s a parallel that we can draw to many current products. The product can keep attention for now, but something better will come along and then their users will abandon them.

WallE-SocialNetwork07

A company can produce a product or piece of software that fills a quick need and initially looks successful. But, that success falls apart as soon as people realize that they have larger and tougher problems that need solving.

Ideally, a team of designers at BNL would have watched after the initial launch and continued improving the social network. By helping people continue to grow and learn new skills, the social network could have kept the people aboard the Axiom it top condition both mentally and physically. By the time Wall-E came around, and life finally began to return to Earth, the passengers would have been ready to return and rebuild civilization on their own.

To the designers of a real Axiom Social Network: You have the chance to build a tool that can save the world.

We know you like blue! Now it looks great in Red!