As mentioned, Johnny in the last phone conversation in the van is not talking to the person he thinks he is. The film reveals Takahashi at his desk, using his hand as if he were a sock puppeteer—but there is no puppet. His desk is emitting a grid of green light to track the movement of his hand and arm.
The Make It So chapter on gestural interfaces suggests Takahashi is using his hand to control the mouth movements of the avatar. I’d clarify this a bit. Lip synching by human animators is difficult even when not done in real time, and while it might be possible to control the upper lip with four fingers, one thumb is not enough to provide realistic motion of the lower lip.Continue reading →
Marty Sr. answers a call from a shady business colleague shortly after coming home. He takes the call in the den on the large video screen there. As he approaches the screen, he sees a crop of a Renoir painting, Dance at La Moulin de la Galette, with a blinking legend INCOMING CALL along the bottom. When he answers it, the Renoir shrinks to a corner of the screen, revealing the live video feed with his correspondent. During the conversation, the Renoir disappears, and text appears near the bottom of the screen providing reminders about the speaker. This appears automatically, with no prompting from Marty Sr.
Needles, Douglas J. Occupation: Sys Operations Age: 47 Birthday: August 6, 1968 Address: 88 Oriole Rd, A6t Wife: Lauren Anne Children: Roberta, 23 Amy, 20 Food Prefence: Steak, Mex Food Dislike: Fish, Tuna Drinks: Scotch, Beer Hobbies: Avid Basketball Fan Sports: Jogging, Slamball, Tennis Politics: None
This is an augmented reality teleconference, as mentioned in Chapter 8 of Make It So: Interaction Design Lessons from Science Fiction. See more information in that chapter. In short, it’s a particularly good example of one type of augmentation that is very useful for people having to interact with networks of people much larger than Dunbar’s number equips us for. Unfortunately, the information appears in a distracting scroll across the bottom, and is not particularly pertinent to the conversation, so could benefit from a bit of context awareness or static high-resolution display to be really useful.Continue reading →
Doc Brown uses some specialized binoculars to verify that Marty Jr. is at the scene according to plan. He flips them open and puts his eyes up to them. When we see his view, a reticle of green corners is placed around the closest individual in view. In the lower right hand corner are three measurements, DIST, gamma, and XYZ. These numbers change continuously. A small pair of graphics at the bottom illustrate whether the reticle is to left or right of center.
As discussed in Chapter 8 of Make It So, augmented reality systems like this can have several awarenesses, and this has some sensor display and people awareness. I’m not sure what use the sensor data is to Doc, and the people detector seems unable to track a single individual consistently.
So, a throwaway interface that doesn’t help much beyond looking gee-whiz(1989).