Sci-fi University Episode 2: Synecdoche & The Ghost in the Shell

How can direct manipulation work on objects that are too large to be directly manipulated?

Sci-fi University critically examines interfaces in sci-fi that illustrate core design concepts. In this 3:30 minute episode, Christopher discusses how the interfaces of Ghost in the Shell introduces synecdoche to our gestural language.

If you know someone who likes anime, and is interested in natural user interfaces—especially gesture—please share this video with them.

Special ありがとう to Tom Parker for his editing.

Watch a supercut of every user interface from The Avengers (2013)

With the reviews of Oblivion behind us, and The Avengers: Age of Ultron upon us in a matter of days, I thought it would be good to review the movie that canonized Joss Whedon into Hollywood sainthood so hard they had to retcon Catholicism into the timeline so this joke could happen.

Here it is, a supercut of every user interface in The Avengers (2013).

Boy there are some amazing interfaces in there. Got any favorites?

Report Card: Oblivion

Read all the Oblivion reviews in chronological order.

According to the director, Oblivion is “a daylight science fiction film with a kind of Twilight Zone story,” a callback to pre-Star Wars, 1970’s lonely man sci-fi set against a huge backdrop. (Read the full interview by Germain Lussier on /Film for more.) Certainly, it’s more visually-satisfying thing than intellectually-satisfying thing, but fortunately that same thing does not play out in the interfaces.

Oblivion-Report-Card

Continue reading

It’s the (drone) ethics

Today, a post touching on some of the ethical issues at hand with drone technology.

drone-week

Much of the debate today and in science fiction about drone technologies rightly focuses on ethics. To start, it is valuable to remember that drones are merely a technology like any other. While the technology’s roots have been driven by military research and military applications, like, say, the internet, the examples in the prior posts demonstrate that the technology can be so much more. But of course it’s not that simple.

Hang on, it’s going to get nerdy. But that’s why you come to this blog, innit?

Where drones become particularly challenging to assess in an ethical context is in their blurring of the lines of agency and accountability. As such, we must consider the ethics of the relationship between user/creator and the technology/device itself. A gun owner doesn’t worry about the gun…itself…turning on him or her. However, in Oblivion, for instance, Tom Cruise’s character flies and repairs the Predator-esque drones but then has them turn on him when their sensors see him as a threat.

image05

While not obviously not an autonomous strong artificial intelligence, a real-world drone alternates between being operated manually and autonomously. Even a hobbyist with a commercial quadcopter can feel this awkward transition when they switch from flying their drone like an RC plane to preprogramming it to fly a pattern or take photos. This transition in agency has serious implications.

Anonymity

When you see someone standing in park, looking at a handheld control or staring up into the sky at their quadcopter buzzing around, the actions of that device are attributed to them. But seeing a drone flying without a clear operator in sight gives any observer a bit of the creeps. Science fiction’s focus on military drones has meant that the depictions can bypass questions about who owns and operates them—it is always the state or the military. But as consumer drones become increasingly available it will become unclear to whom or what we can attribute the actions of a drone. Just this year there was serious public concern when drones were spotted flying around historical landmarks in Paris because their control was entirely anonymous. Should drones have physical or digital identification to service a “license plate” of sorts that could link any actions of the drone to its owner? Most probably. But the bad guys will just yank them off.

The author (in blue) and Chris Noessel (in black), at InfoCamp.

The author (in blue) and Chris Noessel (in black), at InfoCamp.

Gap between agent and outcome

Many researchers have explored the difference between online behaviour and in-person behavior. (There’s a huge body of research here. Contact me if you want more information.) People have a lot less problem typing a vitriolic tweet when they don’t have to face the actual impact of that tweet on the receiver. Will drones have a similar effect? Unlike a car, where the driver is physically within the device and operating it by hand and foot, a drone might be operated a distance of hundreds of feet (or even thousands of miles, for military drones). Will this physical distance, mediated by a handheld controller, a computer interface, or a smartphone application change how the operator behaves? For instance, research has found that these operators, thousands of miles away from combat and working with a semi autonomous technology, are in fact at risk for PTSD. They still feel connected and in enough control of the drone that its effects have a significant impact on their mental health.

However, as drones become more ubiquitous, their applications become more diverse (and mundane), and their agency increases, will this connection remain as strong? If Amazon has tens of thousands of drones flying from house to house, do the technicians managing their flight paths feel the ethical implications of one crashing through a window the same as if they had accidentally knocked a baseball through? If I own a drone and program it to pick up milk from the store, do I feel fully responsible for its behaviour as part of that flight pattern Or does the physical distance, the intangible interface and the mediating technology (the software and hardware purchased from a drone company) disassociate the agent from the effect of the technology?Just imagine the court cases.

From Breaking Defense: As drone operations increase, the military is researching effective interfaces to support human operators

From Breaking Defense: As drone operations increase, the military is researching effective interfaces to support human operators

What are the ethical consequences of the different levels of agency an operator can provide to the drone? What are the moral consequences of increased anonymity in the use of these drone technologies? The U.S. military designs computer interfaces to help its drone pilots make effective decisions to achieve mission targets. Can science fiction propose designs, interfaces and experiences that help users of drone technologies achieve ethical missions?

Come on, sci-fi. Show the way.

People don’t know what to make of this technology. It’s currently the domain of the military, big technology companies, a few startups, and a hobbyist community generally ignored outside of beautiful, drone-filmed YouTube videos. Science fiction is a valuable (and enjoyable) tool for understanding technology and envisioning implications of new technologies. Science fiction should be pushing the limits of how drone technologies will change our world, not just exaggerating today’s worst applications.

As journalist and robotics researcher P.W. Singer puts it in his TED talk, “As exciting as a drone for search-and-rescue is, or environmental monitoring or filming your kids playing soccer, that’s still doing surveillance. It’s what comes next, using it in ways that no one’s yet imagined, that’s where the boom will be.

A definitive list of sci-fi drones (in progress)

In chats with friends and followers of the blog about sci-fi Drone Week, folks seem interested in coming up with a definitive list of sci-fi drones in movies and TV shows. While we might get there eventually by reviewing the movies and TV shows in which they appear, let’s beat that to the punch by creating the list FROM OUR MINDS.

Criteria:

  • In a sci-fi movie or television show
  • Is not simply a representation of a real-world drone
  • Is mobile (in the air, on the ground, or in space)
  • Appears (or defined as) technolgoical, not biological
  • Does not have a sentient controller/pilot aboard
  • Does not possess strong/general artificial intelligence
  • Either automous or remotely-controlled

Here’s what I’ve collected so far. Add more in the comments if you think of them.

Aerial (UAVs)

  • Star Wars: Episode IV – A New Hope (1977)
    • The lightsaber training orb
    • The mouse-bot that Chewbacca scares
  • Flash Gordon (1980) the bot in Ming’s chamber
  • Viper Probe Droid seen on Hoth in Star Wars: Episode V – The Empire Strikes Back (1980)
  • Terminator diegesis (1984–)
    • Aerostats
    • Moto-Terminators (Salvation)
    • Aerostats (Salvation)
    • Hydrobots (Salvation)
  • Star Trek: The Next Generation (1987)
  • They Live (1988) but only when you wore the glasses
  • Back to the Future II (1989) had USA Today drones (unclear if they’re AI, but benefit of the doubt?)
  • Babylon 5’s (1994) camera drones
  • Stargate diegesis (1997–)
    • (early versions of the) Replicators
    • Kinos
    • World-testing UAVs
    • S4E2 The Other Side was all about drone warfare
  • Star Wars: Episode I – The Phantom Menace (1999) had “holocameras” following the podraces
  • Farscape (1999) has adorable little DRDs
  • Dark Angel (2000) had Police Hover Drones that the titular character got to surf.
  • The Incredibles (2004) Syndrome controls a few drones to do his bidding
  • Stealth (2005) (prior to the lightning strike that gives it strong general intelligence
  • Sleep Dealer (2008)
  • Wall•E (2008) SO many, though the level of their AI might disclude some
  • Skyline (2010) (has both alien drones and real world human drones)
  • The topography “pups” of Prometheus (2012)
  • Robocop (2013) (has both aerial and ground)
  • Agents of S.H.I.E.L.D. (2013–) (Seriously, this show has a thing for them)
  • Star Trek: Insurrection’s (1998) transporter/transponder drones
  • Battleship (2012) battle bots
  • Hunger Games (2012) delivery droids
  • Elysium (2013)
  • Drone (2013)
  • Oblivion’s numbered, Tet-tech drones (2014)
  • Captain America: The Winter Soldier’s city-sized drones (2014)
  • Chappie (2015) (aerial-capable, but mostly ground)

Ground

  • The floor-sweeping robots from The Fifth Element (1995)
  • The Robot from the Lost in Space movie (1998), which Will could remotely control
  • The Spyders of Minority Report (2002)
  • The remotely-controlled robots in Surrogates (2009)
  • Microbots from Big Hero 6 (2014) (a swarm of drones)

Thanks to the following suggestors for the initial list: Kelley Strang, John Danuil, Devin Hartnett, Derek Eclavea, Lane Bourn, Wally Pfingsten & kedamono.

Almost but not quite

Some suggestions seem like they would be perfect candidates, but for some reason skim the definition.

  • Bit from Tron (1982) may have been limited to yes or no answers, but was an AI
  • Machine gun drones from the deleted scenes of Aliens (1986) can only swivel, not move
  • Dreadnought from Star Trek: Voyager (1995)(VOY, Dreadnought) it’s AI
  • Jarvis from the cinematic Iron Man/Avengers diegesis, also strong AI

Keep them coming in the comments. What did we forget?

Future uses of drones

Chris: Oh my drone it’s DRONE WEEK! Wait…what’s drone week?

Recently I was invited to the InfoCamp unConference at Berkeley where among the awesome and inspiring presentations, I sat in on Peter Swigert’s workshop on drones. Since the blog was deep in Oblivion, Pete and I agreed to coauthor a series of posts on this phenomenon, and also to set the record a little more straight for sci-fi fans and authors on the real-world state of drones.

Today, a post on some cool and totally not evil speculative uses of drones.

drone-week

While drones are being used for positive purposes already, there will undoubtedly be myriad new applications as the technology develops and more people engage with its possibilities and implications. A few options include:

Voting drones

While purely online voting seems a long way off in the United States, drones could provide a physical link to voters but remove the logistical challenges of getting time off to travel to a polling station (a tactic that suppresses voting turnout and wastes time and resources.) Drones could go from house to house, authenticate by taking a photo of an individual’s face, their ID, and even their thumbprint, and a citizen could place their vote directly into the drone.

…much to the suppressors’ night terrors.

…much to the suppressors’ night terrors.

Weather management drones

With climate change likely to cause increasing challenges in weather, drones could be used as safe, effective tools for weather management. For instance, drones could seed clouds to promote rain. Drones equipped with weather sensors searching for the exact right place to release their payload could be more accurate and effective than current rocket based solutions. A cloud of drones with small parabolic lenses could cool an area by reflecting light away or warm one by concentrating it.

Biological replacement drones

Could drones replace certain species in the ecosystem? The collapse of bee communities in many parts of the world has been a major threat for agriculture and, if it needs to be said, most of human life on the planet. Should the worst happen to our bee friends in the future, could micro-drones serve the some pollination function as bees? In places where keystone species have gone extinct or can’t be maintained, could a drone be developed to automatically serve the same function? For instance, elephants knock down trees and create clearings in certain patterns, facilitating the transition from jungle to grassland. A drone could fly continuously, looking for patterns in the landscape or specific trees that an elephant would normally knock down, and either mark the trees for human removal or be constructed to damage the tree itself. Could these patterns and behaviors be used in terraforming new planets as well?

Little Johnny, it’s time you knew about the birds and the drones.

Little Johnny, it’s time you knew about the birds and the drones.

Avalanche prevention drones

Drones could scout avalanche prone areas and use computer vision and snow sampling to identify possible avalanches, and bring their own explosive payload to detonate preventative avalanches. (A practice done—dangerously—by humans today.) Backcountry skiers could rent time on a resort or park management’s drone to get a first person view of the terrain in real time before hitting the slopes.

Amber alert drones

Drones could be trained in facial recognition or even smell tracking (wouldn’t a bloodhound be more effective if it could fly and smell from the air?) to search for missing children. They could also serve as a notification system as they search for the child, broadcasting real time information to both investigators and citizens in the area.

Musical performance drones

Drones could provide on demand musical performances. No bandshell in a park? Just fly in some drones with speakers; the drones could align themselves appropriately to get the best acoustics for the setting.

“Well, mayhaps something a little less…dubsteppy?”

“Well, mayhaps something a little less…dubsteppy?”

While some ideas may seem absurd (and Chris’ comps up there turn that up to 11), science fiction can provide an interesting testing ground for what these systems might look like if implemented. What are the implications of these ideas? What impact would they have on society? On our last Drone Week post tomorrow we’ll discuss some of the ethical considerations underneath all of this.

Actual drones for not-evil

Chris: Day 2 of mighty mighty DRONE WEEK! Wait…what’s drone week?

Recently I was invited to the InfoCamp unConference at Berkeley where among the awesome and inspiring presentations, I sat in on Peter Swigert’s workshop on drones. Since the blog was deep in Oblivion, Pete and I agreed to coauthor a series of posts on this phenomenon, and also to set the record a little more straight for sci-fi fans and authors on the real-world state of drones.

Today Drone Week continues with the not-so-scary world of actual drones.

drone-week

Delivery drones

While capitalism is a neutral force at best, the speculative drones that Amazon and Google are working on stand to make delivery faster and more direct. While these projects are undoubtedly driven by possible profits, Google suggests that rapid delivery by drone will also have significant social benefits. Astro Teller, director at Google X, suggests that on-demand drop off and pick up we of goods will let us need to own less. “It would help move us from an ownership society to an access society. We would have more of a community feel to the things in our lives. And what if we could do that and lower the noise pollution and lower the carbon footprint, while we improve the safety of having these things come to you?”

Parcel delivery by drone is reminiscent of early proposals for mail delivery by parachute, seen here in a 1921 edition of Popular Mechanic.

Parcel delivery by drone is reminiscent of early proposals for mail delivery by parachute, seen here in a 1921 edition of Popular Mechanic.

Agricultural drones

Drones are already being used to help farmers monitor their crops. Companies like PrecisionHawk or senseFly offer aerial imagery capture and analysis of crop growth and health. Drones can cover much larger areas than on the ground monitoring and require minimal upfront costs or investments. With rising population to feed and climate change and soil degradation to combat, drones can be a valuable tool in increasing agricultural yields.

An example of image processing from aerial imagery taken by drone from HoneyComb, one of many companies offering drone services for agriculture

An example of image processing from aerial imagery taken by drone from HoneyComb, one of many companies offering drone services for agriculture

Medical drones

An emergency drone that carries a defibrillator has been developed and is currently in testing. The drone could be dispatched by emergency services and arrive to the site of a cardiac arrest faster than any ambulance, and “includes a webcam and loudspeaker and allows remote doctors to walk people on the scene through the process of attaching the electrodes and preparing the defibrillator.

Similarly, Doctors Without Borders is experimenting with drones to rapidly transport patient samples to fight tuberculosis epidemics in parts of Papua New Guinea where road transport is too slow.

Image from FastCo.Exist.

Image from FastCo.Exist.

Archeological drones

Drones are also being used for a variety of archaeological projects. They are a cheap method of capturing images to build 3D models of ruins. “In remote northwestern New Mexico, archaeologists are using drones outfitted with thermal-imaging cameras to track the walls and passages of a 1,000-year-old Chaco Canyon settlement, now buried beneath the dirt. In the Middle East, researchers have employed them to guard against looting.” And in the Yucatan peninsula, drones provided a cost effective solution to flying over dense, remote jungles, and identified previously undiscovered Mayan ruins.

Peruvian archaeologists command a drone to search for architectural ruins. (New York Times)

Peruvian archaeologists command a drone to search for architectural ruins. (New York Times)

Of course these are all cool and useful models of non-military uses of drones. But it can get cooler. In the next post, we’ll look at some speculative future uses of drones. Hollywood, get out your pens, or whatever it is you write with these days.