Google Envisions Robot Remote Controls That Know Your Face

A Google patent filing envisions a teddy robot toy acting as a smart remote control. Credit: BlueSkyImage / Shutterstock Cuddly robot toys such as Furby or AIBO the robot dog have won many human hearts and minds over the past decade. That may be why Google researchers envision the possibility of turning such robot toys into intelligent remote controls for home entertainment systems. But the idea of a teddy bear or doll constantly watching or listening in a home has already stirred some controversy about home privacy. A Google patent application spotted by SmartUp, a legal technology firm, describes how an "anthropomorphic device" with hidden cameras for eyes and microphones for ears could automatically translate simple voice commands into actions that activate smart TVs, DVRs, DVD players and other devices. Instead of manually pushing buttons on remote controls or even a large universal remote control, people could simply tell their robot remote control to stream the latest episode of a favorite TV show through their Blu-ray player or Apple TV. The Google patent — filed in 2012 but published on the U.S. Patent and Trademark Office website on May 21, 2015 — suggests that the anthropomorphic device could simplify the process of accessing TV shows and movies through the growing swarm of home devices and online services. The patent also includes drawing concepts for the lovable robot toy as a teddy bear and a stuffed rabbit. “There are at least some advantages to an anthropomorphic device taking on a familiar, toy-like, or “cute” form..." according to the Google patent application. "Some users, especially young children, might find these forms to be attractive user interfaces. However, individuals of all ages may find interacting with these anthropomorphic devices to be more natural than interacting with traditional types of user interfaces." The device — let's just call it "Teddy" — would work something like this. If Teddy detects a person in the room, it would look at that person so that its camera and microphones are pointed in his or her direction. The Teddy might simply recognize the person visually through its camera. Or it might turn its head in the direction of the person based on the sound of his or her voice. A person could also directly address Teddy by name or by using certain keywords, which would be Teddy's cue to look in his or her direction. Teddy might even use video captured by its camera to read the lips of someone speaking, in case the audio coming in through the microphone is too soft or distorted. The Teddy may not necessarily take the form of a physical toy; Google's patent application also allows for the possibility of a hologram or a virtual avatar that only appears on a screen. But the main function of being able to translate voice commands into actions for coordinating home media devices would remain the same in any case. Google's patent specifically describes the possibility of the Teddy device communicating with an "cloud-based" online server that could handle much of the computer processing. Alternately, the Teddy device might be a more capable robot with its own self-contained computer processing power and data storage.