Imagine flipping through pictures on your iPod as you listen to the Beatles' Yellow Submarine, but instead of hearing the Fab Four's familiar tune, something slightly different tickles your eardrums---and it changes with each snapshot. The tempo slows when you view a Rembrandt still life, the volume goes up with the blurred image of a headbanger, and creepy laughter resounds as you look upon a dark, moonlit landscape. This is more or less what a new iPod and iPhone software application aims to do, filtering and slightly modifying songs depending on what's showing on your screen. As Apple explained in a patent it published last week, they've developed an algorithm that looks at image data and determines "one or more characteristics," such as "sharpness, brightness, motion, magnification, zoom setting," and others. Next, an audio processor translates these photo observations into variations in tempo, volume, and pitch---adding its own sound effects ...
Weird App Morphs Music to Match the Picture on Your iPhone
Discover how a new application creates a personalized music experience integrated with your favorite photos and surroundings.
More on Discover
Stay Curious
SubscribeTo The Magazine
Save up to 40% off the cover price when you subscribe to Discover magazine.
Subscribe