Stories
Slash Boxes
Comments

SoylentNews is people

posted by cmn32480 on Wednesday November 04 2015, @02:23PM   Printer-friendly
from the oh-I-see dept.

Researchers from the California Institute of Technology in Pasadena have built smart glasses that translate video into sound:

The device, called vOICe (OIC stands for "Oh! I See"), is a pair of dark glasses with an attached camera, connected to a computer. It's based on an algorithm of the same name developed in 1992 by Dutch engineer Peter Meijer. The system converts pixels in the camera's video feed into sound, mapping brightness and vertical location to an associated pitch and volume.

A cluster of dark pixels at the bottom of the frame sounds quiet and has a low pitch, while a bright patch at the top would sound loud and high-pitched. The way a sound changes over time is governed by how the image looks when scanned left to right across the frame. Headphones sends the processed sound into the wearer's ear.

[...] Tested on the device, blind people with no experience of using it were able to match the shapes to the sounds as often as those who had been trained – both groups performed 33 per cent better than by chance. But when the encoding was reversed, so that a high part of the image became a low pitch and a bright part of the image became a quiet sound, volunteers found it harder to match image to sound.

Originally spotted on The Eponymous Pickle.


Original Submission

 
This discussion has been archived. No new comments can be posted.
Display Options Threshold/Breakthrough Mark All as Read Mark All as Unread
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
  • (Score: 2, Funny) by Anonymous Coward on Wednesday November 04 2015, @02:32PM

    by Anonymous Coward on Wednesday November 04 2015, @02:32PM (#258365)

    Google announces "Glass for the Blind" featuring an ad-supported "enhanced audio experience".

    Starting Score:    0  points
    Moderation   +2  
       Insightful=1, Funny=1, Total=2
    Extra 'Funny' Modifier   0  

    Total Score:   2  
  • (Score: 2) by LoRdTAW on Wednesday November 04 2015, @04:11PM

    by LoRdTAW (3755) on Wednesday November 04 2015, @04:11PM (#258395) Journal

    Blind man walks past McDonalds...
    "Hungry? How about a Big Mac value meal!
    Walk past starbucks....
    "How about a nice tall iced mocha latte with a cappuccino blast topped off with whipped cream!"
    Walks past a Wal-Mart...
    "Stop in for huge savings on items like fake christmas trees and cook ware!"

    Blind man is now also a deaf man.

  • (Score: 4, Funny) by DeathMonkey on Wednesday November 04 2015, @06:27PM

    by DeathMonkey (1380) on Wednesday November 04 2015, @06:27PM (#258455) Journal

    The Googles, they do nothing!