Stories
Slash Boxes
Comments

SoylentNews is people

posted by on Sunday November 27 2016, @06:59AM   Printer-friendly
from the one-step-closer-to-HAL-9000 dept.

Arthur T Knackerbracket has found the following story:

Lip-reading is notoriously difficult, depending as much on context and knowledge of language as it does on visual clues. But researchers are showing that machine learning can be used to discern speech from silent video clips more effectively than professional lip-readers can.

In one project, a team from the University of Oxford's Department of Computer Science has developed a new artificial-intelligence system called LipNet. As Quartz reported, its system was built on a data set known as GRID, which is made up of well-lit, face-forward clips of people reading three-second sentences. Each sentence is based on a string of words that follow the same pattern.

The team used that data set to train a neural network, similar to the kind often used to perform speech recognition. In this case, though, the neural network identifies variations in mouth shape over time, learning to link that information to an explanation of what's being said. The AI doesn't analyze the footage in snatches but considers the whole thing, enabling it to gain an understanding of context from the sentence being analyzed. That's important, because there are fewer mouth shapes than there are sounds produced by the human voice.

When tested, the system was able to identify 93.4 percent of words correctly. Human lip-reading volunteers asked to perform the same tasks identified just 52.3 percent of words correctly.


Original Submission

 
This discussion has been archived. No new comments can be posted.
Display Options Threshold/Breakthrough Mark All as Read Mark All as Unread
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
  • (Score: 0) by Anonymous Coward on Sunday November 27 2016, @10:18PM

    by Anonymous Coward on Sunday November 27 2016, @10:18PM (#433779)

    Clever line, but how is it at cunnilingus?

  • (Score: 2) by nukkel on Monday November 28 2016, @08:24PM

    by nukkel (168) on Monday November 28 2016, @08:24PM (#434193)

    I dunno -- it was tongue-in-cheek.