Automatic lip reading is a growing branch of speech recognition technology that tracks a speaker’s lip movements and other related elements to interpret verbal messages. It requires a video of the speaker and can use facial expressions and head movements as contributing factors. Lip geometry estimation is one of the most advanced computer systems used in the field, but there is still room for progress. The technology has received recent attention for its implementation on archived home videos of Adolf Hitler.
Lip-reading is hardly a new form of communication—it’s a primary tool of the deaf community, not to mention a useful skill for conveying messages across a raucous party or over the heads of children. A new form of technology, however, is attempting to mechanize this ancient method of communication. Automatic lip reading, also known as automatic speech reading, is a growing branch of speech recognition technology. In theory, by tracking a speaker’s lip movements and other related elements, specially designed computer programs can interpret verbal messages even when noise interference or other obstacles prevent a human voice from being heard correctly.
Usually, automatic lip reading requires a video of the speaker. The shapes and rhythms formed by the lips are often the most important factors in interpretation, but a variety of other movements can also help decipher the speaker’s message. Facial expressions and head movements may be contributing factors. If helpful audio is available, the automatic lip reading process is greatly facilitated, because contextual cues from the audible portion can suggest inaudible words or speech fragments.
The development of automatic lip reading technology is based on the ability to identify isolated words that use the same lip movements each time they are spoken. Lip geometry estimation (LGE) is one of the most advanced computer systems in use that monitors and interprets such patterns. Scientists have developed a remarkable automatic lip reading and speech recognition system for the Dutch language, but overall the field still has a lot of room for progress.
Automatic lip reading has received a recent surge of interest and attention due to its implementation on archived home videos of Adolf Hitler. Filmed by Eva Braun during the war, the once silent films came to life when speech recognition technology was applied to footage. Whether or not the interpretations are entirely accurate, the automatic lip reading program has provided a glimpse into a historical figure who will no doubt create continued interest in the field of automatic lip reading.
Protect your devices with Threat Protection by NordVPN
