Send the link below via email or IMCopy
Present to your audienceStart remote presentation
- Invited audience members will follow you as you navigate and present
- People invited to a presentation do not need a Prezi account
- This link expires 10 minutes after you close the presentation
- A maximum of 30 users can follow your presentation
- Learn more about this feature in our knowledge base article
Transcript of Lip Reading
Lip Reading System?
Stand alone mode
How Does It Work?
Given a video segment, an image-processing algorithm identifies the lips and extracts the coordinates of a number of points on the lips from each frame.
Auto Lip Recognition Algorithm:
For each frame:
Identify lip area using Haar function (OpenCV)
Finding middle upper and lower lip coordiantes
Finding the edges of the lips
Cons: Requires certain light conditions
User put stickers on his lips and configure the colors
Stickers colors are saved in application
For each frame:
Finding the pixels in stickers colors (OpenCV)
Cons: Requires stickers on user lip
Colored Stickers Recognition Algorithm:
Skipped Frames Normalizer
Multi Layer Perceptron Classifier
Support Vector Machine Classifier
Dynamic Time Wrapping Classifier
Normalization Of The Data:
Lip coordinates data is going through a series of normalization actions to improve the classification results.
Using Weka Machine Learning algorithms package
Classification model containing data of many records of words/phrases
Classifier returns a corresponding string of the new data instance according to the model.
String returned from Classifier to voice
using Google Voice Library
Lip Reading Application
Communication for everyone...
Dr. Kobi Gal
Dr. Gavi Kohlberg