MINOR PROJECT
ON
SIGN LANGUAGE RECOGNITION
SUBMITTED BY: GUIDED BY:
LOHIT BHARDWAJ(0105CB201026) PROF. PRINCY
NIPUN GOSWAMI (0105CB201033) SHRIVASTAVA
PRESENTATION OUTLINE
• INTRODUCTION
• OBJECTIVES OF THE PROJECT
• TECHNOLOGY PLATFORM OVERVIEW
• APPLICATION FEATURE OVERVIEW
• IMPLEMENTATION
• PROJECT SNAPSHOTS
• EVALUATION
• CONCLUSION
• FUTURE WORK
• LEARNING FROM PROJECTS
• TEAM COLLABORATIONS
INTRODUCTION:
• Communication is very crucial to human beings, as it enables us to express ourselves. We
communicate through speech, gestures, body language, reading, writing or through visual aids,
speech being one of the most commonly used among them. However, unfortunately, for the
speaking and hearing impaired minority, there is a communication gap. Visual aids, or an
interpreter, are used for communicating with them. However, these methods are rather
cumbersome and expensive, and can't be used in an emergency. Sign Language chiefly uses
manual communication to convey meaning. This involves simultaneously combining hand shapes,
orientations and movement of the hands, arms or body to express the speaker's thoughts.
• Sign Language consists of fingerspelling, which spells out words character by character, and word
level association which involves hand gestures that convey the word meaning. Fingerspelling is a
vital tool in sign language, as it enables the communication of names, addresses and other words
that do not carry a meaning in word level association. In spite of this, fingerspelling is not widely
used as it is challenging to understand and difficult to use. Moreover, there is no universal sign
language and very few people know it, which makes it an inadequate alternative for
communication.
OBJECTIVES:
• In this sign language recognition project, we have created a sign
detector, which detects numbers from 1 to 10 that can very easily be
extended to cover a vast multitude of other signs and hand gestures
including the alphabets.
• The main objective of this project is to make a platform that can
understand the sign language of disabled persons and behave like a
medium between normal people and disabled people.
TECHNICAL OVERVIEW
• PYTHON: Python is an OOPs (Object Oriented Programming) based, high level, interpreted
programming language. It is a robust, highly useful language focused on rapid application
development (RAD). Python helps in easy writing and execution of codes. Python can implement the
same logic with as much as 1/5th code as compared to other OOPs languages.
• TENSORFLOW: TensorFlow is an end-to-end open source platform for machine learning. Explore!
Solve challenging, real-world problems with machine learning with TensorFlow by Google. Easy
model building. Flexibility and control. Free. Robust deployment tools.
• KERAS: Keras is an API designed for human beings, not machines. Keras follows best
practices for reducing cognitive load: it offers consistent & simple APIs, it minimizes the
number of user actions required for common use cases, and it provides clear & actionable
error messages. It also has extensive documentation and developer guides.
• OPEN CV: OpenCV is the huge open-source library for the computer vision, machine learning, and
image processing and now it plays a major role in real-time operation which is very important in
today’s systems. By using it, one can process images and videos to identify objects, faces, or even
handwriting of a human.
APPLICATION OVERVIEW
• In this sign language recognition project, we create a sign
detector, which detects numbers from 1 to 10 that can very
easily be extended to cover a vast multitude of other signs
and hand gestures including the alphabets.We have developed
this project using OpenCV and Keras modules of python.
FLOW DIAGRAM
PROPOSED IDEA
• Purpose of this project is to make a platform through which we can
interact with differently abled persons by the means of sign language.
• The sign language recognition will act as an interface into the digital
world by understanding user’s sign language and translating it to
normal language (understandable by normal person).
• The use of sign language recognition can also enhance the system of
IoT (Internet of Things).
SDLC
IMPLEMENTATION
INNOVATION & UPGRADATION (FUTURE
WORK)
• Features that can be added:
• Deploy the project on cloud and create an API for using it.
• Increase the vocabulary of our model
• Incorporate feedback mechanism to make the model more robust
• Add more sign languages
PROJECT COLLABORATORS
• Lohit Bhardwaj (Software developer)
• Nipun Goswami(Testing and debugging , research ,
documentation)
THANK YOU!
