Skip to content

GargiMittal/Sign-Language-Communication-System

Repository files navigation

Signease: Unified ASL Translator Hub

Signease is a user-friendly desktop application that brings together multiple American Sign Language (ASL) translation tools into a single interface.


presentation image

💡 Features

  1. Sign Language to Audio Translator
    Uses hand gesture recognition from a webcam to detect ASL letters and speak them aloud.

  2. YouTube to ASL Interpreter
    Fetches captions from YouTube videos and displays corresponding ASL letter animations using pre-stored sign videos.

  3. Audio to ASL Translator
    Listens to audio from the microphone and displays matching ASL signs as videos.


🐍 Python Version

  • Requires Python 3.7 or higher
    (Recommended: Python 3.10+ for best package support)

📦 Installation & Requirements

Install all dependencies using:

pip install -r requirements.txt

Or manually install them:

pip install tk opencv-python cvzone numpy mediapipe pyttsx3 SpeechRecognition youtube-transcript-api pillow

requirements.txt content:

tk
opencv-python
cvzone
numpy
mediapipe
pyttsx3
SpeechRecognition
youtube-transcript-api
pillow

🗂️ Folder Structure

signease/
│
├── main.py                  # GUI launcher
├── prediction1.py           # Camera-based sign detection
├── ytasl2.py                # YouTube video to ASL
├── AudioToASL.py            # Audio to ASL translator
├── M/
│   ├── keras_model.h5       # Trained sign language model
│   └── labels.txt           # Labels used in classification
├── gifs/
│   ├── A.mp4, B.mp4, ...    # ASL sign videos for each letter
├── requirements.txt
└── README.md

🚀 Running the App

Launch the hub interface:

python main.py

Then select one of the translator tools from the GUI.


📝 Notes

  • Ensure your webcam and microphone are properly connected.
  • Store ASL sign videos for each alphabet as A.mp4, B.mp4, ... inside a folder named gifs/.
  • Trained model and label files should be inside the M/ directory.

🖼️ Gallery





🔮 Future Improvements

  • Add support for full-word translation.
  • Use deep learning models for improved accuracy.
  • Add support for real-time ASL feedback overlay on videos.

📜 License

This project is open source under the MIT License.

About

Signease: American Sign Language Translator Hub — A real-time ASL recognition system leveraging computer vision and deep learning to convert sign language gestures into text and speech for seamless communication.

Resources

License

Stars

1 star

Watchers

1 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages