RESEARCH INITIATIVES/Intelligent Transportation & HCI
Traffic Sign Recognition and Speech-Based Feedback Generation System for Driver Assistance
Intelligent Transportation & HCI✓ COMPLETED

Traffic Sign Recognition and Speech-Based Feedback Generation System for Driver Assistance

Project Summary

Deep learning embedded vision system running on edge hardware to recognize road sign typography under occlusions and provide low-latency spoken alerts to drivers.

RESEARCH OVERVIEW & DETAILS

Project Scope & Details

A robust advanced driver-assistance system (ADAS) integrating convolutional neural networks for real-time traffic sign detection, classification under varying lighting and adverse weather conditions, and synthetic speech synthesis for non-intrusive auditory alerts.

ARCHITECTURAL & SCIENTIFIC HIGHLIGHTS
01.

Edge Deep Vision Convolutional Pipeline

Lightweight neural architecture detecting and classifying regulatory, warning, and informational signs at 120 FPS.

02.

Real-Time Driver Warning HUD

Synthesizes low-distraction visual and auditory alerts for speed limits, school zones, and sudden road hazards.

03.

Adverse Weather & Occlusion Robustness

Trained on challenging Indian driving conditions, including heavy monsoon rain, fog, and tree canopy occlusion.

04.

Embedded Low-Power In-Cabin Deployment

Operates within a 5W power budget on edge AI microcomputers (Jetson Nano/Orin) for broad fleet retrofitting.

PROJECT GALLERY [1 PHOTOS]
Click to expand
Traffic Sign Detection & Feedback Architecture
FIG. 01

Traffic Sign Detection & Feedback Architecture

ACADEMIC PUBLICATIONS [1]
2023IEEE 5th International Conference on Cybernetics, Cognition and Machine Learning Applications (IC-CCMLA)

A Traffic Sign Recognition and Speech-Based Feedback Generation System to Assist Drivers

Authors: Himangshu Sarma, Navanath Saharia

RESEARCH TEAM
  • Dr. Himangshu Sarma
  • Dr. Navanath Saharia
TECHNOLOGIES
Deep LearningComputer VisionEdge ComputingText-to-SpeechADAS
PREVIOUS PROJECTEnhancing STEM Curriculum with Virtual Reality: Electricity and Magnetism Simulations
NEXT PROJECTGame-Based Virtual Reality Platform for Spatial 3D Geometry Learning
HCI Lab IIITS | Human-Computer Interaction Laboratory