HCI LAB/RESEARCH & INITIATIVES

Research Projects

Interdisciplinary research across spatial computing, mixed reality, assistive neural interfaces, biomechanical physics simulation, and accessibility AI at IIIT Sri City.

DOMAIN:
AI Generated Video Detection via Temporal Graphs and Neighborhood Consistency Regularization
● ACTIVE
2 PHOTOS
Deep Learning & Computer Vision
Graph Neural NetworksDeep LearningTemporal Graphs

AI Generated Video Detection via Temporal Graphs and Neighborhood Consistency Regularization

We propose a Graph Neural Network for detecting AI generated videos. By enforcing Neighborhood Consistency Regularization exclusively across temporal edges, our model prevents spatial overfitting to known artifacts. This structural constraint significantly improves out of distribution generalization, achieving state-of-the-art robustness on unseen generative models.

Mohit Jignesh Madhu
Explore Full Project Details
XR Badminton: Multi-Stroke Neuro-Symbolic Virtual Reality Coaching Platform
● ACTIVE
PAPER3 PHOTOS
Virtual Reality & Physics Simulation
Virtual RealityPhysics SimulationAdaptive Coaching

XR Badminton: Multi-Stroke Neuro-Symbolic Virtual Reality Coaching Platform

An adaptive VR badminton coaching system featuring high-fidelity aerodynamics, multi-stroke kinematics with Holt-linear state filtering, dynamic body-scaled target calibration, and full-body IMU tracking.

VISI - SCROLL: EOG-Based Hands-Free Object Selection System
● ACTIVE
VIDEO2 PHOTOS
Assistive Technology & Biosignals
EOG Signal ProcessingAssistive TechnologyEye Tracking

VISI - SCROLL: EOG-Based Hands-Free Object Selection System

A bio-potential EOG device that enables motor-disabled users to control computers using eye movements, offering hands-free access to navigate and scroll digital interfaces.

Abhigyan Rutwik Bharadhwaj Pendyala
Explore Full Project Details
MRConsultation: Asynchronous Mixed Reality Pre-Surgical Teleconsultation System
● ACTIVE
PAPER19 PHOTOS
Mixed Reality & Healthcare Spatial Computing
Mixed RealityMeta Quest 3Three.js WebGL

MRConsultation: Asynchronous Mixed Reality Pre-Surgical Teleconsultation System

An asymmetric asynchronous Mixed Reality teleconsultation platform bridging pre-surgical patient-clinician communication via intentional semantic abstraction, dynamic local-coordinate serialization, and interactive 6DOF organ models.

Tirumala Darshan with AR
● ACTIVE
VIDEO PAPER5 PHOTOS
Augmented Reality & Cultural Heritage
ARCoreLangChainNeural Networks

Tirumala Darshan with AR

Immersive augmented reality navigation and 3D architectural exploration for the Tirumala temple complex.

Dr. Himangshu SarmaRs. 13,80,860
Explore Full Project Details
Design and development of communication system for the speech and hearing disorder persons
● ACTIVE
1 PHOTO
Deep Learning & Computer Vision
Deep LearningComputer VisionTransfer Learning on Vision Models

Design and development of communication system for the speech and hearing disorder persons

Developing a model to do real time conversion of Indian Sign Language(ISL) to sentence.

Dr. Himangshu SarmaRs. 24,59,424
Explore Full Project Details
Development of Game platform through VR and AR for School Education
✓ COMPLETED
1 PHOTO
Virtual Reality & Education
UnityVR DevelopmentPhysics Simulation

Development of Game platform through VR and AR for School Education

Interactive virtual reality platform for teaching projectile motion and gravity concepts through immersive simulations.

Dr. Himangshu SarmaRs. 16,40,720
Explore Full Project Details
Computer vision algorithm for transformation of Night time Images to corresponding Day time
✓ COMPLETED
1 PHOTO
Computer Vision
Computer vision

Computer vision algorithm for transformation of Night time Images to corresponding Day time

Computer vision algorithm for transformation of Night time Images to corresponding Day time.

Dr. Himangshu SarmaRs. 9,94,943
Explore Full Project Details
Modular Standalone XR Platform for Upper Limb Stroke Rehabilitation
● ACTIVE
PAPER5 PHOTOS
Mixed Reality & Healthcare
Mixed RealityOptical Hand TrackingMotion Tracking

Modular Standalone XR Platform for Upper Limb Stroke Rehabilitation

A modular standalone extended reality platform for upper limb stroke rehabilitation, featuring clinician-configurable tolerance corridors, dual-loop adaptation, and controller-free optical hand tracking on Meta Quest.

Learning Physics through Computer Vision
✓ COMPLETED
1 PHOTO
Virtual Reality & Education
VR DevelopmentPhysics SimulationEducational Design

Learning Physics through Computer Vision

Comprehensive VR simulation platform for Crystal Structure.

Dr. Himangshu SarmaRs. 2,50,000
Explore Full Project Details
Self-Learning Yoga Monitoring System Based on Pose Estimation
✓ COMPLETED
1 PHOTO
Computer Vision & Assistive Health
Computer VisionPose EstimationBiomechanical Analysis

Self-Learning Yoga Monitoring System Based on Pose Estimation

Real-time computer vision pose estimation framework providing biomechanical joint-angle correction and feedback for unassisted yoga practice.

Enhancing STEM Curriculum with Virtual Reality: Electricity and Magnetism Simulations
✓ COMPLETED
1 PHOTO
Virtual Reality & Education
Virtual RealityUnityPhysics Simulation

Enhancing STEM Curriculum with Virtual Reality: Electricity and Magnetism Simulations

Interactive 6DOF virtual reality environment allowing students to visualize invisible 3D electromagnetic vector fields, manipulate charges, and assemble virtual circuits.

Traffic Sign Recognition and Speech-Based Feedback Generation System for Driver Assistance
✓ COMPLETED
1 PHOTO
Intelligent Transportation & HCI
Deep LearningComputer VisionEdge Computing

Traffic Sign Recognition and Speech-Based Feedback Generation System for Driver Assistance

Deep learning embedded vision system running on edge hardware to recognize road sign typography under occlusions and provide low-latency spoken alerts to drivers.

Dr. Himangshu Sarma
Explore Full Project Details
Game-Based Virtual Reality Platform for Spatial 3D Geometry Learning
✓ COMPLETED
1 PHOTO
Virtual Reality & Education
Virtual RealityGamificationUnity

Game-Based Virtual Reality Platform for Spatial 3D Geometry Learning

Immersive 3D geometry sandbox enabling students to manipulate geometric solids, inspect intersecting planes in spatial coordinates, and learn spatial proofs interactively.

Dr. Himangshu Sarma
Explore Full Project Details
Natural Language Text-to-Animation System for Physical Exercises and Rehabilitation
✓ COMPLETED
1 PHOTO
NLP & Biomechanical Simulation
Natural Language ProcessingSemantic Parsing3D Character Animation

Natural Language Text-to-Animation System for Physical Exercises and Rehabilitation

Semantic parser converting freeform clinical and exercise text instructions into synchronized 3D avatar animations for physical therapy.

Dr. Himangshu Sarma
Explore Full Project Details
DPLA-Retriever: Memory-Efficient Web-Scale Retrieval and Single-GPU LLM Co-location
● ACTIVE
2 PHOTOS
Information Retrieval & Systems
Information RetrievalMulti-Vector MaxSimPerceiver Cross-Attention

DPLA-Retriever: Memory-Efficient Web-Scale Retrieval and Single-GPU LLM Co-location

A memory-efficient multi-tier retrieval framework indexing 21 million Wikipedia passages inside 2.58 GB active VRAM, allowing full co-location of an 8B LLM reader on a single consumer GPU.

EgoScore: Importance-Weighted Retrieval for Egocentric Lifelogging via Multi-Signal Perceptual Scoring
● ACTIVE
4 PHOTOS
Wearable Computing & Memory Augmentation
Egocentric Computer VisionWearable ComputingPoincaré Hyperbolic Embeddings

EgoScore: Importance-Weighted Retrieval for Egocentric Lifelogging via Multi-Signal Perceptual Scoring

When users wear always-on egocentric cameras (such as Meta Ray-Ban glasses), they accumulate hours of video daily. EgoScore operationalizes moment importance across social significance, emotional salience, novelty, and memorability by fusing six perceptual signals with Ebbinghaus-inspired temporal decay.

Algorithmic Collusion in Two-Sided Labor Markets: AI Resume Screeners, Monoculture, and Wage Compression
● ACTIVE
4 PHOTOS
Human-Centered AI & Algorithmic Fairness
Agent-Based ModelingDeBERTa-v3 Cross-EncoderFairlearn

Algorithmic Collusion in Two-Sided Labor Markets: AI Resume Screeners, Monoculture, and Wage Compression

Investigating how algorithmic monoculture in automated hiring pipelines induces structural wage compression and correlated candidate rejection through agent-based macroeconomic simulations and two-stage cross-encoder re-ranking audits.

GraphCLaRa: Decoupling Semantic Alignment from Reasoning Potential in Dense Retrieval via Causal Representation Partitioning
● ACTIVE
PAPER4 PHOTOS
Information Retrieval & Graph Systems
Dense RetrievalDeepSeek-R1-Distill-QwenCausal Representation Partitioning

GraphCLaRa: Decoupling Semantic Alignment from Reasoning Potential in Dense Retrieval via Causal Representation Partitioning

Dense retrieval systems encode documents into a single semantic vector, coupling factual content with logical implication. GraphCLaRa introduces a causal partition mask over distilled reasoning LLMs, enforcing architecturally disjoint reasoning and semantic sub-representations within a single forward pass alongside differentiable Personalized PageRank graph routing.

ReallyUnderstandPapers.com: Autonomous AI Research Agent & Pedagogical Paper Coach
● ACTIVE
1 PHOTO
Agentic AI & Interactive Learning Environments
LangGraphModel Context Protocol (MCP)Reflexion Self-Critique

ReallyUnderstandPapers.com: Autonomous AI Research Agent & Pedagogical Paper Coach

An autonomous, agentic research assistant and pedagogical paper coach built on decoupled React/FastAPI architectures, LangGraph, and MCP with Reflexion-style self-critique loops, literature cross-verification, and sandboxed interactive code execution.

PHYLOS: Phylogenetic Hierarchical Yielding Lifelong Ontogenetic System
● ACTIVE
1 PHOTO
Cognitive Modeling & Bio-Inspired AI
Biologically Plausible Neural NetworksPredictive Coding & Variational FEPModern Hopfield Networks

PHYLOS: Phylogenetic Hierarchical Yielding Lifelong Ontogenetic System

A biologically inspired modular neural control architecture combining evolutionary phylogenetic hyperparameter optimization with lifelong ontogenetic local learning without global backpropagation through time.

MangaSpace: Material-Aware Physical Stylization & Artistic Deformation Priors for Mixed Reality
● ACTIVE
1 PHOTO
Spatial Computing & Non-Photorealistic Rendering
Meta Quest 3OpenXRUnity

MangaSpace: Material-Aware Physical Stylization & Artistic Deformation Priors for Mixed Reality

Material-aware physical-artistic stylization engine for Meta Quest 3, bridging continuum mechanics with non-linear anime exaggeration and view-invariant non-photorealistic inking.

Dr. Himangshu SarmaSony Research Award Program 2026
Explore Full Project Details