RESEARCH INITIATIVES/Spatial Computing & Non-Photorealistic Rendering
MangaSpace: Material-Aware Physical Stylization & Artistic Deformation Priors for Mixed Reality
Spatial Computing & Non-Photorealistic Rendering● ACTIVE RESEARCH

MangaSpace: Material-Aware Physical Stylization & Artistic Deformation Priors for Mixed Reality

Project Summary

Material-aware physical-artistic stylization engine for Meta Quest 3, bridging continuum mechanics with non-linear anime exaggeration and view-invariant non-photorealistic inking.

RESEARCH GRANTSony Research Award Program 20262025 – 2027
RESEARCH OVERVIEW & DETAILS

Project Scope & Details

MangaSpace investigates the perceptual foundations of artistic exaggeration in mixed reality spatial computing. By replacing naive 2D filter overlays with an object-space Viscoelastic-to-Artistic Projection Operator, the system maps physical mechanical impedance tensors (Young's modulus, damping, restitution) to volume-preserving squash-and-stretch deformations and normal-oriented 3D onomatopoeia decals within an empirical 45ms visuo-haptic integration window. Standalone 90 FPS execution on Meta Quest 3 is enabled via an asynchronous RTX 4090 neural co-processor.

ARCHITECTURAL & SCIENTIFIC HIGHLIGHTS
01.

Viscoelastic-to-Artistic Projection Operator

Formal mapping from physical mechanical impedance tensors [E, zeta, e, mu] to volume-preserving anime exaggeration manifolds.

02.

Visuo-Haptic Integration Window (tau <= 45ms)

Formulates cross-modal bounds where visual pseudo-haptic exaggeration modulates perceived tactile stiffness without inducing sensorimotor dissonance.

03.

View-Invariant Object-Space Inking

Parameterizes non-photorealistic outlines and halftoning over 3D object manifolds, eliminating binocular retinal rivalry and AR cybersickness.

04.

Dual-Tier Heterogeneous Pipeline

Combines 90 FPS standalone Meta Quest 3 OpenXR tracking and client-side Taubin mesh deformation with asynchronous 10 Hz RTX 4090 semantic segmentation.

INTERACTIVE 3D SPATIAL MODEL & KINEMATIC TELEMETRY

Real-Time 3D Mesh & Spatial Coordinate Simulator

Explore an interactive WebGL OpenXR spatial asset preview. Rotate, orbit, and toggle mesh visualization modes to inspect simulated sub-millimeter 6DOF coordinate tracking.

PROJECT GALLERY [1 PHOTOS]
Click to expand
MangaSpace System Concept Teaser
FIG. 01

MangaSpace System Concept Teaser

ACADEMIC PUBLICATIONS [1]
RESEARCH TEAM
  • Dr. Himangshu Sarma
  • Chaitanya Anand
EXTERNAL COLLABORATORS
  • Sony Research Award Program (Faculty Innovation Award 2026)
FUNDING & GRANTS
SANCTIONED BUDGETSony Research Award Program 2026
SPONSORING AGENCYSony Group Corporation
PROJECT TIMELINE2025-102027-04
TECHNOLOGIES
Meta Quest 3OpenXRUnityColor PassthroughContinuum MechanicsViscoelastic DeformationTaubin FilteringNon-Photorealistic Rendering (NPR)NVIDIA RTX 4090
PREVIOUS PROJECTPHYLOS: Phylogenetic Hierarchical Yielding Lifelong Ontogenetic System
NEXT PROJECTAI Generated Video Detection via Temporal Graphs and Neighborhood Consistency Regularization
HCI Lab IIITS | Human-Computer Interaction Laboratory