Natural Language Text-to-Animation System for Physical Exercises and Rehabilitation
“Semantic parser converting freeform clinical and exercise text instructions into synchronized 3D avatar animations for physical therapy.”
Project Scope & Details
An end-to-end framework combining natural language processing, semantic action ontology mapping, and procedural 3D character animation. The system accepts natural language descriptions of physiotherapy and athletic routines, producing biomechanically accurate avatar animations.
Natural Language Kinematic Parser
Extracts joint targets, repetition counts, and tempo constraints from unstructured physiotherapy prescription notes.
Biomechanical Joint Motion Synthesis
Smooths trajectory keyframes using inverse kinematics to generate biologically plausible human exercise motions.
Custom Physiotherapy Routine Generation
Compiles prescribed rehabilitation exercises into fully animated 3D demonstrations for home patient guidance.
Interactive Multi-Angle Avatar Rendering
Allows patients to orbit 360 degrees around the virtual coach to inspect correct joint angles and posture alignment.
NLP Text-to-Animation Semantic Architecture
A text to animation system for physical exercises
Authors: Himangshu Sarma, Robert Porzel, Jan D. Smeddinck, Rainer Malaka, Arun Baran Samaddar
- Dr. Himangshu Sarma
- Robert Porzel
- Jan D. Smeddinck
- Rainer Malaka
- Arun Baran Samaddar
- ▸University of Bremen, Germany
- ▸National Institute of Technology