Project 02

ArmRest Advanced Mixed-Reality Rehabilitation

Computer Vision Custom Hardware Clinical XR

Overview

ArmRest was designed as a rehabilitation system that combines virtual reality with real object interaction to train shoulders, elbows, wrists, and fingers in meaningful daily-life activities.

I led development and architecture while proactively managing technological risks from integrating multiple software and hardware layers in a medical context.

ArmRest interaction prototype with therapist context

ArmRest system interface and setup layout

ArmRest virtual hand interaction with kitchen training task

ArmRest mixed reality hardware and body tracking setup

ArmRest table projection workflow in motion

Technical Stack

Unity for core XR interaction systems and scene orchestration.
Computer vision with OpenCV, OpenPose and YOLO models.
Ad hoc camera synchronization across multiple RGB-D streams.
Depth masking and touch-enabled projection workflows.
Custom integration with sensor and hardware modules.