MORE | Fall 2024

Enhancing Telepresence in Human-Robot Interaction through Depth Sensing and Augmented Reality

Health icon, disabled. A red heart with a cardiac rhythm running through it.

This research aims to improve spatial awareness in teleoperated humanoid robots by integrating depth-sensing cameras and augmented reality (AR) overlays. The project focuses on modifying the Reachy robot to include depth perception capabilities, developing algorithms for accurate distance estimation, and adapting the AR application to visualize object distances within virtual reality (VR) interfaces. By addressing the limitations of current teleoperation systems, this study seeks to enhance user performance and interaction in remote robotic control scenarios, potentially benefiting fields such as manufacturing, health care, and disaster response.

Student researcher

Shyam Kamlesh Ganatra

Robotics and autonomous systems

Hometown: Rajkot, Gujarat, India

Graduation date: Fall 2025