Robot Control System and Method

Robot Motion Restriction Control System Combining Motion Sensors and HMD Eye-Tracking Data

This technology is a robot control system that manages robot movement via a user-worn device consisting of motion sensors and an HMD that tracks eye status, adjusting the robot's motion restriction range based on the user's eye state.

When remotely controlling a humanoid robot using only user gestures, safety accidents can occur because the robot continues to mirror the user's movements even when the user is not actively monitoring the robot's situation.

This technology proposes a method that uses the HMD's eye-tracking camera to determine if the user's eyes are closed, thereby controlling the robot's motion restriction range while streaming the robot's camera feed directly to the HMD. Applicable to remote-operated robots and hazardous task automation, it prevents malfunctions when the user is not looking, ensuring both safety and operational stability.

‍

‍

Key Features:

• A robot that mirrors user movements while operating within a defined motion restriction range
• A user-worn device comprising motion sensors to detect user gestures and an HMD to track eye status
• A management server that controls robot movement based on user gestures detected by motion sensors
• A configuration where the HMD's eye-tracking camera determines if the user's eyes are closed to adjust the motion restriction range