Home social robot device for the hearing impaired

Social robot for the hearing impaired that detects sounds via indoor autonomous navigation and provides alerts through physical contact

This technology is a robot control mechanism that autonomously navigates indoor spaces to detect sound information. When it determines an alarm situation requires the user's attention, it sends information to the user's device or, if the user does not respond, moves directly to the user to provide an alert through physical contact.

The hearing impaired often face risks or daily inconveniences due to an inability to perceive indoor sound information (such as fire alarms, doorbells, or household appliance sounds) in a timely manner, while existing attachable devices are cumbersome to install and often have blind spots.

This technology features a wheeled body equipped with sound, location, and object detection sensors, utilizing AI algorithms to analyze the user's location and sound data. Upon detecting an alarm, it sends a notification to the user's device; if unconfirmed, the robot navigates to the user's location and induces physical contact (tactile stimulation) by repeatedly moving forward and backward to ensure the alarm is perceived. Applicable to home service robots, indoor safety, and accessibility support, it enhances daily safety by delivering sound information to the hearing impaired immediately.

‍

‍

Key Features:

• An object detection sensor coupled to the body that captures the surroundings to detect the relative position and shape of nearby objects.
• A location sensor coupled to the body that performs 3D scanning of the surrounding space to detect the body's relative position within that space.
• A home social robot device for the hearing impaired that controls the display to show the type and location of detected sounds.
• A sound detection sensor coupled to the body that detects sound information occurring in the vicinity.