Projection-based mobile robot control system and method using code blocks

System for controlling mobile robots using code blocks and projection visualization

This technology is a cyber-physical system (CPS)-based control solution that operates physical mobile robots using executable code generated from user-inputted code blocks. It utilizes a projection module to overlay virtual scenario objects onto the physical driving environment, providing real-time visualization and feedback.

Conventional code block-based educational content is limited to virtual environments, making it difficult for users to experience the interaction between the physical world and digital content, which restricts the development of practical robot application skills in real-world settings.

This technology implements integrated virtual-physical interaction through a system architecture that includes real-time positioning of physical robots using 3D depth sensors, visualization of environmental images and scenario objects via a projection module, and the conversion of user-assembled code blocks into robot executable code, along with location-based situational awareness and feedback generation.

‍

‍

Key Features:

• A projection module that visualizes and displays scenario-related objects by projecting them onto the mobile robot's driving environment.
• A user code block generation module that creates code blocks to control the mobile robot's actions based on user-assembled inputs.
• A code block conversion module that translates the generated code blocks into executable code for controlling the mobile robot.
• A mobile robot control module that executes the code to manage movement based on the robot's position and surrounding situational awareness data.

‍