Skip to content

Agent和RAG结合的机器人控制系统

Notifications You must be signed in to change notification settings

ChirsDejong/mnlm

 
 

Repository files navigation

Source code of robotic arm demo (see Physical Robot Arm and Simulation).

IMAGE ALT TEXT HERE

Build and Start the Docker Container

  1. Install Docker and Docker Compose.
docker-compose up --build -d

This command will build the docker image for the server side, and also start the docker container. Users can also access the simulation environment through the browser by visiting http://localhost:8080/vnc.html. [IMAGE ALT TEXT HERE]

  1. Login to the docker container. If you use vscode, you can install the Dev Container extension and open the running container. Otherwise, you can login to the docker container by running the following command:
docker exec -it mnln-ros_dev_env-1 /bin/bash
  1. Start the ROS2 simulation.
cd /home/small-thinking/mnlm/mnlm/robot/robot_arm_ws
colcon build --symlink-install ; source install/setup.bash ; ros2 launch robot_arm robot_arm_sim.launch.py

You should see the server side program started. And you can visit `http://localhost:8080/vnc.html`` to see the Gazebo Fortress simulation environment. IMAGE ALT TEXT HERE

  1. In your host machine. You can run the command to start the voice based UI.

IMAGE ALT TEXT HERE

In the project folder:
```bash
cd mnlm/client/gpt_control

Then you can see the client side started, and you will be prompoted to tell the robot what to do.

python assistant.py

About

Agent和RAG结合的机器人控制系统

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 55.0%
  • Vim Script 41.7%
  • Dockerfile 2.3%
  • Shell 1.0%