Augmented reality - Object control in the field of Robotics

Requirements:

Software:

Unity3D 2020.1.8f1, Blender, Vuforia 8.3.8 and later, Visual Studio 2017/2019

Supported on the following operating systems:

Universal Windows Platform, Android

Software/Package	Link
Blender	https://www.blender.org/download/
Unity3D	https://unity3d.com/get-unity/download/archive
Vuforia Engine	https://developer.vuforia.com/downloads/sdk
Visual Studio	https://visualstudio.microsoft.com/downloads/

Project Description:

The principle of Augmented Reality (AR) consists in detecting a key object (in our case a QR code), which after successful localization, displays the 3D model on the screen of the mobile phone, tablet or computer together with the control panel of the object.

The augmented reality application was developed for simple control of objects (Universal Robots, ABB, etc.) and for a better understanding of robotic movements and 3D visualization. The application was created in Unity3D using the Vuforia Engine and tested on Android (Tablet, Phone) and Windows (USB Webcam). In our case, the application uses a simple QR code to detect and display the scene.

The augmented reality application demonstrates several cases of control:

• movement of joints / links, scaling, information about the object (robot), animation, etc.

The project was realized at the Institute of Automation and Computer Science, Brno University of Technology, Faculty of Mechanical Engineering (NETME Centre - Cybernetics and Robotics Division).

Project Hierarchy:

Repositary [/AR-Robotics-Object-Control/tree/main/ar_object_control/Assets/]:

[ Object Control              ] /Script/ar_object_control.cs
[ Main Control (Global)       ] /Script/main_control_gVar.cs
[ Individual objects (.blend) ] /Object/
[ Images (UI)                 ] /Image/
[ Animation of the objects    ] /Animation/
[ Scene of the Application    ] /Scenes/ar_object_control

Augmented Reality Application:

Contact Info:

[email protected]

Citation (BibTex)

@misc{RomanParak_Unity3D,
  author = {Roman Parak},
  title = {A digital-twins in the field of industrial robotics integrated into the unity3d development platform},
  year = {2020-2021},
  publisher = {GitHub},
  journal = {GitHub repository},
  howpublished = {\url{https://github.com/rparak/Unity3D_Robotics_Overview}}
}

License

MIT