The Voice SDK enables you to bring voice interactions to your app experiences. Use the Voice SDK to enhance the AR/VR experience with more natural and flexible ways for people to interact with the app. For example, voice commands can shortcut controller actions with a single phrase, or interactive conversation can make the app more engaging.
To learn more about the Voice SDK visit the Oculus Developer docs and read through the Voice SDK Overview
Last but not the least, please see what voice enabled experiences that developers have been building with Voice SDK for more inspiration, Video and we are so pleased to invite you to watch Unreal Voice SDK on Meta Connect 2022. Video
- Voice Command with free ASR (Automatic Speech Recognition) and NLU (Natural Language Understanding)
- TTS (Text to speech)
- Dictation
- High quality voice experience with low latency, with real-time transcription
-
Download the Voice SDK enabled project template from here.
-
Unzip it and copy to
C:\Program Files\Epic Games\UE_[version]\Templates. -
Create a new project as normal but select Game>"Voice SDK enabled".
Note: git is needed.
-
Create a new Unreal project(or open your existing Unreal project).
-
Download the 1-click script from here and put it into your Unreal project folder and execute the script.
- Install the plugin from Marketplace.
- Create a new Unreal project(or open your existing Unreal project).
- Enable the Plugin.
- Open your game with Unreal Editor.
- Settings-> Plugins-> Installed -> Voice -> VoiceSDK.
- Tick the checkbox to enable the plugin (Editor restart is needed).
- Add the lines below to your game's Config/DefaultEngine.ini:
[Voice]
bEnabled=True
-
Save and restart Unreal Editor.
- Create a new Unreal project(or use your existing Unreal project).
- Grab the latest release zip from Releases
- Extract the zip in your game's
Pluginsdirectory. - Add the lines below to your game's Config/DefaultEngine.ini:
[Voice]
bEnabled=True
Voice SDK is powered by the Wit.ai Natural Language Understanding (NLU) service, Please follow this quick start guide to create a new Wit app.
- In Wit.ai, go to Management > Settings and copy the Server Access Token.
- In Unreal Editor go to Menu-> Oculus-> Configuration Editor-> Input a Config file name, paste the copied Server Access Token and-> Click
Create
If you have done the above steps, Congratulations! You have VoiceSDK integrated with your game! You can now start to build voice experiences into your game. But we highly recommend you checkout our sample project first. It demonstrates all Voice SDK features and best practices.
The TTS Speaker won't work without Presets. However since Marketplace doesn't allow plugins to contain content you will need to download the additional content from here.
- Voice SDK Online Documentation
- Wit.ai Documentation
- Voice SDK uses Wit.ai to power its speech recognition, text to speech, and natural language functionality. To learn more about Wit.ai check out the Wit.ai Documentation.
The license for voicesdk-unreal can be found in LICENSE file in the root directory of this source tree.
You can also find the applicable Oculus License here: https://developer.oculus.com/licenses/oculussdk
The MIT license applies to only certain, clearly marked documents. If an individual file does not indicate which license it is subject to, then the Oculus License applies.
Our terms of use can be found at https://opensource.facebook.com/legal/terms.
Use of Wit.ai services fall under the terms of use of Wit.ai found here: https://wit.ai/terms.
Our privacy policy can be found at https://opensource.facebook.com/legal/privacy.
The privacy policy for the Wit.ai service can be found at https://wit.ai/privacy.
Please see the Voice SDK Overview for additional applicable terms and policies.
https://developer.oculus.com/documentation/unreal/vsdk-overview/