This page was last edited on September 28, 2022, at 06:55.
Comments or questions about this documentation? Contact us for support!
The Natural Language Audio Streaming feature is available only for Early Adaptor Customers and availability is under Product Manager Control. Contact your Account Executive for further information on using this feature.
The Natural Language Audio Streaming Menu microapp allows direct streaming of audio to Bot Engines using Nexus, GWS, and Google Dialogflow. Currently, Google Dialogflow Essentials is supported.
You can import the Natural Language Audio Streaming as a new product into Intelligent Automation and use it in your callflows.
You must have the following prerequisites available and configured before you can use the app:
To enable this feature, configure the following Server Settings:
To allow GVP to invoke Nexus for audio streaming, Intelligent Automation uses the following VXML properties:
After the options are configured, a new Bot Registry tab is available. the Bot Registry tab lists all bots that are available in the Nexus server.
You can also add a new bot using the + Add Bot Details option.
The audio streaming module has two additional tabs, Nexus Configuration and Show All Intents.
The Nexus Configuration tab displays the current Nexus configuration setting for the call flow.
If your callflow requires any additional configuration, you can override the settings configured in the Default Server Settings:
When enabled, the Use Nexus config in Default Server Settings setting will use the information configured in the Default Server Settings options.
You can also specify the maximum attempts values by enabling the Enable MaximumAttempts Counter field.
To allow unrecognized intents to be handled, enable the Enable unrecognized intent option. You can configure the module that will be triggered when an intent is unrecognized.
The Context Setting option supports passing audio context to Nexus as part of Audio Streaming application from GIA 9.0.112.12 onwards. The context values are specified by a variable defined in the Enter Variable Name field. The context policy selected in Select Context Policy field will pass on the corresponding context policy on how to use the context to Dialogflow.
Currently the following policies are supported:
The contexts are passed through the asr.contexts property and the context policies using the asr.contextsPolicy property in the VXML.
The Show All Intents tab lists all intents available for the bot.
<assign name="NLIntent" expr="nexus_form_Response.data.intent" />
<assign name="NLSlots" expr="JSON.stringify(nexus_form_Response.data.slots)" />
<assign name="NLTextResponse" expr="nexus_form_Response.data.message" />
<assign name="NLInputText" expr="nexus_form_Response.data.inputTranscript" />