This article will explain how to establish the connection for the Custom AI Assistant and provide end-users access to the AI assistant in the Library pane. The AI assistant will help the users to execute AI functions on text in Word, PowerPoint, and Outlook.
Prerequisites
|
How to set up Azure Open AI in Templafy
- In the Admin Center, access the AI assistant section.
- In the set-up window choose Hosted by Templafy or Azure OpenAI Service.
Hosted by Templafy will connect the AI assistant to a standard GPT model hosted in Templafy's instance of Azure OpenAI.
Azure OpenAI Service will allow you to connect the AI assistant to an AI model in your own Azure OpenAI instance. - Choosing the Azure OpenAI Service will require you to provide the following information.
- API key.
- Endpoint.
- Deployment ID.
- Token limit.
- Click Save
Note
- The current token limit for Templafy hosted service is 4000. Refer to OpenAI's Token calculator to calculate your number of tokens for a specific input.
- The selected option can always be changed under More Options->Settings-> AI Connection.
How to set up Azure Prompt Flow in Templafy
- In the Admin Center, access the AI assistant section.
- In the set-up window choose Azure Prompt Flow.
This will allow the AI Assistant to be connected to prompt flow deployments (configured and deployed from Azure AI Studio) and utilize RAG (Retrieval Augmented Generation). - When setting up a flow and deployment in Azure Prompt Flow it gets two input values from our API request, instructions and message, and that the output of the flow should be named output.
- Choosing the Azure OpenAI Service will require you to provide the following information.
- API key
- Endpoint
- Deployment ID
- Token limit
- Click Save
Enhanced Connection Settings via Microsoft Entra ID
This enhancement allows users to connect via Microsoft Entra ID for increased flexibility and security.
- When adding or editing a connection, toggle the Connect with Microsoft Entra ID switch
- Instead of using the API Key, you will need to enter the following details from your App Registration page in Microsoft Entra: Tenant ID, Client ID, Secret
How to find the required fields to connect to your Azure OpenAI Service
- Open Azure portal and click on the required Resource of type Azure OpenAI.
- After the required Resource has been selected, access Keys and Endpoint menu item.
- API key: both Key 1 or Key 2 can be used in the in Templafy field.
- Endpoint: the full URL should be used in the Templafy field.
-
Deployment ID: Access Model deployments menu item and click on Manage deployments
In Azure I Studio > Deployments, the Deployment name should be used in the Templafy field. - Token limit: restriction on the number of tokens that can be processed in a single interaction.
- Tenant ID: Microsoft Entra App Registrations Page.
- Client ID: Microsoft Entra App Registrations Page.
-
Secret: From your App registration, select Certificates & secrets from the left menu.
On the Certificates & secrets page you'll be able to view your Secret ID however, in order to view a Secret's value, you'll need to create a new Secret.
How to add multiple connections in Templafy
- Once you have set up the AI Assistant, go the Connections tab. You will only have your initial connection from the setup.
- Press the Add connection button.
- Choose the type of connection you want to use, such as Azure OpenAI Service
- Give the connection a name and fill out the required information.
- Click Save
How to delete a connection in Templafy
- Go to the Connections tab.
- Press the … button on the connection you want to delete and select Delete.
- A confirmation dialog will pop-up, you won't be able to delete the connection if the following conditions are being met:
• If it’s the only connection added
• If the connection is being used by existing actions (published or unpublished) - In the confirmation dialog, write the name of the connection and press the Delete connection button.
How to change the connection of a prompt template in the AI Assistant
- Click on the prompt template that should be edited.
- Click on the Prompt tab.
- You can change the connection by selecting Connections tab.
- Once the changes are finalized, click Save in the side pane.
- Click Publish changes and Confirm to publish the changes.
Data Processing
For more information about how data is processed when using the AI assistant, please refer to our Security and Privacy FAQ.
NoteRefer to Data, privacy, and security for Azure OpenAI Service for information directly about Azure OpenAI. |
Comments
Article is closed for comments.