Establishing the AI Connection for the AI Assistant

This article explains how to establish the connection for the Custom AI Assistant and provide end-users access to the AI assistant in the Library pane. The AI assistant will help the users to execute AI functions on text in Word, PowerPoint, Outlook, and Excel. 

How to set up Azure Open AI in Templafy

1. In the Admin Center, access the AI assistant section, and select the Connections tab.
2. Click on Add connection.
3. In the set-up window choose Hosted by Templafy or Azure OpenAI Service.
   Hosted by Templafy will connect the AI assistant to a standard GPT model hosted in Templafy's instance of Azure OpenAI.
   Azure OpenAI Service will allow you to connect the AI assistant to an AI model in your own Azure OpenAI instance.
4. Choosing the Azure OpenAI Service will require you to provide the following information:
   
   • API key.
   • Endpoint.
   • Deployment ID.
   • Input token limit.
   • Output token limit.
5. Click Confirm.

   Note The current token limit for Templafy hosted service is 8000 for input and 8000 for output. Refer to OpenAI's Token calculator to calculate your number of tokens for a specific input. The selected option can always be changed by clicking on the three dots menu and selecting Edit.

How to find the required fields to connect to your Azure OpenAI Service

1. Open Azure portal and click on the required Resource of type Azure OpenAI.
2. After the required Resource has been selected, access Keys and Endpoint menu item.
   • API key: both Key 1 or Key 2 can be used in the in Templafy field.
   • Endpoint: the full URL should be used in the Templafy field.
3. Deployment ID: Access Model deployments menu item and click on Manage deployments
   In Azure I Studio > Deployments, the Deployment name should be used in the Templafy field.
4. Token limit: restriction on the number of tokens that can be processed in a single interaction.
5. Tenant ID: Microsoft Entra App Registrations Page.
6. Client ID: Microsoft Entra App Registrations Page.
7. Secret: From your App registration, select Certificates & secrets from the left menu.
   On the Certificates & secrets page you'll be able to view your Secret ID however, in order to view a Secret's value, you'll need to create a new Secret.

How to set up Azure Prompt Flow in Templafy

1. In the Admin Center, access the AI assistant section, and select the Connections tab.
2. Click on Add connection.
3. In the set-up window choose Azure Prompt Flow. 
   This will allow the AI Assistant to be connected to prompt flow deployments (configured and deployed from Azure AI Studio) and use RAG (Retrieval Augmented Generation).
4. When setting up a flow and deployment in Azure Prompt Flow it gets two input values from our API request, instructions and message, and that the output of the flow should be named output.
5. Choosing the Azure OpenAI Service will require you to provide the following information:
   
   • API key.
   • Endpoint.
   • Deployment ID.
   • Output token limit.
6. Click Confirm.

How to set up a custom connection in Templafy

1. In the Admin Center, access the AI assistant section, and select the Connections tab.
2.  Click on Add connection.
3. In the set-up window choose Custom connection.
4. Choosing the Custom connection will require you to provide the following information:
   • Name.
   • Endpoint.
   • Input token limit.
   • Output token limit.
   • Authorization header name.
   • Authentication scheme.
   • API key.
5. Additional headers can be added to the API calls made from this connection by clicking on Add header under Request headers.
6. Click Confirm.

Enhanced Connection Settings via Microsoft Entra ID

This enhancement allows users to connect via Microsoft Entra ID for increased flexibility and security.

1. When adding or editing a connection, toggle the Connect with Microsoft Entra ID switch.
   
2. Instead of using the API Key, you will need to enter the following details from your App Registration page in Microsoft Entra:  Tenant ID, Client ID, Secret.
   

Managing connections in Templafy

How to add multiple connections in Templafy

1. Once you have set up the AI Assistant, go the Connections tab. You will only have your initial connection from the setup.
2. Press the Add connection button.
3. Choose the type of connection you want to use, such as Azure OpenAI Service.
4. Give the connection a name and fill out the required information.
5. Click Confirm.

How to delete a connection in Templafy

1. Go to the Connections tab.
2. Press the … button on the connection you want to delete and select Delete.
3. A confirmation dialog will pop-up, you won't be able to delete the connection if the following conditions are being met:
   • If it’s the only connection added.
   • If the connection is being used by existing actions (published or unpublished).
4. In the confirmation dialog, write the name of the connection and press the Delete connection button.

How to change the connection of a prompt template in the AI Assistant

1. Click on the prompt template that should be edited.
2. Click on the Prompt tab.
3. You can change the connection by selecting Connections tab.
4. Once the changes are finalized, click Save in the side pane.
5. Click Publish changes and Confirm to publish the changes.

Data Processing

For more information about how data is processed when using the AI assistant, please refer to our Security and Privacy FAQ.