Applies to: SharePoint Online
Pre-requisites
- Azure subscription
- Permissions to create Azure resources and to deploy models for Azure Open AI.
Description
In this article, we have described configuring the below services in Microsoft Azure.
- Azure OpenAI Services
- Azure AI Search
- Azure AI Document Intelligence
Azure OpenAI Services
Azure OpenAI Service provides access to OpenAI’s models including the GPT-4, GPT-4 Turbo with Vision, GPT-3.5-Turbo, DALLE-3 and Embeddings model series with the security and enterprise capabilities of Azure. This service is used by NITRO Copilot to generate AI response for user query using the enterprise data.
To create Azure Open AI service,
1. Open Azure portal and sign in with azure subscription.
2. Open “Azure OpenAI” resource from Azure services or you can search and find out “Azure OpenAI” resource as shown below.
3. Create a new Open AI service.
Note: If Azure OpenAI service is not enabled for your Azure tenancy, then a link will be shown in Azure portal to fill a form. Once the form is submitted, OpenAI service gets enabled within a day as per our experience.
Refer below Microsoft article to create new azure open AI service.
https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/create-resource?pivots=web-portal
4. Open above created Azure Open AI service and navigate to the Azure OpenAI Studio to deploy the completion model (gpt-4o)and text embedding models (text-embedding-ada-002) as shown below
5. Click ‘Deployments’ under Management in Azure OpenAI Studio and create new deployments as shown below
6. Create “gpt-4o” and “text-embedding-ada-002” models
7. Navigate to the Azure OpenAI service that we have created above and copy the keys and endpoint URL to use it for the connection in the NITRO AI Settings.
NITRO Open AI Connection:
Azure AI Search
Azure AI Search provides secure information retrieval at scale over user-owned content in traditional and generative AI search applications.
To create Azure Open AI service,
1. Open Azure portal and sign in with azure subscription.
2. Open “AI Search” resource from Azure services or you can search and find out “Azure AI Search” resource as shown below.
3. Create a new AI search service.
Refer below Microsoft article to create new azure open AI service.
https://learn.microsoft.com/en-us/azure/search/search-create-service-portal
Note: While creating the AI search service, select the pricing tier as per the requirement. If your data is less than 50MB then go with the free tier otherwise select the tier that suits your requirement.
4. Navigate to the Azure AI search service created in above step and copy the URL and this will be used in NITRO AI connection settings.
5. Next navigate to the ‘Keys’ and copy admin key and query key to use it in the NITRO AI connection Settings.
- Admin Key: Used to authenticate and authorize administrative tasks and configurations for Azure API search. This key grant access to manage indexes, query settings, and other administrative functions within your Azure API Search service.
- Query Key: Used to authenticate and authorize queries made to Azure API search. This key allows access to perform search operations and retrieve search results from your Azure API Search service.
NITRO AI Search Connection:
Azure AI Document Intelligence
Create Azure AI cognitive multi service account that is used for document intelligence. Document intelligence is used to extract the content from pdf and word documents. Extracted content can be saved either in the SharePoint list or Azure AI Search for use in the NITRO Copilot.
To create Azure AI cognitive multi service account:
1. Open Azure portal and sign in with azure subscription.
2. Open “AI Search” resource from Azure services or you can search and find out “Azure AI Search” resource as shown below.
3. Create a new AI cognitive service
Refer below Microsoft article to create new azure open AI service.
https://learn.microsoft.com/en-us/azure/ai-services/multi-service-resource?pivots=azportal
4. Navigate to the Azure AI cognitive service created in above step and go to ‘Keys and Endpoint’ under ‘Resource Management’ and copy the key and endpoint URL to use it in the NITRO AI connection Settings.
NITRO AI Document Intelligence Connection:
