Chapter 4. Integrate your Microsoft Azure account with data filtering

Procedure

1. In cost management, navigate to Settings Menu > Integrations > Cloud tab and click Add integration.
2. In the Add a cloud integration wizard, select Microsoft Azure and click Next.
3. Enter a name for your integration and click Next.
4. In the Select application step, select Cost management and click Next.
5. In the Specify cost export scope step, select I wish to manually customize the data set sent to Cost Management. If you are registering RHEL usage billing, select Include RHEL usage.
6. Click Next.

Procedure

1. In your link:https://azure.microsoft.com/en-usMicrosoft Azure account, enter "storage" in the search bar, click Storage accounts, and click Create.
2. Complete the Azure wizard to create the storage account and copy the resource group and storage account names for later use.
3. Click Review, review the storage account details, and click Create.
4. In cost management, navigate to the Add a cloud integration wizard and paste the resource group and storage account names into Resource group name and Storage account name.

Procedure

1. In your Microsoft Azure account, enter "cost exports" in the search bar, click the result, and click Create.
2. In Select a template, click Cost and usage (actual) to export your standard usage and purchase charges.

3. Follow the Azure wizard steps:

   • Create a new resource group and storage account or select existing ones.
   • Set Format to CSV.
   • Set Compression type to None or Gzip.
4. Review the information, click Create, and return to the Add a cloud integration wizard in cost management.
5. Click Next.

Procedure

1. In your Microsoft Azure account, open Cloud Shell and run the following command:

   az account show --query "{subscription_id: id }"

2. Copy the returned subscription_id value:

   Example response:

   {
       "subscription_id": 00000000-0000-0000-000000000000
       }

3. In cost management, navigate to the Subscription ID field of the Add a cloud integration wizard, paste the value, and click Next.

Procedure

1. In cost management, navigate to the Roles section of the Add a cloud integration wizard and copy the az ad sp create-for-rbac command.
2. In your Microsoft Azure account, open Cloud Shell, paste and run the command.

3. Copy the returned values for client ID, secret, and tenant:

   Example response:

   {
       "client_id": "00000000-0000-0000-000000000000",
       "secret": "00000000-0000-0000-000000000000",
       "tenant": "00000000-0000-0000-000000000000"
   }

4. In cost management, return to the wizard, paste the values into their corresponding fields on the Roles page, and click Next.
5. Review your information, click Add, and copy the Source UUID from the pop-up screen for your function script.

Procedure

1. In your Microsoft Azure account, enter functions in the search bar, select Function App, and click Create.

2. Select a hosting option, click Select, add your resource group, and configure the instance details:

   1. Name your function app.
   2. Set Runtime stack to Python and Version to latest.
3. Click Review + create, then click Create. After creation completes, click Go to resource.

4. In Visual Studio Code, open the Microsoft Azure tab, sign in, and create a new function:

   1. Click Azure Functions in the Workspaces drop-down and click Create Function.
   2. Follow the prompts to select Python, Model 2, and the latest version.
   3. Select Timer trigger template, name the function, and set the cron expression (for example, 0 9 * * * for daily at 9 AM).
   4. Click Create and Open in the current window.
5. In the development environment, open requirements.txt, add the required dependencies (azure-functions, pandas, requests, azure-identity, azure-storage-blob), and save.
6. Copy the Python script and paste it into function_app.py.

7. Update the script configuration:

   1. Change the values in # Required vars to update to match your environment.
   2. Ensure the cron timer matches @app.timer_trigger in the script.
   3. Uncomment either filtered_data = hcs_filtering(df) or filtered_data = rhel_filtering(df) for your filtering type.
8. If using custom filtering, ensure the script includes all required columns and follows the column normalization pattern in the example script. Update the custom query under # custom filtering basic example #.
9. Save the file, right-click the Function window in Visual Studio Code, click Deploy to Function App, and select your function app.

Procedure

1. In your Microsoft Azure account, navigate to Key Vaults and click Create.

2. Select the resource group that your function is in and follow the Azure wizard to create a new secret:

   1. In Key vault name, enter any name of your choosing.
   2. In Access policies, click Create new policy and select Secret Management from the templates.
   3. In the Principal tab, search for and select your function as the principal.
3. After completing the wizard, click Create Vault. When the deployment completes, click Go to resource to open the Key Vault page.
4. In the Objects drop-down, select Secrets.

5. Create the first secret for your service account:

   1. Click Generate/import.
   2. In Create a secret, enter a name for your client_id.
   3. Copy the Secret Identifier value for later use.
6. Repeat the previous step to create a second secret for your client_secret.

Procedure

1. In your Microsoft Azure account, navigate to your function and select Settings Environment variables.

2. Click Add, configure the first environment variable, and click Save:

   • Name: ClientIdFromVault
   • Value: @Microsoft.KeyVault(SecretUri=YOUR-CLIENT-ID-URI) (replace YOUR-CLIENT-ID-URI with the Secret Identifier value that you copied previously)

3. Repeat the process for the second environment variable:

   • Name: ClientSecretFromVault
   • Value: @Microsoft.KeyVault(SecretUri=YOUR-CLIENT-SECRET-URI) (replace YOUR-CLIENT-SECRET-URI with the Secret Identifier value that you copied previously)

Procedure

1. In your Microsoft Azure account, enter functions in the search bar and select your function.
2. In the Settings menu, navigate to Identity > System assigned tab, switch Status to On, and click Save.

3. Complete the following steps for each of the two storage accounts that you created:

   1. Click Azure role assignments and then click Add role assignment.
   2. Set Scope to Storage, select one of your storage accounts in Resource, set Role to Storage Blob Data Contributor, and click Save.
   3. Click Add role assignment again.
   4. Set Scope to Storage, select the same storage account in Resource, set Role to Storage Queue Data Contributor, and click Save.
   5. Repeat steps 3-4 for the second storage account.