Optimized query statistics make the queries that run on your database perform faster. The query optimizer runs automatically, so in most cases the query plan, as shown in Figure 9.23,
Category: Monitor Cluster Performance
Understand Custom Logging Options – Monitoring Azure Data Storage and ProcessingUnderstand Custom Logging Options – Monitoring Azure Data Storage and Processing
As you now know, there are many built‐in monitoring logs you can configure to feed into Azure Monitor using Log Analytics. All the categories within each Azure product’s diagnostic settings
APACHE SPARK APPLICATIONS – Monitoring Azure Data Storage and ProcessingAPACHE SPARK APPLICATIONS – Monitoring Azure Data Storage and Processing
The Apache Spark Applications page was discussed in Chapter 6, “Create and Manage Batch Processing and Pipelines.” Figure 6.14 illustrates the details of an invocation of a Spark notebook. The
ConfigureMonitoringServices–Monitoring AzureData Storage and Processing-2ConfigureMonitoringServices–Monitoring AzureData Storage and Processing-2
Another feature currently available to Azure storage accounts is something called Workbooks. As previously mentioned, Application Insights is an SDK that is coded into the product code, whereas the Workbooks
Create an Azure Synapse Analytics Alert – Monitoring Azure Data Storage and ProcessingCreate an Azure Synapse Analytics Alert – Monitoring Azure Data Storage and Processing
FIGURE 9.4 Creating an Azure Synapse Analytics alert condition FIGURE 9.5 The Azure Synapse Analytics Alerts blade Three options are available on the + Create drop‐down menu you selected in
Summary – Keeping Data Safe and SecureSummary – Keeping Data Safe and Secure
This chapter discussed data‐related security concepts. The number one takeaway is that although you now know much about data security and some security design and implementation principals, you engage with
Monitor and Manage Azure Synapse Analytics Logs – Monitoring Azure Data Storage and Processing-1Monitor and Manage Azure Synapse Analytics Logs – Monitoring Azure Data Storage and Processing-1
FIGURE 9.13 Azure Synapse Analytics pipeline runs filtered by annotations FIGURE 9.14 Azure Synapse Analytics activity runs FIGURE 9.15 Azure Synapse Analytics data flow modifiers FIGURE 9.16 Azure Synapse Analytics
Develop a Batch Processing Solution – Keeping Data Safe and SecureDevelop a Batch Processing Solution – Keeping Data Safe and Secure
Chapter 6 covered all the aspects of designing a batch processing solution, excluding some security issues. At that point, you had not been exposed to an Azure key vault, managed
Use an Azure Key Vault Secret to Store an Authentication Key for a Linked Service – Keeping Data Safe and SecureUse an Azure Key Vault Secret to Store an Authentication Key for a Linked Service – Keeping Data Safe and Secure
FIGURE 8.43 Access key in Key Vault from a blob linked service failure FIGURE 8.44 Access key from Key Vault to blob linked service failure By default, ADLS access keys
Create a User‐assigned Managed Identity – Keeping Data Safe and SecureCreate a User‐assigned Managed Identity – Keeping Data Safe and Secure
FIGURE 8.40 Creating and applying a user‐assigned managed identity Creating a user‐assigned managed identity is simple, as you just learned. Adding the identity to the Contributor role of your Azure