Microsoft DP-203 Certification Exam Implement Azure RBAC for ADLS,Microsoft Certifications,Microsoft DP-203 LINK CONNECTIONS – Monitoring Azure Data Storage and Processing-1

LINK CONNECTIONS – Monitoring Azure Data Storage and Processing-1




As of this writing, link connections are in preview. They are currently supported only with Azure SQL database and SQL server. When either of those datastores is linked with a dedicated SQL pool, the operational data from the source database is automatically replicated to the SQL pool. Once the operational data is in the Azure Synapse Analytics workspace, you can perform analytics on it and gather business insights from it.

System Dynamic Management Views

Chapter 2, “CREATE DATABASE dbName; GO,” introduced Database Console Commands (DBCC), which have database‐scoped dynamic management views (DMVs). Platform system dynamic management views (PDW) have a server scope, which, as the name implies, is focused on the health of the server the database is running on. Although PDWs and DMVs have different names and scope, their purpose is to provide useful information for tuning performance and diagnosing problems on dedicated SQL pools. There are many PDW and DMV functions, which are broken into categories such as Change Tracking, Database, Execution, I/O, and Transactions. The category most relevant in this context is Azure Synapse Analytics & Parallel Warehouse. Table 9.2 provides many of the PDW and DMV functions in this category, plus a few noteworthy functions for monitoring Azure Synapse Analytics workspace features.

TABLE 9.2  Synapse platform system dynamic management views

NameDescription
sys.dm_pdw_component_health_alertStores a historical list of issued alerts
sys.dm_pdw_component_health_statusRetains the current status of component health
sys.dm_pdw_diag_processing_statsPresents internal diagnostic events information
sys.dm_pdw_lock_waitsHas information about requests waiting for locks
sys.dm_pdw_network_credentialsProvides a list of networking credentials
sys.dm_pdw_node_statusDisplays node status and performance metrics
sys.dm_pdw_nodesRenders a list of nodes in the workspace
sys.dm_pdw_os_event_logsContains Windows Event logs per node
sys.dm_pdw_os_performance:countersHas Windows performance counters per node
sys.dm_pdw_os_threadsShows a list of and details about threads per node
sys.dm_pdw_resource:waitsLists wait information for workspace resources
sys.dm_pdw_sys_infoPresents application‐level activity counters
sys.dm_pdw_wait_statsShows node wait states for queries and requests
sys.dm_pdw_waitsLists wait states for queries, requests, and locks
sys.dm_tran_active_transactionsDisplays SQL Server‐level transaction details
sys.dm_tran_current_transactionReturns transaction‐specific details
sys.dm_tran_database_transactionsDisplays database‐level transaction details
sys.dm_tran_locksPresents the active lock manager status
sys.dm_pdw_errorsProvides query or request execution error details
sys.dm_pdw_exec_requestsProvides current and recent request information
sys.dm_pdw_exec_sessionsLists current and recently open sessions
sys.dm_pdw_request_stepsLists steps that make up a request or query
sys.dm_pdw_sql_requestsStores query distributions as part of SQL steps

Because they are based on internal and implementation specific data, these DMVs and functions change often. Therefore, you should not create any application dependency on them. Additionally, you must recognize that they depend directly on the software versions the product is running on, where “software versions” implies the entire stack, from the operating system to the source code library performing the operations. This means that you can expect a great variety of function availability and rendered output. To be successful in this area, you must be flexible and skilled at operational data interpretation and the configuration of DBMS management components. The following are a few examples of DMV output, beginning with sys.dm_pdw_nodes. These functions can be executed within a SQL script that targets a dedicated SQL pool within your Azure Synapse Analytics workspace. The output followed by the TSQL that generates it contains the node ID, type, name, and passive state: SELECT TOP 10 * FROM sys.dm_pdw_nodes

Leave a Reply

Your email address will not be published. Required fields are marked *

Related Post

Monitor and Manage Azure Synapse Analytics Logs – Monitoring Azure Data Storage and Processing-1Monitor and Manage Azure Synapse Analytics Logs – Monitoring Azure Data Storage and Processing-1



FIGURE 9.13 Azure Synapse Analytics pipeline runs filtered by annotations FIGURE 9.14 Azure Synapse Analytics activity runs FIGURE 9.15 Azure Synapse Analytics data flow modifiers FIGURE 9.16 Azure Synapse Analytics