I ran into a situation last month where my customer noticed that there were numerous Windows Failover Cluster role server names (aka ‘network name’ aka ‘virtual name’) that were not getting discovered by SCOM. When I looked closer it became clear that the problem was present on cluster ‘roles’ where there was more than one virtual name attached. In the screenshot below you will notice there are two Server Names; a ‘V’ name and a ‘C’ name. (This is the naming convention used by the customer. The customer was only interested in the ‘V’ name and wasn’t really using the ‘C’ names at the time, so they didn’t really care about discovering the ‘C’ names. ) For most of the roles, only the ‘V’ name was being discovered, not the ‘C’ name. However for a small minority of the roles, only the ‘C’ name was being discovered. There didn’t seem to be any consistency or any obvious logic for which one was found by the discovery; not the IP network/subnet, not the order in which they appeared in Failover Cluster Manager, not the name (spelling, alphabetical order). The only thing I could guess was perhaps it was related to the order in which the names were created and added to the cluster role by whomever set up the WFC, and I don’t have a time machine nor a magic portal to go gather that intel. Therefore the enumeration order remains a mystery.
I decided that discovery is technically working, but only recognizing the “first” virtual name. Now what?
I started digging into the discovery. I eventually found the cause and solution. I’m going to describe my journey here so that hopefully my process and methods will help someone else down the road.
I have a two-node Windows cluster in my lab, “DBC1”. On that cluster I added a SQL server Always On Availability Group to the Roles. The AOAG has a virtual name, “DBC1AGListener”.
I deployed the SCOM (2019) agent to my first SQL server only (db01.contoso.com), some time later (10-15 minutes?) both the Windows cluster name and the AG listener name appeared.
There are some things to note here. My lab is different in a number of ways from the customer.
Specs | Customer | My Lab |
Windows Server Ver. | 2016 | 2019 |
Cluster Nodes | 4 | 2 |
SQL AOAG | 2016 | 2017 |
Cluster Role(s) Virtual Names | 2 | 1 |
SCOM | 2016 UR8 | 2019 |
In the end, the labs were similar enough to research the problem.
I needed to dig into the discovery process to figure out what it was doing. Before I could do that, I needed to identify which discovery to focus on. Before I could do that, I needed to identify what was being discovered; what are ‘DBC1.Contoso.com’ and ‘DBC1AGListener.Contoso.com’? That is to say, what type of objects are they? Once I know their class types I can identify the discoveries that are capable if discovering them.
I safely assumed that they were either a “virtual” or “cluster” type class (name) so I used the following code to show me all class instances related to the AGListener name.
# Get all classes with 'virtual' or 'cluster' in the Name $v = Get-SCOMClass | ? {$_.Name -match 'virtual|cluster'} # Display class instances $AG = $v | Get-SCOMClassInstance | ? {$_.fullname -match 'DBC1AGListener'} $AG
Hit! I got the object, now let’s look at it’s type(s).
$Ag | Format-List
From the screenshot above you can see that there are 3 classes in the family tree of the object. Let’s find out what those classes are.
Here I use the New-SCOMClassGraph function to show me the entire family tree for the 3 related classes.
$AG | ForEach { Get-SCOMClass -Id $_.MonitoringClassIds | select displayname,name,managementpackname,id } | New-SCOMClassGraph -Combine
Success! “DBC1AGListener.Contoso.com” is a “Microsoft.Windows.Cluster.VirtualServer” or “Virtual Server” (DisplayName) shown at the bottom of the graph. From the graph you can see that the only discovery (blue box) that is linked to that class type is: “Microsoft.Windows.Cluster.Classes.Discovery” and it is defined in this management pack: “Microsoft.Windows.Cluster.Library”.
MP DisplayName: Windows Cluster Library
MP Name: Microsoft.Windows.Cluster.Library
MP Version: 7.0.8437.16
Now we know what type of object “DBC1AGListener.Contoso.com” is and which discovery workflow is responsible for discovering it and we know where to find the discovery.
I export the MP with PowerShell and locate the discovery in the .xml file.
Get-SCOMManagementPack -Name Microsoft.Windows.Cluster.Library | Export-SCOMManagementPack -Path C:\Temp
<Discovery ID="Microsoft.Windows.Cluster.Classes.Discovery" Enabled="true" Target="Microsoft.Windows.Cluster.Service.ForVirtualServer" ConfirmDelivery="false" Remotable="true" Priority="Normal"> <Category>Discovery</Category> <DiscoveryTypes> <DiscoveryClass TypeID="Microsoft.Windows.Cluster"> <Property TypeID="System!System.Entity" PropertyID="DisplayName" /> <Property TypeID="Microsoft.Windows.Cluster" PropertyID="Name" /> <Property TypeID="Microsoft.Windows.Cluster" PropertyID="VendorId" /> <Property TypeID="Microsoft.Windows.Cluster" PropertyID="OSVersion" /> <Property TypeID="Microsoft.Windows.Cluster" PropertyID="HighestVersion" /> <Property TypeID="Microsoft.Windows.Cluster" PropertyID="LowestVersion" /> <Property TypeID="Microsoft.Windows.Cluster" PropertyID="IsRunningMixedVersion" /> </DiscoveryClass> <DiscoveryClass TypeID="Microsoft.Windows.Cluster.VirtualServer"> <Property TypeID="System!System.Entity" PropertyID="DisplayName" /> <Property TypeID="Windows!Microsoft.Windows.Computer" PropertyID="PrincipalName" /> <Property TypeID="Windows!Microsoft.Windows.Computer" PropertyID="NetworkName" /> <Property TypeID="Windows!Microsoft.Windows.Computer" PropertyID="IPAddress" /> <Property TypeID="Windows!Microsoft.Windows.Server.Computer" PropertyID="IsVirtualNode" /> <Property TypeID="Microsoft.Windows.Cluster.VirtualServer" PropertyID="GroupName" /> <Property TypeID="Microsoft.Windows.Cluster.VirtualServer" PropertyID="Network" /> <Property TypeID="Microsoft.Windows.Cluster.VirtualServer" PropertyID="SubnetMask" /> <Property TypeID="Microsoft.Windows.Cluster.VirtualServer" PropertyID="EnableNetBIOS" /> <Property TypeID="Microsoft.Windows.Cluster.VirtualServer" PropertyID="ProxyingEnabled" /> </DiscoveryClass> </DiscoveryTypes> <DataSource ID="DiscoveryDataSource" TypeID="Microsoft.Windows.Cluster.Classes.Discovery.ModuleType"> <ManagementGroupId>$Target/ManagementGroup/Id$</ManagementGroupId> <DiscoveringSourceObjectId>$MPElement$</DiscoveringSourceObjectId> <DiscoveringManagedEntityId>$Target/Host/Id$</DiscoveringManagedEntityId> <Computer>$Target/Host/Property[Type="Windows!Microsoft.Windows.Computer"]/NetworkName$</Computer> <FuncionalityCheckTimeout>3000</FuncionalityCheckTimeout> <ExcludedServers /> <ProxyingEnabled>$Target/Property[Type="Microsoft.Windows.Cluster.Service"]/ProxyingEnabled$</ProxyingEnabled> <PopulateProxyingEnabled>true</PopulateProxyingEnabled> <DiscoverMultipleVirtualServers>false</DiscoverMultipleVirtualServers> </DataSource> </Discovery>
Notice this line in the discovery code above: <DiscoverMultipleVirtualServers>false</DiscoverMultipleVirtualServers>
This implies that the discovery has the ability to discovery more than one virtual server at a time, but it is set to “false” by default. This would explain the symptoms we are seeing in the customer’s environment. Can we override it to “true”? A quick look at the DataSource will determine yes or no.
This is the datasource: <DataSource ID="DiscoveryDataSource" TypeID="Microsoft.Windows.Cluster.Classes.Discovery.ModuleType">
Here we can see in the datasource module type that this parameter, “DiscoverMultipleVirtualServers”, is able to be overridden.
This is what it looks like in the Console:
After the customer enabled this parameter, SCOM instantly started to discover all of the missing virtual server names from the cluster roles.
Problem solved.
One Reply on “Windows Clusters – Discover Multiple Virtual Servers”