Questions[cisco-ucs](server)

nagios raid_check for new CiscoC240M5 with Cisco 12G Modular Raid Controller SAS3516 was failing.

For now I've modified check_raid to skip over the volume check part, checking only the physical drives but ideally we'd want to check both, with check_raid. Has anyone found a way around this? Or should I forgo check_raid and use a wrapper script for megaclisas-status --nagios instead, accepting the (cosmetic?) problems with the virtual drive size figures?

onboard 14 disks,

• 2* 480 GB Micron_5300_MTFDDAK480TDS in RAID1
• 12* 8T TOSHIBA MG06SCA800A in RAID10 of which 2 are hot spares.

error:

CRITICAL: megacli:[Volumes(2): DISK0.0:,DISK1.1:; Devices(14): 00,11=Hotspare 03,09,06,12,05,01,08,10,07,04,13,02=Online]

Turned out to be missing data from megacli command:

# /usr/sbin/megacli -LdInfo -Lall -aall
Adapter 0 -- Virtual Drive Information:
Virtual Drive: 0 (Target Id: 0)

Virtual Drive: 1 (Target Id: 1)

Exit Code: 0x00

tip from a fellow user to use

# /usr/sbin/megacli ShowSummary -Aall

reveals another problem, the Toshiba MG06SCA800A 8T disks are reported with capacity 931.436 GB. That results in the total for the virtual drive being way off too, 4T reported instead of 36T

[...]
                Connector          : Port 12 - 15<Internal>: Slot 6 
                Vendor Id          : TOSHIBA 
                Product Id         : MG06SCA800A     
                State              : Online
                Disk Type          : SAS,Hard Disk Device
                Capacity           : 931.436 GB
                Power State        : Active

Vdisk:

                Virtual drive      : Target Id 1 ,VD name RAID10_12345678
                Size               : 4.547 TB
                State              : Optimal
                RAID Level         : 10 

same for megaclisas-status since it uses megacli. disk info is right but array info is missing:

# megaclisas-status --nagios
RAID OK - Arrays: OK:2 Bad:0 - Disks: OK:14 Bad:0
# megaclisas-status
-- Controller information --
-- ID | H/W Model                                                        | RAM    | Temp | BBU    | Firmware     
c0    | Cisco 12G Modular Raid Controller with 2GB cache (max 16 drives) | 2048MB | 67C  | Good   | FW: 51.10.0-3612 

-- Array information --
-- ID | Type |    Size |  Strpsz | Flags | DskCache |   Status |  OS Path | CacheCade |InProgress   
c0u0  | N/A  |         |         |       |      N/A |      N/A | /dev/sda | None      |None         
c0u1  | N/A  |         |         |       |      N/A |      N/A | /dev/sdb | None      |None         

-- Disk information --
-- ID   | Type | Drive Model                                   | Size     | Status          | Speed    | Temp | Slot ID  | LSI ID  
c0u0p0  | SSD  | 202529BD123BMicron_5300_MTFDDAK480TDS D3MC000 | 446.1 Gb | Online, Spun Up | 6.0Gb/s  | 31C  | [134:13] | 13      
c0u0p1  | SSD  | 202529BCC1C0Micron_5300_MTFDDAK480TDS D3MC000 | 446.1 Gb | Online, Spun Up | 6.0Gb/s  | 32C  | [134:14] | 2       
c0u1p0  | HDD  | TOSHIBA MG06SCA800A 5701Z020A0FSFRJG          | 7.276 TB | Online, Spun Up | 12.0Gb/s | 26C  | [134:1]  | 3       
c0u1p1  | HDD  | TOSHIBA MG06SCA800A 5701Z020A05RFRJG          | 7.276 TB | Online, Spun Up | 12.0Gb/s | 26C  | [134:2]  | 9       
c0u1p0  | HDD  | TOSHIBA MG06SCA800A 5701Z020A0FRFRJG          | 7.276 TB | Online, Spun Up | 12.0Gb/s | 27C  | [134:3]  | 6       
c0u1p1  | HDD  | TOSHIBA MG06SCA800A 5701Z020A0E7FRJG          | 7.276 TB | Online, Spun Up | 12.0Gb/s | 26C  | [134:4]  | 12      
c0u1p0  | HDD  | TOSHIBA MG06SCA800A 5701Z020A05UFRJG          | 7.276 TB | Online, Spun Up | 12.0Gb/s | 26C  | [134:5]  | 5       
c0u1p1  | HDD  | TOSHIBA MG06SCA800A 5701Z020A052FRJG          | 7.276 TB | Online, Spun Up | 12.0Gb/s | 26C  | [134:6]  | 1       
c0u1p0  | HDD  | TOSHIBA MG06SCA800A 5701Z020A0EGFRJG          | 7.276 TB | Online, Spun Up | 12.0Gb/s | 26C  | [134:7]  | 8       
c0u1p1  | HDD  | TOSHIBA MG06SCA800A 5701Z020A0FEFRJG          | 7.276 TB | Online, Spun Up | 12.0Gb/s | 26C  | [134:8]  | 10      
c0u1p0  | HDD  | TOSHIBA MG06SCA800A 5701Z020A04AFRJG          | 7.276 TB | Online, Spun Up | 12.0Gb/s | 26C  | [134:9]  | 7       
c0u1p1  | HDD  | TOSHIBA MG06SCA800A 5701Z020A0KGFRJG          | 7.276 TB | Online, Spun Up | 12.0Gb/s | 26C  | [134:10] | 4       

-- Unconfigured Disk information --
-- ID   | Type | Drive Model                          | Size     | Status                | Speed    | Temp | Slot ID  | LSI ID | Path    
c0uXpY  | HDD  | TOSHIBA MG06SCA800A 5701Z020A0EFFRJG | 7.276 TB | Hotspare, Spun down   | 12.0Gb/s | 26C  | [134:11] | 0      | N/A     
c0uXpY  | HDD  | TOSHIBA MG06SCA800A 5701Z020A0DRFRJG | 7.276 TB | Hotspare, Spun down   | 12.0Gb/s | 26C  | [134:12] | 11     | N/A     

storcli actually shows the right figures but it's not in the hwraid.le-vert.net repo's so it's offlimits

I've spent way too much time on this.

We have a 8 node Microsoft Private Cloud, hosted on a Cisco Flexpod (B200 blades, Nexus 5k, 6248FI's with two NetApp FAS2550 controllers for SAN). Running UCS 2.2(5a) firmware.

All the hosts SAN boot, and run Server 2012 R2 Datacentre. There is a CSV mounted on each host, that hosts our 70-odd virtual machine's VHDX's.

Recently, we moved to Visual Studio Online and commissioned a number of build servers (well, 3). Once the build is complete, the artifacts are published to our staging and testing environments, each consisting of a single virtual machine running Server 2012 R2 Standard. This publishing uses Robocopy to copy the artificats to the C$ share of those virtual machines.

When that copy happens, we see the following:

• The virtual machine's GUI becomes unresponsive
• When connecting to the VM during this state, we are unable to log in (sometimes ctrl-alt-del has no effect, sometimes the login prompt is shown but typing doesn't show in the password box)
• If we were logged in before the CIFS/SMB traffic started, GUI elements keep running until you interact with them
• After a while, all virtual machines hosted on the same Hyper-V host start experiencing timeouts
• The VM is unresponse to shutdown commands through Failover cluster manager, and we have to turn off the VM which takes a little time, but completes
• After rebooting the VM, it's fine again until you try and copy to it again
• Existing VMs (i.e. VMs commissioned a long time ago) are unaffected, it's only ones commissioned in the last month

To debug, I tried a manual (i.e. Windows copy and paste), which exhibits the same issue.

I've tried:

• Changing receive side scaling settings
• Disabled VMQ (even though we don't have Broadcom adapters, but Cisco VICs), both on the host and on the VM's network adapter
• Restarted the entire cluster (rolling restart of hosts)
• Building a new VM, without any Windows updates. Experiences the same issue
• Confirmed that we don't have any duplicate IP addresses
• There is no AV running on any of the hosts or guest VMs
• Because GUI items that are open before the issue starts keeps running, I ran Resource Monitor and checked the disk utilization. When the issue starts, the disk IO drops to pretty much 0. On this point (along with NetApp specific monitoring tools, and the fact that VM's on all the other nodes keep running) I've eliminated the storage component as being the culprit. See below the screenshot of when the copy started:

Note the drop in disk IO. Incidentally, all other VMs on the same Hyper-V host's disk IO drops to 0 at the same time.

Out of frustration, this morning I created a Gen1 Virtual Machine, and commissioned it as I would any other Gen2. This for some unknown reason, works. If I copy to the C$ share of a Gen2 machine, it fails. If I copy from the exact same location, to the C$ share of this new Gen1 machine, there are no issues.

Update: I've also noted that copying from the Gen2 machines is fine. Just when copying TO them does the issue exhibit.

What could be causing this? What is the difference between Gen1 and Gen2? Could it be a UCS firmware issue.

On a Cisco UCS C220-M4 I have 3 450GB disks and I want to create a RAID5 with those.

My RAID controller is Cisco 12G SAS Modular Raid Controller.

On the CIMC page for the server though, I only have the option to create RAID1, RAID0, or RAID10. Nowhere can I create a RAID5 virtual drive.

Is this normal? Is it a limitation of my RAID controller?

Thanks

Deploying some new Cisco UCS C220 M3 rack servers and was wondering if there is any management software similar to Dell's OpenManage that I should install on each server?

We have an Oracle VM Cluster that we are provisioning on a Cisco UCS B series blade chassis. It has 2 fabric interconnects (FC0 and FC1) provisioned to the (3) Oracle VM service profiles and it is set to boot from san with no local storage configured at all. The issue is that each time we reboot the Oracle VM Server, there is about an 80% chance that it will result in the below errors. I have been able to boot all three service profiles up at the same time with no issue at least three times throughout this process.

Setting up Logical Volume Management: /dev/sdq: open failed: No medium found /dev/sdp: open failed: No medium found

Checking filesystems fsck.ext3: Unable to resolve 'UUID=39b6935d-5c93-45aa-b54d-344fa171c40c'

This drops me to a 'Repair filesystem' prompt where a fsck gives me the same error. I am able to mount this uuid and view the data (from withing the Repair filesystem). Running 'blkid' shows that the boot partition and erroring partition's UUIDs match and they are mapped exactly between grub.conf and /etc/fstab.

As a test, I just zoned the fabric switches back to Single initiator, single target for this service profile, but this has provided no positive movement. Are there zoning or specific UCS service profile requirements that need to be met in order to boot from san with Oracle VM? Any help would be appreciated.

Don