Chapter 3. SGI RAID for CXFS Clusters

This chapter discusses SGI RAID for CXFS clusters:

For additional updates, see the CXFS release notes.

RAID Hardware

CXFS supports the following RAID hardware:

  • Fibre Channel RAID:

    SGI InfiniteStorage 17500
    SGI InfiniteStorage 17000
    SGI InfiniteStorage 16000
    SGI InfiniteStorage 15000
    SGI InfiniteStorage 11000
    SGI InfiniteStorage 10000
    SGI InfiniteStorage 7700X
    SGI InfiniteStorage 6700
    SGI InfiniteStorage 6120
    SGI InfiniteStorage 5500
    SGI InfiniteStorage 5000
    SGI InfiniteStorage 4600
    SGI InfiniteStorage 4500
    SGI InfiniteStorage 4100
    SGI InfiniteStorage 4000
    SGI InfiniteStorage 220
    SGI RM660
    SGI RM610
    SGI TP9700
    SGI TP9500S (serial ATA)
    SGI TP9500
    SGI TP9400
    SGI TP9300S (serial ATA)
    SGI TP9300
    SGI TP9100
    SGI S330

  • InfiniBand RAID:

    SGI InfiniteStorage 17500
    SGI InfiniteStorage 17000
    SGI InfiniteStorage 16000
    SGI InfiniteStorage 15000
    SGI InfiniteStorage 10000
    SGI InfiniteStorage 7700X
    SGI InfiniteStorage 5500
    SGI InfiniteStorage 5000
    SGI InfiniteStorage 4600

  • SAS RAID:

    SGI InfiniteStorage 5600i
    SGI InfiniteStorage 5600
    SGI InfiniteStorage 5500
    SGI InfiniteStorage 5100
    SGI InfiniteStorage 5000

The SGI RAID will be initially installed and configured by SGI personnel.

RAID Firmware

SGI RAID supports the following firmware:


Note: SGI InfiniteStorage 220 does not support online updates of the controller firmware.


  • SGI InfiniteStorage 11000 and 15000 supports controller firmware version 6.02 or later.

  • SGI InfiniteStorage 6700 supports controller firmware version V3.00 or later.

  • SGI InfiniteStorage IS4600 supports controller firmware version 7.36 or later.

  • SGI InfiniteStorage IS4100 supports controller firmware version 7.60 or later.

  • SGI RM610 and RM660 running version 5.12b or later.

  • The TP9700 9.14 CD contains the required controller firmware and NVSRAM files. The 06.14.xx.xx code or later must be installed.

  • The TP9500S 8.0 CD contains the required controller firmware and NVSRAM files. The 05.41.xx.xx code or later must be installed.

  • The TP9400/TP9500 6.0 CD contains the required controller firmware and NVSRAM files. The 05.30.xx.xx code or later must be installed.

  • The TP9400 4.0 CD contains the required controller firmware and NVSRAM files for the 4774 or 4884 units:

    • If you have a 4774 unit, the 04.01.xx.xx , 04.02.xx.xx, or 05.30.xx.xx code or later must be installed.

    • If you have a 4884 unit, the 04.02. xx.xx code is installed by default.

  • The TP9300S 8.0 CD contains the required controller firmware and NVSRAM files. The 05.41.xx.xx code or later must be installed if using 2882 controllers, or 05.42.xx.xx code or later if using 2822 controllers.


    Note: The initial TP9300S used 2882 controllers in the controller module. This product was later replaced with 2822 controllers (still using the TP9300S marketing code). With the release of the 2822 controller, SATA disk drives can be installed in the controller module (the 2882 did not have disk drives installed in the controller module).


  • The TP9300 8.42 CD (TPSSM 8.42) contains the required 8.42 firmware for the S330.

  • The TP9300 7.0 CD contains the required controller firmware and NVSRAM files. The 05.33.xx.xx code or later must be installed.

  • The TP9100 1Gb 4.0 CD contains the required version 7.75 controller firmware for the 1-Gbit TP9100. Supported via special request with optical attach (other conditions may apply).

  • TP9100 2Gb requires firmware 9.03 or later.

  • The TP9100 5.0 CD contains the required version 8.40 firmware for the 2-Gbit TP9100.


    Note: The TP9100 is limited to 64 host connections.


  • The TP9100 4.0 CD contains the required version 7.75 controller firmware for the 1-Gbit TP9100. Supported via special request with optical attach (other conditions may apply).

For more information, see “Using SGI Knowledgebase” in Chapter 15.

See also “XVM Path Failover Overview” in Chapter 8.

Support for a Single Partition Only

CXFS supports the number of LUNs supported by a RAID controller in a single partition.


Note: CXFS does not support multiple partitions of storage arrays such as NetApp SANshare.


Software Requirements for InfiniBand RAID

This section discusses the following:

The appropriate installation steps depend upon whether every HCA port is used exclusively for block I/O or if there is a mix of block I/O and network traffic (such as NFS). Contact SGI Support for assistance.

Software Requirements for InfiniBand RAID on RHEL

To use InfiniBand RAID on RHEL, ensure that the required software is installed:

rhel# yum groupinstall "Infiniband Support"
rhel# yum install srptools.x86_64
rhel# yum install srptools-debuginfo.x86_64
rhel# yum install opensm infiniband-diags

Software Requirements for InfiniBand RAID on SLES

To use InfiniBand RAID on SLES, ensure that the required software is installed:

  • If using an embedded subnet manager:

    Mellanox:

    sles# zypper in --type package ofed srptools infiniband-diags libibverbs mstflint

    Other:

    sles# zypper in --type package ofed srptools infiniband-diags libibverbs

  • For direct-attach or if an embedded subnet manager is not supported:

    Mellanox:

    sles# zypper in --type package ofed srptools infiniband-diags libibverbs mstflint opensm

    Other:

    sles# zypper in --type package ofed srptools infiniband-diags libibverbs opensm

Note the following:

  • libibverbs RPM provides the ibv_devices and ibv_devinfo commands that can be used to list useful information.

  • srptools RPM provides the ibsrpdm command, which is used to determine device IDs (such as id_ext and ioc_guid) required when tuning.

  • mstflint provides tools required to update firmware and determine Mellanox card model information, such as the mstvpd command.