This appendix contains a summary of the new features for each version of this guide.
CXFS version 1 is the original implementation of CXFS.
The 007-4016-002 update contains additional troubleshooting information and instructions for unmounting and remounting filesystems with the command line interface. It was reorganized to make the tasks of installation and configuration clearer.
The 007-4016-003 update contains the following:
Metadata server recovery information
Administrative shutdown procedures
Additional troubleshooting information
Instructions for unmounting and remounting filesystems with the CLI
Reorganized installation and configuration information
The 007-4016-004 update contains the following:
Support for hierarchical storage management (HSM) through data management application programming interface (DMAPI), also know as X/Open data storage management specification (XDSM)
Changes to administrative shutdown, including two new cmgr subcommands to stop CXFS services on the local nodes: admin cxfs_stop and admin cxfs_stop
Quorum changes without panics
The 007-4016-005 update contains the following:
Coexecution of CXFS and IRIS FailSafe 2.1, including commands to convert nodes and clusters to apply to both utilities
Ability to use the cmgr command without extra prompting (-p), permitting the use of scripts
New tasks to revoke and allow membership of the local node
Ability to specify the tie-breaker node, which is used in the process of computing node membership for the cluster when exactly half the nodes in the cluster are up and can communicate with each other
Clarification that a single subnet should be used
The 007-4016-006 update contains the following:
Clarifications about CXFS shutdown and database shutdown
Additional information about CXFS daemons
Clarifications to the comparison of XFS and CXFS
The 007-4016-007 update contains the following:
Addition of the Origin 3000 partition ID to node configuration
Troubleshooting information for a two-node cluster when both nodes go down
Information about editing the /etc/hosts file to use an alternate interface for heartbeat and control.
Clarification about the use of hardware reset and tie-breaker nodes
Ability to unset the tie-breaker node
Use of fsr
CXFS version 2 includes client-only nodes on operating system platforms other than IRIX (multiOS cluster, or heterogeneous clients).
The 007-4016-008 update contains the following:
A cluster of at least three weighted nodes is recommended for a production environment (that is, one requiring relocation and recovery of the metadata server).
If you use a two-weighted-node cluster for production, you must do one of the following:
Use reset lines to avoid data corruption and ensure that only one node is running in error conditions (reset lines are recommended for all CXFS clusters and required for use with IRIS FailSafe).
Weight one node as 1 and the other as 0.
Set a tie-breaker node.
However, there are issues with a two-weighted-node cluster.
The new cluster_status command, which provides a curses interface to display status information gathered by the cad daemon (this information is also displayed by the cxdetail command).
Cluster nodes can run adjacent levels of the IRIX operating system (OS); for example, 6.5.11f and 6.5.12f (this applies as of 6.5.12f).
The ability to execute your own custom scripts around mounting operations.
Partition ID information.
Clarification about the following:
Hostname resolution rules; it is critical that you understand these rules and have files configured poperly before attempting to configure a cluster.
The difference between CXFS membership and fs2d membership.
Configuration of nodes supported in an IRIS FailSafe and CXFS coexecution environment.
Unwritten extent tracking (unwritten=1|0 ) with CXFS.
Including the CXFS mount point in the /etc/exports file.
Number of nodes supported: 16 CXFS nodes, and up to 8 IRIS FailSafe nodes with coexecution.
The flow of information in a coexecution cluster.
The 007-4016-009 update contains the following:
The structure of the CXFS filesystem configuration has changed. CXFS filesystems can now be defined, modified, managed and deleted independently of each other and of the cluster definition. (Previously, the CXFS filesystems were defined as attributes to the cluster definition.)
The new design improves the performance, flexibility and reliability of filesystem configuration. To accommodate clusters mixing nodes running 6.5.12 and 6.5.13, backwards compatibility is enforced by default in 6.5.13. The result is that the performance achievements are not visible; however, if you are 6.5.13 on all nodes in the cluster, you may wish to turn off backwards compatibility. Backwards compatibility will be turned off in the 6.5.14 release.
Information about locating the xfsdump inventory in a shared directory.
Information about the IRIS FailSafe CXFS resource type that can be used to failover applications that use CXFS filesystems.
The -p option is no longer required when defining filesystems with the cmgr command; the scripting capability is therefore provided.
For certain GUI tasks, the ability to select all nodes at once in addition to specifying nodes individually.
New /var/cluster/cmgr-scripts/rotatelogs script to save log files with day and month name as suffixes.
The setting to force an unmount of a filesystem using the umount -k option is turned off by default in the GUI. There is no default when using the cmgr command.
Clarification of the term CLI to mean the underlying set of commands that are used by the cmgr cluster manager tool and by the GUI.
Use of sgi_apache.sw.server.
Correction: real-time filesystems are not currently supported. Changes to reflect this have been made in text.
New and revised figures.
The 007-4016-011 update contains the following:
The graphical user interface (GUI) has been improved. The separate cluster view (the cxdetail command) and task manager (the cxtask command) have been streamlined into one window, the CXFS Manager. Both the cxtask and cxdetail commands are kept for historical purposes; this document refers to just cxtask for simplicity.
The new GUI provides the following features:
Access to tasks through the menu bar or by clicking the right mouse button within the tree view
Faster filesystem status and cluster status updates
Access to the salog (4) file, which shows every command run from the GUI
A Find textfield helps you find components within the displayed tree-view
Information about the use of xfs_repair and CXFS filesystems.
Caution: Do not use xfs_repair on a CXFS filesystem unless you are certain there is a problem.
Information about using cmgr (1M):
Invoking subcommands directly on the command line with the -c option
Using template scripts provided in the /var/cluster/cmgr-templates directory
Information about MAC labels in a mixed Trusted IRIX and IRIX cluster.
The structure of the CXFS filesystem configuration was changed with the release of IRIX 6.5.13. Backward compatibility with earlier versions is no longer maintained as of IRIX 6.5.14, because all nodes in the cluster must be running the same or adjacent releases.
If you are upgrading from 6.5.13f entirely to 6.5.14f, there is no further impact.
If you intend to run a mixture of 6.5.13f and 6.5.14f nodes, you must turn off backward compatibility.
If you are upgrading from 6.5.12f or earlier without first installing and running 6.5.13f, then you must perform a one-time manual conversion of your CXFS filesystem definitions.
The 007-4016-012 update contains the following:
 | Note: Relocation and recovery are deferred in this release. |
Support for clients of other operating systems such as Solaris and Windows NT as defined in the CXFS 5 Client-Only Guide for SGI InfiniteStorage. These clients will be released asynchronously from the IRIX release. This support will require a minimum of IRIX 6.5.15f plus appropriate patches. For more information, see your SGI support contact.
Default scripts are now provided in the /var/cluster/clconfd-scripts directory to permit NFS-exporting of CXFS filesystems listed in /etc/exports.
Reset lines are mandatory for two-node and two-weighted node clusters. Larger clusters should have an odd number of weighted nodes, or must have serial reset lines if only two of the nodes are weighted.
Simplification of Chapter 1. General information about the CXFS Manager GUI and cmgr have been moved to their respective reference chapters, coexecution details have been moved into a separate chapter, and the communication flow diagrams and daemon information have been moved into an appendix.
Information about the error messages that may cause administrators to use xfs_repair inappropriately.
Changes to the rotatelogs script syntax. The root crontab file now has an entry to run the rotatelogs script weekly. If you run the script twice in one day, it will append the current log file to the previous saved copy, rather than overwriting it.
A new figure describing some of the various combinations of node and cluster types in a coexecution cluster.
The 007-4016-013 update contains the following:
| Note: Relocation and recovery are fully implemented, but the number of associated problems prevents support of these features in CXFS. While data integrity is not compromised, cluster node panics or hangs are likely to occur. These features will be fully supported when these issues are resolved. |
Support for Solaris and Windows NT systems in a multiple operating system (multiOS) cluster, including the following:
Information about defining the operating system for a node. For existing clusters that are upgraded to IRIX 6.5.16f, existing nodes will be assigned an operating system type of IRIX.
Information about I/O fencing, which allows a problem node to be isolated from the storage area network (SAN) so that it cannot corrupt data in the shared CXFS filesystem. Solaris and Windows NT nodes require a Brocade switch in order to support I/O fencing for data integrity protection; therefore, the Brocade switch is a required piece of hardware in a cluster running multiple operating systems.
The new terms multiOS and CXFS client-only node.
Support for the L1 controller on SGI Origin 300, SGI Origin 3200C, SGI Onyx 300, and SGI Onyx 3200C systems.
Information about the CXFS GUI tasks to define and modify a filesystem, which have been split into two pages for ease of use.
New GUI icons.
The 007-4016-014 update contains the following:
A new appendix contains an example /etc/ipfilterd.conf file that can be used to provide IP filtering for the CXFS private network.
The build_cmgr_script command, which generates a cmgr script from the cluster database. The script can be used later to recreate the cluster database after performing a cdbreinit command.
A sample script to unexport and locally unmount an lofs filesystem.
Use of the new command name cxfsmgr. The cxfsmgr command has the same function as the cxtask and cxdetail commands, which are kept for historical purposes.
Clarifications to the following:
Starting the CXFS Manager graphical user interface
Masking and I/O fencing
Terminology such as cluster, node, and pool
Terminology used to describe the GUI
The 007-4016-015 update contains the following:
| Note: In this release, relocation is disabled by default and recovery
is supported only when using standby nodes.
A standby node is a metadata server-capable administration node that is configured as a potential metadata server for a given filesystem, but does not currently run any applications that will use that filesystem. To use recovery, you must not run any applications on any of the potential metadata servers for a given filesystem; after the active metadata server has been chosen by the system, you can then run applications that use the filesystem on the active metadata server and client-only nodes. Relocation and recovery are fully implemented, but the number of associated problems prevents full support of these features in the current release. Although data integrity is not compromised, cluster node panics or hangs are likely to occur. Relocation and recovery will be fully supported in a future release when these issues are resolved. |
IRIX nodes may now be CXFS client-only nodes, meaning that they run a minimal implementation of the CXFS and cluster services, and do not contain a copy of the CXFS cluster database. Client-only nodes are installed with the cxfs_client software product.
This change also introduces the term CXFS administration node, which is a node that is installed with the cluster_admin software product, allowing the node to perform cluster administration tasks and contain a copy of the cluster database. Nodes that you want to run as metadata servers must be installed as CXFS server-capable administration nodes; SGI recommends that all other nodes be installed as client-only nodes.
When you define a node, you no longer need to specify the node weight. This has been replaced by the Node Function field, allowing you to choose Server-capable Admin, Client Admin, or Client-Only. (For Solaris and Windows nodes, Client-Only is automatically selected for you.) Similar fields are provided for the cmgr command.
When upgrading to 6.5.18f, already existing IRIX nodes will by default be assigned as Server-capable Admin if they had a weight of 1.
This version also clarifies the terms used for membership: CXFS kernel membership and cluster database membership .
New system-tunable parameters:
cxfs_relocation_ok lets you enable or disable the relocation feature; relocation is disabled by default in this release, and SGI recommends that you do not enable it.
cxfsd_min and cxfsd_max let you specify the minimum and maximum number of cxfsd threads to run per CXFS filesystem.
New commands:
cxfs_info provides status information about the cluster, nodes, and filesystems and is run from a client-only node.
cxfsdump gathers CXFS configuration information.
A CXFS cluster is supported with as many as 32 nodes. As many as 16 of those nodes can be CXFS administration nodes and all other nodes can be client-only nodes. You can choose to define a node as a CXFS client administration node, however, SGI strongly recommends that only potential metadata servers be configured as CXFS server-capable administration nodes and that there be an odd number of server-capable administration nodes for quorum calculation purposes.
The graphical user interfaces for XVM and CXFS have been combined into one. This guide provides an overview of the XVM-specific tasks provided by the GUI; for details about these tasks, see the XVM Volume Manager Administrator's Guide .
The tasks to make, grow, mount/unmount a filesystem are now provided in the GUI.
Tips about using CXFS and Trusted IRIX.
Support for Microsoft Windows 2000 systems as client-only nodes. (This guide uses Windows to refer to both Microsoft Windows NT and Microsoft Windows 2000 nodes when the information applies equally to both. Information that applies to only one of these types of nodes is identified.)
The 007-4016-016 update contains the following:
The new rolling annual upgrade policy that permits you to upgrade from 6.5.n to the n+1 or n+4 release, as of 6.5.18f.
The time required to update and propagate the database across nodes in the cluster has been significantly decreased.
If you use I/O fencing and ipfilterd on a node, the ipfilterd configuration must allow communication between the node and the telnet(1) port on the switch.
The following nodes do not contain system controllers and therefore require I/O fencing for data integrity protection:
Silicon Graphics Fuel visual workstation
Silicon Graphics Octane system
Silicon Graphics Octane2 system
The CXFS Manager graphical user interface (GUI) has added a new icon to represent client-only nodes.
In preparation for future CXFS MultiOS client releases, the CXFS software now also allows you to specify the Linux, IBM AIX, and Hewlett-Packard HP-UX operating systems when defining a node. For support details, see the CXFS 5 Client-Only Guide for SGI InfiniteStorage and release notes.
This version clarifies the various methods to perform cluster database backups and restorations.
Application programmers should be aware that XFS recently relaxed the requirement that direct I/O be aligned along filesystem block boundaries. As of IRIX 6.5.19f, direct I/O will also be accepted using 512-byte alignment.
This change makes the use of direct I/O on a CXFS partition more consistent with that of other vendor's requirements and thus makes the use of CXFS more transparent. See the description of direct I/O requirements in the fcntl man page.
This version lists the system tunable parameters found in the /var/sysgen/mtune/cell file, some of which should not be modified.
The 007-4016-017 update contains the following:
Changes to the CXFS graphical user interface (GUI):
New login connection choices, including support for a remote shell connection, which connects to the server via a user-specified command shell, such as rsh or ssh.
The ability for the root user to grant other users permission to execute specific GUI tasks.
Use of Java2 for the CXFS GUI, which simplifies the Java installation and co-operation with third-party GUIs. This also enhances the ability to run the GUI through a web browser (via http:// server/CXFSManager/).
Information about using the right mouse button to access tasks appropriate to the selected GUI item.
Changes to the cxfsd_min and cxfsd_max defaults, and the cxfsd_max legal values.
More information about memberships, quorums, and tiebreakers.
A new figure describing standby mode.
More information about IRIX client-only issues:
Client-only node system files
Status in log files
cxfs_client error messages
CXFS version 3 adds support for CXFS metadata servers on SGI Altix systems running Linux (2.4 kernel).
The 007-4016-018 update contains the following:
Support for SGI ProPack metadata servers on SGI Altix 3000 family of servers and superclusters. A CXFS cluster can contain either SGI ProPack 2.3 server-capable administration nodes on Altix systems or IRIX server-capable administration nodes; you cannot mix IRIX and SGI ProPack server-capable administration nodes within one cluster.
CXFS does not support the relocation or recovery of DMAPI filesystems that are being served by SGI ProPack metadata servers.
Coexecution with FailSafe is not supported on SGI ProPack nodes.
Due to packaging enhancements, CXFS may now be installed on the M stream or the F stream.
The IRIX CXFS software will no longer be bundled in the IRIX overlay CDs but instead is on a separate CXFS IRIX Server and Client 3.0 for IRIX 6.5.22 CD. This changes the installation procedure.
Note: If you are upgrading from a previous IRIX release and have CXFS installed, you must upgrade both IRIX and CXFS. If you try to upgrade one without the other, conflicts will occur. Information about defining networks for CXFS kernel messaging (in addition to the network used for heartbeat/control). However, use of these networks is deferred.
Support for IRIX real-time filesystems.
Suggestions for configuring large clusters.
Information about using ping to verify general connectivity and CXFS heartbeat in a multicast environment.
The GUI has been changed to show a single display for the nodes in the cluster and nodes that are in the pool but not in the cluster. This new selection is View: Nodes and Cluster.
Information about information retaining system core files and the output from the cxfsdump utility when reporting problems.
Information about monitoring heartbeat timeouts for IRIX using Performance Co-Pilot or the icrash command.
The ability to define multiple CXFS filesystems at one time with the GUI.
The 007-4016-019 update contains the following:
Information about migrating from an IRIX cluster to a SGI ProPack cluster
Support for a cluster of up to 64 nodes.
Information about the TP9300 RAID.
Information about the cxfs-config command.
Clarification that serial hardware reset lines or I/O fencing is required for all nodes in order to protect data integrity.
The ability to define a reset method for a given node to one of the following:
powerCycle to turn power off and on
reset to perform a serial reset
nmi to perform a nonmaskable interrupt
You can define this method using either the cmgr command or the GUI. You can manually perform a powercycle or an NMI with the cmgr command.
New appendixes summarizing operating system path differences and new features from previous releases
The 007-4016-020 version contains the following:
Support for client-only nodes running the Mac OS X operating system in the configuration tools.
Information about console redirection.
Information about the SGI TP9300, SGI TP9300S, and SGI TP9500S.
Information about hardware changes and I/O fencing.
Updated migration examples.
Removal of the unimplemented GUI feature to define CXFS kernel messaging networks.
The 007-4016-021 update contains the following:
Information about private network failover as defined with the cmgr command. (Although the primary network must be private, the backup network may be public.)
Support for Guaranteed-rate I/O version 2 (GRIOv2) in the IRIX installation procedure.
Corrections to CXFS and cluster administration path differences between IRIX and SGI ProPack on SGI Altix systems.
Updated the example for clconf_info command. The clconf_info command now reports a node as inactive rather than DOWN* and the unused incarnation number has been removed.
Support for token obtain optimization. To disable, use the cxfs_prefetch system tunable parameter.
If you have a cluster with an even number of server-capable administration nodes and no tiebreaker: to avoid a split-brain scenario, you should not use the Shutdown setting on any server-capable administration node.
Information about multiple Ethernet interfaces on SGI Altix systems and providing persistent device naming.
Clarification about the chkconfig arguments used for IRIX administration nodes, SGI ProPack administration nodes, and client-only nodes.
Information about the correct options to use for quotas on SGI ProPack clusters (uquota and gquota ).
Information about serial reset configurations.
Information about using the hafence(1M) command to define a QLogic switch. (You cannot use the GUI or the cmgr command to define or modify a switch other than a Brocade switch.)
If you want to use quotas on a CXFS filesystem, you must install the quota package.
Information about removing a metadata server from the cluster for maintenance.
Mount options information.
Addition of the XVM graphical user interface (GUI) to the CXFS SGI ProPack package.
The 007-4016-022 update contains the following:
Procedures to remove a single client from the cluster and restore it, and shut down the entire cluster.
A new chapter about best practices.
Information about XVM failover.
Updates to the rolling upgrade policy.
Information about performing a miniroot install.
Information about installing the latest Java2 software for use with the CXFS GUI and SGI ProPack.
Information about modifying the httpd.conf file in order to use the CXFS GUI on SGI ProPack.
Clarifications to terminology.
The 007-4016-023 update contains the following:
Information about discoverying the WWNs
Support for system reset for SGI Altix systems that use an integrated L2, such as a NUMAlink 4 R-brick, or SGI Altix 3000 Bx2 systems. Configuring a node of this type requires use of cmgr .
Support for SGI ProPack for Linux 4 as a client-only node.
Support for the cxfsdump -secure option for secure remote connections. In cluster mode (the default), cxfsdump requires rsh/ssh and rcp/scp access across all nodes in the cluster.
CXFS version 4 adds support for CXFS metadata servers on SGI Altix systems running Linux 2.6 kernel.
The 007-4016-024 update contains the following:
Support for SGI ProPack 4 for Linux Service Pack 3.
Support for IRIX 6.5.29.
Server-side CXFS client license keys are now supported on server-capable administration nodes, allowing a client without a node-locked client-side license key to request a license key from the server. Server-side license keys are optional on IRIX metadata servers, but are required on SGI ProPack metadata servers. The licensing software is based on the FLEXlm product from Macrovision Corporation.
Support for the cxfs_admin cluster configuration and administration command, which waits for a command to be completed before continuing, provides the ability to limit which nodes can mount a filesystem, provides an improved interface over cmgr (including <TAB> completion of commands), and scripting capabilities. In a future release, cxfs_admin will replace cmgr.
The availability of dynamic heartbeat monitoring.
Information about choosing the correct version of XVM failover for your cluster.
Support for an SGI ProPack node as a server for the Guaranteed Rate I/O version 2 (GRIOv2) feature of CXFS.
Support for GPT labels.
Information about using the md driver on large SGI Altix systems with CXFS.
Updates to IRIX CXFS installation procedures.
Support for specifying a direct list of port numbers to be masked (that is, ports that will never be fenced), rather than using a hexadecimal string that represents the list. Ports that can be masked are now in the range 0 through 1023.
Ability to specify a vendor when defining a Fibre Channel switch using the GUI.
Requirement to start the file alteration monitoring ( fam) service on SGI ProPack nodes in order to use the CXFS graphical user interface (GUI).
Information about switching between SGIRDAC and SGIAVT mode for SGI RAID.
Information about CXFS port usage. CXFS Port Usage.
Information about the recovery timeout mechanism, in which nodes are polled for progress after a recovery has begun. If recovery for a node is not progressing according to the specified polls, the recovery is considered stalled and the node will then shut down or panic; this prevents the cluster from hanging and keeps filesystems available for the rest of the nodes in the cluster. The following site-changeable system tunable parameters are used:
cxfs_recovery_timeout_panic cxfs_recovery_timeout_period cxfs_recovery_timeout_stalled cxfs_recovery_timeout_start Information about using the filestreams mount option to optimize disk layout.
Best-practices information about:
Using proper storage management procedures
Being aware of differences between IRIX and Linux system administration
Modifying updatedb to avoid unnecessary load
Using fast copying for large CXFS files
Minimizing the number of switches
Note: The contents of the former “Avoid Problems” section from the Troubleshooting chapter was moved into the Best Practices chapter. Addition of SGI RAID information (this information was removed from the release notes).
Addition of switches information (this information was removed from the release notes).
A complete list of system-tunable parameters.
Support for drag-and-drop within the GUI to move nodes between the pool and the cluster.
Client administration nodes are only supported and appropriate for IRIX nodes running in coexecution with FailSafe. If you are running an earlier release and have an SGI ProPack node that is defined as a client administration node, you must delete the node from the cluster database, uninstall CXFS, reinstall CXFS, and redefine the node as a client-only node. For simplicity, this guide no longer refers to client-administration node or administration node except in specific instances.
For clarity, this book now uses the term SGI ProPack rather than Linux when referring to CXFS nodes running SGI ProPack for Linux.
The 007-4016-025 version includes the following:
Support for SGI IRIX 6.5.30.
Support for SGI ProPack 5 running SUSE Linux Enterprise Server 10 (SLES 10).
Support for SGI License Key (LK) software on SGI ProPack server-capable administration nodes.
Server-side licensing is required on the following client-only nodes (to determine the Linux architecture type, use the uname -i command):
SGI ProPack 5
Red Hat Enterprise Linux (RHEL) 4 on x86_64
SLES 9 on x86_64
SLES 10 on x86_64 or ia64
Note: For specific release levels, see the release notes. Other client-only nodes can use either server-side or client-side licensing. However, if one node within a cluster requires server-side licensing, all nodes must use server-side licensing. If no nodes in the cluster require server-side licensing, the nodes can continue to use existing client-side licensing.
Note: Server-side licensing is preferred, and no new client-side licenses will be issued. Customers with support contracts can exchange their existing client-side licenses for new server-side licenses. A future release will not support client-side licensing. For more information, contact SGI customer support. Support for the following RAID hardware:
SGI InfiniteStorage 10000 SGI InfiniteStorage 6700 SGI InfiniteStorage 4500 SGI InfiniteStorage 4000 DMAPI is disabled by default on SGI ProPack 5 systems. When you install DMF on a server-capable administration node, it automatically enables DMAPI. However, if you want to mount filesystems on an SGI ProPack 5 client-only node with the dmi mount option, you must enable DMAPI.
Information about the appropriate use of lcrash for SGI ProPack.
Information about the procedure required when upgrading from CXFS 3.4.1 or earlier for clusters with three or more server capable nodes.
Information about removing a metadata server from the cluster while avoiding a reset.
New mtcp_rpc_thread system tunable parameter (for SGI ProPack and Linux third-party nodes) that specifies whether metadata messages are sent from a separate thread in order to save stack space.
Information about rotating log files on SGI ProPack.
Information about SYSLOG credid warnings.
The table of mount options is now located in the CXFS 5 Client-Only Guide for SGI InfiniteStorage .
The 007-4016-026 version includes the following:
Support for the SGI InfiniteStorage 220 RAID.
Support for Intelligent Platform Management Interface (IPMI) reset using a baseboard management controller (BMC).
As of CXFS 4.2, all server-capable administration nodes running 4.2 and client-only nodes running 4.2 require server-side licensing. If all existing client-only nodes are running a prior supported release, they may continue to use client-side license as part of the rolling upgrade policy until they are upgraded to 4.2. All client-only nodes in the cluster must use the same licensing type -- if any client-only node in the cluster is upgraded to 4.2 or if a new 4.2 client-only node is added, then all nodes must use server-side licensing.
Customers with support contracts can exchange their existing client-side licenses for new server-side licenses. For more information, contact SGI customer support.
Support for GPT-labeled LUNs larger than 2 TB. (All nodes that mount a filesystem using LUNs larger than 2 TB must be upgraded to CXFS 4.2 or later.)
Disk layout optimization for approved media customers
If you have multiple clusters connected to the same public network, use the -i option to cxfs_admin to identify the cluster name.
Precedence of configuration options
Support for printing hafence debug information to the specified file debugfile by using the -d option in the /etc/cluster/config/clconfd.options file.
Using cxfs-reprobe on client-only nodes (SGI ProPack)
Information about parameters that must be set for QLogic switches.
The ability to use environment variables or the .cxfs_admin file to specify defaults for cxfs_admin , in addition to the set command.
Documentation for the support of XVM failover version 2 on Windows (first supported in the CXFS 4.1.1 release).
A new section that describes how to view the current CXFS licenses with the cxfs_admin command.
clconfd.options on CXFS Administration Nodes
Information about the cmgr command has been moved to an appendix. With the exception of performing the following administrative cmgrcommands, the preferred CXFS configuration tools are cxfs_admin and the CXFS graphical user interface (GUI):
admin ping admin reset admin powerCycle
As of the CXFS 5.0 release, this functionality will be provided by the cxfs_admin command and the cmgr command will not be supported.
CXFS version 5 supports CXFS metadata servers running Linux.
The 007-4016-027 version contains the following:
Support for clusters with server-capable administration nodes running only SGI ProPack for Linux. IRIX is now exclusively supported as a client-only platform and is generally documented in CXFS 5 Client-Only Guide for SGI InfiniteStorage.
Because IRIX is no longer supported as a server-capable administration node, CXFS 5.0 also no longer supports coexecution with FailSafe. Because the client administration node type (client_admin) was supported only for coexecution with FailSafe, this node type is no longer supported.
For information about moving from a cluster with IRIX metadata servers to a cluster with SGI ProPack metadata servers, see the IRIX chapter in this book.
Note: CXFS does not support SGIRDAC mode. New initial installation and update procedures.
The ability to revoke and restore the CXFS kernel membership for the local node, which must be a server-capable administration node, by using the stop_cxfs and start_cxfs commands in cxfs_admin.
The ability to generate streaming workload for SD/HD/2K/4K formats of video streams by using the frametest (1) command.
Support for the framesort utility, which provides easy file-layout analysis and advanced file-sequence reorganization.
The new site-changeable static system-tunable parameter mtcp_hb_local_options.
Reorganization to improve clarity.
Information about the cmgr command is located primarily in an appendix (which has not been updated to reflect CXFS 5.0 support). With the exception of a few administrative cmgrcommands, the preferred CXFS configuration tools are cxfs_admin and the CXFS graphical user interface (GUI). The following cmgr commands are still useful:
admin fence admin nmi admin ping admin powerCycle admin reset start/stop cx_services test connectivity test serial
In addition, the build_cmgr_script command is still useful.
In a future release, all of cmgr functionality will be provided by the cxfs_admin command and the cmgr command will not be supported.
The following commands are now deprecated: clconf_status and cluster_status. The functionality of these commands is now provided by the cxfs_admin command and/or the CXFS GUI.
The 007-4016-028 version contains the following:
Support for easy client configuration using the cxfs_admin command and the new autoconf object, which was introduced in CXFS 5.1. This feature lets you specify new client-only nodes that are allowed to be automatically configured into the cluster database. (This action only applies to hosts that are not currently defined in the cluster database.)
CXFS server-capable nodes must run SGI Foundation Software 1.
SGI Foundation Software 1 is a new product from SGI consisting of technical support tools, utilities, and driver software that enable SGI's Linux systems to run reliably and consistently. SGI ProPack 6 is the next generation of SGI's suite of performance-optimization libraries and tools that accelerate applications on SGI's Linux systems. SGI ProPack 6 may be optionally installed on any CXFS node running SGI Foundation Software 1. For more information on the content of these products, upgrades, ordering, service contracts, and licensing, see Supportfolio.
Information about limited support for case-insensitive CXFS filesystems, first introduced with CXFS 5.1.
Support for edge serving, in which CXFS client nodes can act as servers for NFS, Samba, CIFS, or any third-party network filesystem exporting files from a CXFS filesystem. However, there are no performance guarantees when using edge serving; for best performance, SGI still recommends that you use the active metadata server. If you require a high-performance solution, contact SGI Professional Services.
The 007-4016-029 version contains corrections the following new sections:
“Unmount Filesystems Before Adding or Deleting Server-Capable Administration Nodes”
“Change the Brocade Password when Prompted”
“Use a Time Synchronization Application”
“Turn Off Local XVM on Linux Nodes if Unused”
“Configuring SuSEfirewall2”
“Dynamic Parameters for Debugging Purposes Only”