The BMC must not be on the primary CXFS private network. Ideally, the BMC should be on a different private network that is reachable by all server-capable administration nodes in the cluster. A public network is not ideal for security reasons, but is acceptable.
SGI x86_64 systems contain an integrated BMC. CXFS uses Intelligent Platform Management Interface (IPMI) to communicate with the BMC.
To use the BMC, you must create an admin user ID and assign the BMC a static IP address. This can be done using ipmitool(1) on the system containing the BMC. Do the following:
Verify that you have ipmitool(1) version 1.8.9 or later:
# ipmitool -V ipmitool version 1.8.9
Load the following IPMI modules:
# modprobe ipmi_msghandler # modprobe ipmi_devintf # modprobe ipmi_si
Create a user named admin with a password and ADMINISTRATOR privileges:
Find the next available user ID:
# ipmitool -d /dev/ipmi0 user list 1|2
Assign the user name admin to the next available user ID:
# ipmitool -d /dev/ipmi0 user set name userID admin
Set the password for user admin:
# ipmitool -d /dev/ipmi0 user set password userID admin_password
Enable the access modes and set the privilege level to ADMINISTRATOR:
# ipmitool -d /dev/ipmi0 channel setaccess 1|2 userID callin=on ipmi=on link=on privilege=4
Note: You must apply the privilege change separately for channel 1 and for channel 2. Verify that the correct settings were applied:
# ipmitool -d /dev/ipmi0 user list 1|2 # ipmitool -d /dev/ipmi0 channel getaccess 1|2 userID
For example (line breaks shown here for readability):
# ipmitool -d /dev/ipmi0 user list 1 ID Name Callin Link Auth IPMI Msg Channel Priv Limit 1 true false true ADMINISTRATOR # ipmitool -d /dev/ipmi0 user list 2 ID Name Callin Link Auth IPMI Msg Channel Priv Limit 1 true false true ADMINISTRATOR # ipmitool -d /dev/ipmi0 user set name 2 admin # ipmitool -d /dev/ipmi0 user set password 2 password # ipmitool -d /dev/ipmi0 channel setaccess 1 2 callin=on \ ipmi=on link=on privilege=4 [root@linux root]# ipmitool -d /dev/ipmi0 channel setaccess 2 2 callin=on \ ipmi=on link=on privilege=4 # ipmitool -d /dev/ipmi0 user list 1 ID Name Callin Link Auth IPMI Msg Channel Priv Limit 1 true false true ADMINISTRATOR 2 admin true true true ADMINISTRATOR # ipmitool -d /dev/ipmi0 user list 2 ID Name Callin Link Auth IPMI Msg Channel Priv Limit 1 true false true ADMINISTRATOR 2 admin true true true ADMINISTRATOR # ipmitool -d /dev/ipmi0 channel getaccess 1 2 Maximum User IDs : 15 Enabled User IDs : 2 User ID : 2 User Name : admin Fixed Name : No Access Available : call-in / callback Link Authentication : enabled IPMI Messaging : enabled Privilege Level : ADMINISTRATOR # ipmitool -d /dev/ipmi0 channel getaccess 2 2 Maximum User IDs : 15 Enabled User IDs : 2 User ID : 2 User Name : admin Fixed Name : No Access Available : call-in / callback Link Authentication : enabled IPMI Messaging : enabled Privilege Level : ADMINISTRATOR
Apply the following local area network (LAN) settings for the BMC on the SGI x86_64 system, for which the IPMI device is /dev/ipmi0. The BMC LAN settings apply to LAN channels 1 and 2.
Note: You must apply each change separately for channel 1 and for channel 2. Set the IP Address (use the same IP address for both channels):
# ipmitool -d /dev/ipmi0 lan set 1|2 ipaddr IP_address
Set the subnet mask (use the same value for both channels):
# ipmitool -d /dev/ipmi0 lan set 1|2 netmask netmask
Enable address resolution protocol (ARP) responses:
# ipmitool -d /dev/ipmi0 lan set 1|2 arp respond on
Enable gratuitous ARP, which broadcasts the MAC address to IP address mappings on a specified interface:
# ipmitool -d /dev/ipmi0 lan set 1|2 arp generate on
Set the gratuitous ARP interval (in seconds):
Note: An interval of 5 seconds is supported for CXFS. # ipmitool -d /dev/ipmi0 lan set 1|2 arp interval 5
For example:
# ipmitool -d /dev/ipmi0 lan set 1 ipaddr nodename-bmc.company.com Setting LAN IP Address to nodename-bmc.company.com # ipmitool -d /dev/ipmi0 lan set 2 ipaddr nodename-bmc.company.com Setting LAN IP Address to nodename-bmc.company.com # ipmitool -d /dev/ipmi0 lan set 1 netmask 255.255.0.0 Setting LAN Subnet Mask to 255.255.0.0 # ipmitool -d /dev/ipmi0 lan set 2 netmask 255.255.0.0 Setting LAN Subnet Mask to 255.255.0.0 # ipmitool -d /dev/ipmi0 lan set 1 arp respond on Enabling BMC-generated ARP responses # ipmitool -d /dev/ipmi0 lan set 2 arp respond on Enabling BMC-generated ARP responses # ipmitool -d /dev/ipmi0 lan set 1 arp generate on Enabling BMC-generated Gratuitous ARPs # ipmitool -d /dev/ipmi0 lan set 2 arp generate on Enabling BMC-generated Gratuitous ARPs # ipmitool -d /dev/ipmi0 lan set 1 arp interval 5 BMC-generated Gratuitous ARP interval: 5.0 seconds # ipmitool -d /dev/ipmi0 lan set 2 arp interval 5 BMC-generated Gratuitous ARP interval: 5.0 seconds
Verify your changes by using the following command:
# ipmitool -d /dev/ipmi0 lan print 1|2
For example:
# ipmitool -d /dev/ipmi0 lan print 1 Set in Progress : Set Complete Auth Type Support : NONE MD5 PASSWORD Auth Type Enable : Callback : : User : : Operator : : Admin : MD5 PASSWORD : OEM : IP Address Source : Static Address IP Address : nodename-bmc.company.com Subnet Mask : 255.255.0.0 MAC Address : 00:04:23:d5:af:3c SNMP Community String : IP Header : TTL=0x40 Flags=0x40 Precedence=0x00 TOS=0x10 BMC ARP Control : ARP Responses Enabled, Gratuitous ARP Enabled Gratituous ARP Intrvl : 5.0 seconds Default Gateway IP : 0.0.0.0 Default Gateway MAC : 00:00:00:00:00:00 Backup Gateway IP : 0.0.0.0 Backup Gateway MAC : 00:00:00:00:00:00 RMCP+ Cipher Suites : 0,1,2,3,4,5,6,7,8,9,10,11,12,13,14 Cipher Suite Priv Max : XXXXXXXXXXXXXXX : X=Cipher Suite Unused : c=CALLBACK : u=USER : o=OPERATOR : a=ADMIN : O=OEM
Verify the BMC configuration and connectivity from a remote node by issuing ipmitool(1) commands remotely:
# ping IP_address_or_hostname # ipmitool -H IP_address_or_hostname -U admin -P admin_passwd lan print 1|2
For example (line breaks shown here for readability):
# ping nodename-bmc.company.com # ipmitool -H nodename-bmc.company.com -U admin \ -P mypassword lan print 1 Set in Progress : Set Complete Auth Type Support : NONE MD5 PASSWORD Auth Type Enable : Callback : : User : : Operator : : Admin : MD5 PASSWORD : OEM : IP Address Source : Static Address IP Address : nodename-bmc.company.com Subnet Mask : 255.255.0.0 MAC Address : 00:04:23:d5:af:3c SNMP Community String : IP Header : TTL=0x40 Flags=0x40 Precedence=0x00 TOS=0x10 BMC ARP Control : ARP Responses Enabled, Gratuitous ARP Enabled Gratituous ARP Intrvl : 5.0 seconds Default Gateway IP : 0.0.0.0 Default Gateway MAC : 00:00:00:00:00:00 Backup Gateway IP : 0.0.0.0 Backup Gateway MAC : 00:00:00:00:00:00 RMCP+ Cipher Suites : 0,1,2,3,4,5,6,7,8,9,10,11,12,13,14 Cipher Suite Priv Max : XXXXXXXXXXXXXXX : X=Cipher Suite Unused : c=CALLBACK : u=USER : o=OPERATOR : a=ADMIN : O=OEM
For more information, see:
ipmitool(1) man page
The user guide or quick start guide for your system