Patch steps for IB Switches

If your prerequisite  steps are good,you are ready to patch IB switches.Patch manager patches each switches one by one.So no need to worry about.If something goes wrong,patch manager never go to other switch(es).

 

[root@#5dbadm01 patch_18.1.5.0.0.180506]# ./patchmgr -ibswitches ibswitches.lst -upgrade

2018-11-11 07:40:18 -0600 1 of 1 :Working: DO: Initiate upgrade of InfiniBand switches to 2.2.9-3. Expect up to 40 minutes for each switch

—– InfiniBand switch update process started 2018-11-11 07:40:18 -0600 —–
[NOTE ] Log file at /u01/patches/CELL_18.1.5.0/patch_18.1.5.0.0.180506/upgradeIBSwitch.log

[INFO ] List of InfiniBand switches for upgrade: ( #5sw-iba01 #5sw-ibb01 )
[SUCCESS ] Verifying Network connectivity to #5sw-iba01
[SUCCESS ] Verifying Network connectivity to #5sw-ibb01
[SUCCESS ] Validating verify-topology output
[INFO ] Proceeding with upgrade of InfiniBand switches to version 2.2.9_3
[INFO ] Master Subnet Manager is set to “#5sw-iba01” in all Switches
[INFO ] Upgrade to 2.2.9_3 requires that the InfiniBand switch be at 2.2.7-2. Upgrading #5sw-iba01 first to 2.2.7-2

[INFO ] ———- Starting with InfiniBand Switch #5sw-iba01
[WARNING ] Infiniband switch meets minimal version requirements, but downgrade is only available to 2.2.8-2 with the current package.
To downgrade to other versions:
– Manually download the InfiniBand switch firmware package to the patch directory
– Set export variable “EXADATA_IMAGE_IBSWITCH_DOWNGRADE_VERSION” to the appropriate version
– Run patchmgr command to initiate downgrade.
[SUCCESS ] Verify SSH access to the patchmgr host #5dbadm01.%.com from the InfiniBand Switch #5sw-iba01.
[INFO ] Starting pre-update validation on #5sw-iba01
[SUCCESS ] Verifying that /tmp has 120M in #5sw-iba01, found 496M
[SUCCESS ] Verifying that / has 80M in #5sw-iba01, found 181M
[SUCCESS ] Service opensmd is running on InfiniBand Switch #5sw-iba01
[SUCCESS ] NTP daemon is running on #5sw-iba01.
[SUCCESS ] opensm.conf passed all validations
[INFO ] Manually validate the following entries Date:(YYYY-MM-DD) 2018-11-11 Time:(HH:MM:SS) 07:40:46
[INFO ] Validating the current firmware on the InfiniBand Switch
[WARNING ] Firmware verification on InfiniBand switch #5sw-iba01 failed, possibly due to custom configuration changes. If the errors are result of customization to the configuration, or point to /etc/crontab, fwverify, xcp and libxcp files, then they can be ignored. Otherwise correct the issues and retry validation by running /usr/local/bin/fwverify -s.
[SUCCESS ] Verifying that the patchmgr host #5dbadm01.%.com is recognized on the InfiniBand Switch #5sw-iba01 through getHostByName
[SUCCESS ] Execute plugin check for Patch Check Prereq on #5sw-iba01
[INFO ] Finished pre-update validation on #5sw-iba01
[SUCCESS ] Pre-update validation on #5sw-iba01
[INFO ] Package will be downloaded at firmware update time via scp
[SUCCESS ] Disable Subnet Manager on #5sw-iba01
[SUCCESS ] Execute plugin check for Patching on #5sw-iba01
[INFO ] Starting upgrade on #5sw-iba01 to 2.2.7_2. Please give upto 15 mins for the process to complete. DO NOT INTERRUPT or HIT CTRL+C during the upgrade
[INFO ] Additional firmware load required. Starting secondary firmware load. DO NOT INTERRUPT or HIT CTRL+C
[INFO ] Rebooting #5sw-iba01 to complete the firmware update. Wait for 15 minutes before continuing. DO NOT MANUALLY REBOOT THE INFINIBAND SWITCH
[SUCCESS ] Load firmware 2.2.7_2 onto #5sw-iba01
[SUCCESS ] Disable Subnet Manager on #5sw-iba01
[SUCCESS ] Verify that /conf/configvalid is set to 1 on #5sw-iba01
[INFO ] Set SMPriority to 5 on #5sw-iba01
[INFO ] Rebooting #5sw-iba01. Wait for 4 minutes before continuing
[SUCCESS ] Reboot #5sw-iba01
[SUCCESS ] SUCCESS
[INFO ] Starting post-update validation on #5sw-iba01
[SUCCESS ] Service opensmd is running on InfiniBand Switch #5sw-iba01
[SUCCESS ] NTP daemon is running on #5sw-iba01.
[INFO ] Manually validate the following entries Date:(YYYY-MM-DD) 2018-11-11 Time:(HH:MM:SS) 08:02:54
[INFO ] /conf/configvalid is 1
[INFO ] Validating the current firmware on the InfiniBand Switch
[SUCCESS ] Firmware verification on InfiniBand switch #5sw-iba01
[SUCCESS ] Execute plugin check for Post Patch on #5sw-iba01
[INFO ] Finished post-update validation on #5sw-iba01
[SUCCESS ] Post-update validation on #5sw-iba01

[INFO ] ———- Starting with InfiniBand Switch #5sw-iba01
[WARNING ] Infiniband switch meets minimal version requirements, but downgrade is only available to 2.2.8-2 with the current package.
To downgrade to other versions:
– Manually download the InfiniBand switch firmware package to the patch directory
– Set export variable “EXADATA_IMAGE_IBSWITCH_DOWNGRADE_VERSION” to the appropriate version
– Run patchmgr command to initiate downgrade.
[SUCCESS ] Verify SSH access to the patchmgr host #5dbadm01.%.com from the InfiniBand Switch #5sw-iba01.
[INFO ] Starting pre-update validation on #5sw-iba01
[SUCCESS ] Verifying that /tmp has 120M in #5sw-iba01, found 492M
[SUCCESS ] Verifying that / has 20M in #5sw-iba01, found 28M
[SUCCESS ] Service opensmd is running on InfiniBand Switch #5sw-iba01
[SUCCESS ] NTP daemon is running on #5sw-iba01.
[INFO ] Manually validate the following entries Date:(YYYY-MM-DD) 2018-11-11 Time:(HH:MM:SS) 08:03:11
[INFO ] Validating the current firmware on the InfiniBand Switch
[SUCCESS ] Firmware verification on InfiniBand switch #5sw-iba01
[SUCCESS ] Verifying that the patchmgr host #5dbadm01.%.com is recognized on the InfiniBand Switch #5sw-iba01 through getHostByName
[SUCCESS ] Execute plugin check for Patch Check Prereq on #5sw-iba01
[INFO ] Finished pre-update validation on #5sw-iba01
[SUCCESS ] Pre-update validation on #5sw-iba01
[INFO ] Package will be downloaded at firmware update time via scp
[SUCCESS ] Disable Subnet Manager on #5sw-iba01
[SUCCESS ] Execute plugin check for Patching on #5sw-iba01
[INFO ] Starting upgrade on #5sw-iba01 to 2.2.9_3. Please give upto 15 mins for the process to complete. DO NOT INTERRUPT or HIT CTRL+C during the upgrade
[INFO ] Rebooting #5sw-iba01 to complete the firmware update. Wait for 15 minutes before continuing. DO NOT MANUALLY REBOOT THE INFINIBAND SWITCH
[SUCCESS ] Load firmware 2.2.9_3 onto #5sw-iba01
[SUCCESS ] Disable Subnet Manager on #5sw-iba01
[SUCCESS ] Verify that /conf/configvalid is set to 1 on #5sw-iba01
[INFO ] Set SMPriority to 5 on #5sw-iba01
[INFO ] Rebooting #5sw-iba01. Wait for 4 minutes before continuing
[SUCCESS ] Reboot #5sw-iba01
[SUCCESS ] SUCCESS
[INFO ] Starting post-update validation on #5sw-iba01
[SUCCESS ] Service opensmd is running on InfiniBand Switch #5sw-iba01
[SUCCESS ] NTP daemon is running on #5sw-iba01.
[INFO ] Manually validate the following entries Date:(YYYY-MM-DD) 2018-11-11 Time:(HH:MM:SS) 08:23:41
[INFO ] /conf/configvalid is 1
[INFO ] Validating the current firmware on the InfiniBand Switch
[SUCCESS ] Firmware verification on InfiniBand switch #5sw-iba01
[SUCCESS ] Execute plugin check for Post Patch on #5sw-iba01
[INFO ] Finished post-update validation on #5sw-iba01
[SUCCESS ] Post-update validation on #5sw-iba01
[SUCCESS ] Update InfiniBand switch #5sw-iba01 to 2.2.9_3
[INFO ] Upgrade to 2.2.9_3 requires that the InfiniBand switch be at 2.2.7-2. Upgrading #5sw-ibb01 first to 2.2.7-2

[INFO ] ———- Starting with InfiniBand Switch #5sw-ibb01
[WARNING ] Infiniband switch meets minimal version requirements, but downgrade is only available to 2.2.8-2 with the current package.
To downgrade to other versions:
– Manually download the InfiniBand switch firmware package to the patch directory
– Set export variable “EXADATA_IMAGE_IBSWITCH_DOWNGRADE_VERSION” to the appropriate version
– Run patchmgr command to initiate downgrade.
[SUCCESS ] Verify SSH access to the patchmgr host #5dbadm01.%.com from the InfiniBand Switch #5sw-ibb01.
[INFO ] Starting pre-update validation on #5sw-ibb01
[SUCCESS ] Verifying that /tmp has 120M in #5sw-ibb01, found 496M
[SUCCESS ] Verifying that / has 80M in #5sw-ibb01, found 183M
[SUCCESS ] Service opensmd is running on InfiniBand Switch #5sw-ibb01
[SUCCESS ] NTP daemon is running on #5sw-ibb01.
[SUCCESS ] opensm.conf passed all validations
[INFO ] Manually validate the following entries Date:(YYYY-MM-DD) 2018-11-11 Time:(HH:MM:SS) 08:24:15
[INFO ] Validating the current firmware on the InfiniBand Switch
[WARNING ] Firmware verification on InfiniBand switch #5sw-ibb01 failed, possibly due to custom configuration changes. If the errors are result of customization to the configuration, or point to /etc/crontab, fwverify, xcp and libxcp files, then they can be ignored. Otherwise correct the issues and retry validation by running /usr/local/bin/fwverify -s.
[SUCCESS ] Verifying that the patchmgr host #5dbadm01.%.com is recognized on the InfiniBand Switch #5sw-ibb01 through getHostByName
[SUCCESS ] Execute plugin check for Patch Check Prereq on #5sw-ibb01
[INFO ] Finished pre-update validation on #5sw-ibb01
[SUCCESS ] Pre-update validation on #5sw-ibb01
[INFO ] Package will be downloaded at firmware update time via scp
[SUCCESS ] Disable Subnet Manager on #5sw-ibb01
[SUCCESS ] Execute plugin check for Patching on #5sw-ibb01
[INFO ] Starting upgrade on #5sw-ibb01 to 2.2.7_2. Please give upto 15 mins for the process to complete. DO NOT INTERRUPT or HIT CTRL+C during the upgrade
[INFO ] Additional firmware load required. Starting secondary firmware load. DO NOT INTERRUPT or HIT CTRL+C
[INFO ] Rebooting #5sw-ibb01 to complete the firmware update. Wait for 15 minutes before continuing. DO NOT MANUALLY REBOOT THE INFINIBAND SWITCH
[SUCCESS ] Load firmware 2.2.7_2 onto #5sw-ibb01
[SUCCESS ] Disable Subnet Manager on #5sw-ibb01
[SUCCESS ] Verify that /conf/configvalid is set to 1 on #5sw-ibb01
[INFO ] Set SMPriority to 5 on #5sw-ibb01
[INFO ] Rebooting #5sw-ibb01. Wait for 4 minutes before continuing
[SUCCESS ] Reboot #5sw-ibb01
[SUCCESS ] SUCCESS
[INFO ] Starting post-update validation on #5sw-ibb01
[SUCCESS ] Service opensmd is running on InfiniBand Switch #5sw-ibb01
[SUCCESS ] NTP daemon is running on #5sw-ibb01.
[INFO ] Manually validate the following entries Date:(YYYY-MM-DD) 2018-11-11 Time:(HH:MM:SS) 08:46:24
[INFO ] /conf/configvalid is 1
[INFO ] Validating the current firmware on the InfiniBand Switch
[SUCCESS ] Firmware verification on InfiniBand switch #5sw-ibb01
[SUCCESS ] Execute plugin check for Post Patch on #5sw-ibb01
[INFO ] Finished post-update validation on #5sw-ibb01
[SUCCESS ] Post-update validation on #5sw-ibb01

[INFO ] ———- Starting with InfiniBand Switch #5sw-ibb01
[WARNING ] Infiniband switch meets minimal version requirements, but downgrade is only available to 2.2.8-2 with the current package.
To downgrade to other versions:
– Manually download the InfiniBand switch firmware package to the patch directory
– Set export variable “EXADATA_IMAGE_IBSWITCH_DOWNGRADE_VERSION” to the appropriate version
– Run patchmgr command to initiate downgrade.
[SUCCESS ] Verify SSH access to the patchmgr host #5dbadm01.%.com from the InfiniBand Switch #5sw-ibb01.
[INFO ] Starting pre-update validation on #5sw-ibb01
[SUCCESS ] Verifying that /tmp has 120M in #5sw-ibb01, found 492M
[SUCCESS ] Verifying that / has 20M in #5sw-ibb01, found 28M
[SUCCESS ] Service opensmd is running on InfiniBand Switch #5sw-ibb01
[SUCCESS ] NTP daemon is running on #5sw-ibb01.
[INFO ] Manually validate the following entries Date:(YYYY-MM-DD) 2018-11-11 Time:(HH:MM:SS) 08:46:40
[INFO ] Validating the current firmware on the InfiniBand Switch
[SUCCESS ] Firmware verification on InfiniBand switch #5sw-ibb01
[SUCCESS ] Verifying that the patchmgr host #5dbadm01.%.com is recognized on the InfiniBand Switch #5sw-ibb01 through getHostByName
[SUCCESS ] Execute plugin check for Patch Check Prereq on #5sw-ibb01
[INFO ] Finished pre-update validation on #5sw-ibb01
[SUCCESS ] Pre-update validation on #5sw-ibb01
[INFO ] Package will be downloaded at firmware update time via scp
[SUCCESS ] Disable Subnet Manager on #5sw-ibb01
[SUCCESS ] Execute plugin check for Patching on #5sw-ibb01
[INFO ] Starting upgrade on #5sw-ibb01 to 2.2.9_3. Please give upto 15 mins for the process to complete. DO NOT INTERRUPT or HIT CTRL+C during the upgrade
[INFO ] Rebooting #5sw-ibb01 to complete the firmware update. Wait for 15 minutes before continuing. DO NOT MANUALLY REBOOT THE INFINIBAND SWITCH
[SUCCESS ] Load firmware 2.2.9_3 onto #5sw-ibb01
[SUCCESS ] Disable Subnet Manager on #5sw-ibb01
[SUCCESS ] Verify that /conf/configvalid is set to 1 on #5sw-ibb01
[INFO ] Set SMPriority to 5 on #5sw-ibb01
[INFO ] Rebooting #5sw-ibb01. Wait for 4 minutes before continuing
[SUCCESS ] Reboot #5sw-ibb01
[SUCCESS ] SUCCESS
[INFO ] Starting post-update validation on #5sw-ibb01
[SUCCESS ] Service opensmd is running on InfiniBand Switch #5sw-ibb01
[SUCCESS ] NTP daemon is running on #5sw-ibb01.
[INFO ] Manually validate the following entries Date:(YYYY-MM-DD) 2018-11-11 Time:(HH:MM:SS) 09:07:06
[INFO ] /conf/configvalid is 1
[INFO ] Validating the current firmware on the InfiniBand Switch
[SUCCESS ] Firmware verification on InfiniBand switch #5sw-ibb01
[SUCCESS ] Execute plugin check for Post Patch on #5sw-ibb01
[INFO ] Finished post-update validation on #5sw-ibb01
[SUCCESS ] Post-update validation on #5sw-ibb01
[SUCCESS ] Update InfiniBand switch #5sw-ibb01 to 2.2.9_3
[INFO ] InfiniBand Switches ( #5sw-iba01 #5sw-ibb01 ) updated to 2.2.9_3
[SUCCESS ] Overall status

—– InfiniBand switch update process ended 2018-11-11 09:07:20 -0600 —–
2018-11-11 09:07:20 -0600 1 of 1 :SUCCESS: DONE: Upgrade InfiniBand switch(es) to 2.2.9-3.

Leave a Reply

Your email address will not be published. Required fields are marked *