Patch steps for cell storage nodes

If prerequisite steps areĀ  clear,you ‘re ready to run patch command.

nohup ./patchmgr -cells cell_group1 -patch -rolling &

It is going to patch for each cell in a row so there is no downtime require.But during cell patching if something happen like disk failure,you may loose some data.Oracle recommend rolling patching when you’ve high redundancy ASM disk group.

Each cell server patch takes 45m-1h. Servers go reboot many times.Always watch patching process from ILOM console.

 

[1551371102][2019-02-28 12:04:14 -0600][INFO][0-0][./patchmgr][patchmgr_print_format_message][222] SUCCESS: Wait for cell to reboot and come online.
[1551371102][2019-02-28 12:04:14 -0600][INFO][0-0][./patchmgr][patchmgr_print_format_message][222] Working: DO: Check the state of patch on cells. Up to 5 m
inutes ...
[1551371102][2019-02-28 12:05:56 -0600][INFO][0-0][./patchmgr][patchmgr_print_format_message][222] SUCCESS: Check the state of patch on cell.
[1551371102][2019-02-28 12:05:56 -0600][INFO][0-0][./patchmgr][patchmgr_print_format_message][222] Working: Execute plugin check for Pre Disk Activation ...
[1551371102][2019-02-28 12:06:12 -0600][INFO][0-0][./patchmgr][patchmgr_print_format_message][222] SUCCESS: Execute plugin check for Pre Disk Activation.
[1551371102][2019-02-28 12:06:12 -0600][INFO][0-0][./patchmgr][patchmgr_print_format_message][222] Working: DO: Activate grid disks... Up to 600 minutes .
..
[1551371102][2019-02-28 12:06:23 -0600][INFO][0-0][./patchmgr][patchmgr_print_format_message][222] Wait for checking and activating grid disks
[1551371102][2019-02-28 12:10:32 -0600][INFO][0-0][./patchmgr][patchmgr_print_format_message][222] SUCCESS: DONE: Activate grid disks.
[1551371102][2019-02-28 12:10:46 -0600][INFO][0-0][./patchmgr][patchmgr_print_format_message][222] Working: DO: Execute plugin check for Post Patch ...
[1551371102][2019-02-28 12:11:02 -0600][INFO][0-0][./patchmgr][patchmgr_print_format_message][222] SUCCESS: Execute plugin check for Post Patch.
[1551371102][2019-02-28 12:11:02 -0600][INFO][0-0][./patchmgr][patchmgr_print_format_message][222] Working: Execute plugin check for Patching ...
[1551371102][2019-02-28 12:11:18 -0600][INFO][0-0][./patchmgr][patchmgr_print_format_message][222] SUCCESS: Execute plugin check for Patching.
[1551371102][2019-02-28 12:11:18 -0600][INFO][0-0][./patchmgr][patchmgr_print_format_message][222] Working: Cell will reboot. Up to 5 minutes ...
[1551371102][2019-02-28 12:11:47 -0600][INFO][0-0][./patchmgr][patchmgr_print_format_message][2
22] SUCCESS: Finalize patch on cell.

Check version and patch status each time whenever server come up

[root@###2cel01 ~]# imageinfo

Kernel version: 4.1.12-124.23.4.el7uek.x86_64 #2 SMP Sun Dec 23 20:59:33 PST 2018 x86_64
Cell version: OSS_19.1.2.0.0_LINUX.X64_190111
Cell rpm version: cell-19.1.2.0.0_LINUX.X64_190111-1.x86_64

Active image version: 19.1.2.0.0.190111
Active image kernel version: 4.1.12-124.23.4.el7uek
Active image activated: 2019-02-28 11:16:36 -0600
Active image status: success
Active system partition on device: /dev/md5
Active software partition on device: /dev/md7

Cell boot usb partition: /dev/sdm1
Cell boot usb version: 19.1.2.0.0.190111

Inactive image version: 18.1.5.0.0.180506
Inactive image activated: 2018-08-30 17:28:31 -0500
Inactive image status: success
Inactive system partition on device: /dev/md6
Inactive software partition on device: /dev/md8

Inactive marker for the rollback: /boot/I_am_hd_boot.inactive
Inactive grub config for the rollback: /boot/grub2/grub.cfg.inactive
Inactive usb grub config for the rollback: /boot/grub2/grub.cfg.usb.inactive
Inactive kernel version for the rollback: 4.1.12-94.8.4.el6uek.x86_64
Rollback to the inactive partitions: Possible

[root@###2cel01 ~]# imagehistory
Version : 11.2.3.1.1.120607
Image activation date : 2012-08-13 00:09:39 -0700
Imaging mode : fresh
Imaging status : success

Version : 11.2.3.2.1.130109
Image activation date : 2013-12-15 18:17:37 -0600
Imaging mode : out of partition upgrade
Imaging status : success

Version : 11.2.3.3.1.140708
Image activation date : 2014-08-14 14:52:21 -0500
Imaging mode : out of partition upgrade
Imaging status : success

Version : 12.1.2.1.1.150316.2
Image activation date : 2015-06-26 21:48:20 -0500
Imaging mode : out of partition upgrade
Imaging status : success

Version : 12.1.2.3.1.160718
Image activation date : 2016-08-20 11:50:37 -0500
Imaging mode : out of partition upgrade
Imaging status : success

Version : 18.1.5.0.0.180506
Image activation date : 2018-08-30 17:28:31 -0500
Imaging mode : out of partition upgrade
Imaging status : success

Version : 19.1.2.0.0.190111
Image activation date : 2019-02-28 11:16:36 -0600
Imaging mode : out of partition upgrade
Imaging status : success

Whenever one cell server patched successfully,patchmgr wait to complete griddisks (asm disks) synchronized.All griddisks must be ACTIVE and ONLINE before starting new cell server.Just be patient,if your database has very high load,it may take some time to be synchronized.

Run this command,while waiting synchronize process complete.

cellcli>list griddisk attributes name,status,asmmodestatus,asmdeactivationoutcome

 

Leave a Reply

Your email address will not be published. Required fields are marked *