Monday, August 6, 2018

Upgrading Grid Infrastructure and RDBMS from Oracle 12cR2 (12.2.0) to Oracle 18c in Oracle Exadata x7-2


I have covered major steps here.

Please refer for more details and pre-reqs 
https://mikedietrichde.com/2018/06/18/upgrade-oracle-12-2-0-1-to-oracle-database-18c-on-premises/

Patches to apply before upgrading Oracle GI and DB to 18c or downgrading to previous release (Doc ID 2414935.1)

1. If you have applied the below Jan 2018 PSU Patch on Oracle 12cR2 (12.2.0) it's good to go. It's includes the patch "27006180".
 a. p27100009_122010_Linux-x86-64.zip (GI patch)
 b. p27105253_122010_Linux-x86-64.zip (RDBMS patch)

[grid@rac1-12cr2 OPatch]$ ./opatch lsinventory | grep 27006180
     27068526, 27006180, 26755613, 26433979, 25698636, 25644425, 26664476

Note: If not applied above patches while upgrade we will get pre-reqs screen to apply the below patch
 a. p27006180_122010_Linux-x86-64.zip



After Jan 2018 PSU Patch Installation 




Node-1: rac1-12cr2
=====================
[root@rac1-12cr2 ~]# sh /u01/app/oraInventory/orainstRoot.sh
Changing permissions of /u01/app/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.

Changing groupname of /u01/app/oraInventory to oinstall.
The execution of the script is complete.
[root@rac1-12cr2 ~]#
[root@rac1-12cr2 ~]# exit

Node-2: rac2-12cr2
=====================
[root@rac2-12cr2 ~]# sh /u01/app/oraInventory/orainstRoot.sh
Changing permissions of /u01/app/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.

Changing groupname of /u01/app/oraInventory to oinstall.
The execution of the script is complete.
[root@rac2-12cr2 ~]#

Node-1: rac1-12cr2 (rootupgrade.sh)
=====================================
[root@rac1-12cr2 ~]# sh /u01/app/18.0.0/grid/rootupgrade.sh
Performing root user operation.

The following environment variables are set as:
    ORACLE_OWNER= grid
    ORACLE_HOME=  /u01/app/18.0.0/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]:
The contents of "dbhome" have not changed. No need to overwrite.
The file "oraenv" already exists in /usr/local/bin.  Overwrite it? (y/n)
[n]:
The file "coraenv" already exists in /usr/local/bin.  Overwrite it? (y/n)
[n]:

Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /u01/app/18.0.0/grid/crs/install/crsconfig_params
The log of current session can be found at:
  /u01/app/grid/crsdata/rac1-12cr2/crsconfig/rootcrs_rac1-12cr2_2018-08-06_10-30-08PM.log
2018/08/06 22:30:32 CLSRSC-595: Executing upgrade step 1 of 19: 'UpgradeTFA'.
2018/08/06 22:30:32 CLSRSC-4015: Performing install or upgrade action for Oracle Trace File Analyzer (TFA) Collector.
2018/08/06 22:32:14 CLSRSC-4003: Successfully patched Oracle Trace File Analyzer (TFA) Collector.
2018/08/06 22:32:14 CLSRSC-595: Executing upgrade step 2 of 19: 'ValidateEnv'.
2018/08/06 22:32:26 CLSRSC-595: Executing upgrade step 3 of 19: 'GetOldConfig'.
2018/08/06 22:32:26 CLSRSC-464: Starting retrieval of the cluster configuration data
2018/08/06 22:32:40 CLSRSC-692: Checking whether CRS entities are ready for upgrade. This operation may take a few minutes.
2018/08/06 22:34:19 CLSRSC-693: CRS entities validation completed successfully.
2018/08/06 22:34:26 CLSRSC-515: Starting OCR manual backup.
2018/08/06 22:34:38 CLSRSC-516: OCR manual backup successful.
2018/08/06 22:34:47 CLSRSC-486:
 At this stage of upgrade, the OCR has changed.
 Any attempt to downgrade the cluster after this point will require a complete cluster outage to restore the OCR.
2018/08/06 22:34:48 CLSRSC-541:
 To downgrade the cluster:
 1. All nodes that have been upgraded must be downgraded.
2018/08/06 22:34:48 CLSRSC-542:
 2. Before downgrading the last node, the Grid Infrastructure stack on all other cluster nodes must be down.
2018/08/06 22:34:48 CLSRSC-615:
 3. The last node to downgrade cannot be a Leaf node.
2018/08/06 22:34:59 CLSRSC-465: Retrieval of the cluster configuration data has successfully completed.
2018/08/06 22:34:59 CLSRSC-595: Executing upgrade step 4 of 19: 'GenSiteGUIDs'.
2018/08/06 22:35:02 CLSRSC-595: Executing upgrade step 5 of 19: 'UpgPrechecks'.
2018/08/06 22:35:08 CLSRSC-363: User ignored prerequisites during installation
2018/08/06 22:35:21 CLSRSC-595: Executing upgrade step 6 of 19: 'SaveParamFile'.
2018/08/06 22:35:35 CLSRSC-595: Executing upgrade step 7 of 19: 'SetupOSD'.
2018/08/06 22:35:35 CLSRSC-595: Executing upgrade step 8 of 19: 'PreUpgrade'.
2018/08/06 22:37:17 CLSRSC-468: Setting Oracle Clusterware and ASM to rolling migration mode
2018/08/06 22:37:17 CLSRSC-482: Running command: '/u01/app/12.2.0/grid/bin/crsctl start rollingupgrade 18.0.0.0.0'
CRS-1131: The cluster was successfully set to rolling upgrade mode.
2018/08/06 22:37:21 CLSRSC-482: Running command: '/u01/app/18.0.0/grid/bin/asmca -silent -upgradeNodeASM -nonRolling false -oldCRSHome /u01/app/12.2.0/grid 
-oldCRSVersion 12.2.0.1.0 -firstNode true -startRolling false '

ASM configuration upgraded in local node successfully.

2018/08/06 22:37:54 CLSRSC-469: Successfully set Oracle Clusterware and ASM to rolling migration mode
2018/08/06 22:38:02 CLSRSC-466: Starting shutdown of the current Oracle Grid Infrastructure stack
2018/08/06 22:38:56 CLSRSC-467: Shutdown of the current Oracle Grid Infrastructure stack has successfully completed.
2018/08/06 22:39:05 CLSRSC-595: Executing upgrade step 9 of 19: 'CheckCRSConfig'.
2018/08/06 22:39:06 CLSRSC-595: Executing upgrade step 10 of 19: 'UpgradeOLR'.
2018/08/06 22:39:25 CLSRSC-595: Executing upgrade step 11 of 19: 'ConfigCHMOS'.
2018/08/06 22:39:25 CLSRSC-595: Executing upgrade step 12 of 19: 'UpgradeAFD'.
2018/08/06 22:41:17 CLSRSC-595: Executing upgrade step 13 of 19: 'createOHASD'.
2018/08/06 22:41:34 CLSRSC-595: Executing upgrade step 14 of 19: 'ConfigOHASD'.
2018/08/06 22:41:34 CLSRSC-329: Replacing Clusterware entries in file 'oracle-ohasd.service'
2018/08/06 22:42:30 CLSRSC-595: Executing upgrade step 15 of 19: 'InstallACFS'.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1-12cr2'
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1-12cr2' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
2018/08/06 22:43:39 CLSRSC-595: Executing upgrade step 16 of 19: 'InstallKA'.
2018/08/06 22:43:57 CLSRSC-595: Executing upgrade step 17 of 19: 'UpgradeCluster'.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1-12cr2'
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1-12cr2' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Starting Oracle High Availability Services-managed resources
CRS-2672: Attempting to start 'ora.evmd' on 'rac1-12cr2'
CRS-2672: Attempting to start 'ora.mdnsd' on 'rac1-12cr2'
CRS-2676: Start of 'ora.evmd' on 'rac1-12cr2' succeeded
CRS-2676: Start of 'ora.mdnsd' on 'rac1-12cr2' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'rac1-12cr2'
CRS-2676: Start of 'ora.gpnpd' on 'rac1-12cr2' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'rac1-12cr2'
CRS-2676: Start of 'ora.gipcd' on 'rac1-12cr2' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac1-12cr2'
CRS-2676: Start of 'ora.cssdmonitor' on 'rac1-12cr2' succeeded
CRS-2672: Attempting to start 'ora.crf' on 'rac1-12cr2'
CRS-2672: Attempting to start 'ora.cssd' on 'rac1-12cr2'
CRS-2672: Attempting to start 'ora.diskmon' on 'rac1-12cr2'
CRS-2676: Start of 'ora.diskmon' on 'rac1-12cr2' succeeded
CRS-2676: Start of 'ora.crf' on 'rac1-12cr2' succeeded
CRS-2676: Start of 'ora.cssd' on 'rac1-12cr2' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'rac1-12cr2'
CRS-2672: Attempting to start 'ora.ctssd' on 'rac1-12cr2'
CRS-2676: Start of 'ora.ctssd' on 'rac1-12cr2' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'rac1-12cr2'
CRS-2676: Start of 'ora.crsd' on 'rac1-12cr2' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'rac1-12cr2' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'rac1-12cr2'
CRS-2676: Start of 'ora.asm' on 'rac1-12cr2' succeeded
CRS-6023: Starting Oracle Cluster Ready Services-managed resources
CRS-6017: Processing resource auto-start for servers: rac1-12cr2
CRS-2673: Attempting to stop 'ora.rac1-12cr2.vip' on 'rac2-12cr2'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'rac2-12cr2'
CRS-2672: Attempting to start 'ora.ons' on 'rac1-12cr2'
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'rac2-12cr2' succeeded
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'rac2-12cr2'
CRS-2677: Stop of 'ora.rac1-12cr2.vip' on 'rac2-12cr2' succeeded
CRS-2672: Attempting to start 'ora.rac1-12cr2.vip' on 'rac1-12cr2'
CRS-2677: Stop of 'ora.scan1.vip' on 'rac2-12cr2' succeeded
CRS-2672: Attempting to start 'ora.scan1.vip' on 'rac1-12cr2'
CRS-2676: Start of 'ora.scan1.vip' on 'rac1-12cr2' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN1.lsnr' on 'rac1-12cr2'
CRS-2676: Start of 'ora.ons' on 'rac1-12cr2' succeeded
CRS-2676: Start of 'ora.LISTENER_SCAN1.lsnr' on 'rac1-12cr2' succeeded
CRS-2676: Start of 'ora.rac1-12cr2.vip' on 'rac1-12cr2' succeeded
CRS-2672: Attempting to start 'ora.LISTENER.lsnr' on 'rac1-12cr2'
CRS-2676: Start of 'ora.LISTENER.lsnr' on 'rac1-12cr2' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'rac1-12cr2'
CRS-2676: Start of 'ora.asm' on 'rac1-12cr2' succeeded
CRS-2672: Attempting to start 'ora.DATA.dg' on 'rac1-12cr2'
CRS-2676: Start of 'ora.DATA.dg' on 'rac1-12cr2' succeeded
CRS-2672: Attempting to start 'ora.orcl.db' on 'rac1-12cr2'
CRS-2674: Start of 'ora.orcl.db' on 'rac1-12cr2' failed
CRS-2679: Attempting to clean 'ora.orcl.db' on 'rac1-12cr2'
CRS-2678: 'ora.orcl.db' on 'rac1-12cr2' has experienced an unrecoverable failure
CRS-0267: Human intervention required to resume its availability.
CRS-5802: Unable to start the agent process
CRS-6016: Resource auto-start has completed for server rac1-12cr2
CRS-6024: Completed start of Oracle Cluster Ready Services-managed resources
CRS-4123: Oracle High Availability Services has been started.
2018/08/06 22:57:33 CLSRSC-343: Successfully started Oracle Clusterware stack
clscfg: EXISTING configuration version 5 detected.
clscfg: version 5 is 12c Release 2.
Successfully taken the backup of node specific configuration in OCR.
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
2018/08/06 22:57:58 CLSRSC-595: Executing upgrade step 18 of 19: 'UpgradeNode'.
2018/08/06 22:58:04 CLSRSC-474: Initiating upgrade of resource types
2018/08/06 22:58:34 CLSRSC-475: Upgrade of resource types successfully initiated.
2018/08/06 22:58:53 CLSRSC-595: Executing upgrade step 19 of 19: 'PostUpgrade'.
2018/08/06 22:59:02 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded
[root@rac1-12cr2 ~]#

Node-2: rac2-12cr2 (rootupgrade.sh)
======================================

[root@rac2-12cr2 ~]# sh /u01/app/18.0.0/grid/rootupgrade.sh
Performing root user operation.

The following environment variables are set as:
    ORACLE_OWNER= grid
    ORACLE_HOME=  /u01/app/18.0.0/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]:
The contents of "dbhome" have not changed. No need to overwrite.
The file "oraenv" already exists in /usr/local/bin.  Overwrite it? (y/n)
[n]:
The file "coraenv" already exists in /usr/local/bin.  Overwrite it? (y/n)
[n]:

Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /u01/app/18.0.0/grid/crs/install/crsconfig_params
The log of current session can be found at:
  /u01/app/grid/crsdata/rac2-12cr2/crsconfig/rootcrs_rac2-12cr2_2018-08-06_11-01-13PM.log
2018/08/06 23:01:21 CLSRSC-595: Executing upgrade step 1 of 19: 'UpgradeTFA'.
2018/08/06 23:01:21 CLSRSC-4015: Performing install or upgrade action for Oracle Trace File Analyzer (TFA) Collector.
2018/08/06 23:03:02 CLSRSC-4003: Successfully patched Oracle Trace File Analyzer (TFA) Collector.
2018/08/06 23:03:02 CLSRSC-595: Executing upgrade step 2 of 19: 'ValidateEnv'.
2018/08/06 23:03:04 CLSRSC-595: Executing upgrade step 3 of 19: 'GetOldConfig'.
2018/08/06 23:03:05 CLSRSC-464: Starting retrieval of the cluster configuration data
2018/08/06 23:04:34 CLSRSC-465: Retrieval of the cluster configuration data has successfully completed.
2018/08/06 23:04:34 CLSRSC-595: Executing upgrade step 4 of 19: 'GenSiteGUIDs'.
2018/08/06 23:04:34 CLSRSC-595: Executing upgrade step 5 of 19: 'UpgPrechecks'.
2018/08/06 23:04:35 CLSRSC-363: User ignored prerequisites during installation
2018/08/06 23:04:37 CLSRSC-595: Executing upgrade step 6 of 19: 'SaveParamFile'.
2018/08/06 23:04:39 CLSRSC-595: Executing upgrade step 7 of 19: 'SetupOSD'.
2018/08/06 23:04:40 CLSRSC-595: Executing upgrade step 8 of 19: 'PreUpgrade'.

ASM configuration upgraded in local node successfully.

2018/08/06 23:05:11 CLSRSC-466: Starting shutdown of the current Oracle Grid Infrastructure stack
2018/08/06 23:06:10 CLSRSC-467: Shutdown of the current Oracle Grid Infrastructure stack has successfully completed.
2018/08/06 23:07:29 CLSRSC-595: Executing upgrade step 9 of 19: 'CheckCRSConfig'.
2018/08/06 23:07:30 CLSRSC-595: Executing upgrade step 10 of 19: 'UpgradeOLR'.
2018/08/06 23:07:34 CLSRSC-595: Executing upgrade step 11 of 19: 'ConfigCHMOS'.
2018/08/06 23:07:34 CLSRSC-595: Executing upgrade step 12 of 19: 'UpgradeAFD'.
2018/08/06 23:09:10 CLSRSC-595: Executing upgrade step 13 of 19: 'createOHASD'.
2018/08/06 23:09:11 CLSRSC-595: Executing upgrade step 14 of 19: 'ConfigOHASD'.
2018/08/06 23:09:11 CLSRSC-329: Replacing Clusterware entries in file 'oracle-ohasd.service'
2018/08/06 23:09:40 CLSRSC-595: Executing upgrade step 15 of 19: 'InstallACFS'.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac2-12cr2'
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac2-12cr2' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
2018/08/06 23:10:34 CLSRSC-595: Executing upgrade step 16 of 19: 'InstallKA'.
2018/08/06 23:10:35 CLSRSC-595: Executing upgrade step 17 of 19: 'UpgradeCluster'.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac2-12cr2'
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac2-12cr2' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Starting Oracle High Availability Services-managed resources
CRS-2672: Attempting to start 'ora.evmd' on 'rac2-12cr2'
CRS-2672: Attempting to start 'ora.mdnsd' on 'rac2-12cr2'
CRS-2676: Start of 'ora.mdnsd' on 'rac2-12cr2' succeeded
CRS-2676: Start of 'ora.evmd' on 'rac2-12cr2' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'rac2-12cr2'
CRS-2676: Start of 'ora.gpnpd' on 'rac2-12cr2' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'rac2-12cr2'
CRS-2676: Start of 'ora.gipcd' on 'rac2-12cr2' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac2-12cr2'
CRS-2676: Start of 'ora.cssdmonitor' on 'rac2-12cr2' succeeded
CRS-2672: Attempting to start 'ora.crf' on 'rac2-12cr2'
CRS-2672: Attempting to start 'ora.cssd' on 'rac2-12cr2'
CRS-2672: Attempting to start 'ora.diskmon' on 'rac2-12cr2'
CRS-2676: Start of 'ora.diskmon' on 'rac2-12cr2' succeeded
CRS-2676: Start of 'ora.crf' on 'rac2-12cr2' succeeded
CRS-2676: Start of 'ora.cssd' on 'rac2-12cr2' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'rac2-12cr2'
CRS-2672: Attempting to start 'ora.ctssd' on 'rac2-12cr2'
CRS-2676: Start of 'ora.ctssd' on 'rac2-12cr2' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'rac2-12cr2'
CRS-2676: Start of 'ora.crsd' on 'rac2-12cr2' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'rac2-12cr2' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'rac2-12cr2'
CRS-2676: Start of 'ora.asm' on 'rac2-12cr2' succeeded
CRS-6023: Starting Oracle Cluster Ready Services-managed resources
CRS-6017: Processing resource auto-start for servers: rac2-12cr2
CRS-2673: Attempting to stop 'ora.rac2-12cr2.vip' on 'rac1-12cr2'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'rac1-12cr2'
CRS-2672: Attempting to start 'ora.ons' on 'rac2-12cr2'
CRS-2677: Stop of 'ora.rac2-12cr2.vip' on 'rac1-12cr2' succeeded
CRS-2672: Attempting to start 'ora.rac2-12cr2.vip' on 'rac2-12cr2'
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'rac1-12cr2' succeeded
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'rac1-12cr2'
CRS-2677: Stop of 'ora.scan1.vip' on 'rac1-12cr2' succeeded
CRS-2672: Attempting to start 'ora.scan1.vip' on 'rac2-12cr2'
CRS-2676: Start of 'ora.scan1.vip' on 'rac2-12cr2' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN1.lsnr' on 'rac2-12cr2'
CRS-2676: Start of 'ora.ons' on 'rac2-12cr2' succeeded
CRS-2676: Start of 'ora.LISTENER_SCAN1.lsnr' on 'rac2-12cr2' succeeded
CRS-2676: Start of 'ora.rac2-12cr2.vip' on 'rac2-12cr2' succeeded
CRS-2672: Attempting to start 'ora.LISTENER.lsnr' on 'rac2-12cr2'
CRS-2676: Start of 'ora.LISTENER.lsnr' on 'rac2-12cr2' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'rac2-12cr2'
CRS-2676: Start of 'ora.asm' on 'rac2-12cr2' succeeded
CRS-2672: Attempting to start 'ora.DATA.dg' on 'rac2-12cr2'
CRS-2676: Start of 'ora.DATA.dg' on 'rac2-12cr2' succeeded
CRS-2672: Attempting to start 'ora.orcl.db' on 'rac1-12cr2'
CRS-2672: Attempting to start 'ora.orcl.db' on 'rac2-12cr2'
CRS-2674: Start of 'ora.orcl.db' on 'rac1-12cr2' failed
CRS-2679: Attempting to clean 'ora.orcl.db' on 'rac1-12cr2'
CRS-2674: Start of 'ora.orcl.db' on 'rac2-12cr2' failed
CRS-2679: Attempting to clean 'ora.orcl.db' on 'rac2-12cr2'
CRS-2678: 'ora.orcl.db' on 'rac1-12cr2' has experienced an unrecoverable failure
CRS-0267: Human intervention required to resume its availability.
CRS-2678: 'ora.orcl.db' on 'rac2-12cr2' has experienced an unrecoverable failure
CRS-0267: Human intervention required to resume its availability.
CRS-5802: Unable to start the agent process
===== Summary of resource auto-start failures follows =====
CRS-2807: Resource 'ora.orcl.db' failed to start automatically.
CRS-6016: Resource auto-start has completed for server rac2-12cr2
CRS-6024: Completed start of Oracle Cluster Ready Services-managed resources
CRS-4123: Oracle High Availability Services has been started.
2018/08/06 23:24:09 CLSRSC-343: Successfully started Oracle Clusterware stack
clscfg: EXISTING configuration version 5 detected.
clscfg: version 5 is 12c Release 2.
Successfully taken the backup of node specific configuration in OCR.
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
2018/08/06 23:25:43 CLSRSC-595: Executing upgrade step 18 of 19: 'UpgradeNode'.
Start upgrade invoked..
2018/08/06 23:25:52 CLSRSC-478: Setting Oracle Clusterware active version on the last node to be upgraded
2018/08/06 23:25:52 CLSRSC-482: Running command: '/u01/app/18.0.0/grid/bin/crsctl set crs activeversion'
Started to upgrade the active version of Oracle Clusterware. This operation may take a few minutes.
Started to upgrade CSS.
CSS was successfully upgraded.
Started to upgrade Oracle ASM.
Started to upgrade CRS.
CRS was successfully upgraded.
Successfully upgraded the active version of Oracle Clusterware.
Oracle Clusterware active version was successfully set to 18.0.0.0.0.
2018/08/06 23:26:59 CLSRSC-479: Successfully set Oracle Clusterware active version
2018/08/06 23:26:59 CLSRSC-476: Finishing upgrade of resource types
2018/08/06 23:27:00 CLSRSC-477: Successfully completed upgrade of resource types
2018/08/06 23:28:57 CLSRSC-595: Executing upgrade step 19 of 19: 'PostUpgrade'.
2018/08/06 23:29:21 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded
[root@rac2-12cr2 ~]#

Check the Version

[grid@rac1-12cr2 ~]$ crsctl query crs releaseversion
Oracle High Availability Services release version on the local node is [18.0.0.0.0]
[grid@rac1-12cr2 ~]$ crsctl query crs softwareversion
Oracle Clusterware version on node [rac1-12cr2] is [18.0.0.0.0]
[grid@rac1-12cr2 ~]$ crsctl query crs activeversion
Oracle Clusterware active version on the cluster is [18.0.0.0.0]
[grid@rac1-12cr2 ~]$

[grid@rac2-12cr2 ~]$ . oraenv
ORACLE_SID = [grid] ? +ASM2
ORACLE_HOME = [/home/oracle] ? /u01/app/18.0.0/grid
The Oracle base has been set to /u01/app/grid
[grid@rac2-12cr2 ~]$
[grid@rac2-12cr2 ~]$ crsctl query crs releaseversion
Oracle High Availability Services release version on the local node is [18.0.0.0.0]
[grid@rac2-12cr2 ~]$ crsctl query crs softwareversion
Oracle Clusterware version on node [rac2-12cr2] is [18.0.0.0.0]
[grid@rac2-12cr2 ~]$ crsctl query crs activeversion
Oracle Clusterware active version on the cluster is [18.0.0.0.0]
[grid@rac2-12cr2 ~]$


I will post RDBMS major steps for upgrade shortly ......



Sunday, August 5, 2018

To Extend ROOT directory with added disk in Oracle Linux 7.5 (xfs_growfs)


To Extend ROOT directory with added disk in Oracle Linux 7.5 (xfs_growfs)


[root@rac1-12cr2 ~]# fdisk -l

Disk /dev/sdh: 19.3 GB, 19327352832 bytes, 37748736 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes


Disk /dev/sdc: 10.7 GB, 10737418240 bytes, 20971520 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk label type: dos
Disk identifier: 0x843d33d1

   Device Boot      Start         End      Blocks   Id  System
/dev/sdc1            2048    20971519    10484736   83  Linux

Disk /dev/sdf: 21.5 GB, 21474836480 bytes, 41943040 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk label type: dos
Disk identifier: 0x459c80a0

   Device Boot      Start         End      Blocks   Id  System
/dev/sdf1            2048    41943039    20970496   83  Linux

Disk /dev/sdb: 10.7 GB, 10737418240 bytes, 20971520 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk label type: dos
Disk identifier: 0x28354c5a

   Device Boot      Start         End      Blocks   Id  System
/dev/sdb1            2048    20971519    10484736   83  Linux

Disk /dev/sde: 21.5 GB, 21474836480 bytes, 41943040 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk label type: dos
Disk identifier: 0xb12a1689

   Device Boot      Start         End      Blocks   Id  System
/dev/sde1            2048    41943039    20970496   83  Linux

Disk /dev/sdd: 21.5 GB, 21474836480 bytes, 41943040 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk label type: dos
Disk identifier: 0xc2ab2871

   Device Boot      Start         End      Blocks   Id  System
/dev/sdd1            2048    41943039    20970496   83  Linux

Disk /dev/sdg: 21.5 GB, 21474836480 bytes, 41943040 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk label type: dos
Disk identifier: 0x5d17435b

   Device Boot      Start         End      Blocks   Id  System
/dev/sdg1            2048    41943039    20970496   83  Linux

Disk /dev/sda: 107.4 GB, 107374182400 bytes, 209715200 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk label type: dos
Disk identifier: 0x000b547b

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *        2048     2099199     1048576   83  Linux
/dev/sda2         2099200   209715199   103808000   8e  Linux LVM

Disk /dev/mapper/ol-root: 53.7 GB, 53687091200 bytes, 104857600 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes


Disk /dev/mapper/ol-swap: 5301 MB, 5301600256 bytes, 10354688 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes


Disk /dev/mapper/ol-home: 47.3 GB, 47303360512 bytes, 92389376 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes

[root@rac1-12cr2 ~]# fdisk /dev/sdh
Welcome to fdisk (util-linux 2.23.2).

Changes will remain in memory only, until you decide to write them.
Be careful before using the write command.

Device does not contain a recognized partition table
Building a new DOS disklabel with disk identifier 0xe0dc5856.

Command (m for help): n
Partition type:
   p   primary (0 primary, 0 extended, 4 free)
   e   extended
Select (default p): p
Partition number (1-4, default 1): 1
First sector (2048-37748735, default 2048):
Using default value 2048
Last sector, +sectors or +size{K,M,G} (2048-37748735, default 37748735):
Using default value 37748735
Partition 1 of type Linux and of size 18 GiB is set

Command (m for help): w
The partition table has been altered!

Calling ioctl() to re-read partition table.
Syncing disks.

[root@rac1-12cr2 ~]# pvcreate /dev/sdh1
  Physical volume "/dev/sdh1" successfully created.

[root@rac1-12cr2 ~]# vgdisplay
  --- Volume group ---
  VG Name               ol
  System ID
  Format                lvm2
  Metadata Areas        1
  Metadata Sequence No  4
  VG Access             read/write
  VG Status             resizable
  MAX LV                0
  Cur LV                3
  Open LV               3
  Max PV                0
  Cur PV                1
  Act PV                1
  VG Size               <99.00 GiB
  PE Size               4.00 MiB
  Total PE              25343
  Alloc PE / Size       25342 / 98.99 GiB
  Free  PE / Size       1 / 4.00 MiB
  VG UUID               K1vOu8-ISS5-lq6T-FNCn-FzYP-gPgp-qeuFdL

[root@rac1-12cr2 ~]# vgextend ol /dev/sdh1
  Volume group "ol" successfully extended

[root@rac1-12cr2 ~]# vgdisplay
  --- Volume group ---
  VG Name               ol
  System ID
  Format                lvm2
  Metadata Areas        2
  Metadata Sequence No  5
  VG Access             read/write
  VG Status             resizable
  MAX LV                0
  Cur LV                3
  Open LV               3
  Max PV                0
  Cur PV                2
  Act PV                2
  VG Size               116.99 GiB
  PE Size               4.00 MiB
  Total PE              29950
  Alloc PE / Size       25342 / 98.99 GiB
  Free  PE / Size       4608 / 18.00 GiB
  VG UUID               K1vOu8-ISS5-lq6T-FNCn-FzYP-gPgp-qeuFdL

[root@rac1-12cr2 ~]# pvscan
  PV /dev/sda2   VG ol              lvm2 [<99.00 GiB / 4.00 MiB free]
  PV /dev/sdh1   VG ol              lvm2 [<18.00 GiB / <18.00 GiB free]
  Total: 2 [116.99 GiB] / in use: 2 [116.99 GiB] / in no VG: 0 [0   ]


[root@rac1-12cr2 ~]# lvextend /dev/ol/root /dev/sdh1
  Size of logical volume ol/root changed from 50.00 GiB (12800 extents) to <68.00 GiB (17407 extents).
  Logical volume ol/root successfully resized.

[root@rac1-12cr2 ~]# resize2fs /dev/ol/root
resize2fs 1.42.9 (28-Dec-2013)
resize2fs: Bad magic number in super-block while trying to open /dev/ol/root
Couldn't find valid filesystem superblock.

[root@rac1-12cr2 ~]# mount | grep ol-root
/dev/mapper/ol-root on / type xfs (rw,relatime,seclabel,attr2,inode64,noquota)

[root@rac1-12cr2 ~]# df -h
Filesystem           Size  Used Avail Use% Mounted on
devtmpfs             5.6G   24K  5.6G   1% /dev
tmpfs                5.7G  640M  5.0G  12% /dev/shm
tmpfs                5.7G  9.9M  5.6G   1% /run
tmpfs                5.7G     0  5.7G   0% /sys/fs/cgroup
/dev/mapper/ol-root   50G   23G   28G  45% /
/dev/sda1           1014M  217M  798M  22% /boot
/dev/mapper/ol-home   45G   42M   44G   1% /home
12.2                 448G  435G   13G  98% /media/sf_12.2
tmpfs                1.2G  4.0K  1.2G   1% /run/user/42
tmpfs                1.2G   28K  1.2G   1% /run/user/54321
/dev/sr0              56M   56M     0 100% /run/media/oracle/VBox_GAs_5.2.16
tmpfs                1.2G     0  1.2G   0% /run/user/0

[root@rac1-12cr2 ~]# xfs_growfs /dev/mapper/ol-root
meta-data=/dev/mapper/ol-root    isize=256    agcount=4, agsize=3276800 blks
         =                       sectsz=512   attr=2, projid32bit=1
         =                       crc=0        finobt=0 spinodes=0
data     =                       bsize=4096   blocks=13107200, imaxpct=25
         =                       sunit=0      swidth=0 blks
naming   =version 2              bsize=4096   ascii-ci=0 ftype=1
log      =internal               bsize=4096   blocks=6400, version=2
         =                       sectsz=512   sunit=0 blks, lazy-count=1
realtime =none                   extsz=4096   blocks=0, rtextents=0
data blocks changed from 13107200 to 17824768

[root@rac1-12cr2 ~]# df -h
Filesystem           Size  Used Avail Use% Mounted on
devtmpfs             5.6G   24K  5.6G   1% /dev
tmpfs                5.7G  640M  5.0G  12% /dev/shm
tmpfs                5.7G  9.9M  5.6G   1% /run
tmpfs                5.7G     0  5.7G   0% /sys/fs/cgroup
/dev/mapper/ol-root   68G   23G   46G  33% /
/dev/sda1           1014M  217M  798M  22% /boot
/dev/mapper/ol-home   45G   42M   44G   1% /home
12.2                 448G  435G   13G  98% /media/sf_12.2
tmpfs                1.2G  4.0K  1.2G   1% /run/user/42
tmpfs                1.2G   28K  1.2G   1% /run/user/54321
/dev/sr0              56M   56M     0 100% /run/media/oracle/VBox_GAs_5.2.16
tmpfs                1.2G     0  1.2G   0% /run/user/0
[root@rac1-12cr2 ~]#