Saturday, July 25, 2020

Oracle 12c (12.1.0.2) on Oracle Linux 8.2 and Oracle GI 19c (19.6.0) - - > 3 Node RAC


Oracle 12c (12.1.0.2) on Oracle Linux 8.2 and Oracle GI 19c (19.6.0) - - > 3 Node RAC

Overall Steps:

1. Installed Oracle Enterprise Linux 8.2
2. Installed GRID Infrastructure Oracle 19c (19.3.0).
3. While installation GI, applied Oracle 19c (19.6.0) RU
   ./gridSetup.sh -applyPSU /home/oracle/30501910/
4. Installed RDBMS Oracle 12c (12.1.0.2.0).
5. Applied patch "p21626377_121020_Linux-x86-64.zip"
   (BUG 21626377 - 12.2_150812: DBCA FAILS TO CREATE 12102 DB OVER 12.2 GI/ASM). 
6. Created and Configured Oracle 12c (12.1.0.2) on Oracle Linux 8.2 & Oracle GI 19c (19.6.0) RU

Required Softwares:

1. Oracle Linux 8.2
2. Oracle 19c GRID (19.3.0) binaries
   LINUX.X64_193000_grid_home.zip
3. Oracle 19c GRID (19.6.0) Release Update RU)
   p30501910_190000_Linux-x86-64.zip
4. Oracle 12c RDBMS (12.1.0.2) binaries
5. Latest OPatch   
   p6880880_190000_Linux-x86-64.zip
6. Patch for Oracle 12c RDBMS (12.1.0.2) for GI 12.2 or Above
   p21626377_121020_Linux-x86-64.zip

Step-1: Apply latest OPatch

[oracle@19c-rac1 ~]$ unzip p6880880_190000_Linux-x86-64.zip -d /u01/app/19.3.0/grid/
Archive:  p6880880_190000_Linux-x86-64.zip
replace /u01/app/19.3.0/grid/OPatch/emdpatch.pl? [y]es, [n]o, [A]ll, [N]one, [r]ename: A
  inflating: /u01/app/19.3.0/grid/OPatch/emdpatch.pl
  inflating: /u01/app/19.3.0/grid/OPatch/oracle_common/modules/com.oracle.glcm.common-logging_1.6.5.0.jar

Step-2: Unzip the softwares - Oracle 19c GI (19.6.0) and Oracle 19c GI (19.6.0) RU 

[oracle@19c-rac1 ~]$ unzip p30501910_190000_Linux-x86-64.zip
Archive:  p30501910_190000_Linux-x86-64.zip
   creating: 30501910/
   creating: 30501910/30557433/
  inflating: 30501910/30557433/README.txt
   creating: 30501910/30557433/files/
   creating: 30501910/30557433/files/network/

Step-3: Install 19c GI with 19c (19.6.0) RU

[oracle@19c-rac1 grid]$ cd /u01/app/19.3.0/grid/
[oracle@19c-rac1 grid]$ ./gridSetup.sh -applyPSU /home/oracle/30501910/
Preparing the home to patch...
Applying the patch /home/oracle/30501910/...
Successfully applied the patch.
The log can be found at: /tmp/GridSetupActions2020-07-25_02-43-53PM/installerPatchActions_2020-07-25_02-43-53PM.log











Step-4: Execute scripts as a 'root' user

[root@19c-rac1 ~]# /u01/app/oraInventory/orainstRoot.sh
Changing permissions of /u01/app/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.

Changing groupname of /u01/app/oraInventory to oinstall.
The execution of the script is complete.

[root@19c-rac2 ~]# /u01/app/oraInventory/orainstRoot.sh
Changing permissions of /u01/app/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.

Changing groupname of /u01/app/oraInventory to oinstall.
The execution of the script is complete.
[root@19c-rac2 ~]#

[root@19c-rac3 ~]# /u01/app/oraInventory/orainstRoot.sh
Changing permissions of /u01/app/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.

Changing groupname of /u01/app/oraInventory to oinstall.
The execution of the script is complete.
[root@19c-rac3 ~]#

[root@19c-rac1 ~]# /u01/app/19.3.0/grid/root.sh
Performing root user operation.

The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME=  /u01/app/19.3.0/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]:
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...


Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /u01/app/19.3.0/grid/crs/install/crsconfig_params
The log of current session can be found at:
  /u01/app/oracle/crsdata/19c-rac1/crsconfig/rootcrs_19c-rac1_2020-07-25_07-12-38PM.log
2020/07/25 19:12:49 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.
2020/07/25 19:12:49 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.
2020/07/25 19:12:49 CLSRSC-363: User ignored prerequisites during installation
2020/07/25 19:12:49 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.
2020/07/25 19:12:51 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.
2020/07/25 19:12:53 CLSRSC-594: Executing installation step 5 of 19: 'SetupOSD'.
2020/07/25 19:12:53 CLSRSC-594: Executing installation step 6 of 19: 'CheckCRSConfig'.
2020/07/25 19:12:53 CLSRSC-594: Executing installation step 7 of 19: 'SetupLocalGPNP'.
2020/07/25 19:13:24 CLSRSC-594: Executing installation step 8 of 19: 'CreateRootCert'.
2020/07/25 19:13:27 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2020/07/25 19:13:31 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.
2020/07/25 19:13:48 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.
2020/07/25 19:13:48 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.
2020/07/25 19:13:53 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.
2020/07/25 19:13:54 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2020/07/25 19:14:18 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.
2020/07/25 19:14:23 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.
2020/07/25 19:14:36 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.
2020/07/25 19:14:41 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.
Redirecting to /bin/systemctl restart rsyslog.service

ASM has been created and started successfully.

[DBT-30001] Disk groups created successfully. Check /u01/app/oracle/cfgtoollogs/asmca/asmca-200725PM071514.log for details.

2020/07/25 19:16:30 CLSRSC-482: Running command: '/u01/app/19.3.0/grid/bin/ocrconfig -upgrade oracle oinstall'
CRS-4256: Updating the profile
Successful addition of voting disk ebeea6dcabca4f1ebfd5c96606a31426.
Successfully replaced voting disk group with +OCRVD.
CRS-4256: Updating the profile
CRS-4266: Voting file(s) successfully replaced
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   ebeea6dcabca4f1ebfd5c96606a31426 (/dev/sdj1) [OCRVD]
Located 1 voting disk(s).
2020/07/25 19:17:59 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'.
2020/07/25 19:19:19 CLSRSC-343: Successfully started Oracle Clusterware stack
2020/07/25 19:19:20 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.
2020/07/25 19:20:58 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.
2020/07/25 19:21:22 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded
[root@19c-rac1 ~]#


[root@19c-rac2 ~]# /u01/app/19.3.0/grid/root.sh
Performing root user operation.

The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME=  /u01/app/19.3.0/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]:
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...


Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /u01/app/19.3.0/grid/crs/install/crsconfig_params
The log of current session can be found at:
  /u01/app/oracle/crsdata/19c-rac2/crsconfig/rootcrs_19c-rac2_2020-07-25_07-22-01PM.log
2020/07/25 19:22:08 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.
2020/07/25 19:22:08 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.
2020/07/25 19:22:09 CLSRSC-363: User ignored prerequisites during installation
2020/07/25 19:22:09 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.
2020/07/25 19:22:10 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.
2020/07/25 19:22:10 CLSRSC-594: Executing installation step 5 of 19: 'SetupOSD'.
2020/07/25 19:22:10 CLSRSC-594: Executing installation step 6 of 19: 'CheckCRSConfig'.
2020/07/25 19:22:11 CLSRSC-594: Executing installation step 7 of 19: 'SetupLocalGPNP'.
2020/07/25 19:22:13 CLSRSC-594: Executing installation step 8 of 19: 'CreateRootCert'.
2020/07/25 19:22:13 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.
2020/07/25 19:22:31 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.
2020/07/25 19:22:31 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.
2020/07/25 19:22:33 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.
2020/07/25 19:22:34 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2020/07/25 19:22:37 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2020/07/25 19:22:54 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.
2020/07/25 19:22:56 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.
2020/07/25 19:22:57 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.
2020/07/25 19:22:59 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.
Redirecting to /bin/systemctl restart rsyslog.service
2020/07/25 19:23:07 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'.
2020/07/25 19:24:01 CLSRSC-343: Successfully started Oracle Clusterware stack
2020/07/25 19:24:02 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.
2020/07/25 19:24:16 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.
2020/07/25 19:24:23 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded
[root@19c-rac2 ~]#

[root@19c-rac3 ~]# /u01/app/19.3.0/grid/root.sh
Performing root user operation.

The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME=  /u01/app/19.3.0/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]:
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...


Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /u01/app/19.3.0/grid/crs/install/crsconfig_params
The log of current session can be found at:
  /u01/app/oracle/crsdata/19c-rac3/crsconfig/rootcrs_19c-rac3_2020-07-25_07-25-01PM.log
2020/07/25 19:25:08 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.
2020/07/25 19:25:09 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.
2020/07/25 19:25:09 CLSRSC-363: User ignored prerequisites during installation
2020/07/25 19:25:09 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.
2020/07/25 19:25:10 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.
2020/07/25 19:25:10 CLSRSC-594: Executing installation step 5 of 19: 'SetupOSD'.
2020/07/25 19:25:10 CLSRSC-594: Executing installation step 6 of 19: 'CheckCRSConfig'.
2020/07/25 19:25:11 CLSRSC-594: Executing installation step 7 of 19: 'SetupLocalGPNP'.
2020/07/25 19:25:13 CLSRSC-594: Executing installation step 8 of 19: 'CreateRootCert'.
2020/07/25 19:25:13 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.
2020/07/25 19:25:33 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.
2020/07/25 19:25:33 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.
2020/07/25 19:25:36 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.
2020/07/25 19:25:36 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2020/07/25 19:25:39 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2020/07/25 19:25:57 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.
2020/07/25 19:25:59 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.
2020/07/25 19:26:00 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.
2020/07/25 19:26:01 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.
Redirecting to /bin/systemctl restart rsyslog.service
2020/07/25 19:26:11 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'.
2020/07/25 19:27:05 CLSRSC-343: Successfully started Oracle Clusterware stack
2020/07/25 19:27:06 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.
2020/07/25 19:27:22 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.
2020/07/25 19:27:29 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded
[root@19c-rac3 ~]#

Step-5: Installed of Oracle 12c (12.1.0.2) binaries

Step-6: Check the compatible of RDBMS on ASM Instance


[oracle@19c-rac1 ~]$ sqlplus / as sysasm

SQL*Plus: Release 19.0.0.0.0 - Production on Sat Jul 25 22:08:28 2020
Version 19.6.0.0.0
Copyright (c) 1982, 2019, Oracle.  All rights reserved.
Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.6.0.0.0

SQL> set lines 180 pages 200
SQL> col name format a10
SQL> col COMPATIBILITY format a10
SQL> col DATABASE_COMPATIBILITY format a10
SQL> select NAME,STATE,COMPATIBILITY,DATABASE_COMPATIBILITY from v$asm_diskgroup;

NAME       STATE       COMPATIBIL DATABASE_C
---------- ----------- ---------- ----------
DATADG     MOUNTED     19.0.0.0.0 12.1.0.2.0
OCRVD      MOUNTED     19.0.0.0.0 10.1.0.0.0
RECODG     MOUNTED     19.0.0.0.0 12.1.0.2.0
SQL>

SQL> alter diskgroup OCRVD set attribute 'compatible.rdbms'='12.1.0.2.0';
Diskgroup altered.

SQL> select NAME,STATE,COMPATIBILITY,DATABASE_COMPATIBILITY from v$asm_diskgroup;

NAME       STATE       COMPATIBIL DATABASE_C
---------- ----------- ---------- ----------
DATADG     MOUNTED     19.0.0.0.0 12.1.0.2.0
OCRVD      MOUNTED     19.0.0.0.0 12.1.0.2.0
RECODG     MOUNTED     19.0.0.0.0 12.1.0.2.0
SQL>

Step-7: Got the following error while creation of Oracle 12c (12.1.0.2) Database:


Please refer for more details:
"Recovery Manager Failed to Restore Datafiles" - Using DBCA To Create Database 12.1.0.2.0 
 on Grid Infrastructure / ASM 12.2.0.1.0 (Doc ID 2260473.1)



Step-8: Applied patch on cluster nodes

[oracle@19c-rac1 OPatch]$ export ORACLE_HOME=/u01/app/oracle/product/12.1.0.2/db_1
[oracle@19c-rac1 OPatch]$ ./opatch apply -local /home/oracle/21626377/
Oracle Interim Patch Installer version 12.1.0.1.3
Copyright (c) 2020, Oracle Corporation.  All rights reserved.

Oracle Home       : /u01/app/oracle/product/12.1.0.2/db_1
Central Inventory : /u01/app/oraInventory
   from           : /u01/app/oracle/product/12.1.0.2/db_1/oraInst.loc
OPatch version    : 12.1.0.1.3
OUI version       : 12.1.0.2.0
Log file location : /u01/app/oracle/product/12.1.0.2/db_1/cfgtoollogs/opatch/opatch2020-07-25_23-34-11PM_1.log

Applying interim patch '21626377' to OH '/u01/app/oracle/product/12.1.0.2/db_1'
Verifying environment and performing prerequisite checks...
All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/u01/app/oracle/product/12.1.0.2/db_1')

Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...

Patching component oracle.rdbms, 12.1.0.2.0...

Verifying the update...
Patch 21626377 successfully applied
Log file location: /u01/app/oracle/product/12.1.0.2/db_1/cfgtoollogs/opatch/opatch2020-07-25_23-34-11PM_1.log

OPatch succeeded.
[oracle@19c-rac1 OPatch]$

Step-9: Check the status of ASM and RDBMS instances and version of Oracle Linux


[oracle@19c-rac1 ~]$ cat /etc/os-release | grep Linux | grep 8.2
PRETTY_NAME="Oracle Linux Server 8.2"
[oracle@19c-rac1 ~]$

[oracle@19c-rac1 ~]$ sqlplus sys@db12c as sysdba

SQL*Plus: Release 12.1.0.2.0 Production on Sat Jul 25 23:58:15 2020
Copyright (c) 1982, 2014, Oracle.  All rights reserved.
Enter password:
Connected to:
Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Advanced Analytics and Real Application Testing options

SQL> select instance_name,instance_number from gv$instance;

INSTANCE_NAME    INSTANCE_NUMBER
---------------- ---------------
db12c3                         3
db12c2                         2
db12c1                         1

SQL> show pdbs

    CON_ID CON_NAME                       OPEN MODE  RESTRICTED
---------- ------------------------------ ---------- ----------
         2 PDB$SEED                       READ ONLY  NO
         3 PDB1                           READ WRITE NO
         4 PDB2                           READ WRITE NO
SQL> exit
Disconnected from Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Advanced Analytics and Real Application Testing options
[oracle@19c-rac1 ~]$

[oracle@19c-rac1 ~]$ grid_env
[oracle@19c-rac1 ~]$ sqlplus / as sysasm

SQL*Plus: Release 19.0.0.0.0 - Production on Sat Jul 25 23:58:50 2020
Version 19.6.0.0.0
Copyright (c) 1982, 2019, Oracle.  All rights reserved.
Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.6.0.0.0

SQL> select instance_name,instance_number from gv$instance;

INSTANCE_NAME    INSTANCE_NUMBER
---------------- ---------------
+ASM1                          1
+ASM3                          3
+ASM2                          2
SQL>

Hope it helps......

Sunday, July 19, 2020

Database In-Memory Base Level Feature Now Available in Oracle 19c (19.8.0.0.0) Release Update (RU)


Database In-Memory Base Level Feature Now Available in Oracle 19c (19.8.0.0.0) RU



The Database In-Memory Base Level feature is now available for Oracle Database 19c! Support 
for the Base Level feature was added to 19c in the just released 19.8 RU. 
As a brief review, with the Base Level feature you can use up to a 16GB column store 
without having to license the Database In-Memory option. 

This now gives anyone running Oracle Database 19c Enterprise Edition the ability to try 
out Database In-Memory for in-production workloads, without having to license the 
full Database In-Memory option first.

Simply apply the 19.8 RU and set the INMEMORY_FORCE initialization parameter to BASE_LEVEL and 
set the INMEMORY_SIZE parameter to a value up to 16GB. When you restart your database, 
the Base Level feature will then be enabled. 
That's really all there is to it. 

Oracle Database In-Memory will now have a "Base Level" feature. 
This will allow the use of Database In-Memory with up to a 16GB column store for no extra cost. 
That's not a typo. Database In-Memory will be free to use with up to a 16GB column store!

Note: Apply July 2020 RU to get Oracle 19c (19.8.0.0.0)

Required Softwares:
-------------------

Latest OPatch:                       p6880880_190000_Linux-x86-64.zip
GI Release Update (July 2020):       p31305339_190000_Linux-x86-64.zip
Database Release Update (July 2020): p31281355_190000_Linux-x86-64.zip

Step-1: Check the cluster instances
------------------------------------
[oracle@rac1-oel72 ~]$ ps -ef | grep pmon
oracle    6818     1  0 20:35 ?        00:00:00 asm_pmon_+ASM1
oracle   13729     1  0 20:38 ?        00:00:00 ora_pmon_orcl1
oracle   21836 12071  0 20:46 pts/0    00:00:00 grep --color=auto pmon
[oracle@rac1-oel72 ~]$

[oracle@rac2-oel72 ~]$ ps -ef | grep pmon
oracle    2127     1  0 20:43 ?        00:00:00 asm_pmon_+ASM2
oracle    2692     1  0 20:44 ?        00:00:00 ora_pmon_orcl2
oracle    3033     1  0 20:45 ?        00:00:00 mdb_pmon_-MGMTDB
oracle    3455 20208  0 20:46 pts/0    00:00:00 grep --color=auto pmon
[oracle@rac2-oel72 ~]$

[oracle@rac1-oel72 ~]$ srvctl status database -d orcl
Instance orcl1 is running on node rac1-oel72
Instance orcl2 is running on node rac2-oel72
[oracle@rac1-oel72 ~]$

Step-2: Check the patches 
--------------------------
[oracle@rac1-oel72 ~]$ . oraenv
ORACLE_SID = [orcl1] ? orcl
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@rac1-oel72 ~]$
[oracle@rac1-oel72 ~]$ sh /u01/app/oracle/product/19.3.0/dbhome_1/OPatch/opatch lspatches
31281355;Database Release Update : 19.8.0.0.200714 (31281355)
29585399;OCW RELEASE UPDATE 19.3.0.0.0 (29585399)
OPatch succeeded.
[oracle@rac1-oel72 ~]$

[oracle@rac1-oel72 ~]$ ssh rac2-oel72
Last login: Sun Jul 19 21:08:10 2020
[oracle@rac2-oel72 ~]$
[oracle@rac2-oel72 ~]$ . oraenv
ORACLE_SID = [orcl2] ? orcl
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@rac2-oel72 ~]$

[oracle@rac2-oel72 ~]$ sh /u01/app/oracle/product/19.3.0/dbhome_1/OPatch/opatch lspatches
31281355;Database Release Update : 19.8.0.0.200714 (31281355)
29585399;OCW RELEASE UPDATE 19.3.0.0.0 (29585399)
OPatch succeeded.
[oracle@rac2-oel72 ~]$

Step-3: Increase the SGA ans restart the cluster instances  
----------------------------------------------------------
[oracle@rac1-oel72 ~]$ . oraenv
ORACLE_SID = [orcl] ? orcl
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@rac1-oel72 ~]$

[oracle@rac1-oel72 ~]$ sqlplus sys/oracle@orcl as sysdba

SQL*Plus: Release 19.0.0.0.0 - Production on Sun Jul 19 20:14:00 2020
Version 19.8.0.0.0
Copyright (c) 1982, 2020, Oracle.  All rights reserved.
Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.8.0.0.0

SQL> show parameter sga_

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
sga_max_size                         big integer 5952M
sga_min_size                         big integer 0
sga_target                           big integer 5952M
unified_audit_sga_queue_size         integer     1048576
SQL>

SQL> show parameter inmemory

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
inmemory_adg_enabled                 boolean     TRUE
inmemory_automatic_level             string      OFF
inmemory_clause_default              string
inmemory_expressions_usage           string      ENABLE
inmemory_force                       string      DEFAULT
inmemory_max_populate_servers        integer     0
inmemory_optimized_arithmetic        string      DISABLE
inmemory_prefer_xmem_memcompress     string
inmemory_prefer_xmem_priority        string
inmemory_query                       string      ENABLE
inmemory_size                        big integer 0
inmemory_trickle_repopulate_servers_ integer     1
percent
inmemory_virtual_columns             string      MANUAL
inmemory_xmem_size                   big integer 0
optimizer_inmemory_aware             boolean     TRUE
SQL>

SQL> select instance_name from v$instance;

INSTANCE_NAME
----------------
orcl1

SQL> create pfile='/home/oracle/initorcl_07192020.ora' from spfile;
File created.

SQL> alter system set sga_target=20480M scope=spfile;
System altered.

SQL> alter system set sga_max_size=20480M scope=spfile;
System altered.

SQL> exit
Disconnected from Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.8.0.0.0
[oracle@rac1-oel72 ~]$

[oracle@rac1-oel72 ~]$ srvctl status database -d orcl
Instance orcl1 is running on node rac1-oel72
Instance orcl2 is running on node rac2-oel72
[oracle@rac1-oel72 ~]$

[oracle@rac1-oel72 ~]$ srvctl stop database -d orcl

[oracle@rac1-oel72 ~]$ srvctl start database -d orcl
PRCR-1079 : Failed to start resource ora.orcl.db
CRS-5017: The resource action "ora.orcl.db start" encountered the following error:
ORA-27104: system-defined limits for shared memory was misconfigured
. For details refer to "(:CLSN00107:)" in "/u01/app/oracle/diag/crs/rac2-oel72/crs/trace/crsd_oraagent_oracle.trc".

CRS-2674: Start of 'ora.orcl.db' on 'rac2-oel72' failed
CRS-2632: There are no more servers to try to place resource 'ora.orcl.db' on that would satisfy its placement policy
CRS-5017: The resource action "ora.orcl.db start" encountered the following error:
ORA-27104: system-defined limits for shared memory was misconfigured
. For details refer to "(:CLSN00107:)" in "/u01/app/oracle/diag/crs/rac1-oel72/crs/trace/crsd_oraagent_oracle.trc".

CRS-2674: Start of 'ora.orcl.db' on 'rac1-oel72' failed

[oracle@rac1-oel72 ~]$ cat /etc/sysctl.conf | grep kernel | grep shm | grep -v "#"
kernel.shmmni = 4096
kernel.shmall = 1073741824
kernel.shmmax = 4398046511104
[oracle@rac1-oel72 ~]$


Note: Set the 'Kernel' parameters and SGA values according to the InMemory settings

Step-4: Change the values 'inmemory_force' and 'inmemory_size'
-------------------------------------------------------------

[oracle@rac1-oel72 ~]$ srvctl status database -d orcl
Instance orcl1 is running on node rac1-oel72
Instance orcl2 is running on node rac2-oel72
[oracle@rac1-oel72 ~]$

[oracle@rac1-oel72 ~]$ . oraenv
ORACLE_SID = [orcl1] ? orcl1
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@rac1-oel72 ~]$

[oracle@rac1-oel72 ~]$ sqlplus sys@orcl as sysdba

SQL*Plus: Release 19.0.0.0.0 - Production on Sun Jul 19 20:49:13 2020
Version 19.8.0.0.0
Copyright (c) 1982, 2020, Oracle.  All rights reserved.
Enter password:
Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.8.0.0.0

SQL> show parameter sga_

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
sga_max_size                         big integer 20G
sga_min_size                         big integer 0
sga_target                           big integer 20G
unified_audit_sga_queue_size         integer     1048576
SQL>

SQL> show parameter inmemory

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
inmemory_adg_enabled                 boolean     TRUE
inmemory_automatic_level             string      OFF
inmemory_clause_default              string
inmemory_expressions_usage           string      ENABLE
inmemory_force                       string      DEFAULT
inmemory_max_populate_servers        integer     0
inmemory_optimized_arithmetic        string      DISABLE
inmemory_prefer_xmem_memcompress     string
inmemory_prefer_xmem_priority        string
inmemory_query                       string      ENABLE
inmemory_size                        big integer 0
inmemory_trickle_repopulate_servers_ integer     1
percent
inmemory_virtual_columns             string      MANUAL
inmemory_xmem_size                   big integer 0
optimizer_inmemory_aware             boolean     TRUE
SQL>

SQL> show sga

Total System Global Area 2.1475E+10 bytes
Fixed Size                  9146112 bytes
Variable Size            1879048192 bytes
Database Buffers         1.9529E+10 bytes
Redo Buffers               57962496 bytes
SQL>

SQL> show pdbs

    CON_ID CON_NAME                       OPEN MODE  RESTRICTED
---------- ------------------------------ ---------- ----------
         2 PDB$SEED                       READ ONLY  NO
         3 PDB1                           READ WRITE NO
         4 PDB2                           READ WRITE NO
SQL>

SQL> alter system set inmemory_force = 'BASE_LEVEL' scope=spfile;
System altered.

SQL> alter system set inmemory_size = 16G scope=spfile;
System altered.

SQL> exit
Disconnected from Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.8.0.0.0
[oracle@rac1-oel72 ~]$

[oracle@rac1-oel72 ~]$ srvctl stop database -d orcl
[oracle@rac1-oel72 ~]$
[oracle@rac1-oel72 ~]$ srvctl start database -d orcl
[oracle@rac1-oel72 ~]$

[oracle@rac1-oel72 ~]$ srvctl status database -d orcl
Instance orcl1 is running on node rac1-oel72
Instance orcl2 is running on node rac2-oel72
[oracle@rac1-oel72 ~]$

[oracle@rac1-oel72 ~]$ . oraenv
ORACLE_SID = [orcl1] ? orcl1
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@rac1-oel72 ~]$

[oracle@rac1-oel72 ~]$ sqlplus sys@orcl as sysdba

SQL*Plus: Release 19.0.0.0.0 - Production on Sun Jul 19 20:56:08 2020
Version 19.8.0.0.0
Copyright (c) 1982, 2020, Oracle.  All rights reserved.
Enter password:
Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.8.0.0.0

SQL> show pdbs

    CON_ID CON_NAME                       OPEN MODE  RESTRICTED
---------- ------------------------------ ---------- ----------
         2 PDB$SEED                       READ ONLY  NO
         3 PDB1                           READ WRITE NO
         4 PDB2                           READ WRITE NO
SQL>

SQL> show parameter sga_

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
sga_max_size                         big integer 20G
sga_min_size                         big integer 0
sga_target                           big integer 20G
unified_audit_sga_queue_size         integer     1048576
SQL>

SQL> show parameter inmemory_force

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
inmemory_force                       string      BASE_LEVEL
SQL>

SQL> show parameter inmemory_size

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
inmemory_size                        big integer 16G
SQL>

SQL> select instance_name, instance_number from gv$instance order by instance_number;

INSTANCE_NAME    INSTANCE_NUMBER
---------------- ---------------
orcl1                          1
orcl2                          2

SQL>

Please refer for more details:
https://blogs.oracle.com/in-memory/base-level-198-ru
https://blogs.oracle.com/in-memory/oracle-database-in-memory-base-level-feature

Co-Author of the Oracle Database Books


Co-Author of three Oracle Database Books




Oracle Database Upgrade and Migration Methods
https://mikedietrichde.com/2017/12/19/book-recommendation-oracle-database-upgrade-migration-methods/

Oracle High Availability, Disaster Recovery, and Cloud Services
https://www.apress.com/in/book/9781484243503#otherversion=9781484243510

Oracle GoldenGate With Microservices: (Real-Time Scenarios with Oracle GoldenGate)
https://www.amazon.com/dp/9389328489/ref=sr_1_fkmr1_2?keywords=oracle+golden+gate+ravikumar+bpb+publications&qid=1582262272&sr=8-2-fkmr1

Friday, July 17, 2020

Applying GRID RU (19.8.0.0.200714) & Database RU (19.8.0.0.0) to Oracle 19c (19.3.0.0.0) - 3-Node RAC


Applying GI Release Update 19.8.0.0.200714 & Database Release Update 19.8.0.0.0 to Oracle 19c (19.3.0.0.0) - 3-Node RAC
-------------------------------------------------------------------------------------------------------------------------

Required Softwares:
-------------------

Latest OPatch:                          p6880880_190000_Linux-x86-64.zip
GI Release Update (July 2020):       p31305339_190000_Linux-x86-64.zip
Database Release Update (July 2020): p31281355_190000_Linux-x86-64.zip

Check the status of cluster instances:
--------------------------------------

[oracle@19c-rac1 ~]$ srvctl status database -d cdbrac
Instance cdbrac1 is running on node 19c-rac1
Instance cdbrac2 is running on node 19c-rac2
Instance cdbrac3 is running on node 19c-rac3
[oracle@19c-rac1 ~]$

[oracle@19c-rac1 ~]$ . oraenv
ORACLE_SID = [cdbrac] ? cdbrac
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@19c-rac1 ~]$

[oracle@19c-rac1 ~]$ sqlplus sys/oracle@cdbrac as sysdba

SQL*Plus: Release 19.0.0.0.0 - Production on Fri Jul 17 11:58:16 2020
Version 19.7.0.0.0
Copyright (c) 1982, 2020, Oracle.  All rights reserved.
Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.7.0.0.0

SQL> select instance_name,instance_number from gv$instance order by instance_number;

INSTANCE_NAME    INSTANCE_NUMBER
---------------- ---------------
cdbrac1                        1
cdbrac2                        2
cdbrac3                        3
SQL>

Copy latest OPatch (12.2.0.1.21), GRID RU (p31305339_190000_Linux-x86-64.zip) and RDBMS RU (p31281355_190000_Linux-x86-64.zip)
-------------------------------------------------------------------------------------------------------------------------------

[oracle@19c-rac1 ~]$ scp *.zip oracle@192.168.2.20:/home/oracle/
p31281355_190000_Linux-x86-64.zip        100% 1295MB  56.3MB/s   00:23
p31305339_190000_Linux-x86-64.zip        100% 2490MB  53.0MB/s   00:47
p6880880_190000_Linux-x86-64.zip         100%  113MB  56.4MB/s   00:02
[oracle@19c-rac1 ~]$

[oracle@19c-rac2 ~]$ scp *.zip oracle@192.168.2.30:/home/oracle/
p31281355_190000_Linux-x86-64.zip        100% 1295MB  51.8MB/s   00:25
p31305339_190000_Linux-x86-64.zip        100% 2490MB  49.8MB/s   00:50
p6880880_190000_Linux-x86-64.zip         100%  113MB  37.6MB/s   00:03
[oracle@19c-rac2 ~]$

Update latest OPatch in GI and RDBMS homes:
-------------------------------------------

[oracle@19c-rac1 ~]$ unzip p6880880_190000_Linux-x86-64.zip -d /u01/app/19.3.0/grid/
[oracle@19c-rac1 ~]$ unzip p6880880_190000_Linux-x86-64.zip -d /u01/app/oracle/product/19.3.0/dbhome_1/

[oracle@19c-rac2 ~]$ unzip p6880880_190000_Linux-x86-64.zip -d /u01/app/19.3.0/grid/
[oracle@19c-rac2 ~]$ unzip p6880880_190000_Linux-x86-64.zip -d /u01/app/oracle/product/19.3.0/dbhome_1/

[oracle@19c-rac3 ~]$ unzip p6880880_190000_Linux-x86-64.zip -d /u01/app/19.3.0/grid/
[oracle@19c-rac3 ~]$ unzip p6880880_190000_Linux-x86-64.zip -d /u01/app/oracle/product/19.3.0/dbhome_1/


Run OPatch Conflict Check
=========================

[oracle@19c-rac1 ~]$ sh /u01/app/19.3.0/grid/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /home/oracle/31
31281355/ 31305339/

[oracle@19c-rac1 ~]$ sh /u01/app/19.3.0/grid/OPatch/opatch prereq CheckConflictAgainstOHWithDetail 
-phBaseDir /home/oracle/31305339/31281355/

Oracle Interim Patch Installer version 12.2.0.1.21
Copyright (c) 2020, Oracle Corporation.  All rights reserved.

PREREQ session

Oracle Home       : /u01/app/19.3.0/grid
Central Inventory : /u01/app/oraInventory
   from           : /u01/app/19.3.0/grid/oraInst.loc
OPatch version    : 12.2.0.1.21
OUI version       : 12.2.0.7.0
Log file location : /u01/app/19.3.0/grid/cfgtoollogs/opatch/opatch2020-07-17_23-13-59PM_1.log

Invoking prereq "checkconflictagainstohwithdetail"
Prereq "checkConflictAgainstOHWithDetail" passed.

OPatch succeeded.
[oracle@19c-rac1 ~]$

[oracle@19c-rac1 ~]$ sh /u01/app/19.3.0/grid/OPatch/opatch prereq CheckConflictAgainstOHWithDetail 

-phBaseDir /home/oracle/31305339/31305087

Oracle Interim Patch Installer version 12.2.0.1.21
Copyright (c) 2020, Oracle Corporation.  All rights reserved.

PREREQ session

Oracle Home       : /u01/app/19.3.0/grid
Central Inventory : /u01/app/oraInventory
   from           : /u01/app/19.3.0/grid/oraInst.loc
OPatch version    : 12.2.0.1.21
OUI version       : 12.2.0.7.0
Log file location : /u01/app/19.3.0/grid/cfgtoollogs/opatch/opatch2020-07-17_23-15-35PM_1.log

Invoking prereq "checkconflictagainstohwithdetail"

Prereq "checkConflictAgainstOHWithDetail" passed.

OPatch succeeded.
[oracle@19c-rac1 ~]$

[oracle@19c-rac1 ~]$ sh /u01/app/19.3.0/grid/OPatch/opatch prereq CheckConflictAgainstOHWithDetail 
-phBaseDir /home/oracle/31305339/31304218

Oracle Interim Patch Installer version 12.2.0.1.21
Copyright (c) 2020, Oracle Corporation.  All rights reserved.

PREREQ session

Oracle Home       : /u01/app/19.3.0/grid
Central Inventory : /u01/app/oraInventory
   from           : /u01/app/19.3.0/grid/oraInst.loc
OPatch version    : 12.2.0.1.21
OUI version       : 12.2.0.7.0
Log file location : /u01/app/19.3.0/grid/cfgtoollogs/opatch/opatch2020-07-17_23-15-51PM_1.log

Invoking prereq "checkconflictagainstohwithdetail"

Prereq "checkConflictAgainstOHWithDetail" passed.

OPatch succeeded.
[oracle@19c-rac1 ~]$

[oracle@19c-rac1 ~]$ sh /u01/app/19.3.0/grid/OPatch/opatch prereq CheckConflictAgainstOHWithDetail 
-phBaseDir /home/oracle/31305339/

Oracle Interim Patch Installer version 12.2.0.1.21
Copyright (c) 2020, Oracle Corporation.  All rights reserved.

PREREQ session

Oracle Home       : /u01/app/19.3.0/grid
Central Inventory : /u01/app/oraInventory
   from           : /u01/app/19.3.0/grid/oraInst.loc
OPatch version    : 12.2.0.1.21
OUI version       : 12.2.0.7.0
Log file location : /u01/app/19.3.0/grid/cfgtoollogs/opatch/opatch2020-07-17_23-15-59PM_1.log

This command doesn't support System Patch.

OPatch failed with error code 21
[oracle@19c-rac1 ~]$

[oracle@19c-rac1 ~]$ sh /u01/app/19.3.0/grid/OPatch/opatch prereq CheckConflictAgainstOHWithDetail 
-phBaseDir /home/oracle/31305339/31335188

Oracle Interim Patch Installer version 12.2.0.1.21
Copyright (c) 2020, Oracle Corporation.  All rights reserved.

PREREQ session

Oracle Home       : /u01/app/19.3.0/grid
Central Inventory : /u01/app/oraInventory
   from           : /u01/app/19.3.0/grid/oraInst.loc
OPatch version    : 12.2.0.1.21
OUI version       : 12.2.0.7.0
Log file location : /u01/app/19.3.0/grid/cfgtoollogs/opatch/opatch2020-07-17_23-16-11PM_1.log

Invoking prereq "checkconflictagainstohwithdetail"

Prereq "checkConflictAgainstOHWithDetail" passed.

OPatch succeeded.
[oracle@19c-rac1 ~]$

As a Oracle User:
=================

[oracle@19c-rac1 ~]$ sh /u01/app/oracle/product/19.3.0/dbhome_1/OPatch/opatch prereq CheckConflictAgainstOHWithDetail 
-phBaseDir /home/oracle/31305339/31281355

Oracle Interim Patch Installer version 12.2.0.1.21
Copyright (c) 2020, Oracle Corporation.  All rights reserved.

PREREQ session

Oracle Home       : /u01/app/oracle/product/19.3.0/dbhome_1
Central Inventory : /u01/app/oraInventory
   from           : /u01/app/oracle/product/19.3.0/dbhome_1/oraInst.loc
OPatch version    : 12.2.0.1.21
OUI version       : 12.2.0.7.0
Log file location : /u01/app/oracle/product/19.3.0/dbhome_1/cfgtoollogs/opatch/opatch2020-07-17_23-18-06PM_1.log

Invoking prereq "checkconflictagainstohwithdetail"

Prereq "checkConflictAgainstOHWithDetail" passed.

OPatch succeeded.
[oracle@19c-rac1 ~]$

[oracle@19c-rac1 ~]$ sh /u01/app/oracle/product/19.3.0/dbhome_1/OPatch/opatch prereq CheckConflictAgainstOHWithDetail 
-phBaseDir /home/oracle/31305339/31305087

Oracle Interim Patch Installer version 12.2.0.1.21
Copyright (c) 2020, Oracle Corporation.  All rights reserved.

PREREQ session

Oracle Home       : /u01/app/oracle/product/19.3.0/dbhome_1
Central Inventory : /u01/app/oraInventory
   from           : /u01/app/oracle/product/19.3.0/dbhome_1/oraInst.loc
OPatch version    : 12.2.0.1.21
OUI version       : 12.2.0.7.0
Log file location : /u01/app/oracle/product/19.3.0/dbhome_1/cfgtoollogs/opatch/opatch2020-07-17_23-18-34PM_1.log

Invoking prereq "checkconflictagainstohwithdetail"

Prereq "checkConflictAgainstOHWithDetail" passed.

OPatch succeeded.
[oracle@19c-rac1 ~]$

Run OPatch SystemSpace Check:
==============================

[oracle@19c-rac1 ~]$ . oraenv
ORACLE_SID = [+ASM1] ? cdbrac
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@19c-rac1 ~]$

[oracle@19c-rac1 ~]$ sh /u01/app/19.3.0/grid/OPatch/opatch prereq CheckSystemSpace -phBaseFile /tmp/patch_list_gihome.txt
Oracle Interim Patch Installer version 12.2.0.1.21
Copyright (c) 2020, Oracle Corporation.  All rights reserved.

PREREQ session

Oracle Home       : /u01/app/oracle/product/19.3.0/dbhome_1
Central Inventory : /u01/app/oraInventory
   from           : /u01/app/oracle/product/19.3.0/dbhome_1/oraInst.loc
OPatch version    : 12.2.0.1.21
OUI version       : 12.2.0.7.0
Log file location : /u01/app/oracle/product/19.3.0/dbhome_1/cfgtoollogs/opatch/opatch2020-07-17_23-26-45PM_1.log

Invoking prereq "checksystemspace"
Prereq "checkSystemSpace" passed.
OPatch succeeded.
[oracle@19c-rac1 ~]$

To patch the GI home and all Oracle RAC database homes of the same version:
---------------------------------------------------------------------------

[root@19c-rac1 ~]# . oraenv
ORACLE_SID = [root] ? +ASM1
The Oracle base has been set to /u01/app/oracle
[root@19c-rac1 ~]#

[root@19c-rac1 ~]# sh /u01/app/19.3.0/grid/OPatch/opatchauto apply /home/oracle/31305339


OPatchauto session is initiated at Fri Jul 17 23:28:25 2020

System initialization log file is /u01/app/19.3.0/grid/cfgtoollogs/opatchautodb/systemconfig2020-07-17_11-28-29PM.log.

Session log file is /u01/app/19.3.0/grid/cfgtoollogs/opatchauto/opatchauto2020-07-17_11-29-09PM.log
The id for this session is 46DR

Executing OPatch prereq operations to verify patch applicability on home /u01/app/19.3.0/grid

Executing OPatch prereq operations to verify patch applicability on home /u01/app/oracle/product/19.3.0/dbhome_1
Patch applicability verified successfully on home /u01/app/oracle/product/19.3.0/dbhome_1

Patch applicability verified successfully on home /u01/app/19.3.0/grid

Verifying SQL patch applicability on home /u01/app/oracle/product/19.3.0/dbhome_1
SQL patch applicability verified successfully on home /u01/app/oracle/product/19.3.0/dbhome_1

Preparing to bring down database service on home /u01/app/oracle/product/19.3.0/dbhome_1
Successfully prepared home /u01/app/oracle/product/19.3.0/dbhome_1 to bring down database service

Bringing down CRS service on home /u01/app/19.3.0/grid
CRS service brought down successfully on home /u01/app/19.3.0/grid

Performing prepatch operation on home /u01/app/oracle/product/19.3.0/dbhome_1
Perpatch operation completed successfully on home /u01/app/oracle/product/19.3.0/dbhome_1

Start applying binary patch on home /u01/app/oracle/product/19.3.0/dbhome_1
Binary patch applied successfully on home /u01/app/oracle/product/19.3.0/dbhome_1

Performing postpatch operation on home /u01/app/oracle/product/19.3.0/dbhome_1
Postpatch operation completed successfully on home /u01/app/oracle/product/19.3.0/dbhome_1

Start applying binary patch on home /u01/app/19.3.0/grid
Binary patch applied successfully on home /u01/app/19.3.0/grid

Starting CRS service on home /u01/app/19.3.0/grid
CRS service started successfully on home /u01/app/19.3.0/grid

Preparing home /u01/app/oracle/product/19.3.0/dbhome_1 after database service restarted
No step execution required.........

Trying to apply SQL patch on home /u01/app/oracle/product/19.3.0/dbhome_1
SQL patch applied successfully on home /u01/app/oracle/product/19.3.0/dbhome_1

OPatchAuto successful.
--------------------------------Summary--------------------------------
Patching is completed successfully. Please find the summary as follows:

Host:19c-rac1
RAC Home:/u01/app/oracle/product/19.3.0/dbhome_1
Version:19.0.0.0.0
Summary:

==Following patches were SKIPPED:

Patch: /home/oracle/31305339/31304218
Reason: This patch is not applicable to this specified target type - "rac_database"

Patch: /home/oracle/31305339/31335188
Reason: This patch is not applicable to this specified target type - "rac_database"

==Following patches were SUCCESSFULLY applied:

Patch: /home/oracle/31305339/31281355
Log: /u01/app/oracle/product/19.3.0/dbhome_1/cfgtoollogs/opatchauto/core/opatch/opatch2020-07-17_23-36-23PM_1.log

Patch: /home/oracle/31305339/31305087
Log: /u01/app/oracle/product/19.3.0/dbhome_1/cfgtoollogs/opatchauto/core/opatch/opatch2020-07-17_23-36-23PM_1.log

Host:19c-rac1
CRS Home:/u01/app/19.3.0/grid
Version:19.0.0.0.0
Summary:

==Following patches were SUCCESSFULLY applied:

Patch: /home/oracle/31305339/31281355
Log: /u01/app/19.3.0/grid/cfgtoollogs/opatchauto/core/opatch/opatch2020-07-17_23-41-50PM_1.log

Patch: /home/oracle/31305339/31304218
Log: /u01/app/19.3.0/grid/cfgtoollogs/opatchauto/core/opatch/opatch2020-07-17_23-41-50PM_1.log

Patch: /home/oracle/31305339/31305087
Log: /u01/app/19.3.0/grid/cfgtoollogs/opatchauto/core/opatch/opatch2020-07-17_23-41-50PM_1.log

Patch: /home/oracle/31305339/31335188
Log: /u01/app/19.3.0/grid/cfgtoollogs/opatchauto/core/opatch/opatch2020-07-17_23-41-50PM_1.log

OPatchauto session completed at Fri Jul 17 23:57:46 2020
Time taken to complete the session 29 minutes, 21 seconds
[root@19c-rac1 ~]#

Second Node: 19c-rac2
----------------------

[oracle@19c-rac2 ~]$ su - root
Password:
[root@19c-rac2 ~]# . oraenv
ORACLE_SID = [root] ? +ASM2
The Oracle base has been set to /u01/app/oracle
[root@19c-rac2 ~]#

[root@19c-rac2 ~]# sh /u01/app/19.3.0/grid/OPatch/opatchauto apply /home/oracle/31305339


OPatchauto session is initiated at Sat Jul 18 00:00:53 2020

System initialization log file is /u01/app/19.3.0/grid/cfgtoollogs/opatchautodb/systemconfig2020-07-18_12-00-57AM.log.

Session log file is /u01/app/19.3.0/grid/cfgtoollogs/opatchauto/opatchauto2020-07-18_12-01-21AM.log
The id for this session is QIXV

Executing OPatch prereq operations to verify patch applicability on home /u01/app/19.3.0/grid

Executing OPatch prereq operations to verify patch applicability on home /u01/app/oracle/product/19.3.0/dbhome_1
Patch applicability verified successfully on home /u01/app/19.3.0/grid

Patch applicability verified successfully on home /u01/app/oracle/product/19.3.0/dbhome_1

Verifying SQL patch applicability on home /u01/app/oracle/product/19.3.0/dbhome_1
SQL patch applicability verified successfully on home /u01/app/oracle/product/19.3.0/dbhome_1

Preparing to bring down database service on home /u01/app/oracle/product/19.3.0/dbhome_1
Successfully prepared home /u01/app/oracle/product/19.3.0/dbhome_1 to bring down database service

Bringing down CRS service on home /u01/app/19.3.0/grid
CRS service brought down successfully on home /u01/app/19.3.0/grid

Performing prepatch operation on home /u01/app/oracle/product/19.3.0/dbhome_1
Perpatch operation completed successfully on home /u01/app/oracle/product/19.3.0/dbhome_1

Start applying binary patch on home /u01/app/oracle/product/19.3.0/dbhome_1
Binary patch applied successfully on home /u01/app/oracle/product/19.3.0/dbhome_1

Performing postpatch operation on home /u01/app/oracle/product/19.3.0/dbhome_1
Postpatch operation completed successfully on home /u01/app/oracle/product/19.3.0/dbhome_1

Start applying binary patch on home /u01/app/19.3.0/grid
Binary patch applied successfully on home /u01/app/19.3.0/grid

Starting CRS service on home /u01/app/19.3.0/grid
CRS service started successfully on home /u01/app/19.3.0/grid

Preparing home /u01/app/oracle/product/19.3.0/dbhome_1 after database service restarted
No step execution required.........

Trying to apply SQL patch on home /u01/app/oracle/product/19.3.0/dbhome_1
SQL patch applied successfully on home /u01/app/oracle/product/19.3.0/dbhome_1

OPatchAuto successful.
--------------------------------Summary--------------------------------
Patching is completed successfully. Please find the summary as follows:

Host:19c-rac2
RAC Home:/u01/app/oracle/product/19.3.0/dbhome_1
Version:19.0.0.0.0
Summary:

==Following patches were SKIPPED:

Patch: /home/oracle/31305339/31304218
Reason: This patch is not applicable to this specified target type - "rac_database"

Patch: /home/oracle/31305339/31335188
Reason: This patch is not applicable to this specified target type - "rac_database"

==Following patches were SUCCESSFULLY applied:

Patch: /home/oracle/31305339/31281355
Log: /u01/app/oracle/product/19.3.0/dbhome_1/cfgtoollogs/opatchauto/core/opatch/opatch2020-07-18_00-05-12AM_1.log

Patch: /home/oracle/31305339/31305087
Log: /u01/app/oracle/product/19.3.0/dbhome_1/cfgtoollogs/opatchauto/core/opatch/opatch2020-07-18_00-05-12AM_1.log

Host:19c-rac2
CRS Home:/u01/app/19.3.0/grid
Version:19.0.0.0.0
Summary:

==Following patches were SUCCESSFULLY applied:

Patch: /home/oracle/31305339/31281355
Log: /u01/app/19.3.0/grid/cfgtoollogs/opatchauto/core/opatch/opatch2020-07-18_00-10-52AM_1.log

Patch: /home/oracle/31305339/31304218
Log: /u01/app/19.3.0/grid/cfgtoollogs/opatchauto/core/opatch/opatch2020-07-18_00-10-52AM_1.log

Patch: /home/oracle/31305339/31305087
Log: /u01/app/19.3.0/grid/cfgtoollogs/opatchauto/core/opatch/opatch2020-07-18_00-10-52AM_1.log

Patch: /home/oracle/31305339/31335188
Log: /u01/app/19.3.0/grid/cfgtoollogs/opatchauto/core/opatch/opatch2020-07-18_00-10-52AM_1.log

OPatchauto session completed at Sat Jul 18 00:31:50 2020
Time taken to complete the session 30 minutes, 57 seconds
[root@19c-rac2 ~]#

Third Node: 19c-rac3:
----------------------

[oracle@19c-rac3 ~]$ su - root
Password:
[root@19c-rac3 ~]# . oraenv
ORACLE_SID = [root] ? +ASM3
The Oracle base has been set to /u01/app/oracle
[root@19c-rac3 ~]#

[root@19c-rac3 ~]# sh /u01/app/19.3.0/grid/OPatch/opatchauto apply /home/oracle/31305339

OPatchauto session is initiated at Sat Jul 18 00:33:22 2020

System initialization log file is /u01/app/19.3.0/grid/cfgtoollogs/opatchautodb/systemconfig2020-07-18_12-33-26AM.log.

Session log file is /u01/app/19.3.0/grid/cfgtoollogs/opatchauto/opatchauto2020-07-18_12-33-51AM.log
The id for this session is SJV7

Executing OPatch prereq operations to verify patch applicability on home /u01/app/19.3.0/grid

Executing OPatch prereq operations to verify patch applicability on home /u01/app/oracle/product/19.3.0/dbhome_1
Patch applicability verified successfully on home /u01/app/19.3.0/grid

Patch applicability verified successfully on home /u01/app/oracle/product/19.3.0/dbhome_1

Verifying SQL patch applicability on home /u01/app/oracle/product/19.3.0/dbhome_1
SQL patch applicability verified successfully on home /u01/app/oracle/product/19.3.0/dbhome_1

Preparing to bring down database service on home /u01/app/oracle/product/19.3.0/dbhome_1
Successfully prepared home /u01/app/oracle/product/19.3.0/dbhome_1 to bring down database service

Bringing down CRS service on home /u01/app/19.3.0/grid
CRS service brought down successfully on home /u01/app/19.3.0/grid

Performing prepatch operation on home /u01/app/oracle/product/19.3.0/dbhome_1
Perpatch operation completed successfully on home /u01/app/oracle/product/19.3.0/dbhome_1

Start applying binary patch on home /u01/app/oracle/product/19.3.0/dbhome_1
Binary patch applied successfully on home /u01/app/oracle/product/19.3.0/dbhome_1

Performing postpatch operation on home /u01/app/oracle/product/19.3.0/dbhome_1
Postpatch operation completed successfully on home /u01/app/oracle/product/19.3.0/dbhome_1

Start applying binary patch on home /u01/app/19.3.0/grid
Binary patch applied successfully on home /u01/app/19.3.0/grid

Starting CRS service on home /u01/app/19.3.0/grid
CRS service started successfully on home /u01/app/19.3.0/grid

Preparing home /u01/app/oracle/product/19.3.0/dbhome_1 after database service restarted
No step execution required.........

Trying to apply SQL patch on home /u01/app/oracle/product/19.3.0/dbhome_1
SQL patch applied successfully on home /u01/app/oracle/product/19.3.0/dbhome_1

OPatchAuto successful.
--------------------------------Summary--------------------------------

Patching is completed successfully. Please find the summary as follows:

Host:19c-rac3
RAC Home:/u01/app/oracle/product/19.3.0/dbhome_1
Version:19.0.0.0.0
Summary:

==Following patches were SKIPPED:

Patch: /home/oracle/31305339/31304218
Reason: This patch is not applicable to this specified target type - "rac_database"

Patch: /home/oracle/31305339/31335188
Reason: This patch is not applicable to this specified target type - "rac_database"

==Following patches were SUCCESSFULLY applied:

Patch: /home/oracle/31305339/31281355
Log: /u01/app/oracle/product/19.3.0/dbhome_1/cfgtoollogs/opatchauto/core/opatch/opatch2020-07-18_00-40-38AM_1.log

Patch: /home/oracle/31305339/31305087
Log: /u01/app/oracle/product/19.3.0/dbhome_1/cfgtoollogs/opatchauto/core/opatch/opatch2020-07-18_00-40-38AM_1.log

Host:19c-rac3
CRS Home:/u01/app/19.3.0/grid
Version:19.0.0.0.0
Summary:

==Following patches were SUCCESSFULLY applied:

Patch: /home/oracle/31305339/31281355
Log: /u01/app/19.3.0/grid/cfgtoollogs/opatchauto/core/opatch/opatch2020-07-18_00-46-06AM_1.log

Patch: /home/oracle/31305339/31304218
Log: /u01/app/19.3.0/grid/cfgtoollogs/opatchauto/core/opatch/opatch2020-07-18_00-46-06AM_1.log

Patch: /home/oracle/31305339/31305087
Log: /u01/app/19.3.0/grid/cfgtoollogs/opatchauto/core/opatch/opatch2020-07-18_00-46-06AM_1.log

Patch: /home/oracle/31305339/31335188
Log: /u01/app/19.3.0/grid/cfgtoollogs/opatchauto/core/opatch/opatch2020-07-18_00-46-06AM_1.log

OPatchauto session completed at Sat Jul 18 01:41:24 2020
Time taken to complete the session 68 minutes, 2 seconds
[root@19c-rac3 ~]#

Grid Home:
----------

[oracle@19c-rac1 ~]$ . oraenv
ORACLE_SID = [cdbrac1] ? +ASM1
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@19c-rac1 ~]$ sh /u01/app/oracle/product/19.3.0/dbhome_1/OPatch/opatch lspatches
31335188;TOMCAT RELEASE UPDATE 19.0.0.0.0 (31335188)
31305087;OCW RELEASE UPDATE 19.8.0.0.0 (31305087)
31304218;ACFS RELEASE UPDATE 19.8.0.0.0 (31304218)
31281355;Database Release Update : 19.8.0.0.200714 (31281355)
OPatch succeeded.
[oracle@19c-rac1 ~]$

RDBMS Home:
-----------

[oracle@19c-rac1 ~]$ sh /u01/app/oracle/product/19.3.0/dbhome_1/OPatch/opatch lspatches
31305087;OCW RELEASE UPDATE 19.8.0.0.0 (31305087)
31281355;Database Release Update : 19.8.0.0.200714 (31281355)
OPatch succeeded.
[oracle@19c-rac1 ~]$


[oracle@19c-rac1 ~]$ . oraenv
ORACLE_SID = [+ASM1] ? cdbrac
The Oracle base remains unchanged with value /u01/app/oracle
[oracle@19c-rac1 ~]$ srvctl status database -d cdbrac
Instance cdbrac1 is running on node 19c-rac1
Instance cdbrac2 is running on node 19c-rac2
Instance cdbrac3 is running on node 19c-rac3
[oracle@19c-rac1 ~]$