A new RU (Release Update) came out in January 2021, and I wanted to take this opportunity to show you how to upgrade Oracle Restart 19.9 to 19.10 on a CentOS 8.3 VM. The reason for the upgrade for most of the people out there might be the following bug fixes.
Grid Infrastructure 19 Release Updates and Revisions Bugs Fixed Lists (Doc ID 2523221.1)
However, Oracle does not include only bug fixes in the RU. It includes also enhancements. Enhancements are indicated by an uppercase ‘E’ at the end of the number. E.g. 29739311E: Fix and Zip CHM Data in JSON Format
Very interesting are the ones with a ‘+’ sign, which indicates a particularly notable bug. Luckily there is none in the 19.10 RU. Here is the complete list of all special characters for which you might look out for.
‘*’ against a bug indicates that an alert exists for that issue
‘+’ indicates a particularly notable bug
‘P’ indicates a port specific bug
‘E’ indicates an “Enhancement” (as opposed to a bug fix)
‘D’ indicates that the bug fix is disabled by default
Just for the record. The 19.10 RU comes with 23 enhancements in regards to the Oracle Portable ClusterWare.
29062169E flex: rebooting all nodes, except some asm flex instances, evicts one with asm 29739311E Fix and Zip CHM Data in JSON Format 30437043E HAS Build - Compile Errors for the List of Below Files 30713448PE Skip the Check for the Owner of Old CRS Home on Window 30833909E CRS REJOIN AFTER NODE DOWN CAN BE DELAYED BY SLOW RESOURCES 30869943E Add Support for Restauth Adapter to Use REST APIs for Remote Command Execution [HAS Side Changes] 31021750E ZDM RELIABILITY : ZDM ERROR REPORTING FOR BAD TOKEN IN RSP FILE. 31105578E Performance Improvement Fix to Speed LMON Membership in CSS 31152741E Checks Missing for PreCRS and PreDB -R Ccommands for Some CRS/RAC Versions 31167566E ORA-00028: Session has been Killed Error During Service Relocate Operations 31295991E After Successful SSH Setup on GRIDSETUP GUI, SSH Test Will Fail with SSH Not Setup (At 21C Grid Install Steo 4 of 17) 31448087E GIMR to Provide Subroutines for Checking Necessary Constraints Prior to Cluster Rename 31488316E MISSING INFORMATION IN GI INCIDENT AND TRACE FILES 31494121E Alert log 1719 for Scheduling Delay Does Not Differentiate Between IO Delay and Scheduling Delay 31513130E RETRYING PATCHING JOB FAILS WHEN PREVIOUS FAILURE WAS DURING POST-PATCH STEP 31536584E NODE REBOOTED DURING FTCSS-OCSSD RECOVERY 31607561E RHP / FPP - ADD WC FAILS WITHOUT TRANSFERRING BITS TO RHPC DOES NOT ATTEMPT ADDITIONAL PORTS 31637251E new error messages for diskmon split-brain 31699081E Diagsnap to Use Non-blocking Option -b with lsof 31722457E resiliency for ssh issues 31742512E lrg problems with fix for bug-30857353 31752814E NEED TO HAVE OPTION TO ABORT A JOB IN FPP 31987354E RESTART QOS AND CHA RESOURCES AFTER GRID UPGRADE
OK, enough of talking. Let’s get started. The patching processes can be divided into a few major points:
- Backup the Database
- Backup Oracle Restart and ASM related things
- Patch OPatch in the GI and Oracle home
- Apply the RU to the GI home
- Apply the RU to the Oracle home
- Run some dictionary scripts (datapatch -verbose)
I will skip the backup of the database part, and in regards to Oracle Restart and ASM I already wrote a blog post with things that you might want to include to your backup strategy.
https://ptdb.ch/2020/11/02/a-few-things-you-might-want-to-add-to-your-backup-strategy-if-you-have-oracle-restart-19c-and-asm/
Patch OPatch in the GI and Oracle home
The first thing to do is to update the OPatch utility itself. Download the OPatch 12.2.0.1.24 from here:
OPatch 12.2.0.1.24 for Db 12.x, 18.x, 19.x and 20.x releases (Feb 2021)
And copy OPatch to the Grid and the Oracle Home and unpack it in each home. This is an online operation and no downtime is required until now.
[oracle@ocm199 19.10]$ cp OPatch_12.2.0.1.24_p6880880_121010_Linux-x86-64.zip /u01/grid/19c/ [oracle@ocm199 19.10]$ cp OPatch_12.2.0.1.24_p6880880_121010_Linux-x86-64.zip /u01/app/oracle/product/19c/ [oracle@ocm199 19.10]$ [oracle@ocm199 19.10]$ cd /u01/grid/19c/ [oracle@ocm199 19c]$ unzip OPatch_12.2.0.1.24_p6880880_121010_Linux-x86-64.zip replace OPatch/emdpatch.pl? [y]es, [n]o, [A]ll, [N]one, [r]ename: A inflating: OPatch/emdpatch.pl inflating: OPatch/oracle_common/modules/com.oracle.glcm.common-logging_1.6.5.0.jar inflating: OPatch/oracle_common/modules/common-logging-config.jar inflating: OPatch/oplan/oplan inflating: OPatch/datapatch inflating: OPatch/docs/FAQ inflating: OPatch/docs/Prereq_Users_Guide.txt inflating: OPatch/docs/cversion.txt inflating: OPatch/docs/Users_Guide.txt extracting: OPatch/ocm/generic.zip inflating: OPatch/README.txt ... [oracle@ocm199 19c]$ [oracle@ocm199 19c]$ cd /u01/app/oracle/product/19c [oracle@ocm199 19c]$ unzip OPatch_12.2.0.1.24_p6880880_121010_Linux-x86-64.zip Archive: OPatch_12.2.0.1.24_p6880880_121010_Linux-x86-64.zip replace OPatch/emdpatch.pl? [y]es, [n]o, [A]ll, [N]one, [r]ename: A inflating: OPatch/emdpatch.pl inflating: OPatch/oracle_common/modules/com.oracle.glcm.common-logging_1.6.5.0.jar inflating: OPatch/oracle_common/modules/common-logging-config.jar inflating: OPatch/oplan/oplan inflating: OPatch/datapatch inflating: OPatch/docs/FAQ inflating: OPatch/docs/Prereq_Users_Guide.txt inflating: OPatch/docs/cversion.txt inflating: OPatch/docs/Users_Guide.txt extracting: OPatch/ocm/generic.zip inflating: OPatch/README.txt ... [oracle@ocm199 19c]$
Apply the RU to the GI home
Now its time to apply the RU to the GI home. Take care, because the opatchauto utility with take down your ASM instance and all associated DB’s with it. Download the following patch and check the readme carefully in case you have some special installation.
Patch 32226239 – GI Release Update 19.10.0.0.210119
How to do the upgrade is described in a great detail here.
https://updates.oracle.com/Orion/Services/download?type=readme&aru=24017144
First of all, we check the current patch level on the GRID home.
[oracle@ocm199 ~]$ . GRID
[oracle@ocm199 ~]$
[oracle@ocm199 ~]$ opatch lsinv
Oracle Interim Patch Installer version 12.2.0.1.24
Copyright (c) 2021, Oracle Corporation. All rights reserved.
Oracle Home : /u01/grid/19c
Central Inventory : /u01/app/oraInventory
from : /u01/grid/19c/oraInst.loc
OPatch version : 12.2.0.1.24
OUI version : 12.2.0.7.0
Log file location : /u01/grid/19c/cfgtoollogs/opatch/opatch2021-03-02_03-21-27AM_1.log
Lsinventory Output file location : /u01/grid/19c/cfgtoollogs/opatch/lsinv/lsinventory2021-03-02_03-21-27AM.txt
--------------------------------------------------------------------------------
Local Machine Information::
Hostname: ocm199
ARU platform id: 226
ARU platform description:: Linux x86-64
Installed Top-level Products (1):
Oracle Grid Infrastructure 19c 19.0.0.0.0
There are 1 products installed in this Oracle Home.
Interim patches (4) :
Patch 31780966 : applied on Tue Oct 27 03:45:37 EDT 2020
Unique Patch ID: 23770942
Patch description: "TOMCAT RELEASE UPDATE 19.0.0.0.0 (31780966)"
Created on 20 Aug 2020, 09:07:34 hrs PST8PDT
Bugs fixed:
30009095, 31657943, 29286300, 30997459, 30729044
Patch 31773437 : applied on Tue Oct 27 03:45:10 EDT 2020
Unique Patch ID: 23768260
Patch description: "ACFS RELEASE UPDATE 19.9.0.0.0 (31773437)"
Created on 24 Aug 2020, 22:19:56 hrs PST8PDT
Bugs fixed:
27494830, 27917085, 28064731, 28293236, 28321248, 28375150, 28531803
28553487, 28611527, 28649123, 28687713, 28701011, 28740425, 28818513
28825772, 28837603, 28844788, 28855761, 28860451, 28900212, 28951588
...
...
Patch 31772784 : applied on Tue Oct 27 03:44:20 EDT 2020
Unique Patch ID: 23854876
Patch description: "OCW RELEASE UPDATE 19.9.0.0.0 (31772784)"
Created on 10 Oct 2020, 04:06:52 hrs PST8PDT
Bugs fixed:
17787434, 25736599, 26675491, 26813848, 27092095, 27148384, 27222128
27262781, 27505699, 27526265, 27572040, 27604329, 27663388, 27760043
27877830, 27935374, 28302439, 28302580, 28319989, 28336118, 28344129
28406406, 28441307, 28462255, 28470673, 28554809, 28567875, 28621543
...
...
Patch 31771877 : applied on Tue Oct 27 03:41:58 EDT 2020
Unique Patch ID: 23869227
Patch description: "Database Release Update : 19.9.0.0.201020 (31771877)"
Created on 7 Oct 2020, 21:34:19 hrs PST8PDT
Bugs fixed:
30150710, 31935717, 7391838, 8460502, 8476681, 14735102, 17428816
17468475, 19080742, 19697993, 20313356, 21374587, 21639146, 21888352
21965541, 22580355, 22729345, 22748979, 23294761, 23296836, 23606241
23645975, 23734075, 23763462, 24596874, 24669730, 24687075, 24833686
24971456, 25030027, 25092651, 25093917, 25404117, 25416731, 25560538
25756945, 25804387, 25806201, 25809128, 25883179, 25905368, 25986062
...
...
31668061, 31672605, 31683044, 31718134, 31718346, 31747989, 31758846
31781897, 31792615, 31796208, 31796277, 31820859, 31833172, 31867037
31876368, 31886547, 31888148, 31897786, 31905033
--------------------------------------------------------------------------------
OPatch succeeded.
[oracle@ocm199 ~]$
And also check the current patch level of the Oracle home:
[oracle@ocm199 ~]$ . ORACLE
[oracle@ocm199 ~]$ opatch lsinv
Oracle Interim Patch Installer version 12.2.0.1.24
Copyright (c) 2021, Oracle Corporation. All rights reserved.
Oracle Home : /u01/app/oracle/product/19c
Central Inventory : /u01/app/oraInventory
from : /u01/app/oracle/product/19c/oraInst.loc
OPatch version : 12.2.0.1.24
OUI version : 12.2.0.7.0
Log file location : /u01/app/oracle/product/19c/cfgtoollogs/opatch/opatch2021-03-02_03-22-35AM_1.log
Lsinventory Output file location : /u01/app/oracle/product/19c/cfgtoollogs/opatch/lsinv/lsinventory2021-03-02_03-22-35AM.txt
--------------------------------------------------------------------------------
Local Machine Information::
Hostname: ocm199
ARU platform id: 226
ARU platform description:: Linux x86-64
Installed Top-level Products (1):
Oracle Database 19c 19.0.0.0.0
There are 1 products installed in this Oracle Home.
Interim patches (2) :
Patch 31772784 : applied on Tue Oct 27 06:05:45 EDT 2020
Unique Patch ID: 23854876
Patch description: "OCW RELEASE UPDATE 19.9.0.0.0 (31772784)"
Created on 10 Oct 2020, 04:06:52 hrs PST8PDT
Bugs fixed:
17787434, 25736599, 26675491, 26813848, 27092095, 27148384, 27222128
27262781, 27505699, 27526265, 27572040, 27604329, 27663388, 27760043
27877830, 27935374, 28302439, 28302580, 28319989, 28336118, 28344129
28406406, 28441307, 28462255, 28470673, 28554809, 28567875, 28621543
28628631, 28642469, 28697242, 28697896, 28699321, 28704073, 28710663
...
...
Patch 31771877 : applied on Tue Oct 27 06:04:27 EDT 2020
Unique Patch ID: 23869227
Patch description: "Database Release Update : 19.9.0.0.201020 (31771877)"
Created on 7 Oct 2020, 21:34:19 hrs PST8PDT
Bugs fixed:
30150710, 31935717, 7391838, 8460502, 8476681, 14735102, 17428816
17468475, 19080742, 19697993, 20313356, 21374587, 21639146, 21888352
21965541, 22580355, 22729345, 22748979, 23294761, 23296836, 23606241
23645975, 23734075, 23763462, 24596874, 24669730, 24687075, 24833686
24971456, 25030027, 25092651, 25093917, 25404117, 25416731, 25560538
25756945, 25804387, 25806201, 25809128, 25883179, 25905368, 25986062
...
...
31668061, 31672605, 31683044, 31718134, 31718346, 31747989, 31758846
31781897, 31792615, 31796208, 31796277, 31820859, 31833172, 31867037
31876368, 31886547, 31888148, 31897786, 31905033
--------------------------------------------------------------------------------
OPatch succeeded.
[oracle@ocm199 ~]$
After checking the current patch level, it is advisable to run the OPatch conflict check. This is still an online operation and no downtime until now. By checking it beforehand, you can save a lot of time, in case some errors should be reported.
For Grid Infrastructure Home, as home user run the following commands:
$ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /u01/app/oracle/product/stage/19.10/32226239/32218454 $ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /u01/app/oracle/product/stage/19.10/32226239/32222571 $ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /u01/app/oracle/product/stage/19.10/32226239/32218663 $ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /u01/app/oracle/product/stage/19.10/32226239/29340594 $ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /u01/app/oracle/product/stage/19.10/32226239/32240590
For Database home, as home user run the following commands:
$ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /u01/app/oracle/product/stage/19.10/32226239/32218454 $ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /u01/app/oracle/product/stage/19.10/32226239/32222571
[oracle@ocm199 ~]$ . GRID [oracle@ocm199 ~]$ [oracle@ocm199 ~]$ $ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /u01/app/oracle/product/stage/19.10/32226239/32218454 Oracle Interim Patch Installer version 12.2.0.1.24 Copyright (c) 2021, Oracle Corporation. All rights reserved. PREREQ session Oracle Home : /u01/grid/19c Central Inventory : /u01/app/oraInventory from : /u01/grid/19c/oraInst.loc OPatch version : 12.2.0.1.24 OUI version : 12.2.0.7.0 Log file location : /u01/grid/19c/cfgtoollogs/opatch/opatch2021-03-02_03-26-13AM_1.log Invoking prereq "checkconflictagainstohwithdetail" Prereq "checkConflictAgainstOHWithDetail" passed. OPatch succeeded. [oracle@ocm199 ~]$ $ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /u01/app/oracle/product/stage/19.10/32226239/32222571 Oracle Interim Patch Installer version 12.2.0.1.24 Copyright (c) 2021, Oracle Corporation. All rights reserved. PREREQ session Oracle Home : /u01/grid/19c Central Inventory : /u01/app/oraInventory from : /u01/grid/19c/oraInst.loc OPatch version : 12.2.0.1.24 OUI version : 12.2.0.7.0 Log file location : /u01/grid/19c/cfgtoollogs/opatch/opatch2021-03-02_03-27-34AM_1.log Invoking prereq "checkconflictagainstohwithdetail" Prereq "checkConflictAgainstOHWithDetail" passed. OPatch succeeded. [oracle@ocm199 ~]$ $ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /u01/app/oracle/product/stage/19.10/32226239/32218663 Oracle Interim Patch Installer version 12.2.0.1.24 Copyright (c) 2021, Oracle Corporation. All rights reserved. PREREQ session Oracle Home : /u01/grid/19c Central Inventory : /u01/app/oraInventory from : /u01/grid/19c/oraInst.loc OPatch version : 12.2.0.1.24 OUI version : 12.2.0.7.0 Log file location : /u01/grid/19c/cfgtoollogs/opatch/opatch2021-03-02_03-27-54AM_1.log Invoking prereq "checkconflictagainstohwithdetail" Prereq "checkConflictAgainstOHWithDetail" passed. OPatch succeeded. [oracle@ocm199 ~]$ $ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /u01/app/oracle/product/stage/19.10/32226239/29340594 Oracle Interim Patch Installer version 12.2.0.1.24 Copyright (c) 2021, Oracle Corporation. All rights reserved. PREREQ session Oracle Home : /u01/grid/19c Central Inventory : /u01/app/oraInventory from : /u01/grid/19c/oraInst.loc OPatch version : 12.2.0.1.24 OUI version : 12.2.0.7.0 Log file location : /u01/grid/19c/cfgtoollogs/opatch/opatch2021-03-02_03-28-14AM_1.log Invoking prereq "checkconflictagainstohwithdetail" Prereq "checkConflictAgainstOHWithDetail" passed. OPatch succeeded. [oracle@ocm199 ~]$ $ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /u01/app/oracle/product/stage/19.10/32226239/32240590 Oracle Interim Patch Installer version 12.2.0.1.24 Copyright (c) 2021, Oracle Corporation. All rights reserved. PREREQ session Oracle Home : /u01/grid/19c Central Inventory : /u01/app/oraInventory from : /u01/grid/19c/oraInst.loc OPatch version : 12.2.0.1.24 OUI version : 12.2.0.7.0 Log file location : /u01/grid/19c/cfgtoollogs/opatch/opatch2021-03-02_03-28-38AM_1.log Invoking prereq "checkconflictagainstohwithdetail" Prereq "checkConflictAgainstOHWithDetail" passed. OPatch succeeded. [oracle@ocm199 ~]$ . ORACLE [oracle@ocm199 ~]$ [oracle@ocm199 ~]$ [oracle@ocm199 ~]$ $ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /u01/app/oracle/product/stage/19.10/32226239/32218454 Oracle Interim Patch Installer version 12.2.0.1.24 Copyright (c) 2021, Oracle Corporation. All rights reserved. PREREQ session Oracle Home : /u01/app/oracle/product/19c Central Inventory : /u01/app/oraInventory from : /u01/app/oracle/product/19c/oraInst.loc OPatch version : 12.2.0.1.24 OUI version : 12.2.0.7.0 Log file location : /u01/app/oracle/product/19c/cfgtoollogs/opatch/opatch2021-03-02_03-30-11AM_1.log Invoking prereq "checkconflictagainstohwithdetail" Prereq "checkConflictAgainstOHWithDetail" passed. OPatch succeeded. [oracle@ocm199 ~]$ $ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /u01/app/oracle/product/stage/19.10/32226239/32222571 Oracle Interim Patch Installer version 12.2.0.1.24 Copyright (c) 2021, Oracle Corporation. All rights reserved. PREREQ session Oracle Home : /u01/app/oracle/product/19c Central Inventory : /u01/app/oraInventory from : /u01/app/oracle/product/19c/oraInst.loc OPatch version : 12.2.0.1.24 OUI version : 12.2.0.7.0 Log file location : /u01/app/oracle/product/19c/cfgtoollogs/opatch/opatch2021-03-02_03-30-24AM_1.log Invoking prereq "checkconflictagainstohwithdetail" Prereq "checkConflictAgainstOHWithDetail" passed. OPatch succeeded.
If everything succeeds, it is time the run the opatchauto. Be careful, the next step is bringing down CRS service on home /u01/grid/19c, incl. ASM and all associated DB’s with it.
To start the patching procedure, login as root and run opatchauto.
[root@ocm199 19.10]# /u01/grid/19c/OPatch/opatchauto apply /u01/app/oracle/product/stage/19.10/32226239 -oh /u01/grid/19c OPatchauto session is initiated at Tue Mar 2 03:33:53 2021 System initialization log file is /u01/grid/19c/cfgtoollogs/opatchautodb/systemconfig2021-03-02_03-33-55AM.log. Session log file is /u01/grid/19c/cfgtoollogs/opatchauto/opatchauto2021-03-02_03-33-58AM.log The id for this session is M34Q Executing OPatch prereq operations to verify patch applicability on home /u01/grid/19c Patch applicability verified successfully on home /u01/grid/19c Executing patch validation checks on home /u01/grid/19c Patch validation checks successfully completed on home /u01/grid/19c Performing prepatch operations on CRS - bringing down CRS service on home /u01/grid/19c Prepatch operation log file location: /u01/app/oracle/crsdata/ocm199/crsconfig/hapatch_2021-03-02_03-34-30AM.log CRS service brought down successfully on home /u01/grid/19c Start applying binary patch on home /u01/grid/19c Binary patch applied successfully on home /u01/grid/19c Performing postpatch operations on CRS - starting CRS service on home /u01/grid/19c Postpatch operation log file location: /u01/app/oracle/crsdata/ocm199/crsconfig/hapatch_2021-03-02_03-42-35AM.log CRS service started successfully on home /u01/grid/19c OPatchAuto successful. --------------------------------Summary-------------------------------- Patching is completed successfully. Please find the summary as follows: Host:ocm199 SIHA Home:/u01/grid/19c Version:19.0.0.0.0 Summary: ==Following patches were SUCCESSFULLY applied: Patch: /u01/app/oracle/product/stage/19.10/32226239/29340594 Log: /u01/grid/19c/cfgtoollogs/opatchauto/core/opatch/opatch2021-03-02_03-34-57AM_1.log Patch: /u01/app/oracle/product/stage/19.10/32226239/32218454 Log: /u01/grid/19c/cfgtoollogs/opatchauto/core/opatch/opatch2021-03-02_03-34-57AM_1.log Patch: /u01/app/oracle/product/stage/19.10/32226239/32218663 Log: /u01/grid/19c/cfgtoollogs/opatchauto/core/opatch/opatch2021-03-02_03-34-57AM_1.log Patch: /u01/app/oracle/product/stage/19.10/32226239/32222571 Log: /u01/grid/19c/cfgtoollogs/opatchauto/core/opatch/opatch2021-03-02_03-34-57AM_1.log Patch: /u01/app/oracle/product/stage/19.10/32226239/32240590 Log: /u01/grid/19c/cfgtoollogs/opatchauto/core/opatch/opatch2021-03-02_03-34-57AM_1.log OPatchauto session completed at Tue Mar 2 03:43:38 2021 Time taken to complete the session 9 minutes, 46 seconds [root@ocm199 19.10]#
Cluster resources and the DB are started automatically again after the patching is done
[oracle@ocm199 OPatch]$ crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.DATA.dg
ONLINE ONLINE ocm199 STABLE
ora.FRA.dg
ONLINE ONLINE ocm199 STABLE
ora.LISTENER.lsnr
ONLINE ONLINE ocm199 STABLE
ora.asm
ONLINE ONLINE ocm199 Started,STABLE
ora.ons
OFFLINE OFFLINE ocm199 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.cdb.db
1 ONLINE ONLINE ocm199 Open,HOME=/u01/app/o
racle/product/19c,ST
ABLE
ora.cssd
1 ONLINE ONLINE ocm199 STABLE
ora.diskmon
1 OFFLINE OFFLINE STABLE
ora.evmd
1 ONLINE ONLINE ocm199 STABLE
--------------------------------------------------------------------------------
[oracle@ocm199 OPatch]$
Apply RU to the Oracle home
Now we are patching the Oracle home. Take care, the patching is bringing down database service which are attached to the home /u01/app/oracle/product/19c
[root@ocm199 19.10]# /u01/app/oracle/product/19c/OPatch/opatchauto apply /u01/app/oracle/product/stage/19.10/32226239 -oh /u01/app/oracle/product/19c OPatchauto session is initiated at Tue Mar 2 03:53:42 2021 System initialization log file is /u01/app/oracle/product/19c/cfgtoollogs/opatchautodb/systemconfig2021-03-02_03-53-44AM.log. Session log file is /u01/app/oracle/product/19c/cfgtoollogs/opatchauto/opatchauto2021-03-02_03-53-47AM.log The id for this session is 2X84 Executing OPatch prereq operations to verify patch applicability on home /u01/app/oracle/product/19c Patch applicability verified successfully on home /u01/app/oracle/product/19c Executing patch validation checks on home /u01/app/oracle/product/19c Patch validation checks successfully completed on home /u01/app/oracle/product/19c Verifying SQL patch applicability on home /u01/app/oracle/product/19c SQL patch applicability verified successfully on home /u01/app/oracle/product/19c Preparing to bring down database service on home /u01/app/oracle/product/19c Successfully prepared home /u01/app/oracle/product/19c to bring down database service Bringing down database service on home /u01/app/oracle/product/19c Following database has been stopped and will be restarted later during the session: cdb Database service successfully brought down on home /u01/app/oracle/product/19c Start applying binary patch on home /u01/app/oracle/product/19c Binary patch applied successfully on home /u01/app/oracle/product/19c Starting database service on home /u01/app/oracle/product/19c Database service successfully started on home /u01/app/oracle/product/19c Preparing home /u01/app/oracle/product/19c after database service restarted No step execution required......... Trying to apply SQL patch on home /u01/app/oracle/product/19c SQL patch applied successfully on home /u01/app/oracle/product/19c OPatchAuto successful. --------------------------------Summary-------------------------------- Patching is completed successfully. Please find the summary as follows: Host:ocm199 SIDB Home:/u01/app/oracle/product/19c Version:19.0.0.0.0 Summary: ==Following patches were SKIPPED: Patch: /u01/app/oracle/product/stage/19.10/32226239/32218663 Reason: This patch is not applicable to this specified target type - "oracle_database" Patch: /u01/app/oracle/product/stage/19.10/32226239/29340594 Reason: This patch is not applicable to this specified target type - "oracle_database" Patch: /u01/app/oracle/product/stage/19.10/32226239/32240590 Reason: This patch is not applicable to this specified target type - "oracle_database" ==Following patches were SUCCESSFULLY applied: Patch: /u01/app/oracle/product/stage/19.10/32226239/32218454 Log: /u01/app/oracle/product/19c/cfgtoollogs/opatchauto/core/opatch/opatch2021-03-02_03-55-16AM_1.log Patch: /u01/app/oracle/product/stage/19.10/32226239/32222571 Log: /u01/app/oracle/product/19c/cfgtoollogs/opatchauto/core/opatch/opatch2021-03-02_03-55-16AM_1.log OPatchauto session completed at Tue Mar 2 04:05:51 2021 Time taken to complete the session 12 minutes, 10 seconds [root@ocm199 19.10]#
From the alert.log you can see that the dictionary scripts run against the CDB$ROOT and PDB$SEED automatically. All other PDB’s are excluded from this automation process.
...
...
Starting ORACLE instance (normal) (OS id: 23607)
2021-03-02T03:59:12.877637-05:00
****************************************************
Sys-V shared memory will be used for creating SGA
****************************************************
2021-03-02T03:59:12.878078-05:00
**********************************************************************
2021-03-02T03:59:12.878115-05:00
Dump of system resources acquired for SHARED GLOBAL AREA (SGA)
2021-03-02T03:59:12.878164-05:00
Per process system memlock (soft) limit = UNLIMITED
2021-03-02T03:59:12.878211-05:00
Expected per process system memlock (soft) limit to lock
instance MAX SHARED GLOBAL AREA (SGA) into memory: 3074M
2021-03-02T03:59:12.878269-05:00
Available system pagesizes:
4K, 2048K
2021-03-02T03:59:12.878384-05:00
Supported system pagesize(s):
2021-03-02T03:59:12.878446-05:00
PAGESIZE AVAILABLE_PAGES EXPECTED_PAGES ALLOCATED_PAGES ERROR(s)
2021-03-02T03:59:12.878474-05:00
4K Configured 8 786440 NONE
2021-03-02T03:59:12.878595-05:00
2048K 0 1537 0 NONE
2021-03-02T03:59:12.878634-05:00
RECOMMENDATION:
2021-03-02T03:59:12.878665-05:00
1. For optimal performance, configure system with expected number
of pages for every supported system pagesize prior to the next
instance restart operation.
2021-03-02T03:59:12.880799-05:00
**********************************************************************
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Initial number of CPU is 4
Number of processor cores in the system is 4
Number of processor sockets in the system is 1
Capability Type : Network
capabilities requested : 7 detected : 0 Simulated : 0
Capability Type : Runtime Environment
capabilities requested : 400000FF detected : 40000000 Simulated : 0
Capability Type : Engineered Systems
capabilities requested : F detected : 0 Simulated : 0
Capability Type : Database Test
capabilities requested : 3 detected : 0 Simulated : 0
Capability Type : Database Editions
capabilities requested : C detected : 8 Simulated : 0
Using LOG_ARCHIVE_DEST_1 parameter default value as USE_DB_RECOVERY_FILE_DEST
Autotune of undo retention is turned on.
IMODE=BR
ILAT =55
LICENSE_MAX_USERS = 0
SYS auditing is enabled
NOTE: remote asm mode is local (mode 0x1; from cluster type)
NOTE: Using default ASM root directory ASM
NOTE: remote asm mode is local (mode 0x1; from cluster type)
NOTE: Cluster configuration type = SIHA [3]
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.10.0.0.0.
ORACLE_HOME: /u01/app/oracle/product/19c
System name: Linux
Node name: ocm199
Release: 4.18.0-240.10.1.el8_3.x86_64
Version: #1 SMP Mon Jan 18 17:05:51 UTC 2021
Machine: x86_64
Using parameter settings in server-side spfile +DATA/CDB/PARAMETERFILE/spfile.270.1054881393
System parameters with non-default values:
processes = 320
nls_language = "AMERICAN"
nls_territory = "AMERICA"
sga_target = 3G
control_files = "+DATA/CDB/CONTROLFILE/current.261.1054880119"
control_files = "+FRA/CDB/CONTROLFILE/current.256.1054880119"
control_file_record_keep_time= 144
db_block_size = 8192
compatible = "19.0.0"
log_archive_format = "%t_%s_%r.dbf"
db_create_file_dest = "+DATA"
db_recovery_file_dest = "+FRA"
db_recovery_file_dest_size= 12732M
undo_tablespace = "UNDOTBS1"
remote_login_passwordfile= "EXCLUSIVE"
dispatchers = "(PROTOCOL=TCP) (SERVICE=CDBXDB)"
local_listener = "LISTENER_CDB"
audit_file_dest = "/u01/app/oracle/admin/CDB/adump"
audit_trail = "DB"
db_name = "CDB"
open_cursors = 300
pga_aggregate_target = 2G
diagnostic_dest = "/u01/app/oracle"
enable_pluggable_database= TRUE
2021-03-02T03:59:13.093221-05:00
============================================================
NOTE: PatchLevel of this instance 0
============================================================
2021-03-02T03:59:14.275231-05:00
Starting background process PMON
2021-03-02T03:59:14.282646-05:00
PMON started with pid=2, OS id=23622
Starting background process CLMN
2021-03-02T03:59:14.290915-05:00
CLMN started with pid=3, OS id=23626
Starting background process PSP0
2021-03-02T03:59:14.299010-05:00
PSP0 started with pid=4, OS id=23630
Starting background process VKTM
2021-03-02T03:59:15.332574-05:00
VKTM started with pid=5, OS id=23634 at elevated (RT) priority
2021-03-02T03:59:15.332615-05:00
Starting background process GEN0
2021-03-02T03:59:15.333494-05:00
VKTM running at (1)millisec precision with DBRM quantum (100)ms
2021-03-02T03:59:15.339782-05:00
GEN0 started with pid=6, OS id=23640
...
...
Starting background process MMON
2021-03-02T03:59:15.554759-05:00
MMON started with pid=34, OS id=23718
Starting background process MMNL
2021-03-02T03:59:15.567505-05:00
MMNL started with pid=35, OS id=23720
2021-03-02T03:59:15.571143-05:00
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
2021-03-02T03:59:15.571323-05:00
NOTE: ASMB (index:0) registering with ASM instance as Standard client 0xffffffffffffffff (reg:602057471) (startid:1066103953) (new connection)
starting up 1 shared server(s) ...
Starting background process TMON
2021-03-02T03:59:15.603334-05:00
TMON started with pid=38, OS id=23728
Setting CPU count to 4
ORACLE_BASE from environment = /u01/app/oracle
2021-03-02T03:59:15.628817-05:00
NOTE: ASMB (index:0) (23710) connected to ASM instance +ASM, osid: 23722 (Standard mode; client id 0xffffffffffffffff)
NOTE: initiating MARK startup
Starting background process MARK
2021-03-02T03:59:15.636542-05:00
MARK started with pid=40, OS id=23732
2021-03-02T03:59:15.637735-05:00
NOTE: MARK has subscribed
2021-03-02T03:59:15.653909-05:00
ALTER DATABASE MOUNT /* db agent *//* {0:0:344} */
2021-03-02T03:59:18.398830-05:00
Using default pga_aggregate_limit of 4096 MB
2021-03-02T03:59:18.755586-05:00
NOTE: ASMB mounting group 1 (DATA)
NOTE: Assigning number (1,0) to disk (/dev/oracleasm/asmdisk01)
NOTE: Assigning number (1,1) to disk (/dev/oracleasm/asmdisk02)
NOTE: Assigning number (1,2) to disk (/dev/oracleasm/asmdisk03)
SUCCESS: mounted group 1 (DATA)
NOTE: grp 1 disk 0: DATA_0000 path:/dev/oracleasm/asmdisk01
NOTE: grp 1 disk 1: DATA_0001 path:/dev/oracleasm/asmdisk02
NOTE: grp 1 disk 2: DATA_0002 path:/dev/oracleasm/asmdisk03
NOTE: ASMB mounting group 2 (FRA)
2021-03-02T03:59:18.851218-05:00
NOTE: dependency between database CDB and diskgroup resource ora.DATA.dg is established
2021-03-02T03:59:18.857326-05:00
NOTE: Assigning number (2,0) to disk (/dev/oracleasm/asmdisk04)
NOTE: Assigning number (2,1) to disk (/dev/oracleasm/asmdisk05)
NOTE: Assigning number (2,2) to disk (/dev/oracleasm/asmdisk06)
NOTE: Assigning number (2,3) to disk (/dev/oracleasm/asmdisk07)
SUCCESS: mounted group 2 (FRA)
NOTE: grp 2 disk 0: FRA_0000 path:/dev/oracleasm/asmdisk04
NOTE: grp 2 disk 1: FRA_0001 path:/dev/oracleasm/asmdisk05
NOTE: grp 2 disk 2: FRA_0002 path:/dev/oracleasm/asmdisk06
NOTE: grp 2 disk 3: FRA_0003 path:/dev/oracleasm/asmdisk07
2021-03-02T03:59:18.879311-05:00
NOTE: dependency between database CDB and diskgroup resource ora.FRA.dg is established
2021-03-02T03:59:23.038061-05:00
.... (PID:23730): Redo network throttle feature is disabled at mount time
2021-03-02T03:59:23.106351-05:00
Successful mount of redo thread 1, with mount id 2182720275
2021-03-02T03:59:23.110361-05:00
Database mounted in Exclusive Mode
Lost write protection disabled
.... (PID:23730): Using STANDBY_ARCHIVE_DEST parameter default value as USE_DB_RECOVERY_FILE_DEST [krsd.c:18158]
Completed: ALTER DATABASE MOUNT /* db agent *//* {0:0:344} */
ALTER DATABASE OPEN /* db agent *//* {0:0:344} */
Ping without log force is disabled:
instance mounted in exclusive mode.
2021-03-02T03:59:23.492696-05:00
Crash Recovery excluding pdb 2 which was cleanly closed.
2021-03-02T03:59:23.492802-05:00
Crash Recovery excluding pdb 3 which was cleanly closed.
Endian type of dictionary set to little
2021-03-02T03:59:23.544072-05:00
TT00 (PID:23752): Gap Manager starting
2021-03-02T03:59:23.550639-05:00
TMON (PID:23728): STARTING ARCH PROCESSES
Starting background process ARC0
2021-03-02T03:59:23.556960-05:00
ARC0 started with pid=47, OS id=23756
Starting background process ARC1
2021-03-02T03:59:23.563197-05:00
ARC1 started with pid=48, OS id=23758
Starting background process ARC2
2021-03-02T03:59:23.569188-05:00
ARC2 started with pid=49, OS id=23760
Starting background process ARC3
2021-03-02T03:59:23.575332-05:00
ARC3 started with pid=50, OS id=23762
TMON (PID:23728): ARC0: Archival started
TMON (PID:23728): ARC1: Archival started
TMON (PID:23728): ARC2: Archival started
2021-03-02T03:59:23.575594-05:00
ARC0 (PID:23756): Becoming a 'no FAL' ARCH
ARC0 (PID:23756): Becoming the 'no SRL' ARCH
2021-03-02T03:59:23.585630-05:00
TMON (PID:23728): ARC3: Archival started
TMON (PID:23728): STARTING ARCH PROCESSES COMPLETE
2021-03-02T03:59:23.602466-05:00
Redo log for group 1, sequence 31 is not located on DAX storage
Thread 1 opened at log sequence 31
Current log# 1 seq# 31 mem# 0: +DATA/CDB/ONLINELOG/group_1.263.1054880121
Current log# 1 seq# 31 mem# 1: +FRA/CDB/ONLINELOG/group_1.259.1054880135
Successful open of redo thread 1
2021-03-02T03:59:23.614852-05:00
MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
Stopping change tracking
2021-03-02T03:59:25.738279-05:00
Undo initialization recovery: Parallel FPTR complete: start:4799362 end:4799377 diff:15 ms (0.0 seconds)
Undo initialization recovery: err:0 start: 4799352 end: 4799377 diff: 25 ms (0.0 seconds)
[23730] Successfully onlined Undo Tablespace 2.
Undo initialization online undo segments: err:0 start: 4799377 end: 4800236 diff: 859 ms (0.9 seconds)
Undo initialization finished serial:0 start:4799352 end:4800255 diff:903 ms (0.9 seconds)
Verifying minimum file header compatibility for tablespace encryption for pdb 1..
Verifying file header compatibility for tablespace encryption completed for pdb 1
Database Characterset is AL32UTF8
2021-03-02T03:59:27.079477-05:00
No Resource Manager plan active
2021-03-02T03:59:29.605186-05:00
joxcsys_required_dirobj_exists: directory object exists with required path /u01/app/oracle/product/19c/javavm/admin/, pid 23730 cid 1
replication_dependency_tracking turned off (no async multimaster replication found)
2021-03-02T03:59:31.399959-05:00
Starting background process AQPC
2021-03-02T03:59:31.406043-05:00
AQPC started with pid=54, OS id=23774
PDB$SEED(2):Autotune of undo retention is turned on.
2021-03-02T03:59:32.059670-05:00
PDB$SEED(2):Endian type of dictionary set to little
PDB$SEED(2):Undo initialization finished serial:0 start:4805960 end:4805960 diff:0 ms (0.0 seconds)
2021-03-02T03:59:32.541459-05:00
PDB$SEED(2):Database Characterset for PDB$SEED is AL32UTF8
2021-03-02T03:59:35.855992-05:00
PDB$SEED(2):Opening pdb with no Resource Manager plan active
2021-03-02T03:59:36.002336-05:00
QPI: opatch file present, opatch
QPI: qopiprep.bat file present
2021-03-02T03:59:37.330985-05:00
Starting background process CJQ0
2021-03-02T03:59:37.341372-05:00
CJQ0 started with pid=65, OS id=23798
Completed: ALTER DATABASE OPEN /* db agent *//* {0:0:344} */
2021-03-02T03:59:40.263766-05:00
alter pluggable database "PDB$SEED" close immediate force instances=('CDB')
2021-03-02T03:59:40.296724-05:00
PDB$SEED(2):JIT: pid 24232 requesting stop
PDB$SEED(2):Buffer Cache flush started: 2
PDB$SEED(2):Buffer Cache flush finished: 2
Pluggable database PDB$SEED closed
2021-03-02T03:59:41.609292-05:00
===========================================================
Dumping current patch information
===========================================================
Patch Id: 32218454
Patch Description: Database Release Update : 19.10.0.0.210119 (32218454)
Patch Apply Time: 2021-03-02T03:56:47-05:00
Bugs Fixed: 7391838,8460502,8476681,14735102,16664572,17428816,17468475,
19080742,19138896,19697993,20313356,20867658,21232786,21374587,21528318,
21629064,21639146,21888352,21965541,22580355,22729345,22748979,23294761,
23296836,23606241,23645975,23734075,23763462,24596874,24669730,24687075,
24833686,24957575,24971456,25030027,25092651,25093917,25404117,25416731,
25560538,25607406,25756945,25792962,25804387,25806201,25809128,25883179,
25905368,25986062,25997810,26001677,26127355,26173091,26284288,26352615,
26440142,26476244,26499997,26611353,26668264,26739322,26777814,26819036,
26872233,27004828,27036163,27044169,27101798,27126122,27126938,27130348,
...
...
32101305,32113113,32118727,32121326,32129659,32130083,32130504,32150818,
32169151,32172777,32174571,32207088,32212635,32221141,32234161,32290399,
32296941,32321765
Patch Id: 32222571
Patch Description: OCW Interim patch for 32222571
Patch Apply Time: 2021-03-02T03:58:54-05:00
Bugs Fixed: 3,17787434,25736599,26305045,26675491,26813848,27092095,27148384,
27222128,27262781,27505699,27526265,27572040,27604329,27663388,27760043,
27877830,27935374,28302439,28302580,28319989,28336118,28344129,28406406,
...
...
29154631,29154636,29154829,29159216,29159661,29160462,29161923,29169540,
29169739,29170717,29173618,29178563,29181568,29182920,29183298,29186091,
29191827,29201143,29201695,29202442,29203691,29209545,29209972,29210577,
29210610,29210624,29210683,29213641,29214935,29218185,29219627,29224294,
2021-03-02T03:59:41.630143-05:00
Completed: alter pluggable database "PDB$SEED" close immediate force instances=('CDB')
29225861,29229839,29231008,29235934,29242906,29243749,29244495,29244766,
29244968,29248723,29249583,29251564,29254863,29255616,29256021,29257308,
29260224,29261171,29261695,29266584,29268887,29271019,29273360,29273690,
29274911,29275362,29276220,29280752,29282090,29282666,29283505,29285453,
29285621,29288842,29289634,29290235,29292232,29293806,29293928,29294753,
29299830,29307090,29307109,29311336,29311884,29318127,29321965,29326865,
29329675,29330791,29338139,29339299,29340414,29342966,29347106,29351297,
29351881,29357821,29359713,29360467,29360775,29367971,29368725,29372221,
...
...
31742512,31748711,31751387,31752814,31752990,31753874,31756012,31765043,
31772216,31775359,31775363,31777242,31778138,31779513,31794046,31795055,
31825446,31825584,31835699,31837685,31837842,31837923,31839233,31848063,
31849609,31856488,31857840,31864173,31887422,31900921,31901236,31935022,
31943944,31987354,31992593,32069815,32137544,32178524
===========================================================
2021-03-02T03:59:42.378872-05:00
alter pluggable database "PDB$SEED" open READ WRITE services=NONE
PDB$SEED(2):Autotune of undo retention is turned on.
2021-03-02T03:59:42.814536-05:00
PDB$SEED(2):Endian type of dictionary set to little
PDB$SEED(2):Undo initialization recovery: Parallel FPTR complete: start:4816793 end:4816828 diff:35 ms (0.0 seconds)
PDB$SEED(2):Undo initialization recovery: err:0 start: 4816786 end: 4816828 diff: 42 ms (0.0 seconds)
2021-03-02T03:59:43.914061-05:00
PDB$SEED(2):[24261] Successfully onlined Undo Tablespace 2.
PDB$SEED(2):Undo initialization online undo segments: err:0 start: 4816828 end: 4817555 diff: 727 ms (0.7 seconds)
PDB$SEED(2):Undo initialization finished serial:0 start:4816786 end:4817583 diff:797 ms (0.8 seconds)
PDB$SEED(2):Database Characterset for PDB$SEED is AL32UTF8
2021-03-02T03:59:46.987155-05:00
PDB$SEED(2):Opening pdb with no Resource Manager plan active
PDB$SEED(2):joxcsys_required_dirobj_exists: directory object exists with required path /u01/app/oracle/product/19c/javavm/admin/, pid 24261 cid 2
2021-03-02T03:59:48.307188-05:00
Pluggable database PDB$SEED opened read write
Completed: alter pluggable database "PDB$SEED" open READ WRITE services=NONE
2021-03-02T03:59:52.433649-05:00
QPI: opatch file present, opatch
QPI: qopiprep.bat file present
2021-03-02T04:00:05.639682-05:00
XDB installed.
XDB initialized.
2021-03-02T04:00:07.105682-05:00
Resize operation completed for file# 201, old size 50176K, new size 51200K
Resize operation completed for file# 201, old size 51200K, new size 52224K
Resize operation completed for file# 201, old size 52224K, new size 53248K
Resize operation completed for file# 201, old size 53248K, new size 54272K
Resize operation completed for file# 201, old size 54272K, new size 55296K
Resize operation completed for file# 1, old size 993280K, new size 1003520K
2021-03-02T04:00:08.485323-05:00
Resize operation completed for file# 1, old size 1003520K, new size 1013760K
Resize operation completed for file# 1, old size 1013760K, new size 1024000K
2021-03-02T04:00:09.532655-05:00
PL/SQL package SYS.DBMS_BACKUP_RESTORE version is not current
2021-03-02T04:00:10.502747-05:00
Resize operation completed for file# 1, old size 1024000K, new size 1034240K
2021-03-02T04:00:11.217719-05:00
PL/SQL package SYS.DBMS_RCVMAN version 19.09.00.00 is too old
2021-03-02T04:00:12.035839-05:00
Resize operation completed for file# 201, old size 55296K, new size 56320K
2021-03-02T04:00:12.736045-05:00
Resize operation completed for file# 201, old size 56320K, new size 57344K
2021-03-02T04:00:12.748278-05:00
Resize operation completed for file# 1, old size 1034240K, new size 1044480K
2021-03-02T04:00:12.808727-05:00
db_recovery_file_dest_size of 12732 MB is 31.47% used. This is a
user-specified limit on the amount of space that will be used by this
database for recovery-related files, and does not reflect the amount of
space available in the underlying filesystem or ASM diskgroup.
2021-03-02T04:00:13.227171-05:00
Resize operation completed for file# 201, old size 57344K, new size 58368K
2021-03-02T04:00:14.201895-05:00
Resize operation completed for file# 1, old size 1044480K, new size 1054720K
2021-03-02T04:00:18.896878-05:00
PDB$SEED(2):
PDB$SEED(2):XDB installed.
PDB$SEED(2):
PDB$SEED(2):XDB initialized.
2021-03-02T04:00:21.152316-05:00
PDB$SEED(2):Resize operation completed for file# 202, old size 50176K, new size 51200K
PDB$SEED(2):Resize operation completed for file# 202, old size 51200K, new size 52224K
PDB$SEED(2):Resize operation completed for file# 202, old size 52224K, new size 53248K
PDB$SEED(2):Resize operation completed for file# 202, old size 53248K, new size 54272K
PDB$SEED(2):Resize operation completed for file# 202, old size 54272K, new size 55296K
PDB$SEED(2):Resize operation completed for file# 5, old size 317440K, new size 327680K
2021-03-02T04:00:22.410727-05:00
PDB$SEED(2):Resize operation completed for file# 5, old size 327680K, new size 337920K
PDB$SEED(2):Resize operation completed for file# 5, old size 337920K, new size 348160K
2021-03-02T04:00:23.650667-05:00
PDB$SEED(2):Resize operation completed for file# 5, old size 348160K, new size 358400K
PDB$SEED(2):Resize operation completed for file# 5, old size 358400K, new size 368640K
PDB$SEED(2):Resize operation completed for file# 5, old size 368640K, new size 378880K
2021-03-02T04:00:25.342960-05:00
Thread 1 cannot allocate new log, sequence 32
Private strand flush not complete
Current log# 1 seq# 31 mem# 0: +DATA/CDB/ONLINELOG/group_1.263.1054880121
Current log# 1 seq# 31 mem# 1: +FRA/CDB/ONLINELOG/group_1.259.1054880135
2021-03-02T04:00:28.436170-05:00
Thread 1 advanced to log sequence 32 (LGWR switch), current SCN: 4202114
Current log# 2 seq# 32 mem# 0: +DATA/CDB/ONLINELOG/group_2.262.1054880121
Current log# 2 seq# 32 mem# 1: +FRA/CDB/ONLINELOG/group_2.257.1054880135
2021-03-02T04:00:28.659253-05:00
ALTER SESSION DISABLE LOGICAL REPLICATION invoked from session 18.14773 at SCN 0x00007ffc9404b880
XDB initialized.
2021-03-02T04:00:31.380727-05:00
ARC1 (PID:23758): Archived Log entry 21 added for T-1.S-31 ID 0x816e34f6 LAD:1
2021-03-02T04:02:42.376084-05:00
ALTER SESSION ENABLE LOGICAL REPLICATION invoked from session 18.14773 at SCN 0x00007ffc9404b88c
SERVER ACTION=RU_APPLY id=: Patch applied from 19.9.0.0.0 to 19.10.0.0.0: Release_Update - 210108185017 Container=CDB$ROOT Id=1
2021-03-02T04:02:53.378228-05:00
TABLE SYS.WRI$_OPTSTAT_HISTHEAD_HISTORY: ADDED INTERVAL PARTITION SYS_P353 (44256) VALUES LESS THAN (TO_DATE(' 2021-03-03 00:00:00', 'SYYYY-MM-DD HH24:MI:SS', 'NLS_CALENDAR=GREGORIAN'))
TABLE SYS.WRI$_OPTSTAT_HISTGRM_HISTORY: ADDED INTERVAL PARTITION SYS_P356 (44256) VALUES LESS THAN (TO_DATE(' 2021-03-03 00:00:00', 'SYYYY-MM-DD HH24:MI:SS', 'NLS_CALENDAR=GREGORIAN'))
2021-03-02T04:03:17.214029-05:00
PDB$SEED(2):TABLE AUDSYS.AUD$UNIFIED: ADDED INTERVAL PARTITION SYS_P248 (81) VALUES LESS THAN (TIMESTAMP' 2021-04-01 00:00:00')
2021-03-02T04:03:18.826819-05:00
PDB$SEED(2):ALTER SESSION DISABLE LOGICAL REPLICATION invoked from session 18.14773 at SCN 0x00007ffc9404b880
PDB$SEED(2):
PDB$SEED(2):XDB initialized.
2021-03-02T04:03:23.114903-05:00
TABLE SYS.WRP$_REPORTS: ADDED INTERVAL PARTITION SYS_P357 (4079) VALUES LESS THAN (TO_DATE(' 2021-03-03 01:00:00', 'SYYYY-MM-DD HH24:MI:SS', 'NLS_CALENDAR=GREGORIAN'))
TABLE SYS.WRP$_REPORTS_DETAILS: ADDED INTERVAL PARTITION SYS_P358 (4079) VALUES LESS THAN (TO_DATE(' 2021-03-03 01:00:00', 'SYYYY-MM-DD HH24:MI:SS', 'NLS_CALENDAR=GREGORIAN'))
TABLE SYS.WRP$_REPORTS_TIME_BANDS: ADDED INTERVAL PARTITION SYS_P361 (4078) VALUES LESS THAN (TO_DATE(' 2021-03-02 01:00:00', 'SYYYY-MM-DD HH24:MI:SS', 'NLS_CALENDAR=GREGORIAN'))
2021-03-02T04:04:37.763092-05:00
PDB$SEED(2):Resize operation completed for file# 6, old size 389120K, new size 399360K
2021-03-02T04:04:38.252197-05:00
PDB$SEED(2):Resize operation completed for file# 6, old size 399360K, new size 409600K
2021-03-02T04:04:54.162608-05:00
Thread 1 advanced to log sequence 33 (LGWR switch), current SCN: 4268486
Current log# 3 seq# 33 mem# 0: +DATA/CDB/ONLINELOG/group_3.264.1054880121
Current log# 3 seq# 33 mem# 1: +FRA/CDB/ONLINELOG/group_3.258.1054880135
2021-03-02T04:04:56.697903-05:00
ARC2 (PID:23760): Archived Log entry 22 added for T-1.S-32 ID 0x816e34f6 LAD:1
2021-03-02T04:04:57.218593-05:00
PDB$SEED(2):ALTER SESSION ENABLE LOGICAL REPLICATION invoked from session 18.14773 at SCN 0x00007ffc9404b88c
PDB$SEED(2):SERVER ACTION=RU_APPLY id=: Patch applied from 19.9.0.0.0 to 19.10.0.0.0: Release_Update - 210108185017 Container=PDB$SEED Id=2
2021-03-02T04:05:04.249820-05:00
PDB$SEED(2):TABLE SYS.WRI$_OPTSTAT_HISTHEAD_HISTORY: ADDED INTERVAL PARTITION SYS_P268 (44256) VALUES LESS THAN (TO_DATE(' 2021-03-03 00:00:00', 'SYYYY-MM-DD HH24:MI:SS', 'NLS_CALENDAR=GREGORIAN'))
PDB$SEED(2):TABLE SYS.WRI$_OPTSTAT_HISTGRM_HISTORY: ADDED INTERVAL PARTITION SYS_P271 (44256) VALUES LESS THAN (TO_DATE(' 2021-03-03 00:00:00', 'SYYYY-MM-DD HH24:MI:SS', 'NLS_CALENDAR=GREGORIAN'))
2021-03-02T04:05:04.809327-05:00
PDB$SEED(2):Resize operation completed for file# 202, old size 55296K, new size 56320K
2021-03-02T04:05:43.603419-05:00
alter pluggable database "PDB$SEED" close immediate force instances=('CDB')
2021-03-02T04:05:43.801142-05:00
PDB$SEED(2):JIT: pid 24863 requesting stop
PDB$SEED(2):Closing sequence subsystem (5177673387).
PDB$SEED(2):Buffer Cache flush started: 2
2021-03-02T04:05:45.988537-05:00
PDB$SEED(2):Buffer Cache flush finished: 2
Pluggable database PDB$SEED closed
Completed: alter pluggable database "PDB$SEED" close immediate force instances=('CDB')
2021-03-02T04:05:46.329905-05:00
alter pluggable database "PDB$SEED" open READ ONLY instances=('CDB')
PDB$SEED(2):Autotune of undo retention is turned on.
PDB$SEED(2):Endian type of dictionary set to little
PDB$SEED(2):Undo initialization finished serial:0 start:5180917 end:5180917 diff:0 ms (0.0 seconds)
2021-03-02T04:05:47.367938-05:00
PDB$SEED(2):Database Characterset for PDB$SEED is AL32UTF8
2021-03-02T04:05:50.495150-05:00
PDB$SEED(2):Opening pdb with no Resource Manager plan active
Pluggable database PDB$SEED opened read only
Completed: alter pluggable database "PDB$SEED" open READ ONLY instances=('CDB')
...
...
Run some dictionary scripts (datapatch -verbose)
The final step is to run the datapatch utility against all other PDB’s which were not patched automatically.
[oracle@ocm199 ~]$ sq
SQL*Plus: Release 19.0.0.0.0 - Production on Tue Mar 2 04:10:01 2021
Version 19.10.0.0.0
Copyright (c) 1982, 2020, Oracle. All rights reserved.
Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.10.0.0.0
SQL> show pdbs
CON_ID CON_NAME OPEN MODE RESTRICTED
---------- ------------------------------ ---------- ----------
2 PDB$SEED READ ONLY NO
3 PDB01 MOUNTED
SQL>
SQL> alter pluggable database all open;
Warning: PDB altered with errors.
SQL>
[oracle@ocm199 OPatch]$ ./datapatch -verbose
SQL Patching tool version 19.10.0.0.0 Production on Tue Mar 2 04:11:29 2021
Copyright (c) 2012, 2020, Oracle. All rights reserved.
Log file for this invocation: /u01/app/oracle/cfgtoollogs/sqlpatch/sqlpatch_25085_2021_03_02_04_11_29/sqlpatch_invocation.log
Connecting to database...OK
Gathering database info...done
Note: Datapatch will only apply or rollback SQL fixes for PDBs
that are in an open state, no patches will be applied to closed PDBs.
Please refer to Note: Datapatch: Database 12c Post Patch SQL Automation
(Doc ID 1585822.1)
Bootstrapping registry and package to current versions...done
Determining current state...done
Current state of interim SQL patches:
No interim patches found
Current state of release update SQL patches:
Binary registry:
19.10.0.0.0 Release_Update 210108185017: Installed
PDB CDB$ROOT:
Applied 19.10.0.0.0 Release_Update 210108185017 successfully on 02-MAR-21 04.05.43.096925 AM
PDB PDB$SEED:
Applied 19.10.0.0.0 Release_Update 210108185017 successfully on 02-MAR-21 04.05.43.534134 AM
PDB PDB01:
Applied 19.9.0.0.0 Release_Update 200930183249 successfully on 27-OCT-20 06.35.34.562450 AM
Adding patches to installation queue and performing prereq checks...done
Installation queue:
For the following PDBs: CDB$ROOT PDB$SEED
No interim patches need to be rolled back
No release update patches need to be installed
No interim patches need to be applied
For the following PDBs: PDB01
No interim patches need to be rolled back
Patch 32218454 (Database Release Update : 19.10.0.0.210119 (32218454)):
Apply from 19.9.0.0.0 Release_Update 200930183249 to 19.10.0.0.0 Release_Update 210108185017
No interim patches need to be applied
Installing patches...
Patch installation complete. Total patches installed: 1
Validating logfiles...done
Patch 32218454 apply (pdb PDB01): SUCCESS
logfile: /u01/app/oracle/cfgtoollogs/sqlpatch/32218454/24018797/32218454_apply_CDB_PDB01_2021Mar02_04_11_59.log (no errors)
SQL Patching tool complete on Tue Mar 2 04:14:09 2021
[oracle@ocm199 OPatch]$
[oracle@ocm199 OPatch]$ sq
SQL*Plus: Release 19.0.0.0.0 - Production on Tue Mar 2 04:24:06 2021
Version 19.10.0.0.0
Copyright (c) 1982, 2020, Oracle. All rights reserved.
Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.10.0.0.0
SQL> show pdbs
CON_ID CON_NAME OPEN MODE RESTRICTED
---------- ------------------------------ ---------- ----------
2 PDB$SEED READ ONLY NO
3 PDB01 READ WRITE YES
The upgrade process has finish and everything is up and running again. As a last step, we can check the patchlevel in each home.
[oracle@ocm199 ~]$ . GRID
[oracle@ocm199 ~]$
[oracle@ocm199 ~]$ opatch lsinv
Oracle Interim Patch Installer version 12.2.0.1.24
Copyright (c) 2021, Oracle Corporation. All rights reserved.
Oracle Home : /u01/grid/19c
Central Inventory : /u01/app/oraInventory
from : /u01/grid/19c/oraInst.loc
OPatch version : 12.2.0.1.24
OUI version : 12.2.0.7.0
Log file location : /u01/grid/19c/cfgtoollogs/opatch/opatch2021-03-02_09-14-11AM_1.log
Lsinventory Output file location : /u01/grid/19c/cfgtoollogs/opatch/lsinv/lsinventory2021-03-02_09-14-11AM.txt
--------------------------------------------------------------------------------
Local Machine Information::
Hostname: ocm199
ARU platform id: 226
ARU platform description:: Linux x86-64
Installed Top-level Products (1):
Oracle Grid Infrastructure 19c 19.0.0.0.0
There are 1 products installed in this Oracle Home.
Interim patches (5) :
Patch 32240590 : applied on Tue Mar 02 03:42:23 EST 2021
Unique Patch ID: 23955141
Patch description: "TOMCAT RELEASE UPDATE 19.0.0.0.0 (32240590)"
Created on 7 Jan 2021, 22:55:01 hrs PST8PDT
Bugs fixed:
30729044, 30009095, 29286300, 31657943, 32107716, 30997459
Patch 32222571 : applied on Tue Mar 02 03:41:20 EST 2021
Unique Patch ID: 24017129
Patch description: "OCW Interim patch for 32222571"
Created on 15 Jan 2021, 01:49:46 hrs PST8PDT
Bugs fixed:
17787434, 25736599, 26305045, 26675491, 26813848, 27092095, 27148384
27222128, 27262781, 27505699, 27526265, 27572040, 27604329, 27663388
27760043, 27877830, 27935374, 28302439, 28302580, 28319989, 28336118
28344129, 28406406, 28441307, 28462255, 28470673, 28554809, 28567875
28621543, 28628631, 28642469, 28677941, 28697242, 28697896, 28699321
28704073, 28710663, 28723237, 28747089, 28755846, 28762163, 28772816
28785321, 28790623, 28800508, 28805158, 28805475, 28808652, 28814106
28815557, 28834364, 28834743, 28847541, 28847572, 28847655, 28852065
28865162, 28870111, 28870496, 28871040, 28874416, 28874529, 28874678
28877252, 28881191, 28881848, 28887675, 28887933, 28888083, 28892095
...
...
Patch 32218663 : applied on Tue Mar 02 03:40:02 EST 2021
Unique Patch ID: 23983106
Patch description: "ACFS RELEASE UPDATE 19.10.0.0.0 (32218663)"
Created on 22 Dec 2020, 12:20:04 hrs PST8PDT
Bugs fixed:
27494830, 27917085, 28064731, 28293236, 28321248, 28375150, 28531803
28553487, 28611527, 28649123, 28687713, 28701011, 28740425, 28818513
28825772, 28837603, 28844788, 28855761, 28860451, 28900212, 28951588
28960047, 28961428, 28995524, 29001307, 29020252, 29030106, 29031452
29039918, 29115917, 29116692, 29127489, 29127491, 29167352, 29173957
29198743, 29229120, 29234059, 29250565, 29264772, 29302070, 29313039
...
...
Patch 32218454 : applied on Tue Mar 02 03:37:10 EST 2021
Unique Patch ID: 24018797
Patch description: "Database Release Update : 19.10.0.0.210119 (32218454)"
Created on 14 Jan 2021, 16:24:38 hrs UTC
Bugs fixed:
31625618, 32321765, 7391838, 8460502, 8476681, 14735102, 16664572
17428816, 17468475, 19080742, 19138896, 19697993, 20313356, 20867658
21232786, 21374587, 21528318, 21629064, 21639146, 21888352, 21965541
22580355, 22729345, 22748979, 23294761, 23296836, 23606241, 23645975
23734075, 23763462, 24596874, 24669730, 24687075, 24833686, 24957575
24971456, 25030027, 25092651, 25093917, 25404117, 25416731, 25560538
25607406, 25756945, 25792962, 25804387, 25806201, 25809128, 25883179
25905368, 25986062, 25997810, 26001677, 26127355, 26173091, 26284288
26352615, 26440142, 26476244, 26499997, 26611353, 26668264, 26739322
26777814, 26819036, 26872233, 27004828, 27036163, 27044169, 27101798
27126122, 27126938, 27130348, 27166935, 27195575, 27195935, 27221350
27244999, 27254335, 27260704, 27261477, 27359766, 27362994, 27369515
27378053, 27392968, 27406105, 27411022, 27423500, 27439716, 27453490
27458357, 27489107, 27582210, 27589260, 27622946, 27629928, 27661222
27666312, 27684864, 27692173, 27700413, 27710072, 27729678, 27742354
27745728, 27801144, 27828892, 27829722, 27846298, 27873364, 27880025
27929509, 27934711, 27935464, 27941110, 27957203, 27967484, 27998559
28007516, 28064977, 28072567, 28078186, 28092783, 28104176, 28109326
28125947, 28127569, 28129791, 28133903, 28138847, 28144569, 28145995
28181021, 28187837, 28189466, 28204262, 28205555, 28209985, 28210681
28263142, 28271258, 28271693, 28276054, 28279456, 28294563, 28313275
28319114, 28322973, 28326928, 28338211, 28350595, 28370061, 28371123
28373960, 28375383, 28379065, 28381939, 28386259, 28390273, 28395302
28397317, 28402823, 28403019, 28406374, 28410431, 28431445, 28435333
28436414, 28442896, 28454215, 28463226, 28475242, 28482048, 28484299
28489419, 28492006, 28498976, 28502773, 28504631, 28513333, 28521330
28530171, 28534475, 28535127, 28537481, 28538439, 28541606, 28542455
28546290, 28547068, 28547926, 28558645, 28561704, 28564479, 28565296
...
...
Patch 29340594 : applied on Tue Mar 02 03:35:19 EST 2021
Unique Patch ID: 24005319
Patch description: "DBWLM RELEASE UPDATE 19.0.0.0.0 (29340594)"
Created on 8 Jan 2021, 01:44:40 hrs PST8PDT
Bugs fixed:
31862202, 31554751, 31547458
--------------------------------------------------------------------------------
OPatch succeeded.
[oracle@ocm199 ~]$
[oracle@ocm199 ~]$ . CDB
[oracle@ocm199 ~]$ opatch lsinv
Oracle Interim Patch Installer version 12.2.0.1.24
Copyright (c) 2021, Oracle Corporation. All rights reserved.
Oracle Home : /u01/app/oracle/product/19c
Central Inventory : /u01/app/oraInventory
from : /u01/app/oracle/product/19c/oraInst.loc
OPatch version : 12.2.0.1.24
OUI version : 12.2.0.7.0
Log file location : /u01/app/oracle/product/19c/cfgtoollogs/opatch/opatch2021-03-02_09-14-44AM_1.log
Lsinventory Output file location : /u01/app/oracle/product/19c/cfgtoollogs/opatch/lsinv/lsinventory2021-03-02_09-14-44AM.txt
--------------------------------------------------------------------------------
Local Machine Information::
Hostname: ocm199
ARU platform id: 226
ARU platform description:: Linux x86-64
Installed Top-level Products (1):
Oracle Database 19c 19.0.0.0.0
There are 1 products installed in this Oracle Home.
Interim patches (2) :
Patch 32222571 : applied on Tue Mar 02 03:58:54 EST 2021
Unique Patch ID: 24017129
Patch description: "OCW Interim patch for 32222571"
Created on 15 Jan 2021, 01:49:46 hrs PST8PDT
Bugs fixed:
17787434, 25736599, 26305045, 26675491, 26813848, 27092095, 27148384
27222128, 27262781, 27505699, 27526265, 27572040, 27604329, 27663388
27760043, 27877830, 27935374, 28302439, 28302580, 28319989, 28336118
28344129, 28406406, 28441307, 28462255, 28470673, 28554809, 28567875
28621543, 28628631, 28642469, 28677941, 28697242, 28697896, 28699321
28704073, 28710663, 28723237, 28747089, 28755846, 28762163, 28772816
28785321, 28790623, 28800508, 28805158, 28805475, 28808652, 28814106
28815557, 28834364, 28834743, 28847541, 28847572, 28847655, 28852065
28865162, 28870111, 28870496, 28871040, 28874416, 28874529, 28874678
28877252, 28881191, 28881848, 28887675, 28887933, 28888083, 28892095
28897229, 28911140, 28912188, 28917537, 28925250, 28925460, 28935956
28940472, 28942694, 28951332, 28958624, 28961306, 28963036, 28968779
28973989, 28979734, 28980448, 28984430, 28987100, 28993689, 28995287
29003207, 29003617, 29016294, 29018680, 29024876, 29026154, 29027933
29030056, 29040641, 29047127, 29050804, 29051269, 29052850, 29053083
29058476, 29062169, 29111631, 29112455, 29112898, 29117337, 29117435
29118754, 29123444, 29125708, 29125786, 29129476, 29130169, 29130654
29131772, 29132456, 29139727, 29146157, 29147849, 29149170, 29152603
29152752, 29154631, 29154636, 29154829, 29159216, 29159661, 29160462
29161923, 29169540, 29169739, 29170717, 29173618, 29178563, 29181568
29182920, 29183298, 29186091, 29191827, 29201143, 29201695, 29202442
29203691, 29209545, 29209972, 29210577, 29210610, 29210624, 29210683
29213641, 29214935, 29218185, 29219627, 29224294, 29225861, 29229839
...
...
Patch 32218454 : applied on Tue Mar 02 03:56:47 EST 2021
Unique Patch ID: 24018797
Patch description: "Database Release Update : 19.10.0.0.210119 (32218454)"
Created on 14 Jan 2021, 16:24:38 hrs UTC
Bugs fixed:
31625618, 32321765, 7391838, 8460502, 8476681, 14735102, 16664572
17428816, 17468475, 19080742, 19138896, 19697993, 20313356, 20867658
21232786, 21374587, 21528318, 21629064, 21639146, 21888352, 21965541
22580355, 22729345, 22748979, 23294761, 23296836, 23606241, 23645975
23734075, 23763462, 24596874, 24669730, 24687075, 24833686, 24957575
24971456, 25030027, 25092651, 25093917, 25404117, 25416731, 25560538
25607406, 25756945, 25792962, 25804387, 25806201, 25809128, 25883179
25905368, 25986062, 25997810, 26001677, 26127355, 26173091, 26284288
26352615, 26440142, 26476244, 26499997, 26611353, 26668264, 26739322
26777814, 26819036, 26872233, 27004828, 27036163, 27044169, 27101798
27126122, 27126938, 27130348, 27166935, 27195575, 27195935, 27221350
27244999, 27254335, 27260704, 27261477, 27359766, 27362994, 27369515
27378053, 27392968, 27406105, 27411022, 27423500, 27439716, 27453490
27458357, 27489107, 27582210, 27589260, 27622946, 27629928, 27661222
27666312, 27684864, 27692173, 27700413, 27710072, 27729678, 27742354
...
...
--------------------------------------------------------------------------------
OPatch succeeded.
Ready. 🙂
Conclusion
Upgrading Oracle Restart from 19.9 to 19.10 runs quite smoothly. The most difficult thing might be to organize the downtime. 🙂