The quarterly PSU and any one-off patches are installed with the opatch utility for your management servers.  If your environment consists of a single OMS, executing opatchauto apply will execute all of the tasks required to install the patch on the management server and provide you with SQL to update the repository database.  When you have more than one server, that same command runs an analysis of your environment and generates detailed sequential instructions you must run at the command line.  I’ll share the results of applying the database plugin update to my OMS’s below.  PSU’s follow exactly the same pattern.

First stage is the analysis:

[Jul 15, 2014 7:44:52 AM] Collect Patch Data: In Progress...
[Jul 15, 2014 7:44:53 AM] Collect Patch Data: Completed.
[Jul 15, 2014 7:44:53 AM] Collect Target Data: In Progress...
[Jul 15, 2014 7:44:53 AM] Collect Target Data: Completed.
[Jul 15, 2014 7:44:53 AM] --------------------------------------------------------------------------------------------------------------------------------------------

EM is configured with local OMS instance along with 2 remote OMS instance(s), it is a Multi-OMS environment, and no HA configuration;

The configuration shows only targets and servers that run OMS instance(s).
Local OMS information
Listen address : oramgmt01.demo.edu
Listen port : 7202
Managed server : EMGC_OMS1
Deployed applications : OCMRepeater
emgc
DMS Application
empbs
wsil-wls
wsm-pm

Remote OMS information
Remote OMS 1
Listen address : oramgmt02.demo.edu
Listen port : 7202
Managed server : EMGC_OMS2
Deployed applications : OCMRepeater
emgc
DMS Application
empbs
wsil-wls
wsm-pm
Remote OMS 2
Listen address : oramgmt03.demo.edu
Listen port : 7202
Managed server : EMGC_OMS3
Deployed applications : OCMRepeater
emgc
DMS Application
empbs
wsil-wls
wsm-pm

Repository details
Connect descriptor : (DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=em03p-scan)(PORT=1521)))(LOAD_BALANCE=ON)(CONNECT_DATA=(SERVICE_NAME=suzy)))


Core OMS Oracle Home
/orabase/Middleware/oms
List of plugin Oracle Homes
oracle_sysman_xa1 : /orabase/Middleware/plugins/oracle.sysman.xa.oms.plugin_12.1.0.4.0
oracle_sysman_mos1 : /orabase/Middleware/plugins/oracle.sysman.mos.oms.plugin_12.1.0.5.0
netapp_storage_sys1 : /orabase/Middleware/plugins/netapp.storage.sys.oms.plugin_12.1.0.1.0
OraHome11 : /orabase/Middleware/plugins/oracle.sysman.emas.oms.plugin_12.1.0.5.0
OraHome12 : /orabase/Middleware/plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0
OraHome1 : /orabase/Middleware/plugins/bm.vmware.vsph.oms.plugin_12.1.0.8.0
--------------------------------------------------------------------------------------------------------------------------------------------
[Jul 15, 2014 7:44:53 AM] Validate Configuration: In Progress...
[Jul 15, 2014 7:44:53 AM] Checking the status of weblogic admin server for OMS instance domain...
[Jul 15, 2014 7:44:54 AM] State of the weblogic admin server "EMGC_ADMINSERVER" for OMS instance domain is : RUNNING
[Jul 15, 2014 7:44:54 AM] GCDomain AdminServer status check: [PASSED]
[Jul 15, 2014 7:44:54 AM] Checking the status of OMS repository...
[Jul 15, 2014 7:44:54 AM] Status of the OMS repository is : UP
[Jul 15, 2014 7:44:54 AM] OMS repository status check: [PASSED]
[Jul 15, 2014 7:44:54 AM] Checking whether software library is configured....
[Jul 15, 2014 7:44:54 AM] Software library is correctly configured.
[Jul 15, 2014 7:44:54 AM] Checking whether software library is configured....Software library configuration check: [PASSED]
[Jul 15, 2014 7:44:54 AM] Validate Configuration: Completed.
[Jul 15, 2014 7:44:54 AM] Running apply prerequisite checks for patch(es) "18649366" and Oracle Home "/orabase/Middleware/plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0"...
[Jul 15, 2014 7:44:58 AM] Patches "18649366" are successfully analyzed for Oracle Home "/orabase/Middleware/plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0"
[Jul 15, 2014 7:44:58 AM] System patch location: /oramedia/cloud_control/12103_patches/18649366
(Oracle home:sub-patches list to be applied)
/orabase/Middleware/plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0: 18649366
[Jul 15, 2014 7:44:59 AM] Copying all logs to: /orabase/Middleware/oms/cfgtoollogs/opatch/2014-07-15_07-43-36AM_SystemPatch_18649366_1
[Jul 15, 2014 7:44:59 AM] opatchauto has successfully completed all prerequisite checks in 'analyze' mode. For steps to be executed in non-analyze mode, Please refer the below generated HTML (or) text files for details.
[Jul 15, 2014 7:45:00 AM] HTML output: /orabase/Middleware/oms/cfgtoollogs/opatch/2014-07-15_07-43-36AM_SystemPatch_18649366_1/html_output/execution.html
[Jul 15, 2014 7:45:00 AM] Text file output: /orabase/Middleware/oms/cfgtoollogs/opatch/2014-07-15_07-43-36AM_SystemPatch_18649366_1/text_output/execution.txt

Open the execution.html in a browser and open terminal windows for each of your OMS servers. The instructions, as you can, are explicit about what to run and where to run it. Pay attention to the OMS state as you go. The OMS’s must be down for one part and up for another.  

 

 

Installation Instructions for Application of Patch 18649366 on OMS System.

Generated at Tue, 15 Jul 2014 07:44:59 by oracle on host oramgmt01.demo.edu for apply operation using OPlan version 12.1.0.1.3.

There are 29 entities in OMS system.

Overview of the System

Important Note: The following diagrammatically represents the system configuration information collected by Oracle. Oracle recommends that you carefully examine this data and verify that it is complete and correct. If you see any discrepancies between the graphic and your actual system configuration, do not follow the instructions outlined in this document. Instead, follow the patch installation instructions provided in the patch README ..

There are 29 entities in OMS system.

 

Apply Patch In-Place using OPatch Command in Non-rolling Mode

  • Advantages: Shorter patching time; offers best diagnosability of issues during patching.
  • Disadvantages: Loss of service while patching; greater number of steps; slower recovery from failures
  • Total number of steps required: 27
    • During the full availability of services: 24
    • During the downtime of all services: 3

Important Note:

  • The steps generated below must be run using bash shell.

Summary: Steps for Manual Patch Apply

 

 

 

 

 

 

 

 

Detailed Manual Patch Apply Steps

 

Step 1: Patch Pre-Apply Phase (All services will be up)

Step 1.1: Download patch to host

Download patch to host

As the oracle user on the host oramgmt02.demo.edu run the following command:

[oracle@oramgmt02.demo.edu]$

NOTE: If your patch is in shared location for all the OMS instances, Please skip execution of this step.

mkdir -p /media/patches;scp -r oramgmt01.demo.edu:/media/patches/18649366 /media/patches/18649366

Step 1.2: Download patch to host

Download patch to host

As the oracle user on the host oramgmt03.demo.edu run the following command:

[oracle@oramgmt03.demo.edu]$

NOTE: If your patch is in shared location for all the OMS instances, Please skip execution of this step.

mkdir -p /media/patches;scp -r oramgmt01.demo.edu:/media/patches/18649366 /media/patches/18649366

Step 1.3: Patch-Prereqs-Title

Patch-Prereqs-Message

As the oracle user on the host oramgmt01.demo.edu run the following command:

[oracle@oramgmt01.demo.edu]$

/orabase/Middleware/oms/OPatch/opatchauto checkApplicable -ph /media/patches/18649366 -oh /orabase/Middleware/oms -invPtrLoc /orabase/Middleware/oms/oraInst.loc

Step 1.4: Patch-Prereqs-Title

Patch-Prereqs-Message

As the oracle user on the host oramgmt02.demo.edu run the following command:

[oracle@oramgmt02.demo.edu]$

/orabase/Middleware/oms/OPatch/opatchauto checkApplicable -ph /media/patches/18649366 -oh /orabase/Middleware/oms -invPtrLoc /orabase/Middleware/oms/oraInst.loc

Step 1.5: Patch-Prereqs-Title

Patch-Prereqs-Message

As the oracle user on the host oramgmt03.demo.edu run the following command:

[oracle@oramgmt03.demo.edu]$

/orabase/Middleware/oms/OPatch/opatchauto checkApplicable -ph /media/patches/18649366 -oh /orabase/Middleware/oms -invPtrLoc /orabase/Middleware/oms/oraInst.loc

Step 2: Patch Apply Phase (All services will be down)

Step 2.1: Patch Apply Phase on oramgmt01.demo.edu
Step 2.1.1: Apply patch to OracleHome

Apply patch to OracleHome

As the oracle user on the host oramgmt01.demo.edu run the following commands:

[oracle@oramgmt01.demo.edu]$

echo /media/patches/18649366/18649366 >> /orabase/Middleware/oms/.phBaseFile.txt

[oracle@oramgmt01.demo.edu]$

/orabase/Middleware/oms/OPatch/opatch napply -phBaseFile /orabase/Middleware/oms/.phBaseFile.txt -invPtrLoc /orabase/Middleware/oms/oraInst.loc -oh /orabase/Middleware/plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0

[oracle@oramgmt01.demo.edu]$

rm /orabase/Middleware/oms/.phBaseFile.txt

Step 2.2: Patch Apply Phase on oramgmt02.demo.edu
Step 2.2.1: Apply patch to OracleHome

Apply patch to OracleHome

As the oracle user on the host oramgmt02.demo.edu run the following commands:

[oracle@oramgmt02.demo.edu]$

echo /media/patches/18649366/18649366 >> /orabase/Middleware/oms/.phBaseFile.txt

[oracle@oramgmt02.demo.edu]$

/orabase/Middleware/oms/OPatch/opatch napply -phBaseFile /orabase/Middleware/oms/.phBaseFile.txt -invPtrLoc /orabase/Middleware/oms/oraInst.loc -oh /orabase/Middleware/plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0

[oracle@oramgmt02.demo.edu]$

rm /orabase/Middleware/oms/.phBaseFile.txt

Step 2.3: Patch Apply Phase on oramgmt03.demo.edu
Step 2.3.1: Apply patch to OracleHome

Apply patch to OracleHome

As the oracle user on the host oramgmt03.demo.edu run the following commands:

[oracle@oramgmt03.demo.edu]$

echo /media/patches/18649366/18649366 >> /orabase/Middleware/oms/.phBaseFile.txt

[oracle@oramgmt03.demo.edu]$

/orabase/Middleware/oms/OPatch/opatch napply -phBaseFile /orabase/Middleware/oms/.phBaseFile.txt -invPtrLoc /orabase/Middleware/oms/oraInst.loc -oh /orabase/Middleware/plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0

[oracle@oramgmt03.demo.edu]$

rm /orabase/Middleware/oms/.phBaseFile.txt

Step 3: Post Patch Apply Phase (All services will be up)

Step 3.1: Post Patch Apply Phase on oramgmt01.demo.edu
Step 3.1.1: Run emctl applypatch

Run emctl applypatch

As the oracle user on the host oramgmt01.demo.edu run the following command:

[oracle@oramgmt01.demo.edu]$

/orabase/Middleware/oms/bin/emctl applypatch repos -patchHome /orabase/Middleware/oms/../plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0/.patch_storage/18649366_May_14_2014_23_40_18/original_patch -pluginHome /orabase/Middleware/oms/../plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0

Step 3.1.2: Run emctl oms register procedures to update MRS

Run emctl oms register procedures to update MRS

As the oracle user on the host oramgmt01.demo.edu run the following command:

[oracle@oramgmt01.demo.edu]$

NOTE: Please replace %EM_REPOS_PASSWORD% with credential for OMS repository SYSMAN user.

/orabase/Middleware/oms/bin/emctl register oms metadata -service procedures -debug -file /orabase/Middleware/oms/../plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0/metadata/procedures/CreateDbService.xml -pluginId oracle.sysman.db -sysman_pwd %EM_REPOS_PASSWORD%

Step 3.1.3: Run emctl oms register procedures to update MRS

Run emctl oms register procedures to update MRS

As the oracle user on the host oramgmt01.demo.edu run the following command:

[oracle@oramgmt01.demo.edu]$

NOTE: Please replace %EM_REPOS_PASSWORD% with credential for OMS repository SYSMAN user.

/orabase/Middleware/oms/bin/emctl register oms metadata -service procedures -debug -file /orabase/Middleware/oms/../plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0/metadata/procedures/ExportData.xml -pluginId oracle.sysman.db -sysman_pwd %EM_REPOS_PASSWORD%

Step 3.1.4: Run emctl oms register procedures to update MRS

Run emctl oms register procedures to update MRS

As the oracle user on the host oramgmt01.demo.edu run the following command:

[oracle@oramgmt01.demo.edu]$

NOTE: Please replace %EM_REPOS_PASSWORD% with credential for OMS repository SYSMAN user.

/orabase/Middleware/oms/bin/emctl register oms metadata -service procedures -debug -file /orabase/Middleware/oms/../plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0/metadata/procedures/provsidb.xml -pluginId oracle.sysman.db -sysman_pwd %EM_REPOS_PASSWORD%

Step 3.1.5: Run emctl oms register procedures to update MRS

Run emctl oms register procedures to update MRS

As the oracle user on the host oramgmt01.demo.edu run the following command:

[oracle@oramgmt01.demo.edu]$

NOTE: Please replace %EM_REPOS_PASSWORD% with credential for OMS repository SYSMAN user.

/orabase/Middleware/oms/bin/emctl register oms metadata -service procedures -debug -file /orabase/Middleware/oms/../plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0/metadata/procedures/upgradegi.xml -pluginId oracle.sysman.db -sysman_pwd %EM_REPOS_PASSWORD%

Step 3.1.6: Run emctl oms register procedures to update MRS

Run emctl oms register procedures to update MRS

As the oracle user on the host oramgmt01.demo.edu run the following command:

[oracle@oramgmt01.demo.edu]$

NOTE: Please replace %EM_REPOS_PASSWORD% with credential for OMS repository SYSMAN user.

/orabase/Middleware/oms/bin/emctl register oms metadata -service procedures -debug -file /orabase/Middleware/oms/../plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0/metadata/procedures/provprereqs.xml -pluginId oracle.sysman.db -sysman_pwd %EM_REPOS_PASSWORD%

Step 3.1.7: Run emctl oms register procedures to update MRS

Run emctl oms register procedures to update MRS

As the oracle user on the host oramgmt01.demo.edu run the following command:

[oracle@oramgmt01.demo.edu]$

NOTE: Please replace %EM_REPOS_PASSWORD% with credential for OMS repository SYSMAN user.

/orabase/Middleware/oms/bin/emctl register oms metadata -service procedures -debug -file /orabase/Middleware/oms/../plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0/metadata/procedures/PatchSADB.xml -pluginId oracle.sysman.db -sysman_pwd %EM_REPOS_PASSWORD%

Step 3.1.8: Run emctl oms register procedures to update MRS

Run emctl oms register procedures to update MRS

As the oracle user on the host oramgmt01.demo.edu run the following command:

[oracle@oramgmt01.demo.edu]$

NOTE: Please replace %EM_REPOS_PASSWORD% with credential for OMS repository SYSMAN user.

/orabase/Middleware/oms/bin/emctl register oms metadata -service procedures -debug -file /orabase/Middleware/oms/../plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0/metadata/procedures/RMANRestore.xml -pluginId oracle.sysman.db -sysman_pwd %EM_REPOS_PASSWORD%

Step 3.1.9: Run emctl oms register procedures to update MRS

Run emctl oms register procedures to update MRS

As the oracle user on the host oramgmt01.demo.edu run the following command:

[oracle@oramgmt01.demo.edu]$

NOTE: Please replace %EM_REPOS_PASSWORD% with credential for OMS repository SYSMAN user.

/orabase/Middleware/oms/bin/emctl register oms metadata -service procedures -debug -file /orabase/Middleware/oms/../plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0/metadata/procedures/DBThinProv.xml -pluginId oracle.sysman.db -sysman_pwd %EM_REPOS_PASSWORD%

Step 3.1.10: Run emctl oms register procedures to update MRS

Run emctl oms register procedures to update MRS

As the oracle user on the host oramgmt01.demo.edu run the following command:

[oracle@oramgmt01.demo.edu]$

NOTE: Please replace %EM_REPOS_PASSWORD% with credential for OMS repository SYSMAN user.

/orabase/Middleware/oms/bin/emctl register oms metadata -service procedures -debug -file /orabase/Middleware/oms/../plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0/metadata/procedures/DNFSProvisioning.xml -pluginId oracle.sysman.db -sysman_pwd %EM_REPOS_PASSWORD%

Step 3.1.11: Run emctl oms register procedures to update MRS

Run emctl oms register procedures to update MRS

As the oracle user on the host oramgmt01.demo.edu run the following command:

[oracle@oramgmt01.demo.edu]$

NOTE: Please replace %EM_REPOS_PASSWORD% with credential for OMS repository SYSMAN user.

/orabase/Middleware/oms/bin/emctl register oms metadata -service procedures -debug -file /orabase/Middleware/oms/../plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0/metadata/procedures/downgradegi.xml -pluginId oracle.sysman.db -sysman_pwd %EM_REPOS_PASSWORD%

Step 3.1.12: Run emctl oms register procedures to update MRS

Run emctl oms register procedures to update MRS

As the oracle user on the host oramgmt01.demo.edu run the following command:

[oracle@oramgmt01.demo.edu]$

NOTE: Please replace %EM_REPOS_PASSWORD% with credential for OMS repository SYSMAN user.

/orabase/Middleware/oms/bin/emctl register oms metadata -service procedures -debug -file /orabase/Middleware/oms/../plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0/metadata/procedures/DbProvUpgradeDeploymentProcedure.xml -pluginId oracle.sysman.db -sysman_pwd %EM_REPOS_PASSWORD%

Step 3.1.13: Run emctl oms register procedures to update MRS

Run emctl oms register procedures to update MRS

As the oracle user on the host oramgmt01.demo.edu run the following command:

[oracle@oramgmt01.demo.edu]$

NOTE: Please replace %EM_REPOS_PASSWORD% with credential for OMS repository SYSMAN user.

/orabase/Middleware/oms/bin/emctl register oms metadata -service procedures -debug -file /orabase/Middleware/oms/../plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0/metadata/procedures/provrac.xml -pluginId oracle.sysman.db -sysman_pwd %EM_REPOS_PASSWORD%

Step 3.1.14: Run emctl oms register swlib to update MRS

Run emctl oms register swlib to update MRS

As the oracle user on the host oramgmt01.demo.edu run the following command:

[oracle@oramgmt01.demo.edu]$

NOTE: Please replace %EM_REPOS_PASSWORD% with credential for OMS repository SYSMAN user.

/orabase/Middleware/oms/bin/emctl register oms metadata -service swlib -debug -file /orabase/Middleware/oms/../plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0/metadata/swlib -pluginId oracle.sysman.db -sysman_pwd %EM_REPOS_PASSWORD%

Step 3.1.15: Run emctl oms register targetType to update MRS

Run emctl oms register targetType to update MRS

As the oracle user on the host oramgmt01.demo.edu run the following command:

[oracle@oramgmt01.demo.edu]$

NOTE: Please replace %EM_REPOS_PASSWORD% with credential for OMS repository SYSMAN user.

/orabase/Middleware/oms/bin/emctl register oms metadata -service targetType -debug -file /orabase/Middleware/oms/../plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0/metadata/targetType/has.xml -pluginId oracle.sysman.db -sysman_pwd %EM_REPOS_PASSWORD%

Step 3.1.16: Run emctl oms register default_collection to update MRS

Run emctl oms register default_collection to update MRS

As the oracle user on the host oramgmt01.demo.edu run the following command:

[oracle@oramgmt01.demo.edu]$

NOTE: Please replace %EM_REPOS_PASSWORD% with credential for OMS repository SYSMAN user.

/orabase/Middleware/oms/bin/emctl register oms metadata -service default_collection -debug -file /orabase/Middleware/oms/../plugins/oracle.sysman.db.oms.plugin_12.1.0.5.0/metadata/default_collection/has.xml -pluginId oracle.sysman.db -sysman_pwd %EM_REPOS_PASSWORD%

Step 3.1.17: Mark patch automation

Mark in Oracle Home inventory that the automation of the system patch is completed

As the oracle user on the host oramgmt01.demo.edu run the following command:

[oracle@oramgmt01.demo.edu]$

/orabase/Middleware/oms/OPatch/opatchauto commit -id 18649366 -oh /orabase/Middleware/oms -invPtrLoc /orabase/Middleware/oms/oraInst.loc

Step 3.2: Post Patch Apply Phase on oramgmt02.demo.edu
Step 3.2.1: Mark patch automation

Mark in Oracle Home inventory that the automation of the system patch is completed

As the oracle user on the host oramgmt02.demo.edu run the following command:

[oracle@oramgmt02.demo.edu]$

/orabase/Middleware/oms/OPatch/opatchauto commit -id 18649366 -oh /orabase/Middleware/oms -invPtrLoc /orabase/Middleware/oms/oraInst.loc

Step 3.3: Post Patch Apply Phase on oramgmt03.demo.edu
Step 3.3.1: Mark patch automation

Mark in Oracle Home inventory that the automation of the system patch is completed

As the oracle user on the host oramgmt03.demo.edu run the following command:

[oracle@oramgmt03.demo.edu]$

/orabase/Middleware/oms/OPatch/opatchauto commit -id 18649366 -oh /orabase/Middleware/oms -invPtrLoc /orabase/Middleware/oms/oraInst.loc