RAC GI patch version mismatched

After GI is patched. the "kfod op=PATCHLVL" and "crsctl query crs softwarepatch" ,output mismatched from node 3 comparing to node 1&2, though "opatch lsinventory" output match...
Patch ID 28729169 and 4104219146 were not in the output of "kfod op=PATCHES " on node 3.

Created oracle SR, the support suggested the following steps to fix the issue.

root>patchgen commit -pi 28729169
root>patchgen commit -pi 4104219146

check the below on all nodes and notify if there is any difference

kfod op=PATCHLVL
kfod op=PATCHES

If they are same run the below

# rootcrs.sh -patch

That fixed the problem.

Comments

Opatch apply/lsinventory error: oneoff is corrupted or does not exist

I am applying the quarterly patch for 19c RDBMS, I tried using napply but failed, but somehow it corrupted the inventory though nothing applied. further apply and lsinventory command ran into error like this: $ ./OPatch/opatch lsinventory Oracle Interim Patch Installer version 12.2.0.1.21 Copyright (c) 2020, Oracle Corporation. All rights reserved. Oracle Home : /u02/app/oracle/19.0.0 Central Inventory : /u01/app/oraInventory from : /u02/app/oracle/19.0.0/oraInst.loc OPatch version : 12.2.0.1.21 OUI version : 12.2.0.7.0 Log file location : /u02/app/oracle/19.0.0/cfgtoollogs/opatch/opatch2020-09-08_13-35-59PM_1.log Lsinventory Output file location : /u02/app/oracle/19.0.0/cfgtoollogs/opatch/lsinv/lsinventory2020-09-08_13-35-59PM.txt -------------------------------------------------------------------------------- Inventory load failed... OPatch cannot load inventory ...

oracle dba_hist_sysmetric_summary

found this blog is helpful to get CPU and IO statistics on oracle database. http://shob-dbadmin.blogspot.ca/2012/12/how-to-find-total-io-of-database.html courtesy to Shomil Bansal , below are hist writing, not mine. How to find total IO of the database instance Total IO of database instance is sum of the physical reads, physical writes and redo writes. There are several views to find these values. v$sysmetric - Reports metric values for only the most current time sample 60 secs. v$sysmetric_summary - Reports metric values for time sample of 1 hour. v$sysmetric_history - Reports metric values every 60 sec from the time instance is up. Better way to analyse IO using this view to take deltas between two time periods. dba_hist_sysmetric_history - All the above views are refreshed when the instance is restarted. This view, part of AWR, stores the historical stats. I have used this view for my report. Query: ====== set lines 350...

fix bad query plan using sql profile created by coe_xfr_sql_profile.sql

After database upgrade from 10g to 12c, some of queries have bad performance, elapsed time are changed from less than 1 second to a few minutes, the immediately fix is to force the application to use 10g optimizer by either change database parameter or use database logon trigger to force specific application to choose the 10g optimizer. I used the database trigger. CREATE OR REPLACE TRIGGER sys.triggername AFTER LOGON ON DATABASE WHEN (upper(sys_context('USERENV','MODULE')) like '%APP_UPPERCASE%' or upper(sys_context('USERENV','MODULE')) like '% APP_UPPERCASE %') BEGIN /* some functions of application running slow after db upgrade from 10g to 12c, this trigger helps to force them to use 10g optimizer and get their normal performance*/ EXECUTE IMMEDIATE 'ALTER SESSION SET optimizer_features_enable=''10.2.0.5'''; END triggername ; / I engaged oracle support on troubleshooting this, sent MOS...

DBA

Search This Blog