Re-Create Oracle EBS Inventory

Execute the recreation commands of Oracle EBS inventory as follows.

Database Tier

[oracle@ebis bin]$ /testfs/TEST/db/12.1.0/oui/bin/runInstaller -silent -attachHome -invPtrLoc /etc/oraInst.loc ORACLE_HOME="/testfs/TEST/db/12.1.0" ORACLE_HOME_NAME="OraDb12c_home1"
Starting Oracle Universal Installer...
Checking swap space: must be greater than 500 MB.   Actual 98286 MB    Passed
The inventory pointer is located at /etc/oraInst.loc
'AttachHome' was successful.

Application Tier fs1

[oracle@ebis bin]$ /testfs/TEST/fs1/EBSapps/10.1.2/oui/bin/runInstaller -silent -attachHome -invPtrLoc /etc/oraInst.loc ORACLE_HOME="/testfs/TEST/fs1/EBSapps/10.1.2" ORACLE_HOME_NAME="TEST_TOOLS__testfs_TEST_fs1_EBSapps_10_1_2"
Starting Oracle Universal Installer...
No pre-requisite checks found in oraparam.ini, no system pre-requisite checks will be executed.
Preparing to launch Oracle Universal Installer from /tmp/OraInstall2018-11-15_04-16-51PM. Please wait ...
'AttachHome' was successful.

[oracle@ebis bin]$ /testfs/TEST/fs1/FMW_Home/oracle_common/oui/bin/runInstaller -silent -attachHome -invPtrLoc /etc/oraInst.loc ORACLE_HOME="/testfs/TEST/fs1/FMW_Home/oracle_common" ORACLE_HOME_NAME="OH_fs1_oracle_common"
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 98286 MB    Passed
Preparing to launch Oracle Universal Installer from /tmp/OraInstall2018-11-15_04-22-46PM. Please wait ...[oracle@ebis bin]$ The inventory pointer is located at /etc/oraInst.loc
The inventory is located at /testfs/TEST/oraInventory
'AttachHome' was successful.

[oracle@ebis bin]$ /testfs/TEST/fs1/FMW_Home/webtier/oui/bin/runInstaller -silent -attachHome -invPtrLoc /etc/oraInst.loc ORACLE_HOME="/testfs/TEST/fs1/FMW_Home/webtier" ORACLE_HOME_NAME="OH_fs1_webtier"
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 98286 MB    Passed
Preparing to launch Oracle Universal Installer from /tmp/OraInstall2018-11-15_04-33-54PM. Please wait ...[oracle@ebis bin]$
The inventory pointer is located at /etc/oraInst.loc
The inventory is located at /testfs/TEST/oraInventory
'AttachHome' was successful.

[oracle@ebis bin]$ /testfs/TEST/fs1/FMW_Home/Oracle_EBS-app1/oui/bin/runInstaller -silent -attachHome -invPtrLoc /etc/oraInst.loc ORACLE_HOME="/testfs/TEST/fs1/FMW_Home/Oracle_EBS-app1" ORACLE_HOME_NAME="OH_fs1_Oracle_EBS_app1"
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 98286 MB    Passed
The inventory pointer is located at /etc/oraInst.loc
The inventory is located at /testfs/TEST/oraInventory
'AttachHome' was successful.

Application Tier fs2

[oracle@ebis bin]$  /testfs/TEST/fs2/FMW_Home/oracle_common/oui/bin/runInstaller -silent -attachHome -invPtrLoc /etc/oraInst.loc ORACLE_HOME="/testfs/TEST/fs2/FMW_Home/oracle_common" ORACLE_HOME_NAME="OH_fs2_oracle_common"
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 98286 MB    Passed
Preparing to launch Oracle Universal Installer from /tmp/OraInstall2018-11-15_04-48-03PM. Please wait ... The inventory pointer is located at /etc/oraInst.loc
The inventory is located at /testfs/TEST/oraInventory
'AttachHome' was successful.

[oracle@ebis bin]$ /testfs/TEST/fs2/FMW_Home/webtier/oui/bin/runInstaller -silent -attachHome -invPtrLoc /etc/oraInst.loc ORACLE_HOME="/testfs/TEST/fs2/FMW_Home/webtier" ORACLE_HOME_NAME="OH_fs2_webtier"
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 98286 MB    Passed
Preparing to launch Oracle Universal Installer from /tmp/OraInstall2018-11-15_04-55-46PM. Please wait ...[oracle@ebis bin]$ The inventory pointer is located at /etc/oraInst.loc
The inventory is located at /testfs/TEST/oraInventory
'AttachHome' was successful.


[oracle@ebis bin]$ /testfs/TEST/fs2/EBSapps/10.1.2/oui/bin/runInstaller -silent -attachHome -invPtrLoc /etc/oraInst.loc ORACLE_HOME="/testfs/TEST/fs2/EBSapps/10.1.2" ORACLE_HOME_NAME="TEST_TOOLS__testfs_TEST_fs2_EBSapps_10_1_2"
Starting Oracle Universal Installer...
No pre-requisite checks found in oraparam.ini, no system pre-requisite checks will be executed.
Preparing to launch Oracle Universal Installer from /tmp/OraInstall2018-11-15_04-44-50PM. Please wait ...
'AttachHome' was successful.

[oracle@ebis bin]$ /testfs/TEST/fs2/FMW_Home/Oracle_EBS-app1/oui/bin/runInstaller -silent -attachHome -invPtrLoc /etc/oraInst.loc ORACLE_HOME="/testfs/TEST/fs2/FMW_Home/Oracle_EBS-app1" ORACLE_HOME_NAME="OH_fs2_Oracle_EBS_app1"
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 98286 MB    Passed
The inventory pointer is located at /etc/oraInst.loc
The inventory is located at /testfs/TEST/oraInventory
'AttachHome' was successful.


Reference

E-Business Suite Applications Manager Central Inventory & Local Inventory Details For System Administration Install, Clone, Upgrade and Maintenance (Doc ID 1550950.1)

Oracle JCS - Weblogic server Issue Resolution

Error/Issue

Admin server is working but other servers are not working in JCS weblogic server.
Below error is given in the weblogic server admin output.

WARNING: Can not connect DB with URL jdbc:oracle:thin:@//xxx:1526/TEST.5679382404.oraclecloud.internal
java.sql.SQLException: ORA-28001: the password has expired

at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:466)
at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:399)
at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:391)
at oracle.jdbc.driver.T4CTTIfun.processError(T4CTTIfun.java:1126)
at oracle.jdbc.driver.T4CTTIoauthenticate.processError(T4CTTIoauthenticate.java:507)
at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:546)
at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:269)
at oracle.jdbc.driver.T4CTTIoauthenticate.doOAUTH(T4CTTIoauthenticate.java:440)
at oracle.jdbc.driver.T4CTTIoauthenticate.doOAUTH(T4CTTIoauthenticate.java:1025)
at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:682)
at oracle.jdbc.driver.PhysicalConnection.connect(PhysicalConnection.java:793)
at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:33)
at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:614)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:247)

Root Cause

Database user passwords have been expired

Resolution

Connect to cdb using SQLPLUS <USERNAME>/<PASSWORD>

ALTER SESSION SET CONTAINER= <PDB1>;

SELECT username, account_status from CDB_USERS where ACCOUNT_STATUS like 'EXP%' and username like '%SP%';

SP549992516_STB
SP549992516_MDS
SP549992516_OPSS
SP549992516_IAU_APPEND
SP549992516_IAU_VIEWER

You will get output of all the users with account expired. Now follow one of the below solution.

1) One solution is to alter the OPSS database schema so the password is the same as specified when the Infrastructure domain was configured.

alter user <schema prefix>_OPSS identified by <original_pwd_here>;
By default the schema password is set to Weblogic Administrator password during the provisioning of the Oracle Java Cloud Service instance.
Altering the database user in this way will reactivate the account if it has expired. If the original password is used, no action is required to reconfigure JPS and the OPSS jdbc datasource (as shown below).

OR

2) You follow the note below to change the User password (only if you do not know the password):

<FMW 12c Infrastructure AdminServer / NodeManager Fail to Start : ORA-28001: password has expired or ORA-01017: invalid username/password; ( Note 1682942.1 )>

Reference 

https://docs.oracle.com/en/cloud/paas/java-cloud/jscug/changing-database-schema-password.html#GUID-3290C685-E975-460E-94AE-419406092FE0
https://docs.oracle.com/en/cloud/paas/java-cloud/jscug/problems-failure-running-service-when-schema-user-password-expires.html

Oracle DBCS Backup Error Resolution

Error

Below error is given when login to the DBCS.

login as: opc
Authenticating with public key "key"
Passphrase for key "key":
*** OBKUP::ERROR INFO ***
OBKUP::ERROR Cannot complete the Archivelogs Backup to Cloud Storage
OBKUP::ERROR KBHS-00715 HTTP CONNECTION ERROR
OBKUP::ERROR An http error was detected please verify your connectivity
*** OBKUP::ERROR END ***

Root Cause

Cloud account password of user xyz@yyyy.com has been changed.

Resolution

As root user, create a file to hold backup configuration:
# vi /tmp/bkp.conf

The contents of file should be:

bkup_cfg_files=yes
bkup_disk=yes
bkup_disk_recovery_window=7
bkup_oss=yes
bkup_oss_recovery_window=30
bkup_oss_url=https://xxx.storage.oraclecloud.com/v1/Storage-xxx/DBaaS
bkup_oss_user=xyz@yyyy.com
bkup_oss_passwd=actualPassword

(Replace actualPassword with correct password of user xyz@yyyy.com)

Change permission on this file as:
# chmod 0600 /tmp/bkp.conf

Now, execute the backup assistant as below
# /var/opt/oracle/ocde/assistants/bkup/bkup -cfg /tmp/bkp.conf