Oracle Apps DBA: 2018

Thursday, 15 March 2018

12.2.4 EBS Migration oracle.apps.fnd.txk.config.InstallService Failed on Solaris During rapidwiz -techstack

APPLIES TO:

Oracle Applications Manager - Version 12.2.4 and later
Information in this document applies to any platform.

SYMPTOMS

Migrating an Oracle EBS 12.2..4 environment to an Oracle MiniCluster, following Note: 2048954.1 -- Application Tier Platform Migration with Oracle E-Business Suite Release 12.2

When running the installation of the FMW (rapidwiz -techstack), getting the following error :

Executing command: /u01/software/eBusiness12.2/startCD/Disk1/rapidwiz/jre/Solaris/1.6.0/bin/java -cp /u01/hcmgrpdb/fs1/inst/apps/hcmgrpdb_rck1-ap02/temp/ASInstallHome/fnd/../j11067592_fnd.zip:/u01/hcmgrpdb/fs1/inst/apps/hcmgrpdb_rck1-ap02/temp/ASInstallHome/fnd/java/3rdparty/stdalone/xmlparserv2.zip -Doracle.apps.fnd.txk.env_home=/u01/hcmgrpdb/fs1/EBSapps/appl/admin/hcmgrpdb_rck1-ap02/ -Doracle.apps.fnd.txk.runtime.config=/u01/hcmgrpdb/fs1/inst/apps/hcmgrpdb_rck1-ap02/temp/xmldocs/instWLS.xml oracle.apps.fnd.txk.config.InstallService

Fatal Error: TXK Install Service

*****************************

> oracle.apps.fnd.txk.install0.log

oracle.apps.fnd.txk.config.ProcessStateException: Weblogic Installer process failed : Exit=255 See log for details. CMD=
/u01/hcmgrpdb/fs1/EBSapps/comn/util/jdk/bin/java -d64 -Dspace.detection=false -jar
/u01/software/eBusiness12.2/TechInstallMedia/wls1036_generic/wls1036_generic.jar -mode=silent
-silent_xml=/u01/hcmgrpdb/fs1/inst/apps/hcmgrpdb_rck1-ap02/temp/cfgHome/response/APPS_JAVA_HOME/txkWLS_1036_rsp.xml
-log=/u01/hcmgrpdb/fs1/EBSapps/appl/admin/hcmgrpdb_rck1-ap02//logs/wls1036.log

at oracle.apps.fnd.txk.config.WLSInstallerPatchActionNode.processState(WLSInstallerPatchActionNode.java:187)
at oracle.apps.fnd.txk.config.PatchActionNode.processState(PatchActionNode.java:187)
at oracle.apps.fnd.txk.config.PatchNode.processState(PatchNode.java:3 8)
at oracle.apps.fnd.txk.config.PatchesNode.processState(PatchesNode.java:79)
at oracle.apps.fnd.txk.config.InstallNode.processState(InstallNode.java: 8)
at oracle.apps.fnd.txk.config.TXKTopology.traverse(TXKTopology.java:594)
at oracle.apps.fnd.txk.config.InstallService.doInvoke(InstallService.java:224)
at oracle.apps.fnd.txk.config.InstallService.invoke(InstallService.java:237)
at oracle.apps.fnd.txk.config.InstallService.main(InstallService.java:291)

>> wls1036.log

2017-07-18 18:21:26,268 INFO [readSilentXML]
com.bea.plateng.wizard.installer.common.parsers.TemplateParser - Silent xml file processed successfully¿
2017-07-18 18:21:28,035 WARN [home]
com.bea.cie.gpr.internal.model.JvmTargetManagerImpl - Property value for solaris32_jdk160_29b11.zip not found..
2017-07-18 18:21:28,102 WARN [home]
com.bea.cie.gpr.internal.model.JvmTargetManagerImpl - Property value for solaris32_jdk160_29b11.zip not found..
2017-07-18 18:21:28,121 ERROR [home]
com.bea.plateng.wizard.installer.silent.tasks.SilentBEAHomeTask - At least one component must be selected.

CHANGES

Migrating a 12.2.4 Environment

CAUSE

Context files from patch and run have identical values.

From > fs2...xml
...............
<file_edition_type oa_var="s_file_edition_type">patch
<file_edition_name oa_var="s_file_edition_name">fs1

from >> fs1...xml
..............
<file_edition_type oa_var="s_file_edition_type">patch
<file_edition_name oa_var="s_file_edition_name">fs1

verified in the context files.

SOLUTION

Context file should be rechecked on the source. The correct ones should be provided for patch and run file systems. Issue is resolved after validating context files.

Preinstall Mode of ADPATCH Asking for Key Store Password

APPLIES TO:

Oracle Applications DBA - Version R11,R12
Information in this document applies to any platform.

SYMPTOMS

When attempting to apply patch with the preinstall=y parameter , the following message is shown

AutoPatch needs the Key Store password in preinstall mode
in order to sign jar files.

Enter the Key Store password for signing Jar files:

SOLUTION

the Key Store password and Key password can be retrieved by running the following:

set serveroutput on
declare
spass varchar2(30);
kpass varchar2(30);
begin
ad_jar.get_jripasswords(spass, kpass);
dbms_output.put_line(spass);
dbms_output.put_line(kpass);
end;
/

Sunday, 21 January 2018

iReceivables Application Start Page Preference Doesn't Work For External Users

Oracle iReceivables - Version 12.1.3 and later
Information in this document applies to any platform.

SYMPTOMS

When trying to control the start page for iReceivables users via the Profile option: Application Start page, it doesn't take the external user to the correct page.

Steps to Reproduce:
Responsibility: iReceivables 2.0 Internal and the iRec Portal page

Set the profile at the user level to 'ARI_EXTERNAL_PAGE$$$AR$$$ARI_EXTERNAL'
Log in through the standard apps login. This takes you directly to the customer search. This is correct.
When logging in through the portal, it takes you to the menu screen. It should take you to the customer search as well.

CAUSE

This issue is addressed in Bug 18614593 APPLICATION START PAGE PROFILE DOESN'T WORK FOR EXTERNAL LINK\USER

SOLUTION

Remove profile option "Application Start Page" value for user level.

E-Business Suite Adpatch Apply Session Fails When Relinking Module FEMCCE With Error '$APPL_TOP/sht/12.0.0/lib/rwtools/libtls0s.a: No such file or directory'

APPLIES TO:

Oracle Applications DBA - Version 12.1.3 and later
Information in this document applies to any platform.

SYMPTOMS

E-Business Suite 12.1.3 Applications DBA, Patch Application Issues

When attempting to apply a patch via adpatch (For example patch 14069503:R12.ATG_PF.B), the following error occurs when relinking module FEMCCE :

An error occurred while relinking application programs.
Continue as if it were successful [No] :
g++:
$APPL_TOP//sht/12.0.0/lib/rwtools/libtls0s.a: No such file or directory
make: *** [$APPL_TOP/fem/12.0.0/bin/FEMCCE]
Error 1
Done with link of fem executable 'FEMCCE'
Relink of module "FEMCCE" failed.

CAUSE

Missing roguewave tools libraries in the following directory path:
$APPL_TOP/sht/12.0.0/lib/rwtools/libtls0s.a

SOLUTION

In order to relink the FEMCCE you need to get the Missing rogueware library libtls0s.a.

To resolve the issue test the following steps in a development instance and then migrate accordingly:

1. As usual before applying any patch please take a backup before of your database and APPL_TOP(s).
2. Apply Patch 10135608 - ROGUEWAVE TOOLS LIBRARY INCLUDING LINUX_ZSER PLATFORM
3. Retest the original patch which failed and confirm the error is resolved.

Relink Of Module "libponao.so" Failed During Application Of Sourcing Patch

APPLIES TO:

Oracle EBS - Version 12.1.3 and later

SYMPTOMS

In Oracle Sourcing, Release 12.1.3, during application of a Sourcing patch (example - Patch 24755043:R12.PON.B), an error occurs during relink of the module libponao.so.

Starting link of pon executable 'libponao.so' on Wed Jul 26 09:59:30 EDT 2017
make: *** No rule to make target `/f12d01/app/oracle/f12d/apps/apps_st/appl/sht/12.0.0/lib/ilog/6.2/libcplex.a', needed by `/f12d01/app/oracle/f12d/apps/apps_st/appl/pon/12.0.0/bin/libponao.so'. Stop.
Done with link of pon executable 'libponao.so' on Wed Jul 26 09:59:30 EDT 2017

`/f12d01/app/oracle/f12d/apps/apps_st/appl/sht/12.0.0/lib/ilog/6.2/libcplex.a' does not exist

Relink of module "libponao.so" failed.
See error messages above (also recorded in log file) for possible
reasons for the failure. Also, please check that the Unix userid
running adrelink has read, write, and execute permissions
on the directory /f12d01/app/oracle/f12d/apps/apps_st/appl/pon/12.0.0/bin,
and that there is sufficient space remaining on the disk partition
containing your Oracle E-Business Suite installation.

CAUSE

The $SHT_TOP/lib/ilog directory does not exist.

SOLUTION

To resolve the issue, the files for directory $SHT_TOP/lib/ilog need to be installed.

Apply Patch 10135606 "ILOG 6.2 STATIC LIBRARY INCLUDING LINUX_ZSER PLATFORM" to supply the missing SHT lib files.
Follow the patch installation instructions as documented in the patch README.txt.

SPECIAL INSTRUCTIONS (from the patch readme.txt):

Apply this patch on the concurrent processing server node where the products rely on Ilog Planner Libraries (MSO MSR WIP WPS MST ENG) have installation status of "Installed" or "Shared".

AutoPatch is not used to apply this patch. It is applied manually, using the below instructions. If you are applying this patch on a Windows platform, substitute the appropriate syntax when necessary.

1. Log in to each concurrent processing server node as the owner of the Applications file system.

2. If the $SHT_TOP/lib/ilog/6.2 directory already exists, back up any files or directories that it contains.

3. Unzip the ilog62lib.zip file, located in the sht/lib directory of this patch, into the $SHT_TOP/lib directory. This will create the ilog/6.2 subdirectory if it doesn't already exist.

4. Change directory to $SHT_TOP/lib/ilog/6.2/<your platform>.

5. If your platform is HP-UX:
- for HP PA-RISC customers, change directory to PA sub directory.
- for HP Itanium customers, change directory to IA32 sub directory.

6. Copy the library files from the current directory to the $SHT_TOP/lib/ilog/6.2 directory.

> On UNIX or Linux, the files are libconcert.a, libcplex.a, libschedule.a, libsolverfloat.a, libconcertext.a, libilocplex.a, libsolver.a, libsolveriim.a
> On Windows, the files are concert.lib, concertext.lib, cplex100.lib, ilocplex.lib, schedule.lib, solver.lib, solverfloat.lib, solveriim.lib, cplex100.dll, ILOG.Concert.dll, ILOG.CPLEX.dll

7. Use AD Administration to relink the following specific executables:
- MSO: MSONEW
- WIP: WICMEX WICMLX
- WPS: WPCWFS
- MSR: MSRNEW
- ENG: ENCACN

Cannot Start OPMN Getting [opmn] [ERROR:1] [107] [internal] XML parser init: error 54 opmnctl start: failed

SYMPTOMS

Cannot start OPMN. Receive the following error:

./opmnctl start
[2014-05-16T12:24:57-04:00] [opmn] [ERROR:1] [107] [internal] XML parser init: error 54.
opmnctl start: failed.

CAUSE

There was an ftp_proxy variable set on the server.

Never set http_proxy and ftp_proxy when running Oracle software.

SOLUTION

Verify if any environment variable set for http and proxy

[applprod@example]$ env|grep -i proxy

APPSJREOPT= -Dhttp.proxyHost= -Dhttp.proxyPort= -Dhttp.nonProxyHosts= -Djava.awt.headless=true

NO_PROXY=localhost,127.0.0.0/8,::1

http_proxy=http://10.188.0.210:8080/

https_proxy=http://10.188.0.210:8080/

HTTPS_PROXY=http://10.188.0.210:8080/

no_proxy=localhost,127.0.0.0/8,::1

HTTP_PROXY=http://10.188.0.210:8080/

Unset all environments except APPSJREOPT than restart OPMN services.

Error 400--Bad RequestFrom RFC 2068 Hypertext Transfer Protocol -- HTTP/1.1 in EBS 12.2.4

APPLIES TO:

Oracle E-Business Suite Technology Stack - Version 12.2.4 and later
Information in this document applies to any platform.

SYMPTOMS

Users Encountering Error 400 Bad Request On Web Pages

From RFC 2068 Hypertext Transfer Protocol

10.4.1 400 Bad Request

The request could not be understood by the server due to malformed syntax.

The client SHOULD NOT repeat the request without modifications.

CAUSE

Applications File system out of sync

SOLUTION

Oracle suggested to follow below action plan but still issue not resolved.

1) Clear out cabo cache by doing the following:
A. Shutdown all services -

B. BACKUP the files in the following directories and then remove the files from the directories :
Note: Once you complete these steps, all the directories will still be present, but will be empty.
$OA_HTML/cabo/images/cache
$OA_HTML/cabo/styles/cache

Example:
cd $OA_HTML/cabo/images
cp -r cache cache_bkup
cd $OA_HTML/cabo/images/cache
rm -r *

C. Run the same steps for $OA_HTML/cabo/styles/cache

2) cd $FND_TOP/patch/115/bin
./ojspCompile.pl --compile --flush -p 2

3) Remove browser and Java Cache.

4) Restart services and retest.

Below solution resolved issue in my case.

There is a huge difference in the size of the two files _frameRedirect.class between working and non working environment,

Seems like some class file corruption _cabo/_jsps

Please perform the following:

1) Take the backup of _pages/_cabo/_jsps directory in non working environment
2) Copy this directory from working environment to non working environment
3) Restart the services in target instance.

The issue was caused due to corruption of class file : _frameredirect.class

Connection has been administratively disabled by console/admin command in EBS 12.2.4 Weblogic 10.3.6

APPLIES TO:

Oracle Applications Technology Stack - Version 12.2 to 12.2.5 [Release 12.2]
Information in this document applies to any platform.

SYMPTOMS

Below message from weblog Adminserver log files.

Caused By: oracle.apps.jtf.base.resources.FrameworkException: Connection has been administratively disabled by console/admin command. Try later. java.lang.Exception: It was disabled

Caused By: oracle.apps.jtf.base.resources.FrameworkException: Connection has been administratively disabled by console/admin command. Try later. java.lang.Exception: It was disabled at Thu Jun 15 05:50:09 IST 2017
at weblogic.jdbc.common.internal.ConnectionEnv.disable(ConnectionEnv.java:357)
at weblogic.jdbc.wrapper.JDBCWrapperImpl.invocationExceptionHandler(JDBCWrapperImpl.java:127)
at weblogic.jdbc.wrapper.PreparedStatement.executeQuery(PreparedStatement.java:152)
at oracle.apps.fnd.cache.GenericCacheLoader.load(GenericCacheLoader.java:225)
at oracle.apps.fnd.cache.GenericCacheLoader.load(GenericCacheLoader.java:201)
at oracle.apps.fnd.cache.GenericCacheLoader.load(GenericCacheLoader.java:176)
at oracle.apps.fnd.cache.GenericCacheLoader.load(GenericCacheLoader.java:151)
at oracle.apps.jtf.cache.GenericCacheLoader.load(Unknown Source)
at oracle.ias.cache.CacheLoader.callLoad(CacheLoader.java:60)

SOLUTION

Action Plan

Inactive Connection Timeout =3600

Login to Weblogic Server Administration Console. Default: http://localhost:7001/console
Select 'Lock and Edit' (if WebLogic server is a Production Mode implementation)
Go to Home > Summary of Servers > AdminServer, Tuning tab.
Change the Stuck Thread Max Time from 3600 to 900.
Change the Stuck Thread Timer Interval from 3600 to 100
Go to Overload tab
Change the Max Stuck Thread Time from 600 to 900.
Change the Stuck Thread Count 0 to 20.
Save and Activate Changes.
Restart the WebLogic server.

12.2 EBS Migration oracle.apps.fnd.txk.config.InstallService Failed on Solaris During rapidwiz -techstack

APPLIES TO:

Oracle Applications Manager - Version 12.2.4 and later
Information in this document applies to any platform.

SYMPTOMS

*****************************

> oracle.apps.fnd.txk.install0.log

>> wls1036.log

CHANGES

Migrating a 12.2.4 Environment

CAUSE

verified in the context files.

SOLUTION

Context file should be rechecked on the source. The correct ones should be provided for patch and run file systems. Issue is resolved after validating context files.

Relink After Platform Migration Fails With Error: wrong ELF Machine Type: EM_386

APPLIES TO:

Oracle Applications DBA - Version 12.2 and later
Information in this document applies to any platform.

SYMPTOMS

After Platform migration, relink is failing with the following error:

wrong ELF machine type: EM_386

/u01/oracle/CLONE/fs1/EBSapps/appl/po/12.0.0/lib/libpo.a(xitpox.o): wrong ELF machine type: EM_386
ld: warning: file
/u01/oracle/CLONE/fs1/EBSapps/appl/gl/12.0.0/lib/libgl.a(xitsqlgl.o): wrong ELF machine type: EM_386
ld: warning: file
/u01/oracle/CLONE/fs1/EBSapps/appl/alr/12.0.0/lib/libalr.a(xitalr.o): wrong ELF machine type: EM_386
ld: fatal: file /u01/oracle/CLONE/fs1/EBSapps/appl/alr/12.0.0/lib/alstub.o: wrong ELF machine type: EM_386
*** Error code 1
make: Fatal error: Command failed for target

SOLUTION

To implement the solution, execute the following steps:

1. Run Adadmin > Maintain Snapshots Information at the source;

2. Regenerate the Manifest File for the source environment;

3. Upload it and generate the Customer Specific Patch;

4. Remove all the *.a and *.o files from the Product tops at the target using the following syntax:

  rm -f $APPL_TOP/*/12.0.0/lib/*.a
  rm -f $APPL_TOP/*/12.0.0/lib/*.o

  - rename the following log files:

  adrelink.log

  adlibout.log

  adlibin.log

  adpatch.log

5. Apply the new customer specific patch generated on step 3.
6. Retest the issue.
7. Migrate the solution as appropriate to other environments.

bsu.sh script running for long time to check weblogic patch conflicts

bsu.sh file output.
applprod@example:~/CRP1/fs1/FMW_Home/utils/bsu$ more bsu.sh
#!/bin/sh

JAVA_HOME="/d2/applprod/CRP1/fs1/EBSapps/comn/util/jdk"

MEM_ARGS="-Xms3072m -Xmx3072m -XX:+UseParallelGC"

"$JAVA_HOME/bin/java" ${MEM_ARGS} -jar patch-client.jar $*

1. MEM_ARGS changed multiple time to run bsu.sh -> changed 1024 and 2048 than finally updated with 3072 but still taking long time.
2. Verified using GUI mode ./bsu.sh and
3. even cleared cache_dir directory under "/d2/applprod/CRP1/fs1/FMW_Home/utils/bsu/cache_dir"
4. Still taking long time for running
applprod@example:~/CRP1/fs1/FMW_Home/utils/bsu$ ./bsu.sh -install -patch_download_dir=/d2/applprod/CRP1/fs1/FMW_Home/utils/bsu/cache_dir -patchlist=FMJJ -prod_dir=/d2/applprod/CRP1/fs1/FMW_Home/wlserver_10.3
Checking for conflicts.........................

Solution:

Oracle SR provided patch to update bsu scripts.
extracted patch 27238412 under $FMW_HOME/util/bsu directory
applprod@example:~/CRP1/fs1/FMW_Home/utils/bsu$ . ./bsu_update.sh install
Installing...
Updating bsu modules
Update was successful.

AD_ZD_ADOP and FND_DIAGNOSTICS packages invalid status after applying any PSU patches in 12.1.0.2 Database

1. Receiving Errors while running AutoConfig as seen below.

2. Additionally, See the following errors for an invalid APPS.AD_ZD_ADOP object:

SQL> alter package APPS.AD_ZD_ADOP compile body;
Warning: Package Body altered with compilation errors.

SQL> show err
Errors for PACKAGE BODY APPS.AD_ZD_ADOP:
LINE/COL ERROR
-------- -----------------------------------------------------------------
2686/3 PL/SQL: Statement ignored
2686/7 PLS-00201: identifier 'SYS.DBMS_METADATA_UTIL' must be declared

ERROR
-----------------------
Script Name : txkGenADOPWrapper.pl
Script Version : 120.0.12020000.3
ERROR DESCRIPTION:
(*******FATAL ERROR*******
PROGRAM : (/r11/app/FLRPRD/R12apps/fs1/inst/apps/FLRTEST_dbfinsfnyp01/admin/install/txkGenADOPWrapper.pl)
TIME : Mon Aug 22 18:15:08 2016
FUNCTION: TXK::SQLPLUS::_doExecute [ Level 3 ]
MESSAGES:
SQLPLUS error: buffer=

SQL> SQL> Connected.
SQL> SELECT ad_zd_adop.get_node_type('dbfinsfnyp01') FROM DUAL
*
ERROR at line 1:
ORA-04063: package body "APPS.AD_ZD_ADOP" has errors

Solution:

sqlplus / as sysdba

1. Complete the following commands:

$ grant execute on DBMS_METADATA_UTIL to apps;
$ alter package APPS.AD_ZD_ADOP compile body;

DBA_DATAPUMP_JOBS view;
sqlplus / as sysdba
SQL> grant select on dba_datapump_jobs to apps;
SQL> alter package APPS.FND_DIAGNOSTICS compile body;

APPS.FND_TRACE Invalid after adgrants.sql
GRANT EXECUTE ON DBMS_SYSTEM TO PUBLIC;
alter package apps.FND_TRACE compile body;
alter package apps.FND_REQUEST compile body;