Installing a Management Agent in Silent Mode Using agentDeploy.sh

There are multiple ways for deploying agent in silent mode on a 13.4 cloud control. This post list the steps for deploying agent in silent mode using the agentDeploy.sh script.
1. The agent will be deployed under a different user (named emagent in this case) than the user who owns the oracle targets. The user must belong to oracle inventory group in this case oinstall. So create the user as

useradd -g oinstall emagent

2. There are several pre-reqs that are needed before running agent in silent mode. However, it was possible to deploy the agent without any of those being done on a server where Oracle restart was running. It is possible that pre-reqs for Oracle restart covers most of the pre-reqs needed by agent deployment. Since the agent is deployed as a separate user it's best to set the ulimit values for that user in limit.d

emagent soft nproc 13312
emagent hard nproc 13312
emagent soft nofile 4096
emagent hard nofile 16384

3. Make the agent base directory with write permission for the user who will install agent

mkdir -p /opt/agent
chown emagent:oinstall agent
chmod 770 agent

4. Get the agent deployment zip file from the OMS host. As first step login using emcli as sysman user

cd $OMS_HOME
./emcli login -username=sysman
Enter password

Login successful

Run the sync to synchronize the emcli

./emcli sync
Synchronized successfully

List the platforms and versions available. On this case only Linux 64-bit was available.

./emcli get_supported_platforms
-----------------------------------------------
Version = 13.4.0.0.0
 Platform = Linux x86-64
-----------------------------------------------
Platforms list displayed successfully.

Download the agent deployment zip to a temporary location. Use the platform and versions number found in the previous command

 mkdir -p /tmp/agent
./emcli get_agentimage -destination=/tmp/agent -platform="Linux x86-64" -version=13.4.0.0.0
 === Partition Detail ===
Space free : 13 GB
Space required : 1 GB
Check the logs at /opt/fc/app/software/em/gc_inst/em/EMGC_OMS1/sysman/emcli/setup/.emcli/get_agentimage_2020-07-14_13-03-35-PM.log
Downloading /tmp/agent/13.4.0.0.0_AgentCore_226.zip
File saved as /tmp/agent/13.4.0.0.0_AgentCore_226.zip
Downloading /tmp/agent/13.4.0.0.0_Plugins_226.zip
File saved as /tmp/agent/13.4.0.0.0_Plugins_226.zip
Downloading /tmp/agent/unzip
File saved as /tmp/agent/unzip
Executing command: /tmp/agent/unzip /tmp/agent/13.4.0.0.0_Plugins_226.zip -d /tmp/agent
Exit status is:0
Agent Image Download completed successfully.

5. Copy the agent deployment zip to the remote sever where agent deployment is expected.



6. Unzip the agent deployment zip to a temporary location on the remote server.

mkdir -p /tmp/agentimg
unzip 13.4.0.0.0_AgentCore_226.zip -d /tmp/agentimg

6. The zip file extraction will create several files. Key among them are agent.rsp and agentDeploy.sh.

7. The agent.rsp file will have entries that need to be edited so agent can find the OMS host. When the parameters are added on the response file they must be within double quotes. If they are passed as command line arguments no need to include them in double quotes. The parameter values used in the agent.rsp is shown below.

OMS_HOST="vm-em-console"
EM_UPLOAD_PORT="5900"
AGENT_REGISTRATION_PASSWORD="agentregpwd"

#--------------------------------------------------------------------------------
#Following are optional parameters
#--------------------------------------------------------------------------------
#b_startAgent=

AGENT_BASE_DIR="/opt/agent"
AGENT_INSTANCE_HOME="/opt/agent/agent_inst"
AGENT_PORT="2255"
ORACLE_HOSTNAME="master-db"
s_agentHomeName="agent13R4"

8. Run the agentDeploy.sh script with response file parameter.

./agentDeploy.sh RESPONSE_FILE=/tmp/agentimg/agent.rsp

The full output is shown below.

./agentDeploy.sh RESPONSE_FILE=/tmp/agentimg/agent.rsp

The space available is ....  262244 MB

 Validating the OMS_HOST & EM_UPLOAD_PORT
Executing command : /opt/agent/agent_13.4.0.0.0/jdk/jre/bin/java -classpath /opt/agent/agent_13.4.0.0.0/jlib/agentInstaller.jar:/opt/agent/agent_13.4.0.0.0/oui/modules/OraInstaller.jar     oracle.sysman.agent.installer.AgentInstaller /opt/agent/agent_13.4.0.0.0 /tmp/agentimg /opt/agent $args -prereq
AGENT_ins home is:RESPONSE_FILE=/tmp/agentimg/agent.rsporaclehome is:/opt/agent/agent_13.4.0.0.0
log loction is setlog
The oraclehome /opt/agent/agent_13.4.0.0.0

Validating oms host & port with url: https://vm-em-console:5900/empbs/genwallet
Validating oms host & port with url: http://vm-em-console:5900/empbs/genwallet
Return status:0-oms http port is passed
Validating the OMS Host and Port completed.
/tmp/agentimg/agentcore.bin -ignoreSysPrereqs -prereqChecker -entryPoint oracle.sysman.top.agent_Complete -silent -ignoreSysPrereqs -detailedExitCodes -responseFile /opt/agent/agentInstall.rsp  -J-DORACLE_HOSTNAME=master-db -J-DAGENT_PORT=2255 -J-Djava.io.tmpdir=/opt/agent/agent_13.4.0.0.0/cfgtoollogs/prereqlogs -J-DAGENT_BASE_DIR=/opt/agent
Launcher log file is /opt/agent/agent_13.4.0.0.0/cfgtoollogs/prereqlogs/OraInstall2020-07-15_02-13-08PM/launcher2020-07-15_02-13-08PM.log.
Checking swap space: must be greater than 512 MB.   Actual 2047 MB    Passed
Checking if this platform requires a 64-bit JVM.   Actual 64    Passed (64-bit not required)
Checking temp space: must be greater than 300 MB.   Actual 260396 MB    Passed
Preparing to launch the Oracle Universal Installer from /opt/agent/agent_13.4.0.0.0/cfgtoollogs/prereqlogs/OraInstall2020-07-15_02-13-08PM
Oracle Prerequisite Checker Version 13.9.4.0.0 Production
Copyright (C) 1999, 2020, Oracle. All rights reserved.

Starting execution of prerequisite checks
Total No of checks: 10

Performing check for CertifiedVersions_agent
Is the software certified on the current operating system?
Expected result: One of enterprise-6, oracle-8, oracle-7, SuSE-11, SuSE-12, redhat-6, redhat-7
Actual Result: redhat-7.6
Check complete. The overall result of this check is: Passed


Check complete: Passed
========================================================
Performing check for Packages_agent
Are the required packages installed on the current operating system?
Checking for make-3.82-21; found make-1:3.82-23.el7-x86_64.     Passed
Checking for binutils-2.23; found binutils-2.27-34.base.0.1.el7-x86_64. Passed
Checking for gcc-4.8.2-16; found gcc-4.8.5-36.0.1.el7_6.2-x86_64.       Passed
Checking for libaio-0.3.109-12; found libaio-0.3.109-13.el7-x86_64.     Passed
Checking for glibc-common-2.17-55; found glibc-common-2.17-260.0.17.el7_6.6-x86_64.     Passed
Checking for libstdc++-4.8.2-16; found libstdc++-4.8.5-36.0.1.el7_6.2-x86_64.   Passed
Checking for sysstat-10.1.5-4; found sysstat-10.1.5-17.el7-x86_64.      Passed
Check complete. The overall result of this check is: Passed


Check complete: Passed
========================================================
Performing check for CompatibilityCheck
Is the software compatible with the current operating system?
sourceLoc is :/opt/agent/agent_13.4.0.0.0/cfgtoollogs/prereqlogs/OraInstall2020-07-15_02-13-08PM/stage/shiphomeproperties.xml
ARU ID is:226
Platform is :x86_64
Check complete. The overall result of this check is: Passed


Check complete: Passed
========================================================
Performing check for AvailableInventorySpace
Checking for sufficient disk space in the Inventory Location
Expected result: 100.0MB
Actual Result: 260335MB
Check complete. The overall result of this check is: Passed


Check complete: Passed
========================================================
Performing check for InventoryWritableCheck
Checking for write permissions on the inventory.
Check complete. The overall result of this check is: Passed


Check complete: Passed
========================================================
Performing check for TZRegionCheck
Checking TimeZone settings...
Check complete. The overall result of this check is: Passed


Check complete: Passed
========================================================
Performing check for AgentBaseDirCheck
Is the ownership of the agent base directory valid?
Check complete. The overall result of this check is: Passed


Check complete: Passed
========================================================
Performing check for PortCheck
Checking for port availability and hostname validity...
Host name to check master-db
Getting Inet Addresses for host master-db
Trying for host : master-db/172.27.3.13 and port : 2255
Trying for host : /127.0.0.1 and port : 2255
** Agent Port Check completed successfully.**
Agent port to use 2255
===Expected Result final Port 2255 must be available on all IP addresses associated with host master-db.
Expected result: Port 2255 must be available on all IP addresses associated with host master-db.
Actual Result: 2255
Check complete. The overall result of this check is: Passed


Check complete: Passed
========================================================
Performing check for OracleHomeCheck
Checking whether the old oracle home entry is present in the central inventory ...
Check complete. The overall result of this check is: Passed


Check complete: Passed
========================================================
Performing check for CheckHostName
Is the host name valid?
value of oracle_hostname:master-db
value of hostname is:master-db
Expected result: Fully qualified domain name, for example foo.mydomain.com
Actual Result: master-db. Ensure that you provide a fully qualified domain name.
Check complete. The overall result of this check is: Passed


Check complete: Passed
========================================================
PrereqChecks complete


The log(s) can be found here: /opt/agent/agent_13.4.0.0.0/cfgtoollogs/prereqlogs/OraInstall2020-07-15_02-13-08PM.

 Agent Prereqs Completed


 Starting Install Phase .....
/tmp/agentimg/agentcore.bin -ignoreSysPrereqs -silent -responseFile /opt/agent/agentInstall.rsp
Launcher log file is /tmp/OraInstall2020-07-15_02-13-30PM/launcher2020-07-15_02-13-30PM.log.
Checking swap space: must be greater than 512 MB.   Actual 2047 MB    Passed
Checking if this platform requires a 64-bit JVM.   Actual 64    Passed (64-bit not required)
Checking temp space: must be greater than 300 MB.   Actual 21561 MB    Passed
Preparing to launch the Oracle Universal Installer from /tmp/OraInstall2020-07-15_02-13-30PM
Jul 15, 2020 2:13:34 PM oracle.sysman.oii.oiio.oiioz.OiiozResponseFile getValue
INFO: This installation is being performed using response file /opt/agent/agentInstall.rsp.
Installation Summary


Disk Space : Required 1,435 MB, Available 261,933 MB
Feature Sets to Install:
        Oracle JDK 12.2.1.3.1
        Perl 5.28.1.0.0 5.28.1.0.0
        Next Generation Install Core 13.9.4.0.0
        OPatch 13.9.4.2.2
        Oracle HTTP Client 12.2.1.3.0
        Oracle XDK 12.2.1.3.0
        DMS Full 12.2.1.3.0
        Wallet Functionality 12.2.1.3.0
        Remote Diagnostic Assistant 8.09.0.1.0
Session log file is /tmp/OraInstall2020-07-15_02-13-30PM/install2020-07-15_02-13-30PM.log

Loading products list. Please wait.
 1%
 40%

Loading products. Please wait.
 41%
 42%
 43%
 44%
 45%
 46%
 47%
 48%
 49%
 50%
 51%
 52%
 53%
 54%
 55%
 56%
 57%
 58%
 59%
 60%
 61%
 62%
 63%
 64%
 65%
 66%
 67%
 68%
 69%
 70%
 71%
 72%
 73%
 74%
 75%
 76%
 77%
 78%
 79%
 80%
 81%
 82%
 83%
 84%
 85%
 86%
 87%
 88%
 89%
 90%
 91%
 92%
 93%
 94%
 95%
 96%
 97%
 98%
 99%

Updating Libraries



Starting Installations
 1%
 2%
 3%
 4%
 5%
 6%
 7%
 8%
 9%
 10%
 11%
 12%
 13%
 14%
 15%
 16%
 17%
 18%
 19%
 20%
 21%
 22%
 23%
 24%
 25%
 26%
 27%
 28%
 29%
 30%
 31%
 32%
 33%
 34%
 35%
 36%
 37%
 38%
 39%
 40%
 41%
 42%
 43%
 44%
 45%
 46%
 47%
 48%
 49%
 50%
 51%
 52%
 53%
 54%
 55%
 56%
 57%
 58%
 59%
 60%
 61%
 62%
 63%
 64%
 65%
 66%
 67%
 68%
 69%
 70%
 71%
 72%
 73%
 74%
 75%
 76%
 77%
 78%
 79%
 80%
 81%
 82%
 83%
 84%
 85%
 86%
 87%
 88%
 89%
 90%
 91%
 92%
 93%
 94%
 95%
 96%
 97%
 98%

Install pending

Installation in progress

 Component : oracle.glcm.logging 1.6.4.0.0

Copying files for oracle.glcm.logging 1.6.4.0.0

 Component : oracle.glcm.comdev 7.8.4.0.0

Copying files for oracle.glcm.comdev 7.8.4.0.0

 Component : oracle.glcm.dependency 1.8.4.0.0

Copying files for oracle.glcm.dependency 1.8.4.0.0

 Component : oracle.glcm.xmldh 3.4.4.0.0

Copying files for oracle.glcm.xmldh 3.4.4.0.0

 Component : oracle.glcm.wizard 7.8.4.0.0

Copying files for oracle.glcm.wizard 7.8.4.0.0

 Component : oracle.commons.cli.commons.cli 1.3.1.0.0

Copying files for oracle.commons.cli.commons.cli 1.3.1.0.0

 Component : oracle.org.apache.commons.commons.compress 1.9.0.0.0

Copying files for oracle.org.apache.commons.commons.compress 1.9.0.0.0

 Component : oracle.osdt.core 12.2.1.3.0

Copying files for oracle.osdt.core 12.2.1.3.0

 Component : oracle.pki 12.2.1.3.0

Copying files for oracle.pki 12.2.1.3.0

 Component : oracle.rsa.crypto 12.2.1.3.0

Copying files for oracle.rsa.crypto 12.2.1.3.0

 Component : oracle.glcm.encryption 2.7.4.0.0

Copying files for oracle.glcm.encryption 2.7.4.0.0

 Component : oracle.help.ohj 12.2.1.3.0

Copying files for oracle.help.ohj 12.2.1.3.0

 Component : oracle.help.share 12.2.1.3.0

Copying files for oracle.help.share 12.2.1.3.0

 Component : oracle.bali.ice 12.2.1.3.0

Copying files for oracle.bali.ice 12.2.1.3.0

 Component : oracle.bali.jewt 12.2.1.3.0

Copying files for oracle.bali.jewt 12.2.1.3.0

 Component : oracle.bali.share 12.2.1.3.0

Copying files for oracle.bali.share 12.2.1.3.0

 Component : oracle.nginst.common 13.9.4.0.0

Copying files for oracle.nginst.common 13.9.4.0.0

 Component : oracle.nginst.osp.compstager 13.9.4.0.0

Copying files for oracle.nginst.osp.compstager 13.9.4.0.0

 Component : oracle.nginst.core 13.9.4.0.0

Copying files for oracle.nginst.core 13.9.4.0.0

 Component : oracle.glcm.opatch.common.api 13.9.4.0.0

Copying files for oracle.glcm.opatch.common.api 13.9.4.0.0

 Component : oracle.nginst.thirdparty 13.9.4.0.0

Copying files for oracle.nginst.thirdparty 13.9.4.0.0

 Component : oracle.swd.opatch 13.9.4.2.2

Copying files for oracle.swd.opatch 13.9.4.2.2

 Component : oracle.glcm.osys.core 13.9.1.0.0

Copying files for oracle.glcm.osys.core 13.9.1.0.0

 Component : oracle.glcm.oplan.core 13.9.4.2.0

Copying files for oracle.glcm.oplan.core 13.9.4.2.0

 Component : oracle.glcm.opatchauto.core 13.9.4.2.0

Copying files for oracle.glcm.opatchauto.core 13.9.4.2.0

 Component : oracle.xdk.jrf.xmlparserv2 12.2.1.3.0

Copying files for oracle.xdk.jrf.xmlparserv2 12.2.1.3.0

 Component : oracle.xdk.jrf.jaxp 12.2.1.3.0

Copying files for oracle.xdk.jrf.jaxp 12.2.1.3.0

 Component : oracle.xdk.jrf 12.2.1.3.0

Copying files for oracle.xdk.jrf 12.2.1.3.0

 Component : oracle.xdk.jrf.fmw 12.2.1.3.0

Copying files for oracle.xdk.jrf.fmw 12.2.1.3.0

 Component : oracle.jse.dms 12.2.1.3.0

Copying files for oracle.jse.dms 12.2.1.3.0

 Component : oracle.jrf.dms.common 12.2.1.3.0

Copying files for oracle.jrf.dms.common 12.2.1.3.0

 Component : oracle.jrf.dms 12.2.1.3.0

Copying files for oracle.jrf.dms 12.2.1.3.0

 Component : oracle.sysman.top.agent 13.4.0.0.0

Copying files for oracle.sysman.top.agent 13.4.0.0.0

 Component : oracle.sysman.common 13.4.0.0.0

Copying files for oracle.sysman.common 13.4.0.0.0

 Component : oracle.sysman.sbin 13.4.0.0.0

Copying files for oracle.sysman.sbin 13.4.0.0.0

 Component : oracle.sysman.emagent.installer 13.4.0.0.0

Copying files for oracle.sysman.emagent.installer 13.4.0.0.0

 Component : oracle.sysman.darda 8.09.0.1.0

Copying files for oracle.sysman.darda 8.09.0.1.0

 Component : oracle.jre 1.8.0.231.34

Copying files for oracle.jre 1.8.0.231.34

 Component : oracle.jdk 1.8.0.231.34

Copying files for oracle.jdk 1.8.0.231.34

 Component : oracle.ldap.rsf 12.2.1.3.0

Copying files for oracle.ldap.rsf 12.2.1.3.0

 Component : oracle.buildtools.rsf 12.1.0.2.0

Copying files for oracle.buildtools.rsf 12.1.0.2.0

instantiating '/opt/agent/agent_13.4.0.0.0/install/utl/rootmacro.sbs'.

 Component : oracle.wsm.common 12.2.1.3.0

Copying files for oracle.wsm.common 12.2.1.3.0

 Component : oracle.jrf.j2ee 12.2.1.3.0

Copying files for oracle.jrf.j2ee 12.2.1.3.0

 Component : oracle.opss.core 12.2.1.3.0

Copying files for oracle.opss.core 12.2.1.3.0

 Component : oracle.sysman.agent.ic 13.4.0.0.0

Copying files for oracle.sysman.agent.ic 13.4.0.0.0

 Component : oracle.http_client 12.2.1.3.0

Copying files for oracle.http_client 12.2.1.3.0

 Component : oracle.perlint 5.28.1.0.0

Copying files for oracle.perlint 5.28.1.0.0

 Component : oracle.perlint.expat 2.0.1.0.4

Copying files for oracle.perlint.expat 2.0.1.0.4

 Component : oracle.perlint.modules 5.28.1.0.0

Copying files for oracle.perlint.modules 5.28.1.0.0

Install successful

Post feature install pending

Post Feature installing

 Feature Set : glcm_common_logging_lib

 Feature Set : commons-cli_1.3.1.0.0

 Feature Set : glcm_common_lib

Post Feature installing commons-cli_1.3.1.0.0

Post Feature installing glcm_common_logging_lib

Post Feature installing glcm_common_lib

 Feature Set : commons-compress_1.9.0.0.0

 Feature Set : commons-cli

Post Feature installing commons-cli

 Feature Set : orapki.lib

Post Feature installing orapki.lib

Post Feature installing commons-compress_1.9.0.0.0

 Feature Set : commons-compress

Post Feature installing commons-compress

 Feature Set : com.oracle.orapki

Post Feature installing com.oracle.orapki

 Feature Set : glcm_encryption_lib

Post Feature installing glcm_encryption_lib

 Feature Set : adf.runtime.war

Post Feature installing adf.runtime.war

 Feature Set : oracle.glcm.opatch.common.api.classpath

Post Feature installing oracle.glcm.opatch.common.api.classpath

 Feature Set : oracle.glcm.osys.core.classpath

Post Feature installing oracle.glcm.osys.core.classpath

 Feature Set : oracle.glcm.oplan.core.classpath

Post Feature installing oracle.glcm.oplan.core.classpath

 Feature Set : oracle.glcm.opatchauto.core.classpath

Post Feature installing oracle.glcm.opatchauto.core.classpath

 Feature Set : oracle.glcm.opatchauto.core.binary.classpath

Post Feature installing oracle.glcm.opatchauto.core.binary.classpath

 Feature Set : oracle.glcm.opatchauto.core.actions.classpath

Post Feature installing oracle.glcm.opatchauto.core.actions.classpath

 Feature Set : oracle.glcm.opatchauto.core.wallet.classpath

Post Feature installing oracle.glcm.opatchauto.core.wallet.classpath

 Feature Set : com.oracle.db.xdk-no-jaxp

Post Feature installing com.oracle.db.xdk-no-jaxp

 Feature Set : oxquery.xmlbeans_dependencies

Post Feature installing oxquery.xmlbeans_dependencies

 Feature Set : oxquery.ee_dependencies

Post Feature installing oxquery.ee_dependencies

 Feature Set : oxquery.xqjapi_dependencies

Post Feature installing oxquery.xqjapi_dependencies

 Feature Set : oracle.xdk.xmlparserv2_dependencies

Post Feature installing oracle.xdk.xmlparserv2_dependencies

Post feature install complete

String substitutions pending

String substituting

 Component : oracle.glcm.logging 1.6.4.0.0

String substituting oracle.glcm.logging 1.6.4.0.0

 Component : oracle.glcm.comdev 7.8.4.0.0

String substituting oracle.glcm.comdev 7.8.4.0.0

 Component : oracle.glcm.dependency 1.8.4.0.0

String substituting oracle.glcm.dependency 1.8.4.0.0

 Component : oracle.glcm.xmldh 3.4.4.0.0

String substituting oracle.glcm.xmldh 3.4.4.0.0

 Component : oracle.glcm.wizard 7.8.4.0.0

String substituting oracle.glcm.wizard 7.8.4.0.0

 Component : oracle.commons.cli.commons.cli 1.3.1.0.0

String substituting oracle.commons.cli.commons.cli 1.3.1.0.0

 Component : oracle.org.apache.commons.commons.compress 1.9.0.0.0

String substituting oracle.org.apache.commons.commons.compress 1.9.0.0.0

 Component : oracle.osdt.core 12.2.1.3.0

String substituting oracle.osdt.core 12.2.1.3.0

 Component : oracle.pki 12.2.1.3.0

String substituting oracle.pki 12.2.1.3.0

 Component : oracle.rsa.crypto 12.2.1.3.0

String substituting oracle.rsa.crypto 12.2.1.3.0

 Component : oracle.glcm.encryption 2.7.4.0.0

String substituting oracle.glcm.encryption 2.7.4.0.0

 Component : oracle.help.ohj 12.2.1.3.0

String substituting oracle.help.ohj 12.2.1.3.0

 Component : oracle.help.share 12.2.1.3.0

String substituting oracle.help.share 12.2.1.3.0

 Component : oracle.bali.ice 12.2.1.3.0

String substituting oracle.bali.ice 12.2.1.3.0

 Component : oracle.bali.jewt 12.2.1.3.0

String substituting oracle.bali.jewt 12.2.1.3.0

 Component : oracle.bali.share 12.2.1.3.0

String substituting oracle.bali.share 12.2.1.3.0

 Component : oracle.nginst.common 13.9.4.0.0

String substituting oracle.nginst.common 13.9.4.0.0

 Component : oracle.nginst.osp.compstager 13.9.4.0.0

String substituting oracle.nginst.osp.compstager 13.9.4.0.0

 Component : oracle.nginst.core 13.9.4.0.0

String substituting oracle.nginst.core 13.9.4.0.0

 Component : oracle.glcm.opatch.common.api 13.9.4.0.0

String substituting oracle.glcm.opatch.common.api 13.9.4.0.0

 Component : oracle.nginst.thirdparty 13.9.4.0.0

String substituting oracle.nginst.thirdparty 13.9.4.0.0

 Component : oracle.swd.opatch 13.9.4.2.2

String substituting oracle.swd.opatch 13.9.4.2.2

 Component : oracle.glcm.osys.core 13.9.1.0.0

String substituting oracle.glcm.osys.core 13.9.1.0.0

 Component : oracle.glcm.oplan.core 13.9.4.2.0

String substituting oracle.glcm.oplan.core 13.9.4.2.0

 Component : oracle.glcm.opatchauto.core 13.9.4.2.0

String substituting oracle.glcm.opatchauto.core 13.9.4.2.0

 Component : oracle.xdk.jrf.xmlparserv2 12.2.1.3.0

String substituting oracle.xdk.jrf.xmlparserv2 12.2.1.3.0

 Component : oracle.xdk.jrf.jaxp 12.2.1.3.0

String substituting oracle.xdk.jrf.jaxp 12.2.1.3.0

 Component : oracle.xdk.jrf 12.2.1.3.0

String substituting oracle.xdk.jrf 12.2.1.3.0

 Component : oracle.xdk.jrf.fmw 12.2.1.3.0

String substituting oracle.xdk.jrf.fmw 12.2.1.3.0

 Component : oracle.jse.dms 12.2.1.3.0

String substituting oracle.jse.dms 12.2.1.3.0

 Component : oracle.jrf.dms.common 12.2.1.3.0

String substituting oracle.jrf.dms.common 12.2.1.3.0

 Component : oracle.jrf.dms 12.2.1.3.0

String substituting oracle.jrf.dms 12.2.1.3.0

 Component : oracle.sysman.top.agent 13.4.0.0.0

String substituting oracle.sysman.top.agent 13.4.0.0.0

 Component : oracle.sysman.common 13.4.0.0.0

String substituting oracle.sysman.common 13.4.0.0.0

 Component : oracle.sysman.sbin 13.4.0.0.0

String substituting oracle.sysman.sbin 13.4.0.0.0

 Component : oracle.sysman.emagent.installer 13.4.0.0.0

String substituting oracle.sysman.emagent.installer 13.4.0.0.0

 Component : oracle.sysman.darda 8.09.0.1.0

String substituting oracle.sysman.darda 8.09.0.1.0

 Component : oracle.jre 1.8.0.231.34

String substituting oracle.jre 1.8.0.231.34

 Component : oracle.jdk 1.8.0.231.34

String substituting oracle.jdk 1.8.0.231.34

 Component : oracle.ldap.rsf 12.2.1.3.0

String substituting oracle.ldap.rsf 12.2.1.3.0

 Component : oracle.buildtools.rsf 12.1.0.2.0

String substituting oracle.buildtools.rsf 12.1.0.2.0

 Component : oracle.wsm.common 12.2.1.3.0

String substituting oracle.wsm.common 12.2.1.3.0

 Component : oracle.jrf.j2ee 12.2.1.3.0

String substituting oracle.jrf.j2ee 12.2.1.3.0

 Component : oracle.opss.core 12.2.1.3.0

String substituting oracle.opss.core 12.2.1.3.0

 Component : oracle.sysman.agent.ic 13.4.0.0.0

String substituting oracle.sysman.agent.ic 13.4.0.0.0

 Component : oracle.http_client 12.2.1.3.0

String substituting oracle.http_client 12.2.1.3.0

 Component : oracle.perlint 5.28.1.0.0

String substituting oracle.perlint 5.28.1.0.0

 Component : oracle.perlint.expat 2.0.1.0.4

String substituting oracle.perlint.expat 2.0.1.0.4

 Component : oracle.perlint.modules 5.28.1.0.0

String substituting oracle.perlint.modules 5.28.1.0.0

String substitutions complete

Link pending

Linking in progress

 Component : oracle.glcm.logging 1.6.4.0.0

Linking oracle.glcm.logging 1.6.4.0.0

 Component : oracle.glcm.comdev 7.8.4.0.0

Linking oracle.glcm.comdev 7.8.4.0.0

 Component : oracle.glcm.dependency 1.8.4.0.0

Linking oracle.glcm.dependency 1.8.4.0.0

 Component : oracle.glcm.xmldh 3.4.4.0.0

Linking oracle.glcm.xmldh 3.4.4.0.0

 Component : oracle.glcm.wizard 7.8.4.0.0

Linking oracle.glcm.wizard 7.8.4.0.0

 Component : oracle.commons.cli.commons.cli 1.3.1.0.0

Linking oracle.commons.cli.commons.cli 1.3.1.0.0

 Component : oracle.org.apache.commons.commons.compress 1.9.0.0.0

Linking oracle.org.apache.commons.commons.compress 1.9.0.0.0

 Component : oracle.osdt.core 12.2.1.3.0

Linking oracle.osdt.core 12.2.1.3.0

 Component : oracle.pki 12.2.1.3.0

Linking oracle.pki 12.2.1.3.0

 Component : oracle.rsa.crypto 12.2.1.3.0

Linking oracle.rsa.crypto 12.2.1.3.0

 Component : oracle.glcm.encryption 2.7.4.0.0

Linking oracle.glcm.encryption 2.7.4.0.0

 Component : oracle.help.ohj 12.2.1.3.0

Linking oracle.help.ohj 12.2.1.3.0

 Component : oracle.help.share 12.2.1.3.0

Linking oracle.help.share 12.2.1.3.0

 Component : oracle.bali.ice 12.2.1.3.0

Linking oracle.bali.ice 12.2.1.3.0

 Component : oracle.bali.jewt 12.2.1.3.0

Linking oracle.bali.jewt 12.2.1.3.0

 Component : oracle.bali.share 12.2.1.3.0

Linking oracle.bali.share 12.2.1.3.0

 Component : oracle.nginst.common 13.9.4.0.0

Linking oracle.nginst.common 13.9.4.0.0

 Component : oracle.nginst.osp.compstager 13.9.4.0.0

Linking oracle.nginst.osp.compstager 13.9.4.0.0

 Component : oracle.nginst.core 13.9.4.0.0

Linking oracle.nginst.core 13.9.4.0.0

 Component : oracle.glcm.opatch.common.api 13.9.4.0.0

Linking oracle.glcm.opatch.common.api 13.9.4.0.0

 Component : oracle.nginst.thirdparty 13.9.4.0.0

Linking oracle.nginst.thirdparty 13.9.4.0.0

 Component : oracle.swd.opatch 13.9.4.2.2

Linking oracle.swd.opatch 13.9.4.2.2

 Component : oracle.glcm.osys.core 13.9.1.0.0

Linking oracle.glcm.osys.core 13.9.1.0.0

 Component : oracle.glcm.oplan.core 13.9.4.2.0

Linking oracle.glcm.oplan.core 13.9.4.2.0

 Component : oracle.glcm.opatchauto.core 13.9.4.2.0

Linking oracle.glcm.opatchauto.core 13.9.4.2.0

 Component : oracle.xdk.jrf.xmlparserv2 12.2.1.3.0

Linking oracle.xdk.jrf.xmlparserv2 12.2.1.3.0

 Component : oracle.xdk.jrf.jaxp 12.2.1.3.0

Linking oracle.xdk.jrf.jaxp 12.2.1.3.0

 Component : oracle.xdk.jrf 12.2.1.3.0

Linking oracle.xdk.jrf 12.2.1.3.0

 Component : oracle.xdk.jrf.fmw 12.2.1.3.0

Linking oracle.xdk.jrf.fmw 12.2.1.3.0

 Component : oracle.jse.dms 12.2.1.3.0

Linking oracle.jse.dms 12.2.1.3.0

 Component : oracle.jrf.dms.common 12.2.1.3.0

Linking oracle.jrf.dms.common 12.2.1.3.0

 Component : oracle.jrf.dms 12.2.1.3.0

Linking oracle.jrf.dms 12.2.1.3.0

 Component : oracle.sysman.top.agent 13.4.0.0.0

Linking oracle.sysman.top.agent 13.4.0.0.0

 Component : oracle.sysman.common 13.4.0.0.0

Linking oracle.sysman.common 13.4.0.0.0

 Component : oracle.sysman.sbin 13.4.0.0.0

Linking oracle.sysman.sbin 13.4.0.0.0

 Component : oracle.sysman.emagent.installer 13.4.0.0.0

Linking oracle.sysman.emagent.installer 13.4.0.0.0

 Component : oracle.sysman.darda 8.09.0.1.0

Linking oracle.sysman.darda 8.09.0.1.0

 Component : oracle.jre 1.8.0.231.34

Linking oracle.jre 1.8.0.231.34

 Component : oracle.jdk 1.8.0.231.34

Linking oracle.jdk 1.8.0.231.34

 Component : oracle.ldap.rsf 12.2.1.3.0

Linking oracle.ldap.rsf 12.2.1.3.0

 Component : oracle.buildtools.rsf 12.1.0.2.0

Linking oracle.buildtools.rsf 12.1.0.2.0

 Component : oracle.wsm.common 12.2.1.3.0

Linking oracle.wsm.common 12.2.1.3.0

 Component : oracle.jrf.j2ee 12.2.1.3.0

Linking oracle.jrf.j2ee 12.2.1.3.0

 Component : oracle.opss.core 12.2.1.3.0

Linking oracle.opss.core 12.2.1.3.0

 Component : oracle.sysman.agent.ic 13.4.0.0.0

Linking oracle.sysman.agent.ic 13.4.0.0.0

 Component : oracle.http_client 12.2.1.3.0

Linking oracle.http_client 12.2.1.3.0

 Component : oracle.perlint 5.28.1.0.0

Linking oracle.perlint 5.28.1.0.0

 Component : oracle.perlint.expat 2.0.1.0.4

Linking oracle.perlint.expat 2.0.1.0.4

 Component : oracle.perlint.modules 5.28.1.0.0

Linking oracle.perlint.modules 5.28.1.0.0

Linking in progress

Link successful

Setup pending

Setup in progress

 Component : oracle.glcm.logging 1.6.4.0.0

Setting up oracle.glcm.logging 1.6.4.0.0

 Component : oracle.glcm.comdev 7.8.4.0.0

Setting up oracle.glcm.comdev 7.8.4.0.0

 Component : oracle.glcm.dependency 1.8.4.0.0

Setting up oracle.glcm.dependency 1.8.4.0.0

 Component : oracle.glcm.xmldh 3.4.4.0.0

Setting up oracle.glcm.xmldh 3.4.4.0.0

 Component : oracle.glcm.wizard 7.8.4.0.0

Setting up oracle.glcm.wizard 7.8.4.0.0

 Component : oracle.commons.cli.commons.cli 1.3.1.0.0

Setting up oracle.commons.cli.commons.cli 1.3.1.0.0

 Component : oracle.org.apache.commons.commons.compress 1.9.0.0.0

Setting up oracle.org.apache.commons.commons.compress 1.9.0.0.0

 Component : oracle.osdt.core 12.2.1.3.0

Setting up oracle.osdt.core 12.2.1.3.0

 Component : oracle.pki 12.2.1.3.0

Setting up oracle.pki 12.2.1.3.0

 Component : oracle.rsa.crypto 12.2.1.3.0

Setting up oracle.rsa.crypto 12.2.1.3.0

 Component : oracle.glcm.encryption 2.7.4.0.0

Setting up oracle.glcm.encryption 2.7.4.0.0

 Component : oracle.help.ohj 12.2.1.3.0

Setting up oracle.help.ohj 12.2.1.3.0

 Component : oracle.help.share 12.2.1.3.0

Setting up oracle.help.share 12.2.1.3.0

 Component : oracle.bali.ice 12.2.1.3.0

Setting up oracle.bali.ice 12.2.1.3.0

 Component : oracle.bali.jewt 12.2.1.3.0

Setting up oracle.bali.jewt 12.2.1.3.0

 Component : oracle.bali.share 12.2.1.3.0

Setting up oracle.bali.share 12.2.1.3.0

 Component : oracle.nginst.common 13.9.4.0.0

Setting up oracle.nginst.common 13.9.4.0.0

 Component : oracle.nginst.osp.compstager 13.9.4.0.0

Setting up oracle.nginst.osp.compstager 13.9.4.0.0

 Component : oracle.nginst.core 13.9.4.0.0

Setting up oracle.nginst.core 13.9.4.0.0

 Component : oracle.glcm.opatch.common.api 13.9.4.0.0

Setting up oracle.glcm.opatch.common.api 13.9.4.0.0

 Component : oracle.nginst.thirdparty 13.9.4.0.0

Setting up oracle.nginst.thirdparty 13.9.4.0.0

 Component : oracle.swd.opatch 13.9.4.2.2

Setting up oracle.swd.opatch 13.9.4.2.2

 Component : oracle.glcm.osys.core 13.9.1.0.0

Setting up oracle.glcm.osys.core 13.9.1.0.0

 Component : oracle.glcm.oplan.core 13.9.4.2.0

Setting up oracle.glcm.oplan.core 13.9.4.2.0

 Component : oracle.glcm.opatchauto.core 13.9.4.2.0

Setting up oracle.glcm.opatchauto.core 13.9.4.2.0

 Component : oracle.xdk.jrf.xmlparserv2 12.2.1.3.0

Setting up oracle.xdk.jrf.xmlparserv2 12.2.1.3.0

 Component : oracle.xdk.jrf.jaxp 12.2.1.3.0

Setting up oracle.xdk.jrf.jaxp 12.2.1.3.0

 Component : oracle.xdk.jrf 12.2.1.3.0

Setting up oracle.xdk.jrf 12.2.1.3.0

 Component : oracle.xdk.jrf.fmw 12.2.1.3.0

Setting up oracle.xdk.jrf.fmw 12.2.1.3.0

 Component : oracle.jse.dms 12.2.1.3.0

Setting up oracle.jse.dms 12.2.1.3.0

 Component : oracle.jrf.dms.common 12.2.1.3.0

Setting up oracle.jrf.dms.common 12.2.1.3.0

 Component : oracle.jrf.dms 12.2.1.3.0

Setting up oracle.jrf.dms 12.2.1.3.0

 Component : oracle.sysman.top.agent 13.4.0.0.0

Setting up oracle.sysman.top.agent 13.4.0.0.0

instantiating '/opt/agent/agent_13.4.0.0.0/install/unix/scripts/agentstup.template'.

instantiating '/opt/agent/agent_13.4.0.0.0/install/unix/scripts/agentstup.template'.

changing permission for "/opt/agent/agent_13.4.0.0.0"

spawning 'chmod -R a+rX /opt/agent/agent_13.4.0.0.0/perl'

changing permission for "/opt/agent/agent_13.4.0.0.0/EMStage"

updating '/opt/agent/agent_13.4.0.0.0/root.sh.template'.

instantiating '/opt/agent/agent_13.4.0.0.0/root.sh.template'.

instantiating '/opt/agent/agent_13.4.0.0.0/replacebins.sh.template'.

instantiating '/opt/agent/agent_13.4.0.0.0/stage/bin/forwarderProxy.template'.

changing permissions for '/opt/agent/agent_13.4.0.0.0/stage/bin/forwarderProxy.template'

instantiating '/opt/agent/agent_13.4.0.0.0/bin/emtgtctl'.

instantiating '/opt/agent/agent_13.4.0.0.0/stage/sysman/config/emd.properties.template'.

updating '/opt/agent/agent_13.4.0.0.0/install/eminstall.info'.

spawning '/opt/agent/agent_13.4.0.0.0/perl/bin/perl /opt/agent/agent_13.4.0.0.0/sysman/admin/scripts/patchUploadTriggers.pl /opt/agent/agent_13.4.0.0.0'

 Component : oracle.sysman.common 13.4.0.0.0

Setting up oracle.sysman.common 13.4.0.0.0

instantiating '/opt/agent/agent_13.4.0.0.0//bin/emctl.pl.template'.

deleting '/opt/agent/agent_13.4.0.0.0//bin/emctl.pl.template'

instantiating '/opt/agent/agent_13.4.0.0.0//bin/emctl.template'.

changing permissions for '/opt/agent/agent_13.4.0.0.0/bin/emctl'

instantiating '/opt/agent/agent_13.4.0.0.0//bin/commonenv.template'.

instantiating '/opt/agent/agent_13.4.0.0.0//install/unix/scripts/gcroot.sh.template'.

changing permissions for '/opt/agent/agent_13.4.0.0.0//install/unix/scripts/gcroot.sh'

instantiating '/opt/agent/agent_13.4.0.0.0/oui/bin/runConfig.sh'.

 Component : oracle.sysman.sbin 13.4.0.0.0

Setting up oracle.sysman.sbin 13.4.0.0.0

 Component : oracle.sysman.emagent.installer 13.4.0.0.0

Setting up oracle.sysman.emagent.installer 13.4.0.0.0

 Component : oracle.sysman.darda 8.09.0.1.0

Setting up oracle.sysman.darda 8.09.0.1.0

 Component : oracle.jre 1.8.0.231.34

Setting up oracle.jre 1.8.0.231.34

 Component : oracle.jdk 1.8.0.231.34

Setting up oracle.jdk 1.8.0.231.34

 Component : oracle.ldap.rsf 12.2.1.3.0

Setting up oracle.ldap.rsf 12.2.1.3.0

 Component : oracle.buildtools.rsf 12.1.0.2.0

Setting up oracle.buildtools.rsf 12.1.0.2.0

 Component : oracle.wsm.common 12.2.1.3.0

Setting up oracle.wsm.common 12.2.1.3.0

 Component : oracle.jrf.j2ee 12.2.1.3.0

Setting up oracle.jrf.j2ee 12.2.1.3.0

 Component : oracle.opss.core 12.2.1.3.0

Setting up oracle.opss.core 12.2.1.3.0

 Component : oracle.sysman.agent.ic 13.4.0.0.0

Setting up oracle.sysman.agent.ic 13.4.0.0.0

 Component : oracle.http_client 12.2.1.3.0

Setting up oracle.http_client 12.2.1.3.0

 Component : oracle.perlint 5.28.1.0.0

Setting up oracle.perlint 5.28.1.0.0

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/corelist'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/cpan'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/dbilogstrip'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/dbiprof'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/dbiproxy'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/enc2xs'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/h2ph'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/h2xs'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/instmodsh'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/libnetcfg'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/perlbug'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/perldoc'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/perlivp'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/piconv'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/pl2pm'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/pod2html'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/pod2man'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/pod2text'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/pod2usage'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/podchecker'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/podselect'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/prove'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/ptar'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/ptardiff'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/shasum'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/splain'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/bin_tmp/xsubpp'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/lib_tmp/Config.pm'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/lib_tmp/Config_heavy.pl'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/lib_tmp/config.h'.

instantiating '/opt/agent/agent_13.4.0.0.0/perl/lib_tmp/perllocal.pod'.

spawning 'rm -rf  /opt/agent/agent_13.4.0.0.0/perl/bin_tmp'

spawning 'rm -rf /opt/agent/agent_13.4.0.0.0/perl/lib_tmp'

 Component : oracle.perlint.expat 2.0.1.0.4

Setting up oracle.perlint.expat 2.0.1.0.4

 Component : oracle.perlint.modules 5.28.1.0.0

Setting up oracle.perlint.modules 5.28.1.0.0

instantiating '/opt/agent/agent_13.4.0.0.0/perl/modules_lib_tmp/mk.pm'.

spawning 'rm -rf /opt/agent/agent_13.4.0.0.0/perl/modules_lib_tmp'

Setup successful

Save inventory pending

Saving inventory
 99%

Saving inventory complete
 100%

Configuration complete

The install operation completed successfully.

Logs successfully copied to /opt/app/oraInventory/logs.
 Agent Software install completed

Creating symlink /opt/agent/agent_13.4.0.0.0/oracle_common/jdk/bin /opt/agent/agent_13.4.0.0.0/jdk/bin
Executing command to check/apply patches if exist in agenthome.....
/opt/agent/agent_13.4.0.0.0/perl/bin/perl /opt/agent/agent_13.4.0.0.0/install/oneoffs/apply_NewOneoffs.pl /opt/agent/agent_13.4.0.0.0 true
The ORACLE HOME is /opt/agent/agent_13.4.0.0.0The install isLocal is trueThe command is opatch napply -invPtrLoc /opt/agent/agent_13.4.0.0.0/oraInst.loc -silent   -local

 Unjarring the oneoff 29812738.zip ...
 /opt/agent/agent_13.4.0.0.0/oracle_common/jdk/bin/jar xvf /opt/agent/agent_13.4.0.0.0/install/oneoffs/agent/29812738.zip
  created: 29812738/
 inflated: 29812738/README.txt
  created: 29812738/files/
  created: 29812738/files/oracle.sysman.agent.ic/
  created: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/
  created: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/
  created: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/
  created: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/
  created: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/
  created: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/
  created: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/net/
  created: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/net/ns/
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/net/ns/NSProtocolStream.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/net/ns/NSProtocolNIO.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/net/ns/NSProtocol.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/net/ns/SQLnetDef.class
  created: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/net/nt/
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/net/nt/NTAdapter$NetworkAdapterType.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/net/nt/TcpsNTAdapter.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/net/nt/SSLSocketChannel.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/net/nt/TcpsConfigure.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/net/nt/ConnOption.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/net/nt/SdpNTAdapter.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/net/nt/CustomSSLSocketFactory.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/net/nt/ConnStrategy.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/net/nt/TcpNTAdapter.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/net/nt/MQLNTAdapter.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/net/nt/NTAdapter.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/net/nt/MQLNTAdapter$1.class
  created: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/net/resolver/
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/net/resolver/AddrResolution.class
  created: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/OracleConnection$DatabaseShutdownMode.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/OracleConnection.class
  created: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/driver/
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/driver/T4CConnection$1.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/driver/NTFListener.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/driver/PhysicalConnection.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/driver/NTFAQRegistration.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/driver/OracleConnection.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/driver/PhysicalConnection$1.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/driver/T4CConnection$ReplayMode.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/driver/PhysicalConnection$DrcpState.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/driver/T4CConnection$3.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/driver/PhysicalConnection$2.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/driver/PhysicalConnection$3.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/driver/NTFConnection.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/driver/T4CConnection$2.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/driver/T4CConnection.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/driver/PhysicalConnection$BufferCacheStore.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/driver/PhysicalConnection$4.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/driver/NTFManager.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/OracleConnection$CommitOption.class
 inflated: 29812738/files/oracle.sysman.agent.ic/13.4.0.0.0/oracle.sysman.agent.ic.symbol/jdbc/lib/ojdbc7.jar/oracle/jdbc/OracleConnection$DatabaseStartupMode.class
  created: 29812738/etc/
  created: 29812738/etc/config/
 inflated: 29812738/etc/config/actions.xml
 inflated: 29812738/etc/config/inventory.xml
patches exist in /opt/agent/agent_13.4.0.0.0

 Applying opatch for the oneoffs 29812738 ...
 /opt/agent/agent_13.4.0.0.0/OPatch/opatch napply -invPtrLoc /opt/agent/agent_13.4.0.0.0/oraInst.loc -silent   -local  -oh /opt/agent/agent_13.4.0.0.0 -phBaseFile /opt/agent/agent_13.4.0.0.0/patch.txt
Oracle Interim Patch Installer version 13.9.4.2.2
Copyright (c) 2020, Oracle Corporation.  All rights reserved.


Oracle Home       : /opt/agent/agent_13.4.0.0.0
Central Inventory : /opt/app/oraInventory
   from           : /opt/agent/agent_13.4.0.0.0/oraInst.loc
OPatch version    : 13.9.4.2.2
OUI version       : 13.9.4.0.0
Log file location : /opt/agent/agent_13.4.0.0.0/cfgtoollogs/opatch/opatch2020-07-15_14-14-08PM_1.log


OPatch detects the Middleware Home as "/opt/agent"

Verifying environment and performing prerequisite checks...
OPatch continues with these patches:   29812738

Do you want to proceed? [y|n]
Y (auto-answered by -silent)
User Responded with: Y
All checks passed.
Backing up files...
Applying interim patch '29812738' to OH '/opt/agent/agent_13.4.0.0.0'

Patching component oracle.sysman.agent.ic, 13.4.0.0.0...
Patch 29812738 successfully applied.
Log file location: /opt/agent/agent_13.4.0.0.0/cfgtoollogs/opatch/opatch2020-07-15_14-14-08PM_1.log

OPatch succeeded.

 Finished one-offs apply...

 Deleting the files...

 Finished deleting the above files...
Copying Install logs to /opt/agent/agent_13.4.0.0.0/cfgtoollogs/agentDeploy .....
Entered Post Install...

Relaxing execute  permission for other users  on /opt/agent/agent_13.4.0.0.0/install for bug#20005612
/bin/chmod: cannot access â/opt/agent/agent_13.4.0.0.0/pluginsâ: No such file or directory
/bin/chmod: cannot access â/opt/agent/agent_13.4.0.0.0/install/unix/scripts/lockgcstartupâ: No such file or directory
/bin/chmod: cannot access â/opt/agent/agent_13.4.0.0.0/install/unix/scripts/gcstartupâ: No such file or directory
/bin/chmod: cannot access â/opt/agent/agent_13.4.0.0.0/install/unix/scripts/unlockgcstartupâ: No such file or directory
Finished post install
Plugin txt:
Inside if ,  is empty
oracle.sysman.oh|13.4.0.0.0| |agentPlugin
oracle.sysman.oh|13.4.0.0.0| |discoveryPlugin
/opt/agent/agent_13.4.0.0.0/oracle_common/jdk/jre/bin/java  -classpath /opt/agent/agent_13.4.0.0.0/jlib/agentInstaller.jar:/opt/agent/agent_13.4.0.0.0/oui/modules/OraInstaller.jar:/opt/agent/agent_13.4.0.0.0/oui/modules/installer-launch.jar oracle.sysman.agent.installer.AgentPluginInstaller /opt/agent/agent_13.4.0.0.0 /tmp/agentimg/plugins
/opt/agent/agent_13.4.0.0.0/oracle_common/jdk/jre/bin/java -classpath /opt/agent/agent_13.4.0.0.0/oui/modules/OraInstaller.jar:/opt/agent/agent_13.4.0.0.0/oui/modules/emCfg.jar:/opt/agent/agent_13.4.0.0.0/jlib/agentInstaller.jar     oracle.sysman.agent.installer.AgentFreshInstaller /opt/agent/agent_13.4.0.0.0 /opt/agent/agent_inst /opt/agent RESPONSE_FILE=/opt/agent/agentInstall.rsp  $args
The AgentFreshInstaller is starting now
Oraclehome : ../opt/agent/agent_13.4.0.0.0
InstanceHome : /opt/agent/agent_inst
Agent Base Directory : /opt/agent
The oraclehome /opt/agent/agent_13.4.0.0.0
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: /opt/agent/agent_13.4.0.0.0
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: /opt/agent/agent_inst
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: /opt/agent
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: RESPONSE_FILE=/opt/agent/agentInstall.rsp
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: RESPONSE_FILE=/tmp/agentimg/agent.rsp
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: OMS_HOST="vm-em-console"
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: EM_UPLOAD_PORT="5900"
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: AGENT_BASE_DIR=/opt/agent
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: AGENT_INSTANCE_HOME=/opt/agent/agent_inst
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: AGENT_PORT="2255"
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: ORACLE_HOSTNAME="master-db"
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: s_agentHomeName="agent13R4"
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: EM_INSTALL_TYPE="AGENT"
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: ORACLE_HOME=/opt/agent/agent_13.4.0.0.0
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: OMS_HOST="vm-em-console"
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: EM_UPLOAD_PORT="5900"
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: AGENT_BASE_DIR=/opt/agent
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: AGENT_INSTANCE_HOME=/opt/agent/agent_inst
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: AGENT_PORT="2255"
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: ORACLE_HOSTNAME="master-db"
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: s_agentHomeName="agent13R4"
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: EM_INSTALL_TYPE="AGENT"
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: ORACLE_HOME=/opt/agent/agent_13.4.0.0.0
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: RESPONSE_FILE=/tmp/agentimg/agent.rsp
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: EMCTLCFG_MODE=NONE
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: OMS_HOST="vm-em-console"
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: EM_UPLOAD_PORT="5900"
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: AGENT_BASE_DIR=/opt/agent
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: AGENT_INSTANCE_HOME=/opt/agent/agent_inst
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: AGENT_PORT="2255"
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: ORACLE_HOSTNAME="master-db"
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: s_agentHomeName="agent13R4"
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: EM_INSTALL_TYPE="AGENT"
Jul 15, 2020 2:14:25 PM oracle.sysman.agent.installer.AgentInstaller parseResponseFile
INFO: ORACLE_HOME=/opt/agent/agent_13.4.0.0.0
log loction is setlog
Writing the following contents into /opt/agent/agent_13.4.0.0.0/install/oragchomelist
/opt/agent/agent_13.4.0.0.0:/opt/agent/agent_inst
Both /etc/oragchomelist and /var/opt/oracle/oragchomelist does not exist.
The value of chainInstall : false forceConfigure : false skipValidation : false
Validating oms host & port with url: https://vm-em-console:5900/empbs/genwallet
Validating oms host & port with url: http://vm-em-console:5900/empbs/genwallet
The status is 0
Validated the oms host and port :- vm-em-console----5900
Getting Inet Addresses for host master-db
** Agent Port Check completed successfully.**
Validated the agent port :- ----2255
shared agent value is :false
chain install is :false
Agent Configuration completed successfully
The following configuration scripts need to be executed as the "root" user. Root script to run : /opt/agent/agent_13.4.0.0.0/root.sh
/opt/agent/agent_13.4.0.0.0/cfgtoollogs/agentDeploy/agentDeploy_2020-07-15_14-14-25-PM.log
Waiting for agent targets to get promoted...
Successfully Promoted agent and its related targets to Management Agent

9. Run the root.sh script as root user

/opt/agent/agent_13.4.0.0.0/root.sh

Finished product-specific root actions.
/etc exist

Creating /etc/oragchomelist file...

10. Verify the agent status

./emctl status agent
Oracle Enterprise Manager Cloud Control 13c Release 4
Copyright (c) 1996, 2020 Oracle Corporation.  All rights reserved.
---------------------------------------------------------------
Agent Version          : 13.4.0.0.0
OMS Version            : 13.4.0.0.0
Protocol Version       : 12.1.0.1.0
Agent Home             : /opt/agent/agent_inst
Agent Log Directory    : /opt/agent/agent_inst/sysman/log
Agent Binaries         : /opt/agent/agent_13.4.0.0.0
Core JAR Location      : /opt/agent/agent_13.4.0.0.0/jlib
Agent Process ID       : 66458
Parent Process ID      : 66404
Agent URL              : https://master-db:2255/emd/main/
Local Agent URL in NAT : https://master-db:2255/emd/main/
Repository URL         : https://vm-em-console:5900/empbs/upload
Started at             : 2020-07-15 14:14:51
Started by user        : emagent
Operating System       : Linux version 4.14.35-1844.1.3.el7uek.x86_64 (amd64)
Number of Targets      : 5
Last Reload            : (none)
Last successful upload                       : 2020-07-15 14:26:06
Last attempted upload                        : 2020-07-15 14:26:06
Total Megabytes of XML files uploaded so far : 0.27
Number of XML files pending upload           : 0
Size of XML files pending upload(MB)         : 0
Available disk space on upload filesystem    : 79.61%
Collection Status                            : Collections enabled
Heartbeat Status                             : Ok
Last attempted heartbeat to OMS              : 2020-07-15 14:25:55
Last successful heartbeat to OMS             : 2020-07-15 14:25:55
Next scheduled heartbeat to OMS              : 2020-07-15 14:26:56

---------------------------------------------------------------
Agent is Running and Ready

If all is fine the agent would be visible on the cloud control.

Related Posts
Installing Enterprise Manager Cloud Control 13c (13.4)
Adding Targets on EM Cloud Control 13c
Installing Enterprise Manager Cloud Control 13c (13.3)
Installing Grid Control 11gR1 and Deploying Agents
Upgrading Grid Control 11g to 12c - 1


Update on 2020-09-29
When the agent is deployed other than oracle user "Can't resolve a non-optional query descriptor property [log_file_absolute] (alert_log_file)" incident could be observed on the EM. This issue is detailed in 1572164.1. Because the alert log direcotry gets created with ownership oracle:asmadmin (when GI is invovled) the agent OS user is unable to read the alert log (xml) files. To fix change the alert log folder and any other folders in the path to oinstall ownership. Also set a sticky bit on alert log folder so that future alert log xml files are created with oracle:oinstall ownership. Below commands could be used to fix the issue assuming ORACLE_SID is set. This needs some changes when used with RAC.

cd $ORACLE_BASE/diag/rdbms
chown oracle:oinstall $ORACLE_SID
cd $ORACLE_BASE/diag/rdbms/$ORACLE_SID
chown oracle:oinstall $ORACLE_SID
cd $ORACLE_BASE/diag/rdbms/$ORACLE_SID/$ORACLE_SID
chown oracle:oinstall alert
chmod 2750 alert
cd $ORACLE_BASE/diag/rdbms/$ORACLE_SID/$ORACLE_SID/alert
chown oracle:oinstall *.xml

Configuring Statspack for Standby Database

Statspack provide separate set of scripts for setting it up for a standby database in a data guard configuration. If enterprise edition is used with diagnostic pack then Remote Management Framework could be configured to get AWR reports of the standby. Depending on the data guard configuration (multiple standbys, snapshot data needed only from read only instances etc) the statspack setup would result in less effort and complexity than setting up RMF for AWR.
RMF has database link from both primary to standby and vice versa. Before a role transition additional work must be done by way of creating database link between future primary and future standby. In contrast the statspack only create one database link between primary and standby. As long as the TNS entry used for creating the DB link is available in the future primary then the statspack would continue to function. This is especially useful in a configuration where only subset of instances are candidate to become primary and all others are part of a reader farm.
In a multi-tenant architecture the data guard works on CDB level. As such the standby statspack is installed on the root container. This will create two users perfstat and stdbyperf. To accomplish this the statspack and standby statspack must be installed using catcon.pl script (Refer 2020285.1). The setup of standby consists of running spcreate.sql (normal statspack) and sbcreate.sql (standby statspack) scripts.
A script defining the statspack setup parameters could be used to automate the statspack creation. Output below shows content of a such script, which defines tablespace to create the statspack related tables and the password for perfstat user among other things.

cat sp.sql
define default_tablespace='STATSPACKTBS'
define temporary_tablespace='TEMP'
define perfstat_password='asanga123'
@?/rdbms/admin/spcreate.sql;
@/home/oracle/statpack/chng.sql;

The chng.sql contains the additional work must be done after setting up statspcak. This include issues mentioned in 382993.1 and 2437142.1. Content of this files is shown below.

cat chng.sql
alter table perfstat.stats$mutex_sleep disable constraint STATS$MUTEX_SLEEP_PK;
create index perfstat.STATS$MUTEX_SLEEP_PK on STATS$MUTEX_SLEEP(SNAP_ID,DBID,INSTANCE_NUMBER,MUTEX_TYPE,LOCATION);
insert into stats$idle_event select name from v$event_name where wait_class='Idle' 
minus select event from stats$idle_event;

If perl binary out of ORACLE_HOME is not in the path then following error will occur when running catcon.pl

perl $ORACLE_HOME/rdbms/admin/catcon.pl -u sys -s -e -c 'CDB$ROOT' -n 1 -b st_spcreate sp.sql
Can't locate Term/ReadKey.pm in @INC (@INC contains: /usr/local/lib64/perl5 /usr/local/share/perl5 /usr/lib64/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib64/perl5 /usr/share/perl5 . /opt/cx/app/oracle/product/19.x.0/dbhome_1/rdbms/admin/) at /opt/cx/app/oracle/product/19.x.0/dbhome_1/rdbms/admin//catcon.pm line 497.
BEGIN failed--compilation aborted at /opt/cx/app/oracle/product/19.x.0/dbhome_1/rdbms/admin//catcon.pm line 497.
Compilation failed in require at /opt/cx/app/oracle/product/19.x.0/dbhome_1/rdbms/admin/catcon.pl line 165.
BEGIN failed--compilation aborted at /opt/cx/app/oracle/product/19.x.0/dbhome_1/rdbms/admin/catcon.pl line 165.

To rectify this issue put perl binary out of OH into the path and run the catcon.pl specifying sp.sql script.

export PATH=$ORACLE_HOME/perl/bin:$PATH
$ which perl
/opt/cx/app/oracle/product/19.x.0/dbhome_1/perl/bin/perl

perl $ORACLE_HOME/rdbms/admin/catcon.pl -u sys -s -e -c 'CDB$ROOT' -n 1 -b st_spcreate sp.sql

Next step is to create the standby statspack. A similar script could be created for that as well. The most important parameter in this case is the TNS alias which will be used to create the database link that will connect to the standby.

cat sb.sql
define default_tablespace='STATSPACKTBS'
define temporary_tablespace='TEMP'
define stdbyuser_password='asanga321'
define perfstat_password='asanga123'
define key='y'
define tns_alias='ppdbxdb5tns'
@?/rdbms/admin/sbcreate.sql;
@/home/oracle/statpack/sbchng.sql;

The sbchng.sql has additional work must be done on standby statspack. As stdbyperf user doesn't have access to v$event_name the idle event related workaround must be done after the setup. Also the STATS$MUTEX_SLEEP on standby statspack doesn't have DBID or instance number columns.

SQL> desc stdbyperf.stats$mutex_sleep
 Name                                      Null?    Type
 ----------------------------------------- -------- ----------------------------
 SNAP_ID                                   NOT NULL NUMBER
 DB_UNIQUE_NAME                            NOT NULL VARCHAR2(30)
 INSTANCE_NAME                             NOT NULL VARCHAR2(16)
 MUTEX_TYPE                                NOT NULL VARCHAR2(32)
 LOCATION                                  NOT NULL VARCHAR2(40)
 SLEEPS                                             NUMBER
 WAIT_TIME                                          NUMBER

Instead db_unique_name and instance_name must be used

cat sbchng.sql
alter table stdbyperf.stats$mutex_sleep disable constraint STATS$MUTEX_SLEEP_PK;
CREATE INDEX stdbyperf.STATS$MUTEX_SLEEP_PK ON stdbyperf.STATS$MUTEX_SLEEP(SNAP_ID,DB_UNIQUE_NAME,INSTANCE_NAME,MUTEX_TYPE, LOCATION);

Run the standby statspack creation with

perl $ORACLE_HOME/rdbms/admin/catcon.pl -u sys -s -e -c 'CDB$ROOT' -n 1 -b st_sbcreate sb.sql

Once standby statspack is created run as sys the following to update the idle events in stdbyperf user schema.

insert into stdbyperf.stats$idle_event select event from perfstat.stats$idle_event minus select event from stdbyperf.stats$idle_event;

Additional standby instaces could be added to the standby statspack by using sbaddins.sql. This must be run using stdbyperf and must specify the TNS entry to the standby db. A script similar to below could be used for accomplishing this. As all the standby database instnaces use same set of tables no need to do the additional work on the subsequent standby instances.

cat sbaddin.sql
connect stdbyperf/asanga321
define key='y'
define tns_alias='ppdbxdb6tns'
define perfstat_password='asanga123'
@?/rdbms/admin/sbaddins.sql;

perl $ORACLE_HOME/rdbms/admin/catcon.pl -u sys -s -e -c 'CDB$ROOT' -n 1 -b st_sbaddins sbaddin.sql

Login as stdbyperf and run the below to view the current statspack standby configuration. This only shows the standby instances added to statspack. Not the actual data guard configuation.

select * from stats$standby_config ;

DB_UNIQUE_NAME                 INST_NAME        DB_LINK                          PACKAGE_NAME
------------------------------ ---------------- -------------------------------- ----------------------------
ppdbxdb5                       ppdbxdb5         STDBY_LINK_ppdbxdb5tns           STATSPACK_ppdbxdb5_ppdbxdb5
ppdbxdb6                       ppdbxdb6         STDBY_LINK_ppdbxdb6tns           STATSPACK_ppdbxdb6_ppdbxdb6

As mentioned earlie the standby statspack uses common set of tables to store data from all the standby instances. Only unique objects created for each standby instance are the database link and PL/SQL package which has the name STATSPACK_<db_unique_name>_<instance_name>. The corresponding package for the particular standby instance must be used in order to work with the instance. This inlcuding taking snapshots, changing statspack parameters and etc. For example in orde to change the snap level on ppdbxdb5 should run the STATSPACK_PPdbxDB5_PPdbxDB5 package. Similarly to change snap level on ppdbxdb6 should use STATSPACK_PPdbxDB6_PPdbxDB6. Below output shows chaning snap level on ppdbxdb6.

exec STATSPACK_PPdbxDB6_PPdbxDB6.modify_statspack_parameter(i_snap_level => 7, i_modify_parameter=>'true');

select DB_UNIQUE_NAME,INSTANCE_NAME,snap_level from stats$statspack_parameter;

DB_UNIQUE_NAME                 INSTANCE_NAME    SNAP_LEVEL
------------------------------ ---------------- ----------
ppdbxdb5                       ppdbxdb5                  7
ppdbxdb6                       ppdbxdb6                  7

Standby statspack use a common sequence to create snap id. As such when multiple instances takes snapshots there will be gaps between two consecutive snap ids.
Manual snapshots could be taken by running STATSPACK_<db_unique_name>_<instance_name>.snap. Snapshot taking is not automated and has to be done manually. Scheduling it in a dbms_scheduler job would allow the snapshot taking to work even after swichover in a reader farm configuration mentioned at the begining of the post.
The user stdbyperf doesn't have permission to create scheduler job. Grant create job and execute on dbms_scheduler (if revoked from public) to stdbyperf. Could create one scheduler job for each standby or have a single wrapper procedure with snap call for each standby. Below shows two separate scheduler job for automating snapshot taking.

--ppdbxdb5                       

BEGIN
DBMS_SCHEDULER.CREATE_JOB (
job_name => 'STANDBY_STATSPACK_PPdbxDB5',
job_type => 'STORED_PROCEDURE',
job_action => 'STATSPACK_PPdbxDB5_PPdbxDB5.snap',
start_date => TO_TIMESTAMP('00' ,'MI'),
repeat_interval => 'FREQ=HOURLY',
enabled => TRUE);
END;
/

--ppdbxdb6
                       
BEGIN
DBMS_SCHEDULER.CREATE_JOB (
job_name => 'STANDBY_STATSPACK_PPdbxDB6',
job_type => 'STORED_PROCEDURE',
job_action => 'STATSPACK_PPdbxDB6_PPdbxDB6.snap',
start_date => TO_TIMESTAMP('01' ,'MI'),
repeat_interval => 'FREQ=HOURLY',
enabled => TRUE);
END;
/

When having multiple scheduler jobs are invoked at the same time it is possible to run into the following error.

2020-06-29T18:02:49.768983+00:00
Errors in file /opt/cx/app/oracle/diag/rdbms/ppdbxdb1/ppdbxdb1/trace/ppdbxdb1_j001_119494.trc:
ORA-12012: error on auto execute of job "STDBYPERF"."STANDBY_STATSPACK_PPdbxDB5"
ORA-02049: timeout: distributed transaction waiting for lock
ORA-06512: at "STDBYPERF.STATSPACK_PPdbxDB5_PPdbxDB5", line 3909
ORA-06512: at "STDBYPERF.STATSPACK_PPdbxDB5_PPdbxDB5", line 5486
ORA-06512: at "STDBYPERF.STATSPACK_PPdbxDB5_PPdbxDB5", line 101
ORA-06512: at line 1
2020-06-29T18:06:57.404823+00:00

To eliminate this have a time gap between two schedulers. Above schedulers are scheduled 1 minute apart.
Create standby statspack report by calling the sbreport. This will prompt to select the db_unique_name and instance_name and prompt the range of snap ids to create the statspack report.

SQL> @?/rdbms/admin/sbreport

Instances in this Statspack schema
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

DB Unique Name                 Instance Name
------------------------------ ----------------
ppdbxdb5                       ppdbxdb5
ppdbxdb6                       ppdbxdb6

Enter the DATABASE UNIQUE NAME of the standby database to report
Enter value for db_unique_name: ppdbxdb5
You entered: ppdbxdb5

Enter the INSTANCE NAME of the standby database instance to report
Enter value for inst_name: ppdbxdb5
You entered: ppdbxdb5


Specify the number of days of snapshots to choose from
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Entering the number of days (n) will result in the most recent
(n) days of snapshots being listed.  Pressing  without
specifying a number lists all completed snapshots.

Listing all Completed Snapshots
                                          Snap
Instance       Snap Id   Snap Started    Level Comment
------------ --------- ----------------- ----- --------------------
ppdbxdb5            14 30 Jun 2020 00:00     7
                    16 30 Jun 2020 01:00     7
                    18 30 Jun 2020 02:00     7
                    20 30 Jun 2020 03:00     7
                    22 30 Jun 2020 04:00     7

Standby statspack report will have a separate section on standby recovery

Recovery Progress Stats  DB/Inst: ppdbxdb5/ppdbxdb5  End Snap: 32
-> End Snapshot Time: 30-Jun-20 09:00:04
-> ordered by Recovery Start Time desc, Units, Item asc

Recovery Start Time Item                       Sofar Units   Redo Timestamp
------------------- ----------------- -------------- ------- ------------------
15-Jun-20 15:18:07  Log Files                 11,360 Files
15-Jun-20 15:18:07  Active Apply Rate            659 KB/sec
15-Jun-20 15:18:07  Average Apply Rat             12 KB/sec
15-Jun-20 15:18:07  Maximum Apply Rat         13,280 KB/sec
15-Jun-20 15:18:07  Redo Applied              14,936 Megabyt
15-Jun-20 15:18:07  Recovery ID                    0 RCVID
15-Jun-20 15:18:07  Last Applied Redo              0 SCN+Tim 30-Jun-20 09:00:15
15-Jun-20 15:18:07  Active Time               29,277 Seconds
15-Jun-20 15:18:07  Apply Time per Lo              1 Seconds
15-Jun-20 15:18:07  Checkpoint Time p              0 Seconds
15-Jun-20 15:18:07  Elapsed Time           1,273,511 Seconds
15-Jun-20 15:18:07  Standby Apply Lag              2 Seconds
          -------------------------------------------------------------

Purging of snapshots must also be done calling the purge procedure of the relavent standby instance package. Following procedure delete snapshots after 32 days of creation.

create table deleted_snaps(delete_time timestamp,
min_snapid number, 
max_snapid number, 
DB_UNIQUE_NAME VARCHAR2(30), 
INSTANCE_NAME VARCHAR2(16), primary key (DB_UNIQUE_NAME,INSTANCE_NAME,delete_time));

create or replace
Procedure Delete_Snaps As
min_snap_id stats$snapshot.snap_id%type;
max_snap_id stats$snapshot.snap_id%type;
db_unq_name stats$snapshot.DB_UNIQUE_NAME%type;
ins_name stats$snapshot.INSTANCE_NAME%type;
snapshots_purged pls_integer;
stm varchar2(500);
cursor delsnaps is select DB_UNIQUE_NAME,INSTANCE_NAME,min(snap_id) as min,
max(snap_id) as max from stats$snapshot 
where to_char(snap_time,'YYYY-MM-DD') = to_char(sysdate-32,'YYYY-MM-DD') 
group by DB_UNIQUE_NAME,INSTANCE_NAME;
begin
open delsnaps;
loop
fetch delsnaps into db_unq_name,ins_name,min_snap_id,max_snap_id;
Exit When Delsnaps%Notfound;
stm := 'begin STATSPACK_'||db_unq_name||'_'||ins_name||'.purge(i_begin_snap =>'||min_snap_id||', i_end_snap =>'|| max_snap_id||', i_snap_range  => true, i_extended_purge  => true, I_DB_UNIQUE_NAME  => '''||db_unq_name||''', I_INSTANCE_NAME => '''||ins_name||'''); end;';
dbms_output.put_line(stm);
execute immediate stm;
commit;
Insert Into Deleted_Snaps values(Systimestamp,Min_Snap_Id,Max_Snap_Id,db_unq_name,ins_name);  
end loop;
Close Delsnaps;
commit;
End;
/

Schedule the deletion of snapshots.

BEGIN
DBMS_SCHEDULER.CREATE_JOB (
job_name => 'Delete_Snaps_job',
job_type => 'STORED_PROCEDURE',
job_action => 'Delete_Snaps',
start_date => trunc(SYSDATE + 1,'DD') + 15/1444,
repeat_interval => 'FREQ=DAILY',
enabled => TRUE);
END;
/

To remove a standby instance from statspack configuration use $ORACLE_HOME/rdbms/admin/sbdelins.sql.

To drop standby statspack and statspack from the database use catcon.pl.

#remove standby statspack
perl $ORACLE_HOME/rdbms/admin/catcon.pl -u sys -s -e -c 'CDB$ROOT' -n 1 -b st_sbdrop  $ORACLE_HOME/rdbms/admin/sbdrop.sql

# remove statspack
perl $ORACLE_HOME/rdbms/admin/catcon.pl -u sys -s -e -c 'CDB$ROOT' -n 1 -b st_spdrop  $ORACLE_HOME/rdbms/admin/spdrop.sql

Useful metalink notes
STATSPACK:Idle Wait Events Missing in STATS$IDLE_EVENT [ID 2673657.1]
STATSPACK REPORTS SHOW "IDLE" DATA GUARD WAIT EVENTS IN TOP 5 IN 12.2 [ID 2305287.1]
12.2 or later STATSPACK: Idle Wait Event Such as 'Data Guard: Timer' is Erroneously Included in Top 5 Timed Events [ID 2437142.1]
New Idle Events are Erroneously Listed in STATSPACK Report [ID 1998538.1]
STATSPACK:Idle Wait Events Missing in STATS$IDLE_EVENT [ID 2673657.1]

Related Posts
Statspack setup in Brief
AWR Reports on Standby when Active Data Guard is Used

Can't locate Data/Dumper.pm in @INC When Using TFACTL

"Can't locate Data/Dumper.pm in @INC" error was encountered while executing tfactl and at times during installation. The environment setup and details are as follows.
OS

cat /etc/oracle-release
Oracle Linux Server release 7.7

uname -r
4.14.35-1902.10.2.1.el7uek.x86_64

Database setup is Oracle restart 19.7.

As the issue wasn't fully resolved even after a SR, it's important to consider the above configuration as issue wasn't happening in RedHat environments with single instance database setup.
The tfactl now comes bundle in Autonomous Health Framework (AHF, refer 2550798.1). Tfactl SR bundles are important specially when raising SR . At times SR will not move forward until a tfactl SR bundle is uploaded to the ticket. Therefore not being able to install or get a SR bundle using tfactl could add to resolution time (and to the frustration).
Tfactl could be installed both as root (in daemon mode) and as non-root user. While installing as non-root user the error was encountered during following step.

./ahf_setup -ahf_loc /opt/cx/tfa

AHF Installer for Platform Linux Architecture x86_64
AHF Installation Log : /tmp/ahf_install_86513_2020_06_24-08_59_24.log
Starting Autonomous Health Framework (AHF) Installation
AHF Version: 20.1.3 Build Date: 202004290950
AHF Location : /opt/cx/tfa/oracle.ahf
AHF Data Directory : /opt/cx/tfa/oracle.ahf/data
Extracting AHF to /opt/cx/tfa/oracle.ahf
Can't locate Data/Dumper.pm in @INC (@INC contains: /usr/local/lib64/perl5 /usr/local/share/perl5 /usr/lib64/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib64/perl5 /usr/share/perl5 . /opt/cx/tfa/oracle.ahf/tfa/bin /opt/cx/tfa/oracle.ahf/tfa/bin/common /opt/cx/tfa/oracle.ahf/tfa/bin/modules /opt/cx/tfa/oracle.ahf/tfa/bin/common/exceptions) at /opt/cx/tfa/oracle.ahf/tfa/bin/tfactl.pl line 294.
BEGIN failed--compilation aborted at /opt/cx/tfa/oracle.ahf/tfa/bin/tfactl.pl line 294.
AHF is deployed at /opt/cx/tfa/oracle.ahf
ORAchk is available at /opt/cx/tfa/oracle.ahf/bin/orachk
AHF binaries are available in /opt/cx/tfa/oracle.ahf/bin
AHF is successfully installed
Moving /tmp/ahf_install_86513_2020_06_24-08_59_24.log to /opt/cx/tfa/oracle.ahf/data/pre-prod/diag/ahf/

Even though error occurred the output says AHF was successfully installed. The installation issue was resolved by adding $OH/perl/bin to path.

export PATH=$ORACLE_HOME/perl/bin:$PATH
$ which perl
/opt/cx/app/oracle/product/19.x.0/dbhome_1/perl/bin/perl

$ ./ahf_setup -ahf_loc /opt/cx/tfa

AHF Installer for Platform Linux Architecture x86_64
AHF Installation Log : /tmp/ahf_install_87817_2020_06_24-09_02_05.log
Starting Autonomous Health Framework (AHF) Installation
AHF Version: 20.1.3 Build Date: 202004290950
AHF Location : /opt/cx/tfa/oracle.ahf
AHF Data Directory : /opt/cx/tfa/oracle.ahf/data
Extracting AHF to /opt/cx/tfa/oracle.ahf
Configuring TFA in Standalone Mode...
Build Version : 201300  Build Date : 202004290950

Discovering Nodes and Oracle Resources

.--------------------------------------------------------------------------------.
|                          Summary of TFA Configuration                          |
+----------------+---------------------------------------------------------------+
| Parameter      | Value                                                         |
+----------------+---------------------------------------------------------------+
| TFA Location   | /opt/cx/tfa/oracle.ahf/tfa                                    |
| Data Directory | /opt/cx/tfa/oracle.ahf/data/pre-prod/tfa      |
| Repository     | /opt/cx/tfa/oracle.ahf/data/repository                        |
| Diag Directory | /opt/cx/tfa/oracle.ahf/data/pre-prod/diag/tfa |
| Java Home      | /opt/cx/tfa/oracle.ahf/jre                                    |
'----------------+---------------------------------------------------------------'

.-----------------------------------------------------------------------------------------------------------------.
| Host                     | Status of TFA | PID | Port    | Version    | Build ID             | Inventory Status |
+--------------------------+---------------+-----+---------+------------+----------------------+------------------+
| pre-prod                 | RUNNING       | -   | OFFLINE | 20.1.3.0.0 | 20130020200429095054 | COMPLETED        |
'--------------------------+---------------+-----+---------+------------+----------------------+------------------'

AHF is deployed at /opt/cx/tfa/oracle.ahf
ORAchk is available at /opt/cx/tfa/oracle.ahf/bin/orachk
AHF binaries are available in /opt/cx/tfa/oracle.ahf/bin
AHF is successfully installed
Moving /tmp/ahf_install_87817_2020_06_24-09_02_05.log to /opt/cx/tfa/oracle.ahf/data/pre-prod/diag/ahf/

However, the running of tfactl failed with "Can't locate Data/Dumper.pm" no matter which perl binary was in the path. On OEL the default perl binary for non-root user (oracle) is out of following location.

which perl
/usr/bin/perl

Running tfactl with this default perl binary fails.

./tfactl diagcollect -srdc dbrac
Can't locate Data/Dumper.pm in @INC (@INC contains: /usr/local/lib64/perl5 /usr/local/share/perl5 /usr/lib64/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib64/perl5 /usr/share/perl5 . /opt/fc/tfa/oracle.ahf/tfa/bin /opt/fc/tfa/oracle.ahf/tfa/bin/common /opt/fc/tfa/oracle.ahf/tfa/bin/modules /opt/fc/tfa/oracle.ahf/tfa/bin/common/exceptions) at /opt/fc/tfa/oracle.ahf/tfa/bin/tfactl.pl line 294.
BEGIN failed--compilation aborted at /opt/fc/tfa/oracle.ahf/tfa/bin/tfactl.pl line 294.

On RHEL the default perl binary for non-root user is out of /bin. Setting this in path also fails to run tfactl.

export PATH=/bin:$PATH
$ which perl
/bin/perl

$ ./tfactl diagcollect -srdc dbrac
Can't locate Data/Dumper.pm in @INC (@INC contains: /usr/local/lib64/perl5 /usr/local/share/perl5 /usr/lib64/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib64/perl5 /usr/share/perl5 . /opt/cx/tfa/oracle.ahf/tfa/bin /opt/cx/tfa/oracle.ahf/tfa/bin/common /opt/cx/tfa/oracle.ahf/tfa/bin/modules /opt/cx/tfa/oracle.ahf/tfa/bin/common/exceptions) at /opt/cx/tfa/oracle.ahf/tfa/bin/tfactl.pl line 294.
BEGIN failed--compilation aborted at /opt/cx/tfa/oracle.ahf/tfa/bin/tfactl.pl line 294.

Running with perl out of ORALCE_HOME also fails.

which perl
/opt/cx/app/oracle/product/19.x.0/dbhome_1/perl/bin/perl

$ ./tfactl diagcollect -srdc dbrac
Can't locate Data/Dumper.pm in @INC (@INC contains: /usr/local/lib64/perl5 /usr/local/share/perl5 /usr/lib64/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib64/perl5 /usr/share/perl5 . /opt/cx/tfa/oracle.ahf/tfa/bin /opt/cx/tfa/oracle.ahf/tfa/bin/common /opt/cx/tfa/oracle.ahf/tfa/bin/modules /opt/cx/tfa/oracle.ahf/tfa/bin/common/exceptions) at /opt/cx/tfa/oracle.ahf/tfa/bin/tfactl.pl line 294.
BEGIN failed--compilation aborted at /opt/cx/tfa/oracle.ahf/tfa/bin/tfactl.pl line 294.

Support note 2233429.1 matches the issue at hand but solution wasn't relavent in this case. For tfactl to work DataDumper.pm and Data/Dumper.pm must be available inside Oracle home. In this case both these files were available.

cd $ORACLE_HOME
find . -name *Dumper.pm
./perl/lib/5.28.1/x86_64-linux-thread-multi/Data/Dumper.pm
./perl/lib/site_perl/5.28.1/x86_64-linux-thread-multi/DBI/Gofer/Serializer/DataDumper.pm

At this point raised a SR. However, SR didn't go anwyhere as the only thing SR handler could do is ask if the above two files are available. On top of that gave wrong information as ahf must be run as root when infact 2550798.1 states "If you are unable to install as root, then you can install as the Oracle home owner". So had to give up on relying on SR support and find a resolution or a workaround.



Inside the AHF (oracle.ahf) the tfactl is availble in serveral locations.

 find . -name tfactl
./data/pre-prod/diag/tfa/tfactl
./data/pre-prod/diag/tfactl
./ahf/bin/tfactl
./tfa/bin/tfactl
./bin/tfactl

All of those tfactl executions failed with the same error as above. However, inside "TFA Location" there's tfactl.pl script. Running this perl script directly with the perl out of ORACLE_HOME worked without error. The default perl binary out of OS (/usr/bin/perl) failed.

which perl
/opt/cx/app/oracle/product/19.x.0/dbhome_1/perl/bin/perl

cd /opt/cx/tfa/oracle.ahf/tfa/bin

perl tfactl.pl diagcollect -srdc dbrac

TFA will collect diagnostics for the last 1 hour(s).
Please enter the time of the incident [YYYY-MM-DD HH24:MI:SS], or  to collect for the last 1 hour(s):

Scripts to be run by this srdc:
Components included in this srdc: OS CRS DATABASE CHMOS ASM ASMPROXY ASMIO ACFS RHP DBWLM

Collection Id : 20200624092805pre-prod

Detailed Logging at : /opt/cx/tfa/oracle.ahf/data/repository/srdc_dbrac_collection_Wed_Jun_24_09_28_08_GMT_2020_node_all/diagcollect_20200624092805_pre-prod.log
2020/06/24 09:28:13 GMT : NOTE : Any file or directory name containing the string .com will be renamed to replace .com with dotcom
2020/06/24 09:28:13 GMT : Collection Name : tfa_srdc_dbrac_Wed_Jun_24_09_28_08_GMT_2020.zip
2020/06/24 09:28:13 GMT : Collecting additional diagnostic information...
2020/06/24 09:28:13 GMT : Getting list of files satisfying time range [06/24/2020 08:28:13 GMT, 06/24/2020 09:28:13 GMT]
2020/06/24 09:28:13 GMT : Completed collection of additional diagnostic information...
2020/06/24 09:28:28 GMT : Collecting ADR incident files...
2020/06/24 09:28:28 GMT : Completed Local Collection
.----------------------------------------------------.
|                 Collection Summary                 |
+--------------------------+-----------+------+------+
| Host                     | Status    | Size | Time |
+--------------------------+-----------+------+------+
| pre-prod                 | Completed | 9MB  |  15s |
'--------------------------+-----------+------+------'

Logs are being collected to: /opt/cx/tfa/oracle.ahf/data/repository/srdc_dbrac_collection_Wed_Jun_24_09_28_08_GMT_2020_node_all
/opt/cx/tfa/oracle.ahf/data/repository/srdc_dbrac_collection_Wed_Jun_24_09_28_08_GMT_2020_node_all/pre-prod.tfa_srdc_dbrac_Wed_Jun_24_09_28_08_GMT_2020.zip

In summary even if the files mentioned in 2233429.1 are present, the tfactl script would fail to run. In such cases run the tfactl perl script directly.

Useful MOS notes
Installing or Running TFA fails with "Can't locate Data/Dumper.pm in @INC (@INC contains" error [ID 2233429.1]