Tuesday, December 7, 2010

Adding a Node to 11gR1 RAC

This post only focus on adding the Oracle components into the new node. It is assumed other pre-reqs such as installing Oracle, configuring NIC, creating Oracle user and establishing user equivalence is done. Similar to deleting a node adding a node is also done in phases. First phase includes adding clusterware, and in second phase Oracle Database Software is added and finally the database and ASM instances are extended to the new node.

Both silent and interactive options could be used for this. Here for most of the commands silent option has been selected.

0. Backup vote disk and ocr

1. To add the clusterware to new node, run addNode.sh on an existing node. In the interactive mode this would open a GUI similar to below were public, vip and private interconnect information is entered. Same could be achieved running the addNode.sh in silent mode as below
$CRS_HOME/oui/bin/addNode.sh -silent "CLUSTER_NEW_NODES={rac2}" "CLUSTER_NEW_PRIVATE_NODE_NAMES={rac2-pvt}" "CLUSTER_NEW_VIRTUAL_HOSTNAMES={rac2-vip}"
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB. Actual 4094 MB Passed
Oracle Universal Installer, Version 11.1.0.7.0 Production
Copyright (C) 1999, 2008, Oracle. All rights reserved.


Performing tests to see whether nodes rac2 are available
......................................................... 100% Done.

-------------------------------------------------------------------
Cluster Node Addition Summary
Global Settings
Source: /opt/crs/oracle/product/11.1.0/crs
New Nodes
Space Requirements
New Nodes
rac2
/: Required 3.45GB : Available 10.48GB
Installed Products
Product Names
Oracle Database 10g Release 2 Patch Set 4 11.1.0.5.0
Oracle Clusterware 11.1.0.6.0
Oracle Database 11g Patch Set 1 11.1.0.7.0
Bali Share 1.1.18.0.0
Oracle Ice Browser 5.2.3.6.0
Bali Share 1.1.19.0.0
Buildtools Common Files 11.1.0.5.0
Enterprise Manager Minimal Integration 11.1.0.5.0
SSL Required Support Files for InstantClient Patch 11.1.0.5.0
DBJAVA Required Support Files Patch 11.1.0.5.0
Agent Required Support Files Patch 11.1.0.5.0
Sun JDK 1.5.0.11.0
Cluster Verification Utility Files 11.1.0.6.0
Oracle Required Support Files 32 bit 11.1.0.6.0
Cluster Verification Utility Common Files 11.1.0.6.0
Oracle Clusterware RDBMS Files 11.1.0.6.0
Oracle Extended Windowing Toolkit 3.4.47.0.0
Buildtools Common Files 11.1.0.6.0
Oracle Notification Service 11.1.0.5.0
Oracle RAC Required Support Files-HAS 11.1.0.6.0
SQL*Plus Required Support Files 11.1.0.6.0
XDK Required Support Files 11.1.0.6.0
Agent Required Support Files 11.1.0.3.1
Parser Generator Required Support Files 11.1.0.6.0
Precompiler Required Support Files 11.1.0.6.0
Platform Required Support Files 11.1.0.6.0
Oracle Core Required Support Files 11.1.0.6.0
Oracle Globalization Support 11.1.0.6.0
Perl Interpreter 5.8.3.0.4
Oracle JFC Extended Windowing Toolkit 4.2.36.0.0
Oracle Help For Java 4.2.9.0.0
LDAP Required Support Files 11.1.0.6.0
SSL Required Support Files for InstantClient 11.1.0.6.0
Oracle Net Required Support Files 11.1.0.6.0
RDBMS Required Support Files for Instant Client 11.1.0.6.0
RDBMS Required Support Files 11.1.0.6.0
Enterprise Manager Minimal Integration 11.1.0.6.0
Oracle Locale Builder 11.1.0.6.0
Oracle Globalization Support 11.1.0.6.0
HAS Common Files 11.1.0.6.0
Cluster Ready Services Files 11.1.0.6.0
Required Support Files 11.1.0.6.0
Installer SDK Component 11.1.0.7.0
Oracle One-Off Patch Installer 11.1.0.7.0
Oracle Universal Installer 11.1.0.7.0
Oracle Notification Service Patch 11.1.0.7.0
Required Support Files Patch 11.1.0.7.0
Perl Interpreter Patch 5.8.3.0.4p
Oracle Required Support Files 32 bit Patch 11.1.0.7.0
Oracle Clusterware RDBMS Files Patch 11.1.0.7.0
Precompiler Required Support Files Patch 11.1.0.7.0
RDBMS Required Support Files for Instant Client Patch 11.1.0.7.0
XDK Required Support Files Patch 11.1.0.7.0
SQL*Plus Required Support Files Patch 11.1.0.7.0
Parser Generator Required Support Files Patch 11.1.0.7.0
Oracle Core Required Support Files Patch 11.1.0.7.0
Oracle Locale Builder Patch 11.1.0.7.0
Oracle Globalization Support Patch 11.1.0.7.0
Oracle Globalization Support Patch 11.1.0.7.0
Oracle Net Required Support Files Patch 11.1.0.7.0
RDBMS Required Support Files Patch 11.1.0.7.0
SSL Required Support Files for InstantClient Patch 11.1.0.7.0
LDAP Required Support Files Patch 11.1.0.7.0
Oracle RAC Required Support Files-HAS Patch 11.1.0.7.0
Cluster Verification Utility Files Patch 11.1.0.7.0
Cluster Ready Services Files Patch 11.1.0.7.0
Cluster Verification Utility Common Files Patch 11.1.0.7.0
HAS Common Files Patch 11.1.0.7.0
Oracle Clusterware Patch 11.1.0.7.0
Platform Required Support Files Patch 11.1.0.7.0
-------------------------------------------------------------------


Instantiating scripts for add node (Monday, December 6, 2010 1:02:44 PM GMT) 1% Done.
Instantiation of add node scripts complete

Copying to remote nodes (Monday, December 6, 2010 1:02:49 PM GMT)
........................................................ 96% Done.
Home copied to new nodes

Saving inventory on nodes (Monday, December 6, 2010 1:08:05 PM GMT) 100% Done.
Save inventory complete
WARNING:
The following configuration scripts need to be executed as the "root" user in each cluster node.
#!/bin/sh
#Root script to run
/opt/crs/oracle/product/11.1.0/crs/install/rootaddnode.sh #On nodes rac1
/opt/crs/oracle/product/11.1.0/crs/root.sh #On nodes rac2
To execute the configuration scripts:
1. Open a terminal window
2. Log in as "root"
3. Run the scripts in each cluster node

The Cluster Node Addition of /opt/crs/oracle/product/11.1.0/crs was successful.
Please check '/tmp/silentInstall.log' for more details.
As mentioned in the output above run the two scripts as root on the respective nodes. On rac1
# /opt/crs/oracle/product/11.1.0/crs/install/rootaddnode.sh
clscfg: EXISTING configuration version 4 detected.
clscfg: version 4 is 11 Release 1.
Attempting to add 1 new nodes to the configuration
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node :
node 2: rac2 rac2-pvt rac2
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
/opt/crs/oracle/product/11.1.0/crs/bin/srvctl add nodeapps -n rac2 -A rac2-vip/255.255.255.0/eth0
On the new node rac2
/opt/crs/oracle/product/11.1.0/crs/root.sh
No need to validate voting disks
Checking to see if Oracle CRS stack is already configured
OCR LOCATIONS = /dev/raw/raw1
OCR backup directory '/opt/crs/oracle/product/11.1.0/crs/cdata/mycluster' does not exist. Creating now
Setting the permissions on OCR backup directory
Setting up Network socket directories
Oracle Cluster Registry configuration upgraded successfully
clscfg: EXISTING configuration version 4 detected.
clscfg: version 4 is 11 Release 1.
Successfully accumulated necessary OCR keys.
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node :
node 1: rac1 rac1-pvt rac1
clscfg: Arguments check out successfully.

NO KEYS WERE WRITTEN. Supply -force parameter to override.
-force is destructive and will destroy any previous cluster
configuration.
Oracle Cluster Registry for cluster has already been initialized
Startup will be queued to init within 30 seconds.
Adding daemons to inittab
Expecting the CRS daemons to be up within 600 seconds.
Cluster Synchronization Services is active on these nodes.
rac1
rac2
Cluster Synchronization Services is active on all the nodes.
Waiting for the Oracle CRSD and EVMD to start
Oracle CRS stack installed and running under init(1M)
2. Running the above scripts would have created the nodeapps on rac2 (new node). But there's a problem with ONS on 11gR1. Therefore ONS may not be up and running on the new node
crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora....SM1.asm application ONLINE ONLINE rac1
ora....C1.lsnr application ONLINE ONLINE rac1
ora.rac1.gsd application ONLINE ONLINE rac1
ora.rac1.ons application ONLINE ONLINE rac1
ora.rac1.vip application ONLINE ONLINE rac1
ora.rac2.gsd application ONLINE ONLINE rac2
ora.rac2.ons application ONLINE OFFLINE
ora.rac2.vip application ONLINE ONLINE rac2
ora.racdb.db application ONLINE ONLINE rac1
ora....b1.inst application ONLINE ONLINE rac1
Tring to start will throw the following error
srvctl stop nodeapps -n rac2
srvctl start nodeapps -n rac2
rac2:ora.rac2.ons:Number of onsconfiguration retrieved, numcfg = 1
rac2:ora.rac2.ons:onscfg[0]
rac2:ora.rac2.ons: {node = rac1.domain.net, port = 6200}
rac2:ora.rac2.ons:Adding remote host rac1.domain.net:6200
rac2:ora.rac2.ons:Number of onsconfiguration retrieved, numcfg = 1
rac2:ora.rac2.ons:onscfg[0]
rac2:ora.rac2.ons: {node = rac1.domain.net, port = 6200}
rac2:ora.rac2.ons:Adding remote host rac1.domain.net:6200
rac2:ora.rac2.ons:onsctl: ons failed to start
rac2:ora.rac2.ons:Number of onsconfiguration retrieved, numcfg = 1
rac2:ora.rac2.ons:onscfg[0]
rac2:ora.rac2.ons: {node = rac1.domain.net, port = 6200}
rac2:ora.rac2.ons:Adding remote host rac1.domain.net:6200
rac2:ora.rac2.ons:ons is not running ...
CRS-0215: Could not start resource 'ora.rac2.ons'.
Remove the existing ONS configuration and add a new configuration with the full host name
racgons add_config rac2.domain.net:6200
srvctl start nodeapps -n rac2

crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora....SM1.asm application ONLINE ONLINE rac1
ora....C1.lsnr application ONLINE ONLINE rac1
ora.rac1.gsd application ONLINE ONLINE rac1
ora.rac1.ons application ONLINE ONLINE rac1
ora.rac1.vip application ONLINE ONLINE rac1
ora.rac2.gsd application ONLINE ONLINE rac2
ora.rac2.ons application ONLINE ONLINE rac2
ora.rac2.vip application ONLINE ONLINE rac2
ora.racdb.db application ONLINE ONLINE rac1
ora....b1.inst application ONLINE ONLINE rac1
This concludes the phase one.



3. To add the Oracle Database software to new node run the $ORACLE_HOME/oui/bin/addNode.sh on an existing node.
$ORACLE_HOME/oui/bin/addNode.sh -silent "CLUSTER_NEW_NODES={rac2}"
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB. Actual 3812 MB Passed
Oracle Universal Installer, Version 11.1.0.7.0 Production
Copyright (C) 1999, 2008, Oracle. All rights reserved.


Performing tests to see whether nodes rac2 are available
............................................................... 100% Done.

-----------------------------------------------------------------------------
Cluster Node Addition Summary
Global Settings
Source: /opt/app/oracle/product/11.1.0/db_1
New Nodes
Space Requirements
New Nodes
rac2
/: Required 4.92GB : Available 7.77GB
Installed Products
Product Names
Oracle Database 11g 11.1.0.6.0
Oracle Database 11g Patch Set 1 11.1.0.7.0
Sun JDK 1.5.0.11.0
Oracle ODBC Driverfor Instant Client 11.1.0.6.0
LDAP Required Support Files 11.1.0.6.0
SSL Required Support Files for InstantClient 11.1.0.6.0
Oracle Net Required Support Files 11.1.0.6.0
Buildtools Common Files 11.1.0.6.0
Bali Share 1.1.18.0.0
Oracle Real Application Testing 11.1.0.6.0
Oracle Data Mining RDBMS Files 11.1.0.6.0
Oracle OLAP RDBMS Files 11.1.0.6.0
Oracle OLAP API 11.1.0.6.0
Oracle Extended Windowing Toolkit 3.4.47.0.0
Oracle JFC Extended Windowing Toolkit 4.2.36.0.0
SQL*Plus Required Support Files 11.1.0.6.0
Oracle RAC Required Support Files-HAS 11.1.0.6.0
XDK Required Support Files 11.1.0.6.0
Provisioning Advisor Framework 11.1.0.3.1
Enterprise Manager Database Plugin -- Repository Support 11.1.0.5.0
Enterprise Manager Repository Core Files 11.1.0.3.1
Enterprise Manager Database Plugin -- Management Service Support 11.1.0.5.0
Enterprise Manager Database Plugin -- Agent Support 11.1.0.5.0
Enterprise Manager Grid Control Core Files 11.1.0.3.1
Enterprise Manager Common Core Files 11.1.0.3.1
Enterprise Manager Agent Core Files 11.1.0.3.1
RDBMS Required Support Files for Instant Client 11.1.0.6.0
Oracle Display Fonts 9.0.2.0.0
RDBMS Required Support Files 11.1.0.6.0
Perl Interpreter 5.8.3.0.4
Oracle Ultra Search Common Files 11.1.0.6.0
Oracle Ultra Search Middle-Tier 11.1.0.6.0
Oracle Ultra Search Server 11.1.0.6.0
Oracle 11g Warehouse Builder Server 11.1.0.6.0
Agent Required Support Files 11.1.0.3.1
Oracle Database 11g Multimedia Files 11.1.0.6.0
Oracle Multimedia Java Advanced Imaging 11.1.0.6.0
Oracle Multimedia Annotator 11.1.0.6.0
Oracle Globalization Support 11.1.0.6.0
Oracle Multimedia Locator RDBMS Files 11.1.0.6.0
Parser Generator Required Support Files 11.1.0.6.0
Precompiler Required Support Files 11.1.0.6.0
Sample Schema Data 11.1.0.6.0
Oracle Starter Database 11.1.0.6.0
Oracle Message Gateway Common Files 11.1.0.6.0
Oracle XML Query 11.1.0.6.0
XML Parser for Oracle JVM 11.1.0.6.0
Oracle JDBC/OCI Instant Client 11.1.0.6.0
Installation Plugin Files 11.1.0.6.0
Enterprise Manager Common Files 11.1.0.3.1
regexp 2.1.9.0.0
Oracle JDBC Server Support Package 11.1.0.6.0
Oracle SQL Developer 11.1.0.6.0
Oracle Application Express 11.1.0.6.0
Oracle Ice Browser 5.2.3.6.0
Platform Required Support Files 11.1.0.6.0
Oracle Core Required Support Files 11.1.0.6.0
SQLJ Runtime 11.1.0.6.0
Database Workspace Manager 11.1.0.6.0
JAccelerator (COMPANION) 11.1.0.6.0
Oracle Containers for Java 11.1.0.6.0
Oracle Help For Java 4.2.9.0.0
Oracle Ultra Search Server Rdbms 11.1.0.6.0
Oracle Code Editor 1.2.1.0.0I
Oracle Required Support Files 32 bit 11.1.0.6.0
Oracle Universal Connection Pool 11.1.0.6.0
Oracle Multimedia Client Option 11.1.0.6.0
Oracle JDBC/THIN Interfaces 11.1.0.6.0
Oracle Java Client 11.1.0.6.0
Secure Socket Layer 11.1.0.6.0
Oracle Locale Builder 11.1.0.6.0
Character Set Migration Utility 11.1.0.6.0
Oracle Globalization Support 11.1.0.6.0
PL/SQL Embedded Gateway 11.1.0.6.0
OLAP SQL Scripts 11.1.0.6.0
Database SQL Scripts 11.1.0.6.0
Required Support Files 11.1.0.6.0
Oracle ODBC Driver 11.1.0.6.0
SQL*Plus Files for Instant Client 11.1.0.6.0
Oracle Database User Interface 2.2.13.0.0
Enterprise Manager Minimal Integration 11.1.0.6.0
XML Parser for Java 11.1.0.6.0
Oracle Security Developer Tools 11.1.0.6.0
Oracle Wallet Manager 11.1.0.6.0
Cluster Verification Utility Common Files 11.1.0.6.0
Oracle Clusterware RDBMS Files 11.1.0.6.0
Precompiler Common Files 11.1.0.6.0
Oracle UIX 2.2.20.0.0
Oracle Help for the Web 2.0.14.0.0
HAS Common Files 11.1.0.6.0
SQL*Plus 11.1.0.6.0
Oracle LDAP administration 11.1.0.6.0
Enterprise Manager plugin Common Files 11.1.0.5.0
Installation Common Files 11.1.0.6.0
Assistant Common Files 11.1.0.6.0
Oracle Notification Service 11.1.0.5.0
Oracle Net 11.1.0.6.0
Oracle Recovery Manager 11.1.0.6.0
PL/SQL 11.1.0.6.0
Secure Socket Layer 11.1.0.6.0
Oracle Database Utilities 11.1.0.6.0
Oracle Internet Directory Client 11.1.0.6.0
Oracle Multimedia Locator 11.1.0.6.0
Oracle Multimedia 11.1.0.6.0
Generic Connectivity Common Files 11.1.0.6.0
Oracle XML Development Kit 11.1.0.6.0
Database Configuration and Upgrade Assistants 11.1.0.6.0
Oracle JVM 11.1.0.6.0
Oracle Advanced Security 11.1.0.6.0
Oracle Database Gateway for ODBC 11.1.0.6.0
Oracle Programmer 11.1.0.6.0
Enterprise Manager Agent 11.1.0.3.1
Oracle Call Interface (OCI) 11.1.0.6.0
HAS Files for DB 11.1.0.6.0
Oracle Net Listener 11.1.0.6.0
Oracle Enterprise Manager Console DB 11.1.0.5.0
Oracle Net Services 11.1.0.6.0
Oracle Text 11.1.0.6.0
Oracle Database 11g 11.1.0.6.0
Oracle OLAP 11.1.0.6.0
Oracle Spatial 11.1.0.6.0
Oracle Partitioning 11.1.0.6.0
Enterprise Edition Options 11.1.0.6.0
Installer SDK Component 11.1.0.7.0
Oracle One-Off Patch Installer 11.1.0.7.0
Oracle Universal Installer 11.1.0.7.0
Oracle Warehouse Builder Required Support Files 11.1.0.7.0
Oracle Configuration Manager 10.3.0.1.0
Oracle Notification Service Patch 11.1.0.7.0
Required Support Files Patch 11.1.0.7.0
Oracle 11g Warehouse Builder Server 11.1.0.7.0
Enterprise Manager Repository Core Files 11.1.0.4.1
Enterprise Manager Common Core Files Patch 11.1.0.4.1
Enterprise Manager Agent Core Files Patch 11.1.0.4.1
Enterprise Manager Grid Control Core Files Patch 11.1.0.4.1
Provisioning Advisor Framework Patch 11.1.0.4.1
Enterprise Manager Common Files Patch 11.1.0.4.1
Enterprise Manager Agent Patch 11.1.0.4.1
Enterprise Manager Database Plugin -- Agent Support Patch 11.1.0.7.0
Enterprise Manager Database Plugin -- Repository Support Patch 11.1.0.7.0
Enterprise Manager plugin Common Files Patch 11.1.0.7.0
Oracle Enterprise Manager Database Console Patch 11.1.0.7.0
Perl Interpreter Patch 5.8.3.0.4p
Oracle Net Listener Patch 11.1.0.7.0
Oracle Required Support Files 32 bit Patch 11.1.0.7.0
Secure Socket Layer Patch 11.1.0.7.0
Oracle Partitioning Patch 11.1.0.7.0
Oracle Multimedia Locator RDBMS Files Patch 11.1.0.7.0
Oracle Clusterware RDBMS Files Patch 11.1.0.7.0
Oracle Database 11g Multimedia Files Patch 11.1.0.7.0
Oracle Real Application Testing Patch 11.1.0.7.0
PL/SQL Patch 11.1.0.7.0
Oracle OLAP RDBMS Files Patch 11.1.0.7.0
Oracle Data Mining RDBMS Files Patch 11.1.0.7.0
Precompiler Required Support Files Patch 11.1.0.7.0
Oracle Multimedia Annotator Patch 11.1.0.7.0
JAccelerator (COMPANION) Patch 11.1.0.7.0
Oracle ODBC Driver Patch 11.1.0.7.0
Oracle Call Interface (OCI) Patch 11.1.0.7.0
RDBMS Required Support Files for Instant Client Patch 11.1.0.7.0
PL/SQL Embedded Gateway Patch 11.1.0.7.0
Oracle Advanced Security Patch 11.1.0.7.0
Oracle JDBC/THIN Interfaces Patch 11.1.0.7.0
Installation Plugin Files Patch 11.1.0.7.0
Oracle LDAP administration Patch 11.1.0.7.0
Oracle Ultra Search Server Rdbms Patch 11.1.0.7.0
Oracle Universal Connection Pool Patch 11.1.0.7.0
Oracle XML Development Kit Patch 11.1.0.7.0
Oracle XML Query Patch 11.1.0.7.0
XDK Required Support Files Patch 11.1.0.7.0
XML Parser for Java Patch 11.1.0.7.0
SQL*Plus Patch 11.1.0.7.0
SQL*Plus Required Support Files Patch 11.1.0.7.0
SQL*Plus Files for Instant Client Patch 11.1.0.7.0
SQLJ Runtime Patch 11.1.0.7.0
Parser Generator Required Support Files Patch 11.1.0.7.0
Oracle Database 11g Patch 11.1.0.7.0
Oracle Spatial Patch 11.1.0.7.0
Oracle Multimedia Locator Patch 11.1.0.7.0
Oracle Database 11g Patch 11.1.0.7.0
Oracle Database Utilities Patch 11.1.0.7.0
Installation Common Files Patch 11.1.0.7.0
Oracle Recovery Manager Patch 11.1.0.7.0
Oracle Starter Database Patch 11.1.0.7.0
Sample Schema Data Patch 11.1.0.7.0
Oracle Database Gateway for ODBC Patch 11.1.0.7.0
Generic Connectivity Common Files Patch 11.1.0.7.0
Database SQL Scripts Patch 11.1.0.7.0
Precompiler Common Files Patch 11.1.0.7.0
Database Workspace Manager Patch 11.1.0.7.0
Oracle Multimedia Patch 11.1.0.7.0
Oracle Multimedia Java Advanced Imaging Patch 11.1.0.7.0
Oracle Multimedia Client Option Patch 11.1.0.7.0
OLAP SQL Scripts Patch 11.1.0.7.0
Oracle OLAP API Patch 11.1.0.7.0
Oracle OLAP Patch 11.1.0.7.0
Oracle Core Required Support Files Patch 11.1.0.7.0
Oracle ODBC Driverfor Instant Client Patch 11.1.0.7.0
Oracle Locale Builder Patch 11.1.0.7.0
Oracle Globalization Support Patch 11.1.0.7.0
Oracle Globalization Support Patch 11.1.0.7.0
Secure Socket Layer Patch 11.1.0.7.0
Oracle Net Required Support Files Patch 11.1.0.7.0
Oracle Net Patch 11.1.0.7.0
RDBMS Required Support Files Patch 11.1.0.7.0
Oracle Message Gateway Common Files Patch 11.1.0.7.0
Oracle Application Express Patch 11.1.0.7.0
Oracle Security Developer Tools Patch 11.1.0.7.0
SSL Required Support Files for InstantClient Patch 11.1.0.7.0
LDAP Required Support Files Patch 11.1.0.7.0
Oracle Wallet Manager Patch 11.1.0.7.0
Oracle Internet Directory Client Patch 11.1.0.7.0
Oracle Containers for Java Patch 11.1.0.7.0
Oracle Java Client Patch 11.1.0.7.0
Oracle JVM Patch 11.1.0.7.0
Oracle Ultra Search Server Patch 11.1.0.7.0
Oracle Ultra Search Common Files Patch 11.1.0.7.0
Oracle Ultra Search Middle-Tier Patch 11.1.0.7.0
Oracle RAC Required Support Files-HAS Patch 11.1.0.7.0
HAS Files for DB Patch 11.1.0.7.0
Cluster Verification Utility Common Files Patch 11.1.0.7.0
HAS Common Files Patch 11.1.0.7.0
Oracle JDBC/OCI Instant Client Patch 11.1.0.7.0
Oracle SQL Developer Patch 11.1.0.7.0
Oracle Text Patch 11.1.0.7.0
Character Set Migration Utility Patch 11.1.0.7.0
Platform Required Support Files Patch 11.1.0.7.0
Database Configuration and Upgrade Assistants Patch 11.1.0.7.0
Assistant Common Files Patch 11.1.0.7.0
-----------------------------------------------------------------------------


Instantiating scripts for add node (Monday, December 6, 2010 2:01:19 PM GMT) 1% Done.
Instantiation of add node scripts complete

Copying to remote nodes (Monday, December 6, 2010 2:01:47 PM GMT)
.......................................................... 96% Done.
Home copied to new nodes

Saving inventory on nodes (Monday, December 6, 2010 2:13:10 PM GMT) 100% Done.
Save inventory complete
WARNING:
The following configuration scripts need to be executed as the "root" user in each cluster node.
#!/bin/sh
#Root script to run
/opt/app/oracle/product/11.1.0/db_1/root.sh #On nodes rac2
To execute the configuration scripts:
1. Open a terminal window
2. Log in as "root"
3. Run the scripts in each cluster node

The Cluster Node Addition of /opt/app/oracle/product/11.1.0/db_1 was successful.
Please check '/tmp/silentInstall.log' for more details.
Run the above mentioned root script.

This concludes phase two.

4. On the new node run the Net Configuration Assistant (NETCA) to add a listener, select only the new node from the node selection list. Alternately could select reconfigure option which will reconfigure listeners for the entire RAC. After the reconfiguration listeners must be manually started on all nodes, this may not be desireable for a production system.

5. From an exisitng node run dbca to extend the database to the new node. This process will add a new node to the cluster. From the options on dbca select instance managment and add instance option and select the new node and proceed to completion.

While extending the database instance ASM will also be extended if the existing nodes also use ASM. Following message could be seen in these situations.End of this operation also concludes the addition of the new node.

Related Post
Adding a Node to 11gR2 RAC