RAC Frequently Asked Questions

RAC Frequently Asked Questions http://www.scribd.
com/doc/9457940/RAC-Frequently-Asked-Questions
Scribd
Upload a Document
Search
Search Books, Presentations, Documents
Business, Academ
Explore
Documents
Books - Fiction
Books - Non-fiction
Health & Medicine
Brochures/Catalogs
Government Docs
How-To Guides/Manuals
Magazines/Newspapers
Recipes/Menus
School Work
+ all categories
Featured
Recent
People
Authors
Students
Researchers
Publishers
Government & Nonprofits
Businesses
Musicians
Artists & Designers
Teachers
+ all categories
Most Followed
Popular
Irshad Ahmed
Account
Home
My Documents
My Collections
My Shelf
View Public Profile
Messages
Notifications
Settings
Help
Log Out
25 / 95
Search within document...
Reading should be social! Post a message on your social networks to let others know what you're reading. Select the sites below and start sharing.
Link account
Readcast this Document edit preferences
Download this Document for Free
1 of 64 1/1/2011 3:48 PM
RAC Frequently Asked Questions http://www.scribd.com/doc/9457940/RAC-Frequently-Asked-Questions
25 / 95
Link account
2 of 64 1/1/2011 3:48 PM
25 / 95
Link account
3 of 64 1/1/2011 3:48 PM
25 / 95
Link account
4 of 64 1/1/2011 3:48 PM
25 / 95
Link account
5 of 64 1/1/2011 3:48 PM
25 / 95
Link account
6 of 64 1/1/2011 3:48 PM
25 / 95
Link account
7 of 64 1/1/2011 3:48 PM
25 / 95
Link account
8 of 64 1/1/2011 3:48 PM
25 / 95
Link account
9 of 64 1/1/2011 3:48 PM
25 / 95
Link account
10 of 64 1/1/2011 3:48 PM
25 / 95
Link account
11 of 64 1/1/2011 3:48 PM
25 / 95
Link account
12 of 64 1/1/2011 3:48 PM
25 / 95
Link account
13 of 64 1/1/2011 3:48 PM
25 / 95
Link account
14 of 64 1/1/2011 3:48 PM
• Sun Trunking (OS based)
• Sun IPMP (OS based)
• Sun Cluster based network failover solution (IPMP based)
More information: Metalink Note 283107.1 - IPMP in general. When IPMP is used for the
interconnect: Metalink Note 368464.1
Related RAC FAQ entries: In Solaris 10, do we need Sun Clusterware to provide redundancy for
the interconnect and multiple switches?
Linux - available solutions:
• Bonding
More information: Metalink Note 298891.1

Related RAC FAQ entries: How do I use multiple network interfaces to provide High Availability
and/or Load Balancing for my interconnect with Oracle Clusterware?
Windows - available solutions:
• Teaming
On Windows teaming solutions to ensure NIC availability are usually part of the network card
driver.
Thus, they depend on the network card used. Please, contact the respective hardware vendor for
more information.
Is there a need to renice LMS processes in Oracle RAC 10g

Release 2?
LMS processes should be running in RT by default since 10.2, so there's NO need to renice
them, or otherwise mess with them.
Check with ps -efl:
0 S spommere 31191 1 0 75 0 - 270857 - 10:01 ? 00:00:00 ora_lmon_appsu01
0 S spommere 31193 1 5 75 0 - 271403 - 10:01 ? 00:00:07 ora_lmd0_appsu01
0 S spommere 31195 1 0 58 - - 271396 - 10:01 ? 00:00:00 ora_lms0_appsu01
0 S spommere 31199 1 0 58 - - 271396 - 10:01 ? 00:00:00 ora_lms1_appsu01
7th column, if it is 75 or 76 then this is Time Share, 58 is Real Time.
25 / 95
Link account
15 of 64 1/1/2011 3:48 PM
You can also use chrt to check:

LMS (Real Time):
$ chrt -p 31199
pid 31199's current scheduling policy: SCHED_RR
pid 31199's current scheduling priority: 1
LMD (Time Share)
$ chrt -p 31193
pid 31193's current scheduling policy: SCHED_OTHER
pid 31193's current scheduling priority: 0
How do I check for network problems on my interconect?

1. Confirm that full duplex is set correctly for all interconnect links on all interfaces on both ends.
Do not rely on auto negotiation.
2. ifconfig -a will give you an indication of collisions/errors/overuns and dropped packets
3. netstat -s will give you a listing of receive packet discards, fragmentation and reassembly
errors for IP and UDP.
4. Set the udp buffers correctly
5. Check your cabling
Note: If you are seeing issues with RAC, RAC uses UDP as the protocol. Oracle Clusterware
uses TCP/IP.
Are there any issues for the interconnect when sharing the same
switch as the public network by using VLAN to separate the
network?
RAC and Clusterware deployment best practices recommend that the interconnect be deployed
on a stand-alone, physically seperate, dedicated switch. Many customers have consolidated
these stand-alone switches into larger managed switches. A consequence of this consolidation is
a merging of IP networks on a single shared switch, segmented by VLANs. There are caveats
associated with such deployments. RAC cache fusion exercises the IP network more rigorously
than non-RAC Oracle databases. The latency and bandwidth requirements as well as availability
requirements of the RAC/Clusterware interconnect IP network are more in-line with high
performance computing. Deploying the RAC/Clusterware interconnect on a shared switch,
segmented VLAN may expose the interconnect links to congestion and instability in the larger IP
network topology. If deploying the interconnect on a VLAN, there should be a 1:1 mapping of
VLAN to non-routable subnet and the VLAN should not span multiple VLANs (tagged) or multiple
switches. Deployment concerns in this environment include Spanning Tree loops when the larger
IP network topology changes, Assymetric routing that may cause packet flooding, and lack of fine
grained monitoring of the VLAN/port.
25 / 95
Link account
16 of 64 1/1/2011 3:48 PM
Can I run RAC 10g with RAC 11g?

Yes. The Oracle Clusterware should always run at the highest level. With Oracle Clusterware
11g, you can run both RAC 10g and RAC 11g databases. If you are using ASM for storage, you
can use either Oracle Database 10g ASM or Oracle Database 11g ASM however to get the 11g
features, you must be running Oracle Database 11g ASM. It is recommended to use Oracle
Database 11g ASM.
Yes, you can run 9iRAC in the cluster as well. 9i RAC requires the clusterware that is certified
with 9i RAC to be running in addition to Oracle Clusterware 11g.
Are jumbo frames supported for the RAC interconnect?

Yes. For details see Metalink <> Cluster Interconnect and Jumbo Frames
Are Sun Logical Domains (ldoms) supported with RAC?

Currently Sun Logical Domains (ldoms) are not supported with Oracle Database (both single
instance and RAC). Check certify for the latest information, if certification is completed, it will be
listed in Certify.
The Veritas installation document on page 219 asks for setting

LD_LIBRARY_PATH_64. Should I remove this?
Yes You do not need to set LD_LIBRARY_PATH for Oracle.
Are block devices supported for OCR, Voting Disks, ASM devices?
Block Devices are only supported on Linux. For Unix platforms, the directio symantics not
applicable (or rather not implemented) for the block devices on these platforms.
Note: On Linux, raw devices are being deprecated so you should move to using block devices.
Note the Oracle Database 10g OUI does not support block devices however Oracle Clusterware
and ASM do.
25 / 95
Link account
17 of 64 1/1/2011 3:48 PM
We are using Transparent Data Encryption (TDE).

We create a wallet on node 1 and copy to nodes 2 & 3. Open the
wallet and we are able to select encrypted data on all three nodes.
Now, we want to REKEY the MASTER KEY. What do we have to
do?
After a re-key on node one, 'alter system set wallet close' on all other nodes, copy the wallet with
the new master key to all other nodes, 'alter system set wallet open identified by "password"; on
all other nodes to load the (obfuscated) master key into node's SGA.
Why does the NOAC attribute need to be set on NFS mounted RAC
Binaries?
The noac attribute is required because the installer determines sharedness by creating a file and
checking for that file s existance on remote node. If the noac attribute is not enabled then this
test will incorrectly fail. This will confuse installer and opatch. Some other minor issues issues
with spfile in the default $ORACLE_HOME/dbs will definitely be affected.
How do I use DBCA in silent mode to set up RAC and ASM?

If I already have an ASM instance/diskgroup then the following creates a RAC database on that
diskgroup:
su oracle -c "$ORACLE_HOME/bin/dbca -silent -createDatabase -templateName

General_Purpose.dbc -gdbName $SID -sid $SID -sysPassword $PASSWORD -systemPassword
$PASSWORD -sysmanPassword $PASSWORD -dbsnmpPassword $PASSWORD -
emConfiguration LOCAL -storageType ASM -diskGroupName $ASMGROUPNAME -
datafileJarLocation $ORACLE_HOME/assistants/dbca/templates -nodeinfo $NODE1,$NODE2 -
characterset WE8ISO8859P1 -obfuscatedPasswords false -sampleSchema false -oratabLocation
/etc/oratab"
The following will create a ASM instance & 1 diskgroup
su oracle -c "$ORA_ASM_HOME/bin/dbca -silent -configureASM -gdbName NO -sid NO -

emConfiguration NONE -diskList $ASM_DISKS -diskGroupName $ASMGROUPNAME -
datafileJarLocation $ORACLE_HOME/assistants/dbca/templates -nodeinfo $NODE1,$NODE2 -
obfuscatedPasswords false -oratabLocation /etc/oratab -asmSysPassword $PASSWORD -
redundancy $ASMREDUNDANCY"
25 / 95
Link account
18 of 64 1/1/2011 3:48 PM
where ASM_DISKS = '/dev/sda1,/dev/sdb1' and ASMREDUNDANCY='NORMAL'
w does OCR mirror work? What happens if my OCR is

lost/corrupt?
OCR is the Oracle Cluster Registry, it holds all the cluster related information such as instances,
services. The OCR file format is binary and starting with 10.2 it is possible to mirror it. Location of
file(s) is located in: /etc/oracle/ocr.loc in ocrconfig_loc and ocrmirrorconfig_loc variables.
Obviously if you only have one copy of the OCR and it is lost or corrupt then you must restore a
recent backup, see ocrconfig utility for details, specifically -showbackup and -restore flags. Until a
valid backup is restored the Oracle Clusterware will not startup due to the corrupt/missing OCR file.
The interesting discussion is what happens if you have the OCR mirrored and one of the copies
gets corrupt? You would expect that everything will continue to work seemlessly. Well.. Almost..
The real answer depends on when the corruption takes place.
If the corruption happens while the Oracle Clusterware stack is up and running, then the
corruption will be tolerated and the Oracle Clusterware will continue to funtion without
interruptions. Despite the corrupt copy. DBA is advised to repair this hardware/software problem
that prevent OCR from accessing the device as soon as possible; alternatively, DBA can replace
the failed device with another healthy device using the ocrconfig utility with -replace flag.
If however the corruption happens while the Oracle Clusterware stack is down, then it will not be
possible to start it up until the failed device becomes online again or some administrative action
using ocrconfig utility with -overwrite flag is taken. When the Clusteware attempts to start you will
see messages similar to:
total id sets (1), 1st set (1669906634,1958222370), 2nd set (0,0) my

votes (1), total votes (2)
2006-07-12 10:53:54.301: [OCRRAW][1210108256]proprioini:disk 0
(/dev/raw/raw1) doesn't have enough votes (1,2)
2006-07-12 10:53:54.301: [OCRRAW][1210108256]proprseterror: Error in
accessing physical storage [26]
This is because the software can't determin which OCR copy is the valid one. In the above
example one of the OCR mirrors was lost while the Oracle Clusterware was down. There are 3
ways to fix this failure:
a) Fix whatever problem (hardware/software?) that prevent OCR from accessing the device.
b) Issue "ocrconfig -overwrite" on any one of the nodes in the cluster. This command will
overwrite the vote check built into OCR when it starts up. Basically, if OCR device is configured
with mirror, OCR assign each device with one vote. The rule is to have more than 50% of total
vote (quorum) in order to safely make sure the available devices contain the latest data. In 2-way
mirroring, the total vote count is 2 so it requires 2 votes to achieve the quorum. In the example
above there isn't enough vote to start if only one device with one vote is available. (In the earlier
25 / 95
Link account
19 of 64 1/1/2011 3:48 PM
25 / 95
Link account
20 of 64 1/1/2011 3:48 PM
25 / 95
Link account
21 of 64 1/1/2011 3:48 PM
25 / 95
Link account
22 of 64 1/1/2011 3:48 PM
25 / 95
Link account
23 of 64 1/1/2011 3:48 PM
25 / 95
Link account
24 of 64 1/1/2011 3:48 PM
25 / 95
Link account
25 of 64 1/1/2011 3:48 PM
25 / 95
Link account
26 of 64 1/1/2011 3:48 PM
25 / 95
Link account
27 of 64 1/1/2011 3:48 PM
25 / 95
Link account
28 of 64 1/1/2011 3:48 PM
25 / 95
Link account
29 of 64 1/1/2011 3:48 PM
25 / 95
Link account
30 of 64 1/1/2011 3:48 PM
25 / 95
Link account
31 of 64 1/1/2011 3:48 PM
25 / 95
Link account
32 of 64 1/1/2011 3:48 PM
25 / 95
Link account
33 of 64 1/1/2011 3:48 PM
25 / 95
Link account
34 of 64 1/1/2011 3:48 PM
25 / 95
Link account
35 of 64 1/1/2011 3:48 PM
25 / 95
Link account
36 of 64 1/1/2011 3:48 PM
25 / 95
Link account
37 of 64 1/1/2011 3:48 PM
25 / 95
Link account
38 of 64 1/1/2011 3:48 PM
25 / 95
Link account
39 of 64 1/1/2011 3:48 PM
25 / 95
Link account
40 of 64 1/1/2011 3:48 PM
25 / 95
Link account
41 of 64 1/1/2011 3:48 PM
25 / 95
Link account
42 of 64 1/1/2011 3:48 PM
25 / 95
Link account
43 of 64 1/1/2011 3:48 PM
25 / 95
Link account
44 of 64 1/1/2011 3:48 PM
25 / 95
Link account
45 of 64 1/1/2011 3:48 PM
25 / 95
Link account
46 of 64 1/1/2011 3:48 PM
25 / 95
Link account
47 of 64 1/1/2011 3:48 PM
25 / 95
Link account
48 of 64 1/1/2011 3:48 PM
25 / 95
Link account
49 of 64 1/1/2011 3:48 PM
25 / 95
Link account
50 of 64 1/1/2011 3:48 PM
25 / 95
Link account
51 of 64 1/1/2011 3:48 PM
25 / 95
Link account
52 of 64 1/1/2011 3:48 PM
25 / 95
Link account
53 of 64 1/1/2011 3:48 PM
25 / 95
Link account
54 of 64 1/1/2011 3:48 PM
25 / 95
Link account
55 of 64 1/1/2011 3:48 PM
25 / 95
Link account
56 of 64 1/1/2011 3:48 PM
25 / 95
Link account
57 of 64 1/1/2011 3:48 PM
25 / 95
Link account
58 of 64 1/1/2011 3:48 PM
25 / 95
Link account
59 of 64 1/1/2011 3:48 PM
25 / 95
RAC Frequently Asked Questions

Reading
Download should be social! Post
this Document a message on your social networksDocument
for FreePrintMobileCollectionsReport to let others know what you're reading. Select the sites below and start sharing.
This is a private document.
Info and Rating

Education-Early-Education
inconsistent amongst
application clusters
Link
createaccount
Readcast
faqs this Document edit preferences
60 of 64 1/1/2011 3:48 PM
ocr id
remote
(more tags)
mailkeruba@yahoo.com
Ads by Google
Share & Embed
Related Documents
PreviousNext
1.
p.
92 p.
92 p.
2.
p.
p.
25 / 95
Searchp.within document...
3.
p.
Link account
Readcast
9 p.this Document edit preferences
61 of 64 1/1/2011 3:48 PM
5 p.
4.
5 p.
310 p.
4 p.
5. 9
p.
31 p.
70 p.
6.
70 p.
3 p.
1 p.
25 / 95
7.
1 p.
2 p.
Link account
62 of 64 1/1/2011 3:48 PM
8 p.
8.
24 p.
7 p.
17 p.
9.
19 p.
p.
21 p.
10.
4 p.
4 p.
25 / 95
11.
24 p.
1 p.
Link account
63 of 64 1/1/2011 3:48 PM
43 p.
12.
1 p.
More from this user

PreviousNext
1.
95 p.
Recent Readcasters
Add a Comment
share:
Characters: 400
This document has made it onto the Rising list!
01 / 12 / 2010
Upload a Document
Search
Search Books, Presentations, Documents
Business, Academ
Follow Us!
scribd.com/scribd
twitter.com/scribd
facebook.com/scribd
25 / 95
Press
Blog
Partners
Scribd
Reading 101be social! Post a message on your social networks to let others know what you're reading. Select the sites below and start sharing.
should
Web Stuff
Scribd Store
Support
FAQ
Developers / API
Jobs
Terms
Copyright
Link account
Privacy
64 of 64 1/1/2011 3:48 PM

RAC Frequently Asked Questions

Uploaded by

Document Information

Original Description:

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

RAC Frequently Asked Questions

Uploaded by

Copyright:

Available Formats

RAC Frequently Asked Questions http://www.scribd.

• Sun Trunking (OS based)

• Sun IPMP (OS based)

• Sun Cluster based network failover solution (IPMP based)

Linux - available solutions:

More information: Metalink Note 298891.1

Windows - available solutions:

Is there a need to renice LMS processes in Oracle RAC 10g

7th column, if it is 75 or 76 then this is Time Share, 58 is Real Time.

You can also use chrt to check:

LMD (Time Share)

How do I check for network problems on my interconect?

Can I run RAC 10g with RAC 11g?

Are jumbo frames supported for the RAC interconnect?

Are Sun Logical Domains (ldoms) supported with RAC?

The Veritas installation document on page 219 asks for setting

We are using Transparent Data Encryption (TDE).

How do I use DBCA in silent mode to set up RAC and ASM?

su oracle -c "$ORACLE_HOME/bin/dbca -silent -createDatabase -templateName

The following will create a ASM instance & 1 diskgroup

su oracle -c "$ORA_ASM_HOME/bin/dbca -silent -configureASM -gdbName NO -sid NO -

where ASM_DISKS = '/dev/sda1,/dev/sdb1' and ASMREDUNDANCY='NORMAL'

w does OCR mirror work? What happens if my OCR is

total id sets (1), 1st set (1669906634,1958222370), 2nd set (0,0) my

RAC Frequently Asked Questions

Info and Rating

Share & Embed

More from this user

This document has made it onto the Rising list!

You might also like