Thinking Out Loud

April 27, 2013

CRS and Cluster

Filed under: 11g,RAC — mdinh @ 5:55 pm

CRS and Cluster, what’s the difference and which one should I use for start and stop?

CRS is Cluster Ready Service and used to manage HAS (High Availability Services)

Cluster is where the application runs on.

Stop CRS is local to the node and will shutdown local HAS – crsctl stop crs
Stop cluster will shutdown across all nodes and will NOT shutdown HAS – crsctl stop cluster -all

Here’s the catch.
Start cluster will NOT start the node without HAS running – crsctl start cluster -all
The node must be started manually – crsctl start crs

 

DEMO:

[root@rac01 ~]# /u01/app/11.2.0.3/grid/bin/crsctl status server

NAME=rac01
STATE=ONLINE

NAME=rac02
STATE=ONLINE

NAME=rac03
STATE=ONLINE

[root@rac01 ~]# /u01/app/11.2.0.3/grid/bin/crsctl stop crs

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac01'
CRS-2673: Attempting to stop 'ora.crsd' on 'rac01'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac01'
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'rac01'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'rac01'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac01'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac01' succeeded
CRS-2673: Attempting to stop 'ora.rac01.vip' on 'rac01'
CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'rac01' succeeded
CRS-2673: Attempting to stop 'ora.scan2.vip' on 'rac01'
CRS-2677: Stop of 'ora.scan2.vip' on 'rac01' succeeded
CRS-2672: Attempting to start 'ora.scan2.vip' on 'rac02'
CRS-2677: Stop of 'ora.rac01.vip' on 'rac01' succeeded
CRS-2672: Attempting to start 'ora.rac01.vip' on 'rac03'
CRS-2676: Start of 'ora.rac01.vip' on 'rac03' succeeded
CRS-2676: Start of 'ora.scan2.vip' on 'rac02' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN2.lsnr' on 'rac02'
CRS-2676: Start of 'ora.LISTENER_SCAN2.lsnr' on 'rac02' succeeded
CRS-2677: Stop of 'ora.DATA.dg' on 'rac01' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac01'
CRS-2677: Stop of 'ora.asm' on 'rac01' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'rac01'
CRS-2677: Stop of 'ora.ons' on 'rac01' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'rac01'
CRS-2677: Stop of 'ora.net1.network' on 'rac01' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac01' has completed
CRS-2677: Stop of 'ora.crsd' on 'rac01' succeeded
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac01'
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac01'
CRS-2673: Attempting to stop 'ora.evmd' on 'rac01'
CRS-2673: Attempting to stop 'ora.asm' on 'rac01'
CRS-2677: Stop of 'ora.evmd' on 'rac01' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'rac01' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac01' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac01'
CRS-2677: Stop of 'ora.ctssd' on 'rac01' succeeded
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac01' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac01'
CRS-2677: Stop of 'ora.cssd' on 'rac01' succeeded
CRS-2673: Attempting to stop 'ora.crf' on 'rac01'
CRS-2677: Stop of 'ora.crf' on 'rac01' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac01'
CRS-2677: Stop of 'ora.gipcd' on 'rac01' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac01'
CRS-2677: Stop of 'ora.gpnpd' on 'rac01' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac01' has completed
CRS-4133: Oracle High Availability Services has been stopped.

[root@rac01 ~]# /u01/app/11.2.0.3/grid/bin/crsctl status server

CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Status failed, or completed with errors.

[root@rac01 ~]# /u01/app/11.2.0.3/grid/bin/crsctl check cluster -all

CRS-4639: Could not contact Oracle High Availability Services
CRS-4000: Command Check failed, or completed with errors.

[root@rac01 ~]# ssh rac02 /u01/app/11.2.0.3/grid/bin/crsctl status server

NAME=rac02
STATE=ONLINE

NAME=rac03
STATE=ONLINE

[root@rac01 ~]# ssh rac02 /u01/app/11.2.0.3/grid/bin/crsctl check cluster -all

**************************************************************
rac02:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
rac03:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************

[root@rac01 ~]# ps -ef|grep grid

root     10899 10603  0 10:24 pts/1    00:00:00 grep grid

[root@rac02 ~]# /u01/app/11.2.0.3/grid/bin/crsctl stop cluster -all

CRS-2673: Attempting to stop 'ora.crsd' on 'rac02'
CRS-2673: Attempting to stop 'ora.crsd' on 'rac03'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac02'
CRS-2673: Attempting to stop 'ora.oc4j' on 'rac02'
CRS-2673: Attempting to stop 'ora.cvu' on 'rac02'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'rac02'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'rac02'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac02'
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'rac02'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac03'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'rac03'
CRS-2673: Attempting to stop 'ora.rac03.vip' on 'rac03'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac03'
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'rac03'
CRS-2677: Stop of 'ora.rac03.vip' on 'rac03' succeeded
CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'rac02' succeeded
CRS-2673: Attempting to stop 'ora.scan2.vip' on 'rac02'
CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'rac02' succeeded
CRS-2673: Attempting to stop 'ora.scan3.vip' on 'rac02'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac02' succeeded
CRS-2673: Attempting to stop 'ora.rac02.vip' on 'rac02'
CRS-2677: Stop of 'ora.scan2.vip' on 'rac02' succeeded
CRS-2677: Stop of 'ora.rac02.vip' on 'rac02' succeeded
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'rac03' succeeded
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'rac03'
CRS-2677: Stop of 'ora.scan3.vip' on 'rac02' succeeded
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac03' succeeded
CRS-2673: Attempting to stop 'ora.rac01.vip' on 'rac03'
CRS-2677: Stop of 'ora.scan1.vip' on 'rac03' succeeded
CRS-2677: Stop of 'ora.rac01.vip' on 'rac03' succeeded
CRS-2677: Stop of 'ora.oc4j' on 'rac02' succeeded
CRS-2677: Stop of 'ora.cvu' on 'rac02' succeeded
CRS-2677: Stop of 'ora.DATA.dg' on 'rac02' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac02'
CRS-2677: Stop of 'ora.DATA.dg' on 'rac03' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac03'
CRS-2677: Stop of 'ora.asm' on 'rac03' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac02' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'rac03'
CRS-2677: Stop of 'ora.ons' on 'rac03' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'rac03'
CRS-2677: Stop of 'ora.net1.network' on 'rac03' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac03' has completed
CRS-2673: Attempting to stop 'ora.ons' on 'rac02'
CRS-2677: Stop of 'ora.ons' on 'rac02' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'rac02'
CRS-2677: Stop of 'ora.net1.network' on 'rac02' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac02' has completed
CRS-2677: Stop of 'ora.crsd' on 'rac03' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac03'
CRS-2673: Attempting to stop 'ora.evmd' on 'rac03'
CRS-2673: Attempting to stop 'ora.asm' on 'rac03'
CRS-2677: Stop of 'ora.crsd' on 'rac02' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac02'
CRS-2673: Attempting to stop 'ora.evmd' on 'rac02'
CRS-2673: Attempting to stop 'ora.asm' on 'rac02'
CRS-2677: Stop of 'ora.evmd' on 'rac03' succeeded
CRS-2677: Stop of 'ora.evmd' on 'rac02' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'rac03' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'rac02' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac03' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac03'
CRS-2677: Stop of 'ora.asm' on 'rac02' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac02'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac02' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac02'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac03' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac03'
CRS-2677: Stop of 'ora.cssd' on 'rac02' succeeded
CRS-2677: Stop of 'ora.cssd' on 'rac03' succeeded

[root@rac02 ~]# ps -ef|grep grid

root      2253     1  1 09:02 ?        00:01:02 /u01/app/11.2.0.3/grid/bin/ohasd.bin reboot
grid      2491     1  0 09:02 ?        00:00:24 /u01/app/11.2.0.3/grid/bin/oraagent.bin
grid      2503     1  0 09:02 ?        00:00:00 /u01/app/11.2.0.3/grid/bin/mdnsd.bin
grid      2513     1  0 09:02 ?        00:00:03 /u01/app/11.2.0.3/grid/bin/gpnpd.bin
grid      2524     1  0 09:02 ?        00:00:18 /u01/app/11.2.0.3/grid/bin/gipcd.bin
root      2537     1  0 09:02 ?        00:00:28 /u01/app/11.2.0.3/grid/bin/orarootagent.bin
root      2549     1  1 09:02 ?        00:01:19 /u01/app/11.2.0.3/grid/bin/osysmond.bin
root      3367     1  1 09:04 ?        00:00:54 /u01/app/11.2.0.3/grid/bin/ologgerd -M -d /u01/app/11.2.0.3/grid/crf/db/rac02
root      8324  8022  0 10:28 pts/0    00:00:00 grep grid

[root@rac02 ~]# /u01/app/11.2.0.3/grid/bin/crsctl status server

CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Status failed, or completed with errors.

[root@rac02 ~]# /u01/app/11.2.0.3/grid/bin/crsctl check crs

CRS-4638: Oracle High Availability Services is online
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4530: Communications failure contacting Cluster Synchronization Services daemon
CRS-4534: Cannot communicate with Event Manager

[root@rac02 ~]# /u01/app/11.2.0.3/grid/bin/crsctl start cluster -all

CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac02'
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac03'
CRS-2676: Start of 'ora.cssdmonitor' on 'rac02' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'rac02'
CRS-2672: Attempting to start 'ora.diskmon' on 'rac02'
CRS-2676: Start of 'ora.cssdmonitor' on 'rac03' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'rac03'
CRS-2672: Attempting to start 'ora.diskmon' on 'rac03'
CRS-2676: Start of 'ora.diskmon' on 'rac02' succeeded
CRS-2676: Start of 'ora.diskmon' on 'rac03' succeeded
CRS-2676: Start of 'ora.cssd' on 'rac02' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'rac02'
CRS-2676: Start of 'ora.cssd' on 'rac03' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'rac03'
CRS-2676: Start of 'ora.ctssd' on 'rac02' succeeded
CRS-2672: Attempting to start 'ora.evmd' on 'rac02'
CRS-2676: Start of 'ora.ctssd' on 'rac03' succeeded
CRS-2672: Attempting to start 'ora.evmd' on 'rac03'
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'rac02'
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'rac03'
CRS-2676: Start of 'ora.evmd' on 'rac02' succeeded
CRS-2676: Start of 'ora.evmd' on 'rac03' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'rac02' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'rac02'
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'rac03' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'rac03'
CRS-2676: Start of 'ora.asm' on 'rac02' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'rac02'
CRS-2676: Start of 'ora.asm' on 'rac03' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'rac03'
CRS-2676: Start of 'ora.crsd' on 'rac02' succeeded
CRS-2676: Start of 'ora.crsd' on 'rac03' succeeded

[root@rac02 ~]# /u01/app/11.2.0.3/grid/bin/crsctl check cluster -all

**************************************************************
rac02:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
rac03:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************

[root@rac02 ~]# /u01/app/11.2.0.3/grid/bin/crsctl status server

NAME=rac02
STATE=ONLINE

NAME=rac03
STATE=ONLINE

[root@rac01 ~]# ps -ef|grep grid

root     11599  2537  0 10:46 pts/0    00:00:00 grep grid
[root@rac01 ~]# ssh rac02 /u01/app/11.2.0.3/grid/bin/crsctl status server
NAME=rac02
STATE=ONLINE

NAME=rac03
STATE=ONLINE

[root@rac01 ~]# /u01/app/11.2.0.3/grid/bin/crsctl start crs

CRS-4123: Oracle High Availability Services has been started.
[root@rac01 ~]# /u01/app/11.2.0.3/grid/bin/crsctl status server
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Status failed, or completed with errors.

[root@rac01 ~]# /u01/app/11.2.0.3/grid/bin/crsctl status server

CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Status failed, or completed with errors.

[root@rac01 ~]# /u01/app/11.2.0.3/grid/bin/crsctl start cluster

CRS-4691: Oracle Clusterware is already running
CRS-4000: Command Start failed, or completed with errors.

[root@rac01 ~]# /u01/app/11.2.0.3/grid/bin/crsctl check cluster -all

**************************************************************
rac01:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
rac02:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
rac03:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************

[root@rac01 ~]# /u01/app/11.2.0.3/grid/bin/crsctl status server

NAME=rac01
STATE=ONLINE

NAME=rac02
STATE=ONLINE

NAME=rac03
STATE=ONLINE

Now, stop and start is making me tired. Now I get to spend – go shopping.

About these ads

Leave a Comment »

No comments yet.

RSS feed for comments on this post. TrackBack URI

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

The Rubric Theme. Blog at WordPress.com.

Follow

Get every new post delivered to your Inbox.

Join 314 other followers

%d bloggers like this: