1.Status before the shutdown
HA Resource Target State ----------- ------ ----- ora.CLUSTERDG.dg ONLINE ONLINE on hpc1 ora.DATA.dg ONLINE ONLINE on hpc1 ora.FLASH.dg ONLINE ONLINE on hpc1 ora.LISTENER.lsnr ONLINE ONLINE on hpc1 ora.LISTENER_SCAN1.lsnr ONLINE ONLINE on hpc1 ora.asm ONLINE ONLINE on hpc1 ora.clusdb.db ONLINE ONLINE on hpc1 ora.eons ONLINE ONLINE on hpc1 ora.gsd OFFLINE OFFLINE ora.hpc1.vip ONLINE ONLINE on hpc1 ora.net1.network ONLINE ONLINE on hpc1 ora.oc4j OFFLINE OFFLINE ora.ons ONLINE ONLINE on hpc1 ora.registry.acfs ONLINE ONLINE on hpc1 ora.scan1.vip ONLINE ONLINE on hpc12. Shutdown one RAC component at time. Some components have dependencies and using force option (appending -f) would resolve those issues. But here each dependent component is shutdown beforehand.
srvctl stop database -d clusdb srvctl stop listener -n hpc1 srvctl stop vip -n hpc1 srvctl stop scan_listener -i 1 srvctl stop scan -i 1 srvctl stop diskgroup -g DATA -n hpc1 srvctl stop diskgroup -g flash -n hpc1 srvctl stop nodeapps -n hpc1 srvctl stop diskgroup -g clusterdg -n hpc13. After this ora.registry.acfs and ora.asm would be the only components running and those cannot be stopped srvctl. Use crsctl as root to stop the acfs registry
crsctl stop resource ora.registry.acfs CRS-2673: Attempting to stop 'ora.registry.acfs' on 'hpc1' CRS-2677: Stop of 'ora.registry.acfs' on 'hpc1' succeeded4. ora.asm cannot be stopped with either crsctl as root nor as srvctl even with force option.
srvctl stop asm -n hpc1 -f PRCR-1014 : Failed to stop resource ora.asm PRCR-1065 : Failed to stop resource ora.asm CRS-2673: Attempting to stop 'ora.asm' on 'hpc1' ORA-15097: cannot SHUTDOWN ASM instance with connected client CRS-2675: Stop of 'ora.asm' on 'hpc1' failed crsctl stop resource ora.asm CRS-2673: Attempting to stop 'ora.asm' on 'hpc1' CRS-2673: Attempting to stop 'ora.asm' on 'hpc1' ORA-15097: cannot SHUTDOWN ASM instance with connected client CRS-2675: Stop of 'ora.asm' on 'hpc1' failed CRS-2675: Stop of 'ora.asm' on 'hpc1' failed CRS-4000: Command Stop failed, or completed with errors.After execution of these commands state of various rac components would be
HA Resource Target State ----------- ------ ----- ora.CLUSTERDG.dg OFFLINE OFFLINE ora.DATA.dg OFFLINE OFFLINE ora.FLASH.dg OFFLINE OFFLINE ora.LISTENER.lsnr OFFLINE OFFLINE ora.LISTENER_SCAN1.lsnr OFFLINE OFFLINE ora.asm OFFLINE ONLINE on hpc1 ora.clusdb.db OFFLINE OFFLINE ora.eons OFFLINE OFFLINE ora.gsd OFFLINE OFFLINE ora.hpc1.vip OFFLINE OFFLINE ora.net1.network OFFLINE OFFLINE ora.oc4j OFFLINE OFFLINE ora.ons OFFLINE OFFLINE ora.registry.acfs OFFLINE OFFLINE ora.scan1.vip OFFLINE OFFLINEInterestingly clusterdg is the asm diskgroup which has the ocr and vote disks. It seem diskgroup being in a mount or unmount state is irrelevant to access ocr and vote disk as long as ASM instnace is running cluster seem to function.
5. Stop the clusterware stack with
crsctl stop cluster CRS-2673: Attempting to stop 'ora.crsd' on 'hpc1' CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'hpc1' CRS-2673: Attempting to stop 'ora.asm' on 'hpc1' CRS-2677: Stop of 'ora.asm' on 'hpc1' succeeded CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'hpc1' has completed CRS-2677: Stop of 'ora.crsd' on 'hpc1' succeeded CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'hpc1' CRS-2673: Attempting to stop 'ora.ctssd' on 'hpc1' CRS-2673: Attempting to stop 'ora.evmd' on 'hpc1' CRS-2673: Attempting to stop 'ora.asm' on 'hpc1' CRS-2677: Stop of 'ora.cssdmonitor' on 'hpc1' succeeded CRS-2677: Stop of 'ora.evmd' on 'hpc1' succeeded CRS-2677: Stop of 'ora.asm' on 'hpc1' succeeded CRS-2677: Stop of 'ora.ctssd' on 'hpc1' succeeded CRS-2673: Attempting to stop 'ora.cssd' on 'hpc1' CRS-2677: Stop of 'ora.cssd' on 'hpc1' succeeded CRS-2673: Attempting to stop 'ora.diskmon' on 'hpc1' CRS-2677: Stop of 'ora.diskmon' on 'hpc1' succeeded6. Stop the oracle high availability services with
crsctl stop crs CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'hpc1' CRS-2673: Attempting to stop 'ora.mdnsd' on 'hpc1' CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'hpc1' CRS-2673: Attempting to stop 'ora.gpnpd' on 'hpc1' CRS-2677: Stop of 'ora.drivers.acfs' on 'hpc1' succeeded CRS-2677: Stop of 'ora.mdnsd' on 'hpc1' succeeded CRS-2677: Stop of 'ora.gpnpd' on 'hpc1' succeeded CRS-2673: Attempting to stop 'ora.gipcd' on 'hpc1' CRS-2677: Stop of 'ora.gipcd' on 'hpc1' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'hpc1' has completed CRS-4133: Oracle High Availability Services has been stopped.
