Thursday, December 5, 2019

CLSRSC-180: An error occurred while executing the command 'asmcmd afd_dsset'

Execution of roothas.pl failed during the reconfiguring of a 19.5 Oracle restart setup after a hostname change
# $ORACLE_HOME/perl/bin/perl $ORACLE_HOME/crs/install/roothas.pl
Using configuration parameter file: /opt/app/oracle/product/19.x.0/grid/crs/install/crsconfig_params
The log of current session can be found at:
  /opt/app/oracle/crsdata/ip-172-31-7-244/crsconfig/roothas_2019-12-03_02-23-25PM.log
2019/12/03 14:23:31 CLSRSC-363: User ignored prerequisites during installation
LOCAL ADD MODE
Creating OCR keys for user 'oracle', privgrp 'oinstall'..
Operation successful.
LOCAL ONLY MODE
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
CRS-4664: Node ip-172-31-7-244 successfully pinned.
2019/12/03 14:24:43 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'

ip-172-31-7-244     2019/12/03 14:26:31     /opt/app/oracle/crsdata/ip-172-31-7-244/olr/backup_20191203_142631.olr     3329448500
2019/12/03 14:26:44 CLSRSC-180: An error occurred while executing the command '/opt/app/oracle/product/19.x.0/grid/bin/asmcmd afd_dsset ""'
Died at /opt/app/oracle/product/19.x.0/grid/crs/install/oraafd.pm line 1943.


The alert log had following entries related to the issue at hand.
2019-12-03 14:39:58: Executing the step [] to postConfig AFD on the SIHA node
2019-12-03 14:39:58: AFD Diskstring:
2019-12-03 14:39:58: Running as user oracle: /opt/app/oracle/product/19.x.0/grid/bin/asmcmd afd_dsset ""
2019-12-03 14:40:11: Removing file /tmp/IumY69Y5LW
2019-12-03 14:40:11: Successfully removed file: /tmp/IumY69Y5LW
2019-12-03 14:40:11: pipe exit code: 65280
2019-12-03 14:40:11: /bin/su exited with rc=255

2019-12-03 14:40:11: /opt/app/oracle/product/19.x.0/grid/bin/asmcmd afd_dsset "" has failed to run with status 255
2019-12-03 14:40:11: Executing cmd: /opt/app/oracle/product/19.x.0/grid/bin/clsecho -p has -f clsrsc -m 180 '/opt/app/oracle/product/19.x.0/grid/bin/asmcmd afd_dsset ""'
2019-12-03 14:40:11: Executing cmd: /opt/app/oracle/product/19.x.0/grid/bin/clsecho -p has -f clsrsc -m 180 '/opt/app/oracle/product/19.x.0/grid/bin/asmcmd afd_dsset ""'
2019-12-03 14:40:11: Command output:
>  CLSRSC-180: An error occurred while executing the command '/opt/app/oracle/product/19.x.0/grid/bin/asmcmd afd_dsset ""'
>End Command output
2019-12-03 14:40:11: CLSRSC-180: An error occurred while executing the command '/opt/app/oracle/product/19.x.0/grid/bin/asmcmd afd_dsset ""'
2019-12-03 14:40:11: ###### Begin DIE Stack Trace ######
2019-12-03 14:40:11:     Package         File                 Line Calling
2019-12-03 14:40:11:     --------------- -------------------- ---- ----------
2019-12-03 14:40:11:  1: main            roothas.pl            155 crsutils::dietrap
2019-12-03 14:40:11:  2: oraClusterwareComp::oraafd oraafd.pm            1943 main::__ANON__
2019-12-03 14:40:11:  3: oraClusterwareComp::oraafd oraafd.pm             287 oraClusterwareComp::oraafd::postConfigAFDSteps
2019-12-03 14:40:11:  4: oraClusterwareComp oraClusterwareComp.pm  123 oraClusterwareComp::oraafd::postConfigureSIHA
2019-12-03 14:40:11:  5: crsinstall      crsinstall.pm        1715 oraClusterwareComp::postConfigureCurrentNode
2019-12-03 14:40:11:  6: crsinstall      crsinstall.pm        1403 crsinstall::siha_post_config
2019-12-03 14:40:11:  7: crsinstall      crsinstall.pm         442 crsinstall::HAInstall
2019-12-03 14:40:11:  8: main            roothas.pl            264 crsinstall::new
2019-12-03 14:40:11: ####### End DIE Stack Trace #######
Solution specified in 2375603.1 didn't resolve it. But as per 29013832.8 the issue is related to bug 29013832 affecting 19.1 and 18.1. There's a patch (29013832 ) available to be applied on top of the 19.5.0.0.191015DBRU (pre-req 30125133).
From the failed state shown above run the patch. This will configure the OHAS and any future deconfig/config runs will not encounter the error.