While I was installing RAC, the last step is to run root.sh, I did not wait for it to complete on the first node and then started to run on the second node, and messed up. I need to clean it up.
use this oracle document as reference:
https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=411427040358360&id=942166.1&_afrWindowMode=0&_adf.ctrl-state=c8ddpyf94_4
Step 1: As root, run "$GRID_HOME/crs/install/rootcrs.pl -verbose -deconfig -force" on all nodes, except the last one.
Step 2: As root, run "$GRID_HOME/crs/install/rootcrs.pl -verbose -deconfig -force -lastnode" on last node. This command will zero out OCR, Voting Disk and the ASM diskgroup for OCR and Voting Disk
Step 2 may not run sucessfully, but I can zero the OCR voting disk using dd command.
Step 3: As root, run $GRID_HOME/root.sh on first node
Step 4: As root, run $GRID_HOME/root.sh on all other node(s), except last one.
Step 5: As root, run $GRID_HOME/root.sh on last node.
the root.sh will use the $GRID_HOME/crs/install/crsconfig_params configuration file to configure cluster.
below is a section of crsconfig_params file
##################################
SILENT=false
ORACLE_OWNER=grid
ORA_DBA_GROUP=oinstall
ORA_ASM_GROUP=asmadmin
LANGUAGE_ID=AMERICAN_AMERICA.AL32UTF8
TZ=America/Vancouver
ISROLLING=true
REUSEDG=false
ASM_AU_SIZE=4
USER_IGNORED_PREREQ=true
ORACLE_HOME=/u01/11.2.0/grid
ORACLE_BASE=/u01/app/oracle
OLD_CRS_HOME=
JREDIR=/u01/11.2.0/grid/jdk/jre/
JLIBDIR=/u01/11.2.0/grid/jlib
VNDR_CLUSTER=false
OCR_LOCATIONS=NO_VAL
CLUSTER_NAME=xxxxracstg01
HOST_NAME_LIST=xxxxracstg01,xxxxracstg02,xxxxracstg03
NODE_NAME_LIST=xxxxracstg01,xxxxracstg02,xxxxracstg03
PRIVATE_NAME_LIST=
VOTING_DISKS=NO_VAL
#VF_DISCOVERY_STRING=%s_vfdiscoverystring%
ASM_UPGRADE=false
ASM_SPFILE=
ASM_DISK_GROUP=ocr_vote
ASM_DISCOVERY_STRING=/dev/emcpower*
ASM_DISKS=/dev/emcpowerd1,/dev/emcpowere1,/dev/emcpowerf1
ASM_REDUNDANCY=NORMAL
CRS_STORAGE_OPTION=1
CSS_LEASEDURATION=400
CRS_NODEVIPS='xxxxracstg01-vip/255.255.254.0/bond0.401,xxxxracstg02-vip/255.255.254.0/bond0.401,xxxxracstg03-vip/255.255.254.0/bond0.401'
NODELIST=xxxxracstg01,xxxxracstg02,xxxxracstg03
NETWORKS="bond0.401"/xx.250.4.0:public,"bond1.34"/xx.10.18.0:cluster_interconnect
SCAN_NAME=xxxxracstg00-scan.company.corp
SCAN_PORT=1521
GPNP_PA=
OCFS_CONFIG=
# GNS consts
GNS_CONF=false
GNS_ADDR_LIST=
GNS_DOMAIN_LIST=
GNS_ALLOW_NET_LIST=
GNS_DENY_NET_LIST=
GNS_DENY_ITF_LIST=
#### Required by OUI add node
NEW_HOST_NAME_LIST=
NEW_NODE_NAME_LIST=
NEW_PRIVATE_NAME_LIST=
NEW_NODEVIPS='xxxxracstg01-vip/255.255.254.0/bond0.401,xxxxracstg02-vip/255.255.254.0/bond0.401,xxxxracstg03-vip/255.255.254.0/bond0.401'
############### OCR constants
# GPNPCONFIGDIR is handled differently in dev (T_HAS_WORK for all)
# GPNPGCONFIGDIR in dev expands to T_HAS_WORK_GLOBAL
GPNPCONFIGDIR=$ORACLE_HOME
GPNPGCONFIGDIR=$ORACLE_HOME
OCRLOC=
OLRLOC=
OCRID=
CLUSTER_GUID=
CLSCFG_MISSCOUNT=
#### IPD/OS
CRFHOME="/u01/11.2.0/grid"
##################################
Because I ran the root.sh on node 3 before node 2, node 2 took +ASM3 instance and node 3 took +ASM2 instance, I use this above method to fix +ASM instance number problem,after I run above procedures again in the correct order, node 2 take +ASM2 now, problem fixed.
use this oracle document as reference:
https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=411427040358360&id=942166.1&_afrWindowMode=0&_adf.ctrl-state=c8ddpyf94_4
Step 1: As root, run "$GRID_HOME/crs/install/rootcrs.pl -verbose -deconfig -force" on all nodes, except the last one.
Step 2: As root, run "$GRID_HOME/crs/install/rootcrs.pl -verbose -deconfig -force -lastnode" on last node. This command will zero out OCR, Voting Disk and the ASM diskgroup for OCR and Voting Disk
Step 2 may not run sucessfully, but I can zero the OCR voting disk using dd command.
# dd if=/dev/zero of=/dev/sdb1 bs=1024 count=100
Step 3: As root, run $GRID_HOME/root.sh on first node
Step 4: As root, run $GRID_HOME/root.sh on all other node(s), except last one.
Step 5: As root, run $GRID_HOME/root.sh on last node.
the root.sh will use the $GRID_HOME/crs/install/crsconfig_params configuration file to configure cluster.
below is a section of crsconfig_params file
##################################
SILENT=false
ORACLE_OWNER=grid
ORA_DBA_GROUP=oinstall
ORA_ASM_GROUP=asmadmin
LANGUAGE_ID=AMERICAN_AMERICA.AL32UTF8
TZ=America/Vancouver
ISROLLING=true
REUSEDG=false
ASM_AU_SIZE=4
USER_IGNORED_PREREQ=true
ORACLE_HOME=/u01/11.2.0/grid
ORACLE_BASE=/u01/app/oracle
OLD_CRS_HOME=
JREDIR=/u01/11.2.0/grid/jdk/jre/
JLIBDIR=/u01/11.2.0/grid/jlib
VNDR_CLUSTER=false
OCR_LOCATIONS=NO_VAL
CLUSTER_NAME=xxxxracstg01
HOST_NAME_LIST=xxxxracstg01,xxxxracstg02,xxxxracstg03
NODE_NAME_LIST=xxxxracstg01,xxxxracstg02,xxxxracstg03
PRIVATE_NAME_LIST=
VOTING_DISKS=NO_VAL
#VF_DISCOVERY_STRING=%s_vfdiscoverystring%
ASM_UPGRADE=false
ASM_SPFILE=
ASM_DISK_GROUP=ocr_vote
ASM_DISCOVERY_STRING=/dev/emcpower*
ASM_DISKS=/dev/emcpowerd1,/dev/emcpowere1,/dev/emcpowerf1
ASM_REDUNDANCY=NORMAL
CRS_STORAGE_OPTION=1
CSS_LEASEDURATION=400
CRS_NODEVIPS='xxxxracstg01-vip/255.255.254.0/bond0.401,xxxxracstg02-vip/255.255.254.0/bond0.401,xxxxracstg03-vip/255.255.254.0/bond0.401'
NODELIST=xxxxracstg01,xxxxracstg02,xxxxracstg03
NETWORKS="bond0.401"/xx.250.4.0:public,"bond1.34"/xx.10.18.0:cluster_interconnect
SCAN_NAME=xxxxracstg00-scan.company.corp
SCAN_PORT=1521
GPNP_PA=
OCFS_CONFIG=
# GNS consts
GNS_CONF=false
GNS_ADDR_LIST=
GNS_DOMAIN_LIST=
GNS_ALLOW_NET_LIST=
GNS_DENY_NET_LIST=
GNS_DENY_ITF_LIST=
#### Required by OUI add node
NEW_HOST_NAME_LIST=
NEW_NODE_NAME_LIST=
NEW_PRIVATE_NAME_LIST=
NEW_NODEVIPS='xxxxracstg01-vip/255.255.254.0/bond0.401,xxxxracstg02-vip/255.255.254.0/bond0.401,xxxxracstg03-vip/255.255.254.0/bond0.401'
############### OCR constants
# GPNPCONFIGDIR is handled differently in dev (T_HAS_WORK for all)
# GPNPGCONFIGDIR in dev expands to T_HAS_WORK_GLOBAL
GPNPCONFIGDIR=$ORACLE_HOME
GPNPGCONFIGDIR=$ORACLE_HOME
OCRLOC=
OLRLOC=
OCRID=
CLUSTER_GUID=
CLSCFG_MISSCOUNT=
#### IPD/OS
CRFHOME="/u01/11.2.0/grid"
##################################
Because I ran the root.sh on node 3 before node 2, node 2 took +ASM3 instance and node 3 took +ASM2 instance, I use this above method to fix +ASM instance number problem,after I run above procedures again in the correct order, node 2 take +ASM2 now, problem fixed.
Comments
Post a Comment