Focus On Oracle

Installing, Backup & Recovery, Performance Tuning,
Troubleshooting, Upgrading, Patching

Oracle Engineered System


当前位置: 首页 » 技术文章 » Exadata

Recreate quorum disk on X6-2

在Exadata上,准备做级联时发现IB地址冲突,修改IB地址后,发现系统出现了一些关于iscsi的错误,刚开始想怎么会出现这些错误呢,后来在asmcmd中发现有OCR所在的磁盘组有offline的disk,查询后发现了quorum disk(在12.1.2.3.0中,引入了Quorum Disk Manager这个功能)的问题。所以就把原来的在操作系统上quorum disk删除,重建后问题消失。下面是详细的步骤。

文件系统信息

[root@dm06dbadm01 iscsi]# pvs
  PV         VG      Fmt  Attr PSize PFree  
  /dev/sda2  VGExaDb lvm2 a--u 1.63t 464.08g
[root@dm06dbadm01 iscsi]# lvs
  LV                 VG      Attr       LSize   Pool Origin Data%  Meta%  Move Log Cpy%Sync Convert
  LVDbOra1           VGExaDb -wi-ao---- 100.00g                                                    
  LVDbSwap1          VGExaDb -wi-ao----  24.00g                                                    
  LVDbSys1           VGExaDb -wi-ao----  30.00g                                                    
  LVDbSys2           VGExaDb -wi-a-----  30.00g                                                    
  LVDoNotRemoveOrUse VGExaDb -wi-a-----   1.00g                                                    
  ogg                VGExaDb -wi-a-----   1.00t                                                    
[root@dm06dbadm01 iscsi]# vgs
  VG      #PV #LV #SN Attr   VSize VFree  
  VGExaDb   1   6   0 wz--n- 1.63t 464.08g
[root@dm06dbadm01 iscsi]# 
创建配置文件(在两个计算节点上都执行)
[root@dm06dbadm01 iscsi]# /opt/oracle.SupportTools/quorumdiskmgr --create --config --owner=grid --group=asmadmin --network-iface-list="ib0, ib1"
[Info] Successfully created iface exadata_ib0 with iface.net_ifacename ib0
[Info] Successfully created iface exadata_ib1 with iface.net_ifacename ib1
[Success] Successfully created quorum disk configurations

[root@dm06dbadm01 iscsi]# /opt/oracle.SupportTools/quorumdiskmgr --list --config
Owner: grid
Group: asmadmin
ifaces: exadata_ib1 exadata_ib0 
创建target(在两个计算节点上都执行)
[root@dm06dbadm01 iscsi]# /opt/oracle.SupportTools/quorumdiskmgr --create --target --asm-disk-group=SYSTEMDG --visible-to="192.168.10.21, 192.168.10.22, 192.168.10.23, 192.168.10.24"
[Success] Successfully created target iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM01.

[root@dm06dbadm01 iscsi]# /opt/oracle.SupportTools/quorumdiskmgr --list --target
Name: iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM01
Host name: DM06DBADM01
ASM disk group name: SYSTEMDG
Size: 128 MB
Visible to: 192.168.10.21, 192.168.10.22, 192.168.10.23, 192.168.10.24
Discovered by: 
创建device(在两个计算节点上都执行)
[root@dm06dbadm01 iscsi]# /opt/oracle.SupportTools/quorumdiskmgr --create --device --target-ip-list="192.168.10.21, 192.168.10.22, 192.168.10.23, 192.168.10.24"
[Success] Successfully created all device(s) from target(s) on machine with IP address 192.168.10.21
[Success] Successfully created all device(s) from target(s) on machine with IP address 192.168.10.22
[Success] Successfully created all device(s) from target(s) on machine with IP address 192.168.10.23
[Success] Successfully created all device(s) from target(s) on machine with IP address 192.168.10.24
[root@dm06dbadm01 iscsi]# /opt/oracle.SupportTools/quorumdiskmgr --list --device
Device path: /dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM01
Host name: DM06DBADM01
ASM disk group name: SYSTEMDG
Size: 128 MB
Device path: /dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM02
Host name: DM06DBADM02
ASM disk group name: SYSTEMDG
Size: 128 MB

查看iscsi信息

[root@dm06dbadm01 iscsi]# cat /etc/tgt/targets.conf
default-driver iscsi
<target iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM01>
        backing-store /dev/VGExaDb/LVDbVdDM06DBADM01SYSTEMDG
        initiator-address 192.168.10.21
        initiator-address 192.168.10.22
        initiator-address 192.168.10.23
        initiator-address 192.168.10.24
</target>

[root@dm06dbadm01 iscsi]# iscsiadm -m node
192.168.10.21:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM01
192.168.10.22:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM01
192.168.10.22:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM01
192.168.10.23:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02
192.168.10.23:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02
192.168.10.23:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02
192.168.10.24:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02
192.168.10.24:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02
192.168.10.24:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02
[root@dm06dbadm01 iscsi]# iscsiadm -m session
tcp: [40406] 192.168.10.21:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM01 (non-flash)
tcp: [40407] 192.168.10.22:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM01 (non-flash)
tcp: [40408] 192.168.10.22:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM01 (non-flash)
tcp: [40409] 192.168.10.23:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02 (non-flash)
tcp: [40410] 192.168.10.23:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02 (non-flash)
tcp: [40411] 192.168.10.23:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02 (non-flash)
tcp: [40412] 192.168.10.24:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02 (non-flash)
tcp: [40413] 192.168.10.24:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02 (non-flash)
tcp: [40414] 192.168.10.24:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02 (non-flash)
查看quorum disk设备
SQL> set linesize 200
SQL> col path format a50
SQL> select inst_id, label, path, mode_status, header_status
  2  from gv$asm_disk where path like '/dev/exadata_quorum/%';

   INST_ID LABEL                           PATH                                               MODE_ST HEADER_STATU
---------- ------------------------------- -------------------------------------------------- ------- ------------
         2 QD_SYSTEMDG_DM06DBADM01         /dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM01        ONLINE  CANDIDATE
         2 QD_SYSTEMDG_DM06DBADM02         /dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM02        ONLINE  CANDIDATE
         1 QD_SYSTEMDG_DM06DBADM01         /dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM01        ONLINE  CANDIDATE
         1 QD_SYSTEMDG_DM06DBADM02         /dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM02        ONLINE  CANDIDATE

SQL> 

将设备加入OCR磁盘组

alter diskgroup SYSTEMDG add quorum failgroup dm06dbadm01 disk '/dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM01' quorum failgroup dm06dbadm02 disk '/dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM02';
SQL> alter diskgroup SYSTEMDG add quorum failgroup dm06dbadm01 disk '/dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM01' quorum failgroup dm06dbadm02 disk '/dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM02';

Diskgroup altered.

SQL> select inst_id, label, path, mode_status, header_status
  2  from gv$asm_disk where path like '/dev/exadata_quorum/%';

   INST_ID LABEL                           PATH                                               MODE_ST HEADER_STATU
---------- ------------------------------- -------------------------------------------------- ------- ------------
         2 QD_SYSTEMDG_DM06DBADM01         /dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM01        ONLINE  MEMBER
         2 QD_SYSTEMDG_DM06DBADM02         /dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM02        ONLINE  MEMBER
         1 QD_SYSTEMDG_DM06DBADM02         /dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM02        ONLINE  MEMBER
         1 QD_SYSTEMDG_DM06DBADM01         /dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM01        ONLINE  MEMBER

SQL> 
查看voting disk信息
[grid@dm06dbadm01 ~]$ crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   40811a83d0f74f5abf1d60f185d49f28 (o/192.168.10.29;192.168.10.30/SYSTEMDG_CD_09_dm06celadm03) [SYSTEMDG]
 2. ONLINE   ea7c8ec508e54fc1bfb17bde01b35f29 (o/192.168.10.25;192.168.10.26/SYSTEMDG_CD_10_dm06celadm01) [SYSTEMDG]
 3. ONLINE   a14e23d77f0d4f60bf9fe4678aa67009 (o/192.168.10.27;192.168.10.28/SYSTEMDG_CD_02_dm06celadm02) [SYSTEMDG]
 4. ONLINE   748cc9da6c544f28bf439a3f7dca3398 (/dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM02) [SYSTEMDG]
 5. ONLINE   56324b85a3af4f23bf8c592641839cde (/dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM01) [SYSTEMDG]
Located 5 voting disk(s).

[grid@dm06dbadm01 ~]$

Reference

http://docs.oracle.com/cd/E80920_01/DBMMN/maintaining-exadata-database-servers.htm#DBMMN22868


关键词:exadata 

相关文章

Oracle ZDLRA (Zero Data Lost Recovery Appliance) FAQ
Oracle ZDLRA (Zero Data Lost Recovery Appliance) Features
Oracle Database 18c On Exadata
Migrate Oracle Database on AIX to Exadata
ExaWatcher Charts
qperf & iperf
How to config IB network listener
Recreate quorum disk on X6-2
How to install/deploy Exadata
Exadata的特性
Exadata的扩展和级联
Exadata Diagnosing tools

联系我们

韩朝阳



    Phone:186-9589-1286

    E-mail:ohsdba@qq.com

    微  信: ohsdba


电话(186-9589-1286)

QQ(375349564)

微信(ohsdba)


常用链接

Oracle
eDelivery
My Oracle Support

Exadata 12.1 Document

Exadata 12.2 Document

Oracle 11gR2 Document

Oracle 12cR1 Document

Oracle 12cR2 Document

GoldenGate 12c

Oracle Fusion Middleware

Mysql Document

PostgreSQL

Python

github

sourceforge



Top
Cell186-9589-1286
QQ 375349564
E-mail ohsdba@qq.com