IP地址被清空导致实例重启

客户10.2.0.4 RAC for Solaris 10环境突然出现了实例重启的现象。 数据库正常运行到下午3点左右，随后两个节点分别重启，其中一个节点上的实例无法自动启动。检查两个实例的告警日志发现，在节点重启前，两个节点都出现了明显的ORA-27504错误： Wed Apr 10 1

客户10.2.0.4 RAC for Solaris 10环境突然出现了实例重启的现象。
数据库正常运行到下午3点左右，随后两个节点分别重启，其中一个节点上的实例无法自动启动。检查两个实例的告警日志发现，在节点重启前，两个节点都出现了明显的ORA-27504错误：

Wed Apr 10 15:00:05 2013Errors IN file /oracle/admin/orcl/udump/orcl1_ora_10997.trc:ORA-00603: ORACLE server SESSION TERMINATED BY fatal errorORA-27504: IPC error creating OSD contextORA-27300: OS system dependent operation:if_not_found failed WITH STATUS: 0ORA-27301: OS failure message: Error 0ORA-27302: failure occurred at: skgxpvaddr9ORA-27303: additional information: requested interface 192.168.168.3 NOT found. CHECK output FROM ifconfig commandWed Apr 10 15:00:06 2013Errors IN file /oracle/admin/orcl/udump/orcl1_ora_11007.trc:ORA-00603: ORACLE server SESSION TERMINATED BY fatal errorORA-27504: IPC error creating OSD contextORA-27300: OS system dependent operation:if_not_found failed WITH STATUS: 0ORA-27301: OS failure message: Error 0ORA-27302: failure occurred at: skgxpvaddr9ORA-27303: additional information: requested interface 192.168.168.3 NOT found. CHECK output FROM ifconfig commandWed Apr 10 15:00:06 2013Errors IN file /oracle/admin/orcl/udump/orcl1_ora_11009.trc:ORA-00603: ORACLE server SESSION TERMINATED BY fatal errorORA-27504: IPC error creating OSD contextORA-27300: OS system dependent operation:if_not_found failed WITH STATUS: 0ORA-27301: OS failure message: Error 0ORA-27302: failure occurred at: skgxpvaddr9ORA-27303: additional information: requested interface 192.168.168.3 NOT found. CHECK output FROM ifconfig commandWed Apr 10 15:00:06 2013Errors IN file /oracle/admin/orcl/udump/orcl1_ora_11011.trc:ORA-00603: ORACLE server SESSION TERMINATED BY fatal errorORA-27504: IPC error creating OSD contextORA-27300: OS system dependent operation:if_not_found failed WITH STATUS: 0ORA-27301: OS failure me<em>本文来源gao.dai.ma.com搞@代*码(网$</em>ssage: Error 0ORA-27302: failure occurred at: skgxpvaddr9ORA-27303: additional information: requested interface 192.168.168.3 NOT found. CHECK output FROM ifconfig command...Wed Apr 10 15:07:08 2013IPC Send timeout detected.Sender: ospid 25688Receiver: inst 2 binc 427282 ospid 11838Wed Apr 10 15:07:08 2013IPC Send timeout detected.Sender: ospid 25724Wed Apr 10 15:07:08 2013IPC Send timeout detected.Sender: ospid 25680Receiver: inst 2 binc 431591 ospid 11822Receiver: inst 2 binc 431795 ospid 11874Wed Apr 10 15:07:08 2013IPC Send timeout detected.Sender: ospid 25684Receiver: inst 2 binc 428985 ospid 11826Wed Apr 10 15:07:08 2013IPC Send timeout detected.Sender: ospid 25708Receiver: inst 2 binc 430048 ospid 11858Wed Apr 10 15:07:09 2013ospid 25678: network interface WITH IP address 192.168.168.3 no longer operationalrequested interface 192.168.168.3 NOT found. CHECK output FROM ifconfig commandWed Apr 10 15:07:35 2013IPC Send timeout TO 1.1 inc 4 FOR msg TYPE 44 FROM opid 7Wed Apr 10 15:07:35 2013IPC Send timeout TO 1.12 inc 4 FOR msg TYPE 44 FROM opid 21Wed Apr 10 15:07:35 2013IPC Send timeout TO 1.2 inc 4 FOR msg TYPE 44 FROM opid 8Wed Apr 10 15:07:35 2013IPC Send timeout TO 1.3 inc 4 FOR msg TYPE 44 FROM opid 10Wed Apr 10 15:07:35 2013IPC Send timeout TO 1.8 inc 4 FOR msg TYPE 44 FROM opid 15Wed Apr 10 15:08:13 2013ospid 25678: network interface WITH IP address 192.168.168.3 no longer operationalrequested interface 192.168.168.3 NOT found. CHECK output FROM ifconfig commandWed Apr 10 15:08:16 2013IPC Send timeout detected.Sender: ospid 25748Receiver: inst 2 binc 430164 ospid 11890...Wed Apr 10 15:08:53 2013IPC Send timeout TO 1.13 inc 4 FOR msg TYPE 36 FROM opid 176Wed Apr 10 15:08:53 2013IPC Send timeout TO 1.15 inc 4 FOR msg TYPE 36 FROM opid 167Wed Apr 10 15:08:57 2013IPC Send timeout TO 1.4 inc 4 FOR msg TYPE 32 FROM opid 180...Wed Apr 10 15:15:51 2013Evicting instance 2 FROM clusterWed Apr 10 15:16:09 2013ospid 25678: network interface WITH IP address 192.168.168.3 no longer operationalrequested interface 192.168.168.3 NOT found. CHECK output FROM ifconfig commandWed Apr 10 15:16:40 2013Waiting FOR instances TO leave: Wed Apr 10 15:17:00 2013Waiting FOR instances TO leave: Wed Apr 10 15:17:09 2013ospid 25678: network interface WITH IP address 192.168.168.3 no longer operationalrequested interface 192.168.168.3 NOT found. CHECK output FROM ifconfig commandWed Apr 10 15:17:20 2013Waiting FOR instances TO leave: 

喜欢 (0)赏

[搞代码]

分享 (0)