数据库当掉因为error 221
Tue May 27 03:55:43 2008
Errors in file /opt/oracle/admin/webapp/bdump/webapp_ckpt_1192110.trc:
ORA-00206: Message 206 not found; No message file for product=RDBMS, facility=ORA; arguments: [3] [1]
ORA-00202: Message 202 not found; No message file for product=RDBMS, facility=ORA; arguments: [/data/webapp/control02.ctl]
ORA-27072: Message 27072 not found; No message file for product=RDBMS, facility=ORA
IBM AIX RISC System/6000 Error: 22: Invalid argument
Additional information: 8
Tue May 27 03:55:43 2008
Errors in file /opt/oracle/admin/webapp/bdump/webapp_ckpt_1192110.trc:
ORA-00221: Message 221 not found; No message file for product=RDBMS, facility=ORA
ORA-00206: Message 206 not found; No message file for product=RDBMS, facility=ORA; arguments: [3] [1]
ORA-00202: Message 202 not found; No message file for product=RDBMS, facility=ORA; arguments: [/data/webapp/control02.ctl]
ORA-27072: Message 27072 not found; No message file for product=RDBMS, facility=ORA
IBM AIX RISC System/6000 Error: 22: Invalid argument
Additional information: 8
Tue May 27 03:55:43 2008
CKPT: terminating instance due to error 221
Termination issued to instance processes. Waiting for the processes to exit
Instance terminated by CKPT, pid = 1192110
Tue May 27 08:56:27 2008
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Picked latch-free SCN scheme 3
Using LOG_ARCHIVE_DEST_10 parameter default value as USE_DB_RECOVERY_FILE_DEST
Autotune of undo retention is turned on.
IMODE=BR
ILAT =165
LICENSE_MAX_USERS = 0
SYS auditing is disabled
ksdpec: called for event 13740 prior to event group initialization
Starting up ORACLE RDBMS Version: 10.2.0.1.0.
System parameters with non-default values:
processes = 1000
sessions = 1500
sga_max_size = 3758096384
lock_sga = TRUE
__shared_pool_size = 956301312
shared_pool_size = 956301312
__large_pool_size = 167772160
large_pool_size = 167772160
__java_pool_size = 50331648
java_pool_size = 50331648
shared_pool_reserved_size= 104857600
nls_language = SIMPLIFIED CHINESE
nls_territory = CHINA
control_files = /data/webapp/control01.ctl, /data/webapp/control02.ctl
db_block_size = 8192
db_cache_size = 1241513984
db_writer_processes = 2
compatible = 10.2.0.1.0
log_buffer = 14302208
db_file_multiblock_read_count= 16
db_recovery_file_dest = /data/dbarch
db_recovery_file_dest_size= 64424509440
fast_start_mttr_target = 1800
undo_management = AUTO
undo_tablespace = UNDOTBS1
remote_login_passwordfile= EXCLUSIVE
db_domain =
dispatchers = (PROTOCOL=TCP) (SERVICE=webappXDB)
job_queue_processes = 100
cursor_sharing = EXACT
background_dump_dest = /opt/oracle/admin/webapp/bdump
user_dump_dest = /opt/oracle/admin/webapp/udump
core_dump_dest = /opt/oracle/admin/webapp/cdump
audit_file_dest = /opt/oracle/admin/webapp/adump
sort_area_size = 65536000
db_name = webapp
open_cursors = 2500
optimizer_mode = CHOOSE
pga_aggregate_target = 805306368
PMON started with pid=2, OS id=14242248
PSP0 started with pid=3, OS id=14246344
MMAN started with pid=4, OS id=13889668
DBW0 started with pid=5, OS id=1073238
DBW1 started with pid=6, OS id=13873268
LGWR started with pid=7, OS id=14250442
CKPT started with pid=8, OS id=14254540
SMON started with pid=9, OS id=14258638
RECO started with pid=10, OS id=14262736
CJQ0 started with pid=11, OS id=14266834
MMON started with pid=12, OS id=13848674
Tue May 27 08:56:29 2008
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
MMNL started with pid=13, OS id=14270932
Tue May 27 08:56:29 2008
starting up 1 shared server(s) ...
Tue May 27 08:56:30 2008
ALTER DATABASE MOUNT
Tue May 27 08:56:34 2008
Setting recovery target incarnation to 2
Tue May 27 08:56:34 2008
Successful mount of redo thread 1, with mount id 2116597886
Tue May 27 08:56:34 2008
Database mounted in Exclusive Mode
Completed: ALTER DATABASE MOUNT
Tue May 27 08:56:34 2008
ALTER DATABASE OPEN
Tue May 27 08:56:34 2008
Beginning crash recovery of 1 threads
parallel recovery started with 15 processes
Tue May 27 08:56:35 2008
Started redo scan
Tue May 27 08:56:35 2008
Completed redo scan
11517 redo blocks read, 22 data blocks need recovery
Tue May 27 08:56:35 2008
Started redo application at
Thread 1: logseq 1909, block 56340
Tue May 27 08:56:35 2008
Recovery of Online Redo Log: Thread 1 Group 1 Seq 1909 Reading mem 0
Mem# 0 errs 0: /data/webapp/redo01.log
Tue May 27 08:56:35 2008
Completed redo application
Tue May 27 08:56:35 2008
Completed crash recovery at
Thread 1: logseq 1909, block 67857, scn 62588965
22 data blocks read, 21 data blocks written, 11517 redo blocks read
Tue May 27 08:56:35 2008
LGWR: STARTING ARCH PROCESSES
ARC0 started with pid=32, OS id=14324206
ARC1 started with pid=33, OS id=14328304
Tue May 27 08:56:35 2008
ARC0: Archival started
ARC1: Archival started
LGWR: STARTING ARCH PROCESSES COMPLETE
Thread 1 advanced to log sequence 1910
Thread 1 opened at log sequence 1910
Current log# 3 seq# 1910 mem# 0: /data/webapp/redo03.log
Successful open of redo thread 1
Tue May 27 08:56:36 2008
ARC1: STARTING ARCH PROCESSES
Tue May 27 08:56:36 2008
ARC0: Becoming the 'no FAL' ARCH
ARC0: Becoming the 'no SRL' ARCH
Tue May 27 08:56:36 2008
SMON: enabling cache recovery
Tue May 27 08:56:36 2008
db_recovery_file_dest_size of 61440 MB is 47.70% used. This is a
user-specified limit on the amount of space that will be used by this
database for recovery-related files, and does not reflect the amount of
space available in the underlying filesystem or ASM diskgroup.
Tue May 27 08:56:36 2008
ARC2: Archival started
ARC1: STARTING ARCH PROCESSES COMPLETE
ARC1: Becoming the heartbeat ARCH
ARC2 started with pid=34, OS id=14332402
Tue May 27 08:56:37 2008
Successfully onlined Undo Tablespace 1.
Tue May 27 08:56:37 2008
SMON: enabling tx recovery
Tue May 27 08:56:37 2008
Database Characterset is ZHS16GBK
replication_dependency_tracking turned off (no async multimaster replication found)
Starting background process QMNC
QMNC started with pid=35, OS id=14291208
Tue May 27 08:56:40 2008
Completed: ALTER DATABASE OPEN
Tue May 27 09:02:36 2008
Shutting down archive processes
Tue May 27 09:02:41 2008
ARCH shutting down
ARC2: Archival stopped
Tue May 27 10:24:20 2008
Memory Notification: Library Cache Object loaded into SGA
Heap size 3595K exceeds notification threshold (2048K)
KGL object name :XDB.XDbD/PLZ01TcHgNAgAIIegtw==
Tue May 27 10:24:21 2008
Memory Notification: Library Cache Object loaded into SGA
Heap size 3774K exceeds notification threshold (2048K)
Details in trace file /opt/oracle/admin/webapp/udump/webapp_ora_13967468.trc
KGL object name :XDB.XDJ7JY/ksrgOzgQ8CoEgGA7A==
Tue May 27 03:55:43 2008
Errors in file /opt/oracle/admin/webapp/bdump/webapp_ckpt_1192110.trc:
ORA-00206: Message 206 not found; No message file for product=RDBMS, facility=ORA; arguments: [3] [1]
ORA-00202: Message 202 not found; No message file for product=RDBMS, facility=ORA; arguments: [/data/webapp/control02.ctl]
ORA-27072: Message 27072 not found; No message file for product=RDBMS, facility=ORA
IBM AIX RISC System/6000 Error: 22: Invalid argument
Additional information: 8
Tue May 27 03:55:43 2008
Errors in file /opt/oracle/admin/webapp/bdump/webapp_ckpt_1192110.trc:
ORA-00221: Message 221 not found; No message file for product=RDBMS, facility=ORA
ORA-00206: Message 206 not found; No message file for product=RDBMS, facility=ORA; arguments: [3] [1]
ORA-00202: Message 202 not found; No message file for product=RDBMS, facility=ORA; arguments: [/data/webapp/control02.ctl]
ORA-27072: Message 27072 not found; No message file for product=RDBMS, facility=ORA
IBM AIX RISC System/6000 Error: 22: Invalid argument
Additional information: 8
Tue May 27 03:55:43 2008
CKPT: terminating instance due to error 221
Termination issued to instance processes. Waiting for the processes to exit
Instance terminated by CKPT, pid = 1192110
Tue May 27 08:56:27 2008
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Picked latch-free SCN scheme 3
Using LOG_ARCHIVE_DEST_10 parameter default value as USE_DB_RECOVERY_FILE_DEST
Autotune of undo retention is turned on.
IMODE=BR
ILAT =165
LICENSE_MAX_USERS = 0
SYS auditing is disabled
ksdpec: called for event 13740 prior to event group initialization
Starting up ORACLE RDBMS Version: 10.2.0.1.0.
System parameters with non-default values:
processes = 1000
sessions = 1500
sga_max_size = 3758096384
lock_sga = TRUE
__shared_pool_size = 956301312
shared_pool_size = 956301312
__large_pool_size = 167772160
large_pool_size = 167772160
__java_pool_size = 50331648
java_pool_size = 50331648
shared_pool_reserved_size= 104857600
nls_language = SIMPLIFIED CHINESE
nls_territory = CHINA
control_files = /data/webapp/control01.ctl, /data/webapp/control02.ctl
db_block_size = 8192
db_cache_size = 1241513984
db_writer_processes = 2
compatible = 10.2.0.1.0
log_buffer = 14302208
db_file_multiblock_read_count= 16
db_recovery_file_dest = /data/dbarch
db_recovery_file_dest_size= 64424509440
fast_start_mttr_target = 1800
undo_management = AUTO
undo_tablespace = UNDOTBS1
remote_login_passwordfile= EXCLUSIVE
db_domain =
dispatchers = (PROTOCOL=TCP) (SERVICE=webappXDB)
job_queue_processes = 100
cursor_sharing = EXACT
background_dump_dest = /opt/oracle/admin/webapp/bdump
user_dump_dest = /opt/oracle/admin/webapp/udump
core_dump_dest = /opt/oracle/admin/webapp/cdump
audit_file_dest = /opt/oracle/admin/webapp/adump
sort_area_size = 65536000
db_name = webapp
open_cursors = 2500
optimizer_mode = CHOOSE
pga_aggregate_target = 805306368
PMON started with pid=2, OS id=14242248
PSP0 started with pid=3, OS id=14246344
MMAN started with pid=4, OS id=13889668
DBW0 started with pid=5, OS id=1073238
DBW1 started with pid=6, OS id=13873268
LGWR started with pid=7, OS id=14250442
CKPT started with pid=8, OS id=14254540
SMON started with pid=9, OS id=14258638
RECO started with pid=10, OS id=14262736
CJQ0 started with pid=11, OS id=14266834
MMON started with pid=12, OS id=13848674
Tue May 27 08:56:29 2008
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
MMNL started with pid=13, OS id=14270932
Tue May 27 08:56:29 2008
starting up 1 shared server(s) ...
Tue May 27 08:56:30 2008
ALTER DATABASE MOUNT
Tue May 27 08:56:34 2008
Setting recovery target incarnation to 2
Tue May 27 08:56:34 2008
Successful mount of redo thread 1, with mount id 2116597886
Tue May 27 08:56:34 2008
Database mounted in Exclusive Mode
Completed: ALTER DATABASE MOUNT
Tue May 27 08:56:34 2008
ALTER DATABASE OPEN
Tue May 27 08:56:34 2008
Beginning crash recovery of 1 threads
parallel recovery started with 15 processes
Tue May 27 08:56:35 2008
Started redo scan
Tue May 27 08:56:35 2008
Completed redo scan
11517 redo blocks read, 22 data blocks need recovery
Tue May 27 08:56:35 2008
Started redo application at
Thread 1: logseq 1909, block 56340
Tue May 27 08:56:35 2008
Recovery of Online Redo Log: Thread 1 Group 1 Seq 1909 Reading mem 0
Mem# 0 errs 0: /data/webapp/redo01.log
Tue May 27 08:56:35 2008
Completed redo application
Tue May 27 08:56:35 2008
Completed crash recovery at
Thread 1: logseq 1909, block 67857, scn 62588965
22 data blocks read, 21 data blocks written, 11517 redo blocks read
Tue May 27 08:56:35 2008
LGWR: STARTING ARCH PROCESSES
ARC0 started with pid=32, OS id=14324206
ARC1 started with pid=33, OS id=14328304
Tue May 27 08:56:35 2008
ARC0: Archival started
ARC1: Archival started
LGWR: STARTING ARCH PROCESSES COMPLETE
Thread 1 advanced to log sequence 1910
Thread 1 opened at log sequence 1910
Current log# 3 seq# 1910 mem# 0: /data/webapp/redo03.log
Successful open of redo thread 1
Tue May 27 08:56:36 2008
ARC1: STARTING ARCH PROCESSES
Tue May 27 08:56:36 2008
ARC0: Becoming the 'no FAL' ARCH
ARC0: Becoming the 'no SRL' ARCH
Tue May 27 08:56:36 2008
SMON: enabling cache recovery
Tue May 27 08:56:36 2008
db_recovery_file_dest_size of 61440 MB is 47.70% used. This is a
user-specified limit on the amount of space that will be used by this
database for recovery-related files, and does not reflect the amount of
space available in the underlying filesystem or ASM diskgroup.
Tue May 27 08:56:36 2008
ARC2: Archival started
ARC1: STARTING ARCH PROCESSES COMPLETE
ARC1: Becoming the heartbeat ARCH
ARC2 started with pid=34, OS id=14332402
Tue May 27 08:56:37 2008
Successfully onlined Undo Tablespace 1.
Tue May 27 08:56:37 2008
SMON: enabling tx recovery
Tue May 27 08:56:37 2008
Database Characterset is ZHS16GBK
replication_dependency_tracking turned off (no async multimaster replication found)
Starting background process QMNC
QMNC started with pid=35, OS id=14291208
Tue May 27 08:56:40 2008
Completed: ALTER DATABASE OPEN
Tue May 27 09:02:36 2008
Shutting down archive processes
Tue May 27 09:02:41 2008
ARCH shutting down
ARC2: Archival stopped
Tue May 27 10:24:20 2008
Memory Notification: Library Cache Object loaded into SGA
Heap size 3595K exceeds notification threshold (2048K)
KGL object name :XDB.XDbD/PLZ01TcHgNAgAIIegtw==
Tue May 27 10:24:21 2008
Memory Notification: Library Cache Object loaded into SGA
Heap size 3774K exceeds notification threshold (2048K)
Details in trace file /opt/oracle/admin/webapp/udump/webapp_ora_13967468.trc
KGL object name :XDB.XDJ7JY/ksrgOzgQ8CoEgGA7A==
是不是控制文件有问题了?
可以参考:http://www.lazydba.com/oracle/0__125149.html
===============================
从 control01.ctl 复制一份试试cd /data/webapp/
rm /data/webapp/control02.ctl
cp /data/webapp/control01.ctl /data/webapp/control02.ctl