Wed Jan 24 16:13:14 CST 2018
Thread 2 advanced to log sequence 179922 (LGWR switch)
Current log# 6 seq# 179922 mem# 0: /oradata/oradata/iesdb/iesdb_redo1_6.log
Wed Jan 24 16:14:03 CST 2018
Thread 2 advanced to log sequence 179923 (LGWR switch)
Current log# 4 seq# 179923 mem# 0: /oradata/oradata/iesdb/redo04.log
Wed Jan 24 16:15:42 CST 2018
Errors in file /usr/appsoft/oracle/admin/iesdb/bdump/iesdb2_lmon_9368.trc:
ORA-00202: control file: '/oradata/oradata/iesdb/control01.ctl'
ORA-27091: unable to queue I/O
ORA-27072: File I/O error
Linux-x86_64 Error: 22: Invalid argument
Additional information: 4
Additional information: 35
Additional information: -1
Wed Jan 24 16:15:42 CST 2018
Errors in file /usr/appsoft/oracle/admin/iesdb/bdump/iesdb2_lgwr_9403.trc:
ORA-00202: control file: '/oradata/oradata/iesdb/control01.ctl'
ORA-27091: unable to queue I/O
ORA-27072: File I/O error
Linux-x86_64 Error: 22: Invalid argument
Additional information: 4
Additional information: 1
Additional information: -1
Wed Jan 24 16:15:42 CST 2018
Errors in file /usr/appsoft/oracle/admin/iesdb/udump/iesdb2_ora_10283.trc:
ORA-00202: control file: '/oradata/oradata/iesdb/control01.ctl'
ORA-27091: unable to queue I/O
ORA-27072: File I/O error
Linux-x86_64 Error: 22: Invalid argument
Additional information: 4
Additional information: 1
Additional information: -1
Wed Jan 24 16:15:42 CST 2018
Errors in file /usr/appsoft/oracle/admin/iesdb/bdump/iesdb2_ckpt_9405.trc:
ORA-00202: control file: '/oradata/oradata/iesdb/control03.ctl'
ORA-27091: unable to queue I/O
ORA-27072: File I/O error
Linux-x86_64 Error: 22: Invalid argument
Additional information: 4
Additional information: 4
Additional information: -1
Wed Jan 24 16:15:42 CST 2018
Errors in file /usr/appsoft/oracle/admin/iesdb/bdump/iesdb2_lgwr_9403.trc:
ORA-00204: error in reading (block 1, # blocks 1) of control file
ORA-00202: control file: '/oradata/oradata/iesdb/control01.ctl'
ORA-27091: unable to queue I/O
ORA-27072: File I/O error
Linux-x86_64 Error: 22: Invalid argument
Additional information: 4
Additional information: 1
Additional information: -1
Wed Jan 24 16:15:42 CST 2018
LGWR: terminating instance due to error 204
Wed Jan 24 16:15:43 CST 2018
Errors in file /usr/appsoft/oracle/admin/iesdb/bdump/iesdb2_lmon_9368.trc:
ORA-00204: error in reading (block 35, # blocks 1) of control file
ORA-00202: control file: '/oradata/oradata/iesdb/control01.ctl'
ORA-27091: unable to queue I/O
ORA-27072: File I/O error
Linux-x86_64 Error: 22: Invalid argument
Additional information: 4
Additional information: 35
Additional information: -1
Wed Jan 24 16:15:44 CST 2018
Errors in file /usr/appsoft/oracle/admin/iesdb/bdump/iesdb2_ckpt_9405.trc:
ORA-00204: error in reading (block 4, # blocks 1) of control file
ORA-00202: control file: '/oradata/oradata/iesdb/control03.ctl'
ORA-27091: unable to queue I/O
ORA-27072: File I/O error
Linux-x86_64 Error: 22: Invalid argument
Additional information: 4
Additional information: 4
Additional information: -1
Wed Jan 24 16:15:59 CST 2018
System state dump is made for local instance
System State dumped to trace file /usr/appsoft/oracle/admin/iesdb/bdump/iesdb2_diag_9362.trc
Wed Jan 24 16:16:08 CST 2018
Shutting down instance (abort)
License high water = 554
Wed Jan 24 16:16:13 CST 2018
Instance terminated by LGWR, pid = 9403
Wed Jan 24 16:16:13 CST 2018
Instance terminated by USER, pid = 27344
Wed Jan 24 16:20:40 CST 2018
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Interface type 1 eth1 10.1.1.0 configured from OCR for use as a cluster interconnect
Interface type 1 eth0 192.168.101.0 configured from OCR for use as a public interface
Picked latch-free SCN scheme 3
Using LOG_ARCHIVE_DEST_1 parameter default value as /usr/appsoft/oracle/product/10.2.0/db_1/dbs/arch
LICENSE_MAX_USERS = 0
SYS auditing is disabled
ksdpec: called for event 13740 prior to event group initialization
Starting up ORACLE RDBMS Version: 10.2.0.5.0.
System parameters with non-default values:
processes = 800
sessions = 885
sga_max_size = 17179869184
__shared_pool_size = 3976200192
__large_pool_size = 16777216
__java_pool_size = 16777216
__streams_pool_size = 0
spfile = /oradata/oradata/iesdb/spfileiesdb.ora
sga_target = 17179869184
control_files = /oradata/oradata/iesdb/control01.ctl, /oradata/oradata/iesdb/control02.ctl, /oradata/oradata/iesdb/control03.ctl
db_block_size = 8192
__db_cache_size = 13153337344
compatible = 10.2.0.5.0
db_files = 500
db_file_multiblock_read_count= 16
cluster_database = TRUE
cluster_database_instances= 2
thread = 2
instance_number = 2
undo_management = AUTO
undo_tablespace = UNDOTBS2
remote_login_passwordfile= EXCLUSIVE
db_domain =
local_listener = (ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.101.97) (PORT = 1521))
remote_listener = LISTENERS_IESDB
job_queue_processes = 10
background_dump_dest = /usr/appsoft/oracle/admin/iesdb/bdump
user_dump_dest = /usr/appsoft/oracle/admin/iesdb/udump
core_dump_dest = /usr/appsoft/oracle/admin/iesdb/cdump
audit_file_dest = /usr/appsoft/oracle/admin/iesdb/adump
db_name = iesdb
open_cursors = 300
pga_aggregate_target = 1671430144
Cluster communication is configured to use the following interface(s) for this instance
10.1.1.2
Wed Jan 24 16:20:42 CST 2018
cluster interconnect IPC version:Oracle UDP/IP (generic)
IPC Vendor 1 proto 2
PSP0 started with pid=4, OS id=12396
PMON started with pid=2, OS id=12392
DIAG started with pid=3, OS id=12394
LMON started with pid=5, OS id=12398
LMD0 started with pid=6, OS id=12400
LMS0 started with pid=7, OS id=12402
LMS1 started with pid=8, OS id=12406
LMS2 started with pid=9, OS id=12410
LMS3 started with pid=10, OS id=12414
MMAN started with pid=11, OS id=12418
DBW0 started with pid=12, OS id=12420
DBW1 started with pid=13, OS id=12422
LGWR started with pid=14, OS id=12424
CKPT started with pid=15, OS id=12426
SMON started with pid=16, OS id=12428
RECO started with pid=17, OS id=12430
CJQ0 started with pid=18, OS id=12432
MMON started with pid=19, OS id=12434
MMNL started with pid=20, OS id=12436
Wed Jan 24 16:20:43 CST 2018
Thread 2 advanced to log sequence 179922 (LGWR switch)
Current log# 6 seq# 179922 mem# 0: /oradata/oradata/iesdb/iesdb_redo1_6.log
Wed Jan 24 16:14:03 CST 2018
Thread 2 advanced to log sequence 179923 (LGWR switch)
Current log# 4 seq# 179923 mem# 0: /oradata/oradata/iesdb/redo04.log
Wed Jan 24 16:15:42 CST 2018
Errors in file /usr/appsoft/oracle/admin/iesdb/bdump/iesdb2_lmon_9368.trc:
ORA-00202: control file: '/oradata/oradata/iesdb/control01.ctl'
ORA-27091: unable to queue I/O
ORA-27072: File I/O error
Linux-x86_64 Error: 22: Invalid argument
Additional information: 4
Additional information: 35
Additional information: -1
Wed Jan 24 16:15:42 CST 2018
Errors in file /usr/appsoft/oracle/admin/iesdb/bdump/iesdb2_lgwr_9403.trc:
ORA-00202: control file: '/oradata/oradata/iesdb/control01.ctl'
ORA-27091: unable to queue I/O
ORA-27072: File I/O error
Linux-x86_64 Error: 22: Invalid argument
Additional information: 4
Additional information: 1
Additional information: -1
Wed Jan 24 16:15:42 CST 2018
Errors in file /usr/appsoft/oracle/admin/iesdb/udump/iesdb2_ora_10283.trc:
ORA-00202: control file: '/oradata/oradata/iesdb/control01.ctl'
ORA-27091: unable to queue I/O
ORA-27072: File I/O error
Linux-x86_64 Error: 22: Invalid argument
Additional information: 4
Additional information: 1
Additional information: -1
Wed Jan 24 16:15:42 CST 2018
Errors in file /usr/appsoft/oracle/admin/iesdb/bdump/iesdb2_ckpt_9405.trc:
ORA-00202: control file: '/oradata/oradata/iesdb/control03.ctl'
ORA-27091: unable to queue I/O
ORA-27072: File I/O error
Linux-x86_64 Error: 22: Invalid argument
Additional information: 4
Additional information: 4
Additional information: -1
Wed Jan 24 16:15:42 CST 2018
Errors in file /usr/appsoft/oracle/admin/iesdb/bdump/iesdb2_lgwr_9403.trc:
ORA-00204: error in reading (block 1, # blocks 1) of control file
ORA-00202: control file: '/oradata/oradata/iesdb/control01.ctl'
ORA-27091: unable to queue I/O
ORA-27072: File I/O error
Linux-x86_64 Error: 22: Invalid argument
Additional information: 4
Additional information: 1
Additional information: -1
Wed Jan 24 16:15:42 CST 2018
LGWR: terminating instance due to error 204
Wed Jan 24 16:15:43 CST 2018
Errors in file /usr/appsoft/oracle/admin/iesdb/bdump/iesdb2_lmon_9368.trc:
ORA-00204: error in reading (block 35, # blocks 1) of control file
ORA-00202: control file: '/oradata/oradata/iesdb/control01.ctl'
ORA-27091: unable to queue I/O
ORA-27072: File I/O error
Linux-x86_64 Error: 22: Invalid argument
Additional information: 4
Additional information: 35
Additional information: -1
Wed Jan 24 16:15:44 CST 2018
Errors in file /usr/appsoft/oracle/admin/iesdb/bdump/iesdb2_ckpt_9405.trc:
ORA-00204: error in reading (block 4, # blocks 1) of control file
ORA-00202: control file: '/oradata/oradata/iesdb/control03.ctl'
ORA-27091: unable to queue I/O
ORA-27072: File I/O error
Linux-x86_64 Error: 22: Invalid argument
Additional information: 4
Additional information: 4
Additional information: -1
Wed Jan 24 16:15:59 CST 2018
System state dump is made for local instance
System State dumped to trace file /usr/appsoft/oracle/admin/iesdb/bdump/iesdb2_diag_9362.trc
Wed Jan 24 16:16:08 CST 2018
Shutting down instance (abort)
License high water = 554
Wed Jan 24 16:16:13 CST 2018
Instance terminated by LGWR, pid = 9403
Wed Jan 24 16:16:13 CST 2018
Instance terminated by USER, pid = 27344
Wed Jan 24 16:20:40 CST 2018
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Interface type 1 eth1 10.1.1.0 configured from OCR for use as a cluster interconnect
Interface type 1 eth0 192.168.101.0 configured from OCR for use as a public interface
Picked latch-free SCN scheme 3
Using LOG_ARCHIVE_DEST_1 parameter default value as /usr/appsoft/oracle/product/10.2.0/db_1/dbs/arch
LICENSE_MAX_USERS = 0
SYS auditing is disabled
ksdpec: called for event 13740 prior to event group initialization
Starting up ORACLE RDBMS Version: 10.2.0.5.0.
System parameters with non-default values:
processes = 800
sessions = 885
sga_max_size = 17179869184
__shared_pool_size = 3976200192
__large_pool_size = 16777216
__java_pool_size = 16777216
__streams_pool_size = 0
spfile = /oradata/oradata/iesdb/spfileiesdb.ora
sga_target = 17179869184
control_files = /oradata/oradata/iesdb/control01.ctl, /oradata/oradata/iesdb/control02.ctl, /oradata/oradata/iesdb/control03.ctl
db_block_size = 8192
__db_cache_size = 13153337344
compatible = 10.2.0.5.0
db_files = 500
db_file_multiblock_read_count= 16
cluster_database = TRUE
cluster_database_instances= 2
thread = 2
instance_number = 2
undo_management = AUTO
undo_tablespace = UNDOTBS2
remote_login_passwordfile= EXCLUSIVE
db_domain =
local_listener = (ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.101.97) (PORT = 1521))
remote_listener = LISTENERS_IESDB
job_queue_processes = 10
background_dump_dest = /usr/appsoft/oracle/admin/iesdb/bdump
user_dump_dest = /usr/appsoft/oracle/admin/iesdb/udump
core_dump_dest = /usr/appsoft/oracle/admin/iesdb/cdump
audit_file_dest = /usr/appsoft/oracle/admin/iesdb/adump
db_name = iesdb
open_cursors = 300
pga_aggregate_target = 1671430144
Cluster communication is configured to use the following interface(s) for this instance
10.1.1.2
Wed Jan 24 16:20:42 CST 2018
cluster interconnect IPC version:Oracle UDP/IP (generic)
IPC Vendor 1 proto 2
PSP0 started with pid=4, OS id=12396
PMON started with pid=2, OS id=12392
DIAG started with pid=3, OS id=12394
LMON started with pid=5, OS id=12398
LMD0 started with pid=6, OS id=12400
LMS0 started with pid=7, OS id=12402
LMS1 started with pid=8, OS id=12406
LMS2 started with pid=9, OS id=12410
LMS3 started with pid=10, OS id=12414
MMAN started with pid=11, OS id=12418
DBW0 started with pid=12, OS id=12420
DBW1 started with pid=13, OS id=12422
LGWR started with pid=14, OS id=12424
CKPT started with pid=15, OS id=12426
SMON started with pid=16, OS id=12428
RECO started with pid=17, OS id=12430
CJQ0 started with pid=18, OS id=12432
MMON started with pid=19, OS id=12434
MMNL started with pid=20, OS id=12436
Wed Jan 24 16:20:43 CST 2018
'/oradata/oradata/iesdb/control01.ctlIO错误。去看下这两个控制文件是不是存在,权限是不是正确。
看下操作系统日志有没有啥报错, /var/log/message