ORA-19566: exceeded limit of 0 corrupt blocks for file /u01/app/oracle/oradata/ORCL/system01.dbf

•  While taking a hot backup of my database, it error-ed out and after checking my alert log file I came to know that there is some block corruption in my system01.dbf

[oracle@mydb ORCL]$ rman target /

Recovery Manager: Release 11.2.0.1.0 - Production on Mon Sep 2 11:20:09 2013

Copyright (c) 1982, 2009, Oracle and/or its affiliates.  All rights reserved.

connected to target database: ORCL (DBID=1348721365)

RMAN> backup database;

Starting backup at 02-SEP-13

using target database control file instead of recovery catalog

allocated channel: ORA_DISK_1

channel ORA_DISK_1: SID=35 device type=DISK

channel ORA_DISK_1: starting compressed full datafile backup set

channel ORA_DISK_1: specifying datafile(s) in backup set

input datafile file number=00001 name=/u01/app/oracle/oradata/ORCL/system01.dbf

input datafile file number=00002 name=/u01/app/oracle/oradata/ORCL/sysaux01.dbf

input datafile file number=00003 name=/u01/app/oracle/oradata/ORCL/undotbs01.dbf

input datafile file number=00005 name=/u01/app/oracle/oradata/ORCL/example01.dbf

input datafile file number=00004 name=/u01/app/oracle/oradata/ORCL/users01.dbf

channel ORA_DISK_1: starting piece 1 at 02-SEP-13

RMAN-00571: ===========================================================

RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============

RMAN-00571: ===========================================================

RMAN-03009: failure of backup command on ORA_DISK_1 channel at 09/02/2013 11:20:34

ORA-19566: exceeded limit of 0 corrupt blocks for file /u01/app/oracle/oradata/ORCL/system01.dbf

CAUSE:-

Contents from alert log file:-

Hex dump of (file 1, block 60) in trace file /u01/app/oracle/diag/rdbms/orcl/ORCL/trace/ORCL_ora_5162.trc

Corrupt block relative dba: 0x0040003c (file 1, block 60)

Contents from trace file:-

Reread of blocknum=60, file=/u01/app/oracle/oradata/ORCL/system01.dbf. found same corrupt data

Reread of blocknum=60, file=/u01/app/oracle/oradata/ORCL/system01.dbf. found same corrupt data

Reread of blocknum=60, file=/u01/app/oracle/oradata/ORCL/system01.dbf. found same corrupt data

Reread of blocknum=60, file=/u01/app/oracle/oradata/ORCL/system01.dbf. found same corrupt data

Reread of blocknum=60, file=/u01/app/oracle/oradata/ORCL/system01.dbf. found same corrupt data

FIX:-

RMAN> blockrecover datafile 1 block 60;

Starting recover at 02-SEP-13

using channel ORA_DISK_1

channel ORA_DISK_1: restoring block(s)

channel ORA_DISK_1: specifying block(s) to restore from backup set

restoring blocks of datafile 00001

channel ORA_DISK_1: reading from backup piece /u01/app/oracle/flash_recovery_area/ORCL/backupset/2013_08_26/o1_mf_nnndf_TAG20130826T234431_91q6r8fm_.bkp

channel ORA_DISK_1: piece handle=/u01/app/oracle/flash_recovery_area/ORCL/backupset/2013_08_26/o1_mf_nnndf_TAG20130826T234431_91q6r8fm_.bkp tag=TAG20130826T234431

channel ORA_DISK_1: restored block(s) from backup piece 1

channel ORA_DISK_1: block restore complete, elapsed time: 00:02:46

starting media recovery

archived log for thread 1 with sequence 16 is already on disk as file /u01/app/oracle/flash_recovery_area/ORCL/archivelog/2013_08_26/o1_mf_1_16_91q6vzbq_.arc

archived log for thread 1 with sequence 17 is already on disk as file /u01/app/oracle/flash_recovery_area/ORCL/archivelog/2013_08_27/o1_mf_1_17_91rh7y71_.arc

archived log for thread 1 with sequence 18 is already on disk as file /u01/app/oracle/flash_recovery_area/ORCL/archivelog/2013_08_27/o1_mf_1_18_91ryvw0l_.arc

archived log for thread 1 with sequence 19 is already on disk as file /u01/app/oracle/flash_recovery_area/ORCL/archivelog/2013_08_27/o1_mf_1_19_91ryz28d_.arc

archived log for thread 1 with sequence 20 is already on disk as file /u01/app/oracle/flash_recovery_area/ORCL/archivelog/2013_08_27/o1_mf_1_20_91spdly4_.arc

archived log for thread 1 with sequence 21 is already on disk as file /u01/app/oracle/flash_recovery_area/ORCL/archivelog/2013_08_28/o1_mf_1_21_91w1lbky_.arc

archived log for thread 1 with sequence 22 is already on disk as file /u01/app/oracle/flash_recovery_area/ORCL/archivelog/2013_08_29/o1_mf_1_22_91xvyqbk_.arc

archived log for thread 1 with sequence 23 is already on disk as file /u01/app/oracle/flash_recovery_area/ORCL/archivelog/2013_08_29/o1_mf_1_23_91yw384q_.arc

archived log for thread 1 with sequence 24 is already on disk as file /u01/app/oracle/flash_recovery_area/ORCL/archivelog/2013_08_30/o1_mf_1_24_91z51nq6_.arc

archived log for thread 1 with sequence 25 is already on disk as file /u01/app/oracle/flash_recovery_area/ORCL/archivelog/2013_09_02/o1_mf_1_25_9287yh94_.arc

media recovery complete, elapsed time: 00:00:10

Finished recover at 02-SEP-13

• You can verify if your datafile still have any corrupted block with the below OS command

[oracle@mydb ORCL]$ dbv file=/u01/app/oracle/oradata/ORCL/system01.dbf

DBVERIFY: Release 11.2.0.1.0 - Production on Mon Sep 2 11:34:19 2013

Copyright (c) 1982, 2009, Oracle and/or its affiliates.  All rights reserved.

DBVERIFY - Verification starting : FILE = /u01/app/oracle/oradata/ORCL/system01.dbf

DBVERIFY - Verification complete

Total Pages Examined         : 94720

Total Pages Processed (Data) : 58702

Total Pages Failing   (Data) : 0

Total Pages Processed (Index): 12335

Total Pages Failing   (Index): 0

Total Pages Processed (Other): 11399

Total Pages Processed (Seg)  : 1

Total Pages Failing   (Seg)  : 0

Total Pages Empty            : 12284

Total Pages Marked Corrupt   : 0

Total Pages Influx           : 0

Total Pages Encrypted        : 0

Highest block SCN            : 2648293 (0.2648293)