Problem:
Today morning one of our development instance crashed due to following error found in alert log file.
Contents of alert log file:-
The Possible reasons for this sudden instance crash are:
In our development database, we reviewed the alert log and trace files related to this ORA error and we found out that there was high load on the Linux server due to RMAN hot backup running, export of a huge schema going on simultaneously.
At the time of this instance crash, there was very high load at the server and that's why the kill blocker interface killed the background process and so the instance crashed.
With these parameter, if the enqueue holder is a background process, then it will not be killed, therefore the instance will not crash
Note:- Don't set undocumented hidden parameters until advise by oracle support.
References:-
Database Crashes With ORA-00494 [ID 753290.1]
Ora-00494: Enqueue [Cf] Held For Too Long Causing Database To Crash [ID 1101862.1]
PHYSICAL: ORA-00494: enqueue [CF] held for too long after Node Crash [ID 747071.1]
ORA-00494 Or ORA-600 [2103] During High Load After 10.2.0.4 Upgrade (Doc ID 779552.1)
Today morning one of our development instance crashed due to following error found in alert log file.
Contents of alert log file:-
Sat Dec 21 02:17:04 2013Cause:-
Errors in file /mnt/DEVapps/oracle/trcdevdb/11.2.0/dbhome_1/log/diag/rdbms/trcdev/TRCDEV/trace/TRCDEV_ora_5707.trc (incident=81065):
ORA-00494: enqueue [CF] held for too long (more than 900 seconds) by 'inst 1, osid 24599'
Sat Dec 21 02:17:14 2013
minact-scn: useg scan erroring out with error e:12751
Suspending MMON action 'Block Cleanout Optim, Undo Segment Scan' for 82800 seconds
Incident details in: /mnt/DEVapps/oracle/trcdevdb/11.2.0/dbhome_1/log/diag/rdbms/trcdev/TRCDEV/incident/incdir_81065/TRCDEV_ora_5707_i81065.trc
Sat Dec 21 02:18:33 2013
Killing enqueue blocker (pid=24599) on resource CF-00000000-00000000 by (pid=5707)
by killing session 3.1
Killing enqueue blocker (pid=24599) on resource CF-00000000-00000000 by (pid=5707)
by terminating the process
USER (ospid: 5707): terminating the instance due to error 2103
Sat Dec 21 02:18:49 2013
Termination issued to instance processes. Waiting for the processes to exit
Instance termination failed to kill one or more processes
Instance terminated by USER, pid = 5707
The Possible reasons for this sudden instance crash are:
- Database running out of memory
- Due to high load,server became unresponsive
- Server is running out of memory and/or swap.
- High concurrency on resources, IO waits and contention
In our development database, we reviewed the alert log and trace files related to this ORA error and we found out that there was high load on the Linux server due to RMAN hot backup running, export of a huge schema going on simultaneously.
At the time of this instance crash, there was very high load at the server and that's why the kill blocker interface killed the background process and so the instance crashed.
- In order to prevent a background blocker from being killed, you can set the following init.ora parameter to 1 (default is 3).
- If you want to avoid the kill of the blocker (background or non-background process) you can set _kill_controlfile_enqueue_blocker=false.
With these parameter, if the enqueue holder is a background process, then it will not be killed, therefore the instance will not crash
Note:- Don't set undocumented hidden parameters until advise by oracle support.
References:-
Database Crashes With ORA-00494 [ID 753290.1]
Ora-00494: Enqueue [Cf] Held For Too Long Causing Database To Crash [ID 1101862.1]
PHYSICAL: ORA-00494: enqueue [CF] held for too long after Node Crash [ID 747071.1]
ORA-00494 Or ORA-600 [2103] During High Load After 10.2.0.4 Upgrade (Doc ID 779552.1)
Very helpful. Thank you
ReplyDeletewhat will impact on database performance if i set these hidden parameter.?
ReplyDeleteYalı
ReplyDeleteBeyazkent
Hisardere
Orhaniye
Karacakaya
L6NXH
Ağrı Lojistik
ReplyDeleteÇorlu Lojistik
Kars Lojistik
Antalya Lojistik
Rize Lojistik
0SBS
F804F
ReplyDeleteArtvin Evden Eve Nakliyat
Silivri Cam Balkon
Afyon Evden Eve Nakliyat
Ardahan Evden Eve Nakliyat
Mardin Evden Eve Nakliyat
9C97C
ReplyDeleteBalıkesir Parça Eşya Taşıma
Eryaman Parke Ustası
Afyon Şehir İçi Nakliyat
Erzurum Şehirler Arası Nakliyat
Erzincan Evden Eve Nakliyat
Sivas Evden Eve Nakliyat
Zonguldak Lojistik
İzmir Lojistik
Çerkezköy Motor Ustası
C1AD6
ReplyDeleteadıyaman kadınlarla ücretsiz sohbet
bingöl canlı sohbet odası
kırşehir bedava sohbet odaları
erzurum görüntülü sohbet ücretsiz
bilecik kadınlarla görüntülü sohbet
kilis bedava sohbet
kastamonu canlı ücretsiz sohbet
telefonda kızlarla sohbet
karaman rastgele görüntülü sohbet ücretsiz
AD5D5
ReplyDeletekaraman sesli görüntülü sohbet
sohbet uygulamaları
şırnak canlı sohbet siteleri ücretsiz
kızlarla canlı sohbet
van telefonda sohbet
trabzon tamamen ücretsiz sohbet siteleri
istanbul görüntülü sohbet
şırnak seslı sohbet sıtelerı
en iyi ücretsiz görüntülü sohbet siteleri
AA298
ReplyDeletebedava görüntülü sohbet sitesi
edirne mobil sesli sohbet
muğla mobil sohbet odaları
Sinop Telefonda Kadınlarla Sohbet
kayseri telefonda kadınlarla sohbet
Adana Parasız Sohbet Siteleri
ardahan bedava görüntülü sohbet
burdur yabancı görüntülü sohbet siteleri
ağrı bedava sohbet
0C3FC
ReplyDeletegoruntulu sohbet
görüntülü sohbet kadınlarla
sesli sohbet
adıyaman sesli görüntülü sohbet
antalya mobil sohbet odaları
kadınlarla ücretsiz sohbet
siirt bedava görüntülü sohbet sitesi
telefonda canlı sohbet
Ağrı Kadınlarla Sohbet
8951E
ReplyDeletezonguldak ücretsiz sohbet
Eskişehir Görüntülü Sohbet Yabancı
Aksaray Canlı Sohbet Odaları
Çorum Ücretsiz Sohbet Sitesi
adıyaman görüntülü sohbet yabancı
manisa görüntülü sohbet kızlarla
artvin sesli sohbet sesli chat
artvin canlı görüntülü sohbet siteleri
bedava sohbet chat odaları
CB776
ReplyDeleteTwitch İzlenme Satın Al
Area Coin Hangi Borsada
Coin Çıkarma Siteleri
Parasız Görüntülü Sohbet
Periscope Takipçi Hilesi
Spotify Takipçi Hilesi
Big Wolf Coin Hangi Borsada
Bitcoin Üretme
Paribu Borsası Güvenilir mi