Mailing List
Home
Forum Home
Linux - General Red Hat Linux discussion list
Installation - Getting started with Red Hat Linux
Enterprise Linux 3 - Discussion of Red Hat Enterprise Linux 3 (Taroon)
Red Hat Linux 9 - Discussion of Red Hat Linux 9 (Shrike)
Red Hat Linux 7.2 - Discussion of Red Hat Linux 7.2 (Enigma)
Red Hat Linux 7.3 - Discussion of Red Hat Linux 7.3 (Valhalla)
Apache Web Server
Oracle database, Microsoft SQL server ...
Subjects
• Subject: application/x mplayer2 plugin
• RPM error: db4 error(16) from dbenv >remove: Device or resource
   busy
• Command stream end of file while reading
• Subject: X Windows problem (xauth)
• Subject: Upgrading openoffice 1 1 rpm
• Subject: FTP: connection refused
• Subject: FTP: connection refused
• mount: /dev/cdrom: is not a valid block device
• Dell Precision 650, RedHat 9, no sound
• how to trace the cause resulting in the crash of bind server
• Virus on the list
• UNINSTALL RPM MYSQL
• usb pen drives: mounting as a user
• Subject: broadcom network interface
• make mrproper
• Couldn 't open PID file /var/run/named/named pid Permission denied
• sendmail configuration on redhat
• kernel 2 6 and /dev/sound/mixer not found
• Subject: Promise 378 controller
• Subject: Problem using up2date
• mrtg step by step howto/configuration for a newbie?
• Compiling and Installing Kernel 2 6
• Can 't locate module ppp0, can 't locate module ppp compress 21
• Subject: Lotus Notes under Wine
• HOW I CAN MAKE BOOTABLE FLOPPY DISKET
• /etc/security/limits conf question
• Intel E/1000 driver
• rpm database corrupt
• Command stream end of file while reading
• qla2300 modules
 
"Out of Memory: Killed process " errors on server running Oracle

"Out of Memory: Killed process " errors on server running Oracle

2007-07-13       - By Gene

 Back
Reply:     1     2     3     4     5     6     7     8     9     10     >>  

We are running OCFS and have plenty of disk space.  Is there anything in
specific I need to check in SGA?

-Gene

On 7/13/07, David.Knight@(protected) <David.Knight@(protected)> wrote:
>
>
> What is the status if the SGA in oracle? are you running ocfs? do you have
> plenty of disk space?
>
>
>  *Gene <gene@(protected)>*
> Sent by: taroon-list-bounces@(protected)
>
> 07/12/2007 04:17 PM  Please respond to
> "Discussion of Red Hat Enterprise Linux 3 (Taroon)" <
> taroon-list@(protected)>
>
>   To
> "Discussion of Red Hat Enterprise Linux 3 (Taroon)" <
> taroon-list@(protected)>  cc
>
>  Subject
> "Out of Memory: Killed process" errors on server running Oracle
>
>
>
>
>
>
> Hola,
>
>  Every 5-6 days I'm getting "Out of Memory: Killed process" messages on a
> Redhat AS 3 server running Oracle 9.20.  These errors will occur for a
> couple hours and will eventually lead to Oracle shutting down.  The load on
> the server did increase recently, but there's still 1.8GB memory free on
> the system during these errors.
>
>  The box is running the smp kernel.  Should I do something like increase
> the stack size or use the hugemem kernel?
> *
> $ uname -a *
> Linux prddb02 2.4.21-15.0.3.ELsmp #1 SMP Tue Jun 29 18:04:47 EDT 2004 i686
> i686 i386 GNU/Linux
> *
> $ ulimit -a*
> core file size        (blocks, -c) 0
> data seg size         (kbytes, -d) unlimited
> file size             (blocks, -f) unlimited
> max locked memory     (kbytes, -l) 4
> max memory size       (kbytes, -m) unlimited
> open files                    (-n) 65536
> pipe size          (512 bytes, -p) 8
> stack size            (kbytes, -s) 10240
> cpu time             (seconds, -t) unlimited
> max user processes            (-u) 16384
> virtual memory        (kbytes, -v) unlimited
> *
> >From /var/log/messages:*
>
> Jul 11 19:06:31 prddb02 kernel: Mem-info:
> Jul 11 19:06:31 prddb02 kernel: Zone:DMA freepages:  2549 min:     0 low:
>     0 high:     0
> Jul 11 19:06:31 prddb02 kernel: Zone:Normal freepages:  1254 min:  1279
> low:  4544 high:  6304
> Jul 11 19:06:31 prddb02 kernel: Zone:HighMem freepages:501745 min:   255
> low: 20992 high: 31488
> Jul 11 19:06:31 prddb02 kernel: Free pages:      505548 (501745 HighMem)
> Jul 11 19:06:31 prddb02 kernel:   aa:0 ac:0 id:0 il:0 ic:0 fr:2549
> Jul 11 19:06:31 prddb02 kernel:   aa:0 ac:40 id:82 il:73 ic:0 fr:1254
> Jul 11 19:06:31 prddb02 kernel:   aa:530276 ac:82904 id:17203 il:6249
> ic:8419 fr:501745
> Jul 11 19:06:31 prddb02 kernel: 1*4kB 2*8kB 2*16kB 1*32kB 0*64kB 1*128kB
> 1*256kB 1*512kB 1*1024kB 0*2048kB 2*4096kB = 10196kB)
> Jul 11 19:06:31 prddb02 kernel: 137*4kB 121*8kB 45*16kB 19*32kB 6*64kB
> 2*128kB 0*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 5020kB)
> Jul 11 19:06:31 prddb02 kernel: 35001*4kB 11806*8kB 4209*16kB 1479*32kB
> 1490*64kB 513*128kB 291*256kB 48*512kB 15*1024kB 5*2048kB 335*4096kB =
> 2006980kB)
> Jul 11 19:06:31 prddb02 kernel: Swap cache: add 0, delete 0, find 0/0,
> race 0+0
> Jul 11 19:06:31 prddb02 kernel: 192549 pages of slabcache
> Jul 11 19:06:31 prddb02 kernel: 1192 pages of kernel stacks
> Jul 11 19:06:31 prddb02 kernel: 0 lowmem pagetables, 127372 highmem
> pagetables
> Jul 11 19:06:31 prddb02 kernel: Free swap:       8192980kB
> Jul 11 19:06:31 prddb02 kernel: 1572864 pages of RAM
> Jul 11 19:06:31 prddb02 kernel: 1277920 pages of HIGHMEM
> Jul 11 19:06:31 prddb02 kernel: 89860 reserved pages
> Jul 11 19:06:31 prddb02 kernel: 24863915 pages shared
> Jul 11 19:06:31 prddb02 kernel: 0 pages swap cached
> Jul 11 19:06:31 prddb02 kernel: Out of Memory: Killed process 8302
> (oracle).
> *
> $ sar -r -f /var/log/sa/sa11*
> 10:00:00 AM kbmemfree kbmemused  %memused kbbuffers  kbcached kbswpfree
> kbswpused  %swpused  kbswpcad
> 05:00:00 PM   1901836   4030180     67.94      4228   1976412   8192980
>       0      0.00         0
> 05:10:00 PM   1755672   4176344     70.40      1456   2115832   8192980
>       0      0.00         0
> 05:20:00 PM   1901120   4030896     67.95      2952   1976168   8192980
>       0      0.00         0
> 05:30:00 PM   1896664   4035352     68.03      2392   1975920   8192980
>       0      0.00         0
> 05:39:59 PM   1892232   4039784     68.10      2200   1975900   8192980
>       0      0.00         0
> 05:50:00 PM   1889808   4042208     68.14      2408   1976076   8192980
>       0      0.00         0
> 06:00:00 PM   1897984   4034032     68.00      2336   1976244   8192980
>       0      0.00         0
> 06:10:00 PM   1831708   4100308     69.12      1192   2040788   8192980
>       0      0.00         0
> 06:20:01 PM   1832808   4099208     69.10      1372   2040912   8192980
>       0      0.00         0
> 06:30:03 PM   1844548   4087468     68.91      1284   2040988   8192980
>       0      0.00         0
> 06:40:01 PM   1895092   4036924     68.05      1304   2041120   8192980
>       0      0.00         0
> 06:50:00 PM   1909852   4022164     67.80      1300   2041248   8192980
>       0      0.00         0*
> 07:00:01 PM   1906980   4025036*     67.85      1104   2041300   8192980
>       0      0.00         0*
> 07:10:01 PM   4363412   1568604*     26.44     13816    726432   8192980
>       0      0.00         0
>
> -Gene
> *
> **gene@(protected)* <gene@(protected)>--
> Taroon-list mailing list
> Taroon-list@(protected)
> https://www.redhat.com/mailman/listinfo/taroon-list
>
> --
> Taroon-list mailing list
> Taroon-list@(protected)
> https://www.redhat.com/mailman/listinfo/taroon-list
>

We are running OCFS and have plenty of disk space.&nbsp; Is there anything in
specific I need to check in SGA?<br><br>-Gene<br><br><div><span class="gmail
_quote">On 7/13/07, <b class="gmail_sendername"><a href="mailto:David.Knight
@(protected)">
David.Knight@(protected)</a></b> &lt;<a href="mailto:David.Knight@(protected)
">David.Knight@(protected)</a>&gt; wrote:</span><blockquote class="gmail_quote"
style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex;
padding-left: 1ex;">

<br><font face="sans-serif" size="2">What is the status if the SGA in oracle?
are you running ocfs? do you have plenty of disk space?</font>
<br>
<br>
<br>
<table width="100%">
<tbody><tr valign="top">
<td width="40%"><font face="sans-serif" size="1"><b>Gene &lt;<a href="mailto
:gene@(protected)" target="_blank" onclick="return top.js.OpenExtLink(window,event
,this)">gene@(protected)</a>&gt;</b>
</font>
<br><font face="sans-serif" size="1">Sent by: <a href="mailto:taroon-list
-bounces@(protected)" target="_blank" onclick="return top.js.OpenExtLink(window
,event,this)">taroon-list-bounces@(protected)</a></font>
<p><font face="sans-serif" size="1">07/12/2007 04:17 PM</font>
<table border="1">
<tbody><tr valign="top">
<td bgcolor="white">
<div align="center"><font face="sans-serif" size="1">Please respond to<br>
&quot;Discussion of Red Hat Enterprise Linux 3 (Taroon)&quot; &lt;<a href=
"mailto:taroon-list@(protected)" target="_blank" onclick="return top.js
.OpenExtLink(window,event,this)">taroon-list@(protected)</a>&gt;</font></div>
</td></tr></tbody></table>
<br>
</p></td><td width="59%">
<table width="100%">
<tbody><tr valign="top">
<td>
<div align="right"><font face="sans-serif" size="1">To</font></div>
</td><td><font face="sans-serif" size="1">&quot;Discussion of Red Hat Enterprise
Linux 3 (Taroon)&quot; &lt;<a href="mailto:taroon-list@(protected)" target="
_blank" onclick="return top.js.OpenExtLink(window,event,this)">taroon-list
@(protected)</a>&gt;</font>
</td></tr><tr valign="top">
<td>
<div align="right"><font face="sans-serif" size="1">cc</font></div>
</td><td>
<br></td></tr><tr valign="top">
<td>
<div align="right"><font face="sans-serif" size="1">Subject</font></div>
</td><td><font face="sans-serif" size="1">&quot;Out of Memory: Killed process
&quot;
errors on server running Oracle</font></td></tr></tbody></table>
<br>
<table>
<tbody><tr valign="top">
<td>
<br></td><td><br></td></tr></tbody></table>
<br></td></tr></tbody></table><div><span class="e" id="q_113c00c2935a3972_1">
<br>
<br>
<br><font size="3">Hola,<br>
<br>
&nbsp;Every 5-6 days I&#39;m getting &quot;Out of Memory: Killed process&quot;
messages on a Redhat AS 3 server running Oracle 9.20. &nbsp;These errors
will occur for a couple hours and will eventually lead to Oracle shutting
down. &nbsp;The load on the server did increase recently, but there&#39;s still
1.8GB memory free on the system during these errors.<br>
<br>
&nbsp;The box is running the smp kernel. &nbsp;Should I do something like
increase the stack size or use the hugemem kernel?<br>
<b><br>
$ uname -a </b><br>
Linux prddb02 2.4.21-15.0.3.ELsmp #1 SMP Tue Jun 29 18:04:47 EDT 2004 i686
i686 i386 GNU/Linux<br>
<b><br>
$ ulimit -a</b><br>
core file size &nbsp; &nbsp; &nbsp; &nbsp;(blocks, -c) 0<br>
data seg size &nbsp; &nbsp; &nbsp; &nbsp; (kbytes, -d) unlimited <br>
file size &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; (blocks, -f) unlimited<br>
max locked memory &nbsp; &nbsp; (kbytes, -l) 4<br>
max memory size &nbsp; &nbsp; &nbsp; (kbytes, -m) unlimited<br>
open files &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
&nbsp;(-n) 65536<br>
pipe size &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;(512 bytes, -p) 8 <br>
stack size &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;(kbytes, -s) 10240<br>
cpu time &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; (seconds, -t) unlimited<br>
max user processes &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;(-u) 16384<br>
virtual memory &nbsp; &nbsp; &nbsp; &nbsp;(kbytes, -v) unlimited<br>
<b><br>
&gt;From /var/log/messages:</b><br>
<br>
Jul 11 19:06:31 prddb02 kernel: Mem-info:<br>
Jul 11 19:06:31 prddb02 kernel: Zone:DMA freepages: &nbsp;2549 min: &nbsp;
&nbsp; 0 low: &nbsp; &nbsp; 0 high: &nbsp; &nbsp; 0<br>
Jul 11 19:06:31 prddb02 kernel: Zone:Normal freepages: &nbsp;1254 min:
&nbsp;1279 low: &nbsp;4544 high: &nbsp;6304 <br>
Jul 11 19:06:31 prddb02 kernel: Zone:HighMem freepages:501745 min: &nbsp;
255 low: 20992 high: 31488<br>
Jul 11 19:06:31 prddb02 kernel: Free pages: &nbsp; &nbsp; &nbsp;505548
(501745 HighMem)<br>
Jul 11 19:06:31 prddb02 kernel: &nbsp; aa:0 ac:0 id:0 il:0 ic:0 fr:2549
<br>
Jul 11 19:06:31 prddb02 kernel: &nbsp; aa:0 ac:40 id:82 il:73 ic:0 fr:1254<br>
Jul 11 19:06:31 prddb02 kernel: &nbsp; aa:530276 ac:82904 id:17203 il:6249
ic:8419 fr:501745<br>
Jul 11 19:06:31 prddb02 kernel: 1*4kB 2*8kB 2*16kB 1*32kB 0*64kB 1*128kB
1*256kB 1*512kB 1*1024kB 0*2048kB 2*4096kB = 10196kB) <br>
Jul 11 19:06:31 prddb02 kernel: 137*4kB 121*8kB 45*16kB 19*32kB 6*64kB
2*128kB 0*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 5020kB)<br>
Jul 11 19:06:31 prddb02 kernel: 35001*4kB 11806*8kB 4209*16kB 1479*32kB
1490*64kB 513*128kB 291*256kB 48*512kB 15*1024kB 5*2048kB 335*4096kB =
2006980kB) <br>
Jul 11 19:06:31 prddb02 kernel: Swap cache: add 0, delete 0, find 0/0,
race 0+0<br>
Jul 11 19:06:31 prddb02 kernel: 192549 pages of slabcache<br>
Jul 11 19:06:31 prddb02 kernel: 1192 pages of kernel stacks<br>
Jul 11 19:06:31 prddb02 kernel: 0 lowmem pagetables, 127372 highmem pagetables
<br>
Jul 11 19:06:31 prddb02 kernel: Free swap: &nbsp; &nbsp; &nbsp; 8192980kB<br>
Jul 11 19:06:31 prddb02 kernel: 1572864 pages of RAM<br>
Jul 11 19:06:31 prddb02 kernel: 1277920 pages of HIGHMEM<br>
Jul 11 19:06:31 prddb02 kernel: 89860 reserved pages <br>
Jul 11 19:06:31 prddb02 kernel: 24863915 pages shared<br>
Jul 11 19:06:31 prddb02 kernel: 0 pages swap cached<br>
Jul 11 19:06:31 prddb02 kernel: Out of Memory: Killed process 8302 (oracle).<br>
<b><br>
$ sar -r -f /var/log/sa/sa11</b></font><font face="Courier" size="2"><br>
10:00:00 AM kbmemfree kbmemused &nbsp;%memused kbbuffers &nbsp;kbcached
kbswpfree kbswpused &nbsp;%swpused &nbsp;kbswpcad<br>
05:00:00 PM &nbsp; 1901836 &nbsp; 4030180 &nbsp; &nbsp; 67.94 &nbsp; &nbsp;
&nbsp;4228 &nbsp; 1976412 &nbsp; 8192980 &nbsp; &nbsp; &nbsp; &nbsp; 0
&nbsp; &nbsp; &nbsp;0.00 &nbsp; &nbsp; &nbsp; &nbsp; 0<br>
05:10:00 PM &nbsp; 1755672 &nbsp; 4176344 &nbsp; &nbsp; 70.40 &nbsp; &nbsp;
&nbsp;1456 &nbsp; 2115832 &nbsp; 8192980 &nbsp; &nbsp; &nbsp; &nbsp; 0
&nbsp; &nbsp; &nbsp;0.00 &nbsp; &nbsp; &nbsp; &nbsp; 0<br>
05:20:00 PM &nbsp; 1901120 &nbsp; 4030896 &nbsp; &nbsp; 67.95 &nbsp; &nbsp;
&nbsp;2952 &nbsp; 1976168 &nbsp; 8192980 &nbsp; &nbsp; &nbsp; &nbsp; 0
&nbsp; &nbsp; &nbsp;0.00 &nbsp; &nbsp; &nbsp; &nbsp; 0<br>
05:30:00 PM &nbsp; 1896664 &nbsp; 4035352 &nbsp; &nbsp; 68.03 &nbsp; &nbsp;
&nbsp;2392 &nbsp; 1975920 &nbsp; 8192980 &nbsp; &nbsp; &nbsp; &nbsp; 0
&nbsp; &nbsp; &nbsp;0.00 &nbsp; &nbsp; &nbsp; &nbsp; 0<br>
05:39:59 PM &nbsp; 1892232 &nbsp; 4039784 &nbsp; &nbsp; 68.10 &nbsp; &nbsp;
&nbsp;2200 &nbsp; 1975900 &nbsp; 8192980 &nbsp; &nbsp; &nbsp; &nbsp; 0
&nbsp; &nbsp; &nbsp;0.00 &nbsp; &nbsp; &nbsp; &nbsp; 0 <br>
05:50:00 PM &nbsp; 1889808 &nbsp; 4042208 &nbsp; &nbsp; 68.14 &nbsp; &nbsp;
&nbsp;2408 &nbsp; 1976076 &nbsp; 8192980 &nbsp; &nbsp; &nbsp; &nbsp; 0
&nbsp; &nbsp; &nbsp;0.00 &nbsp; &nbsp; &nbsp; &nbsp; 0<br>
06:00:00 PM &nbsp; 1897984 &nbsp; 4034032 &nbsp; &nbsp; 68.00 &nbsp; &nbsp;
&nbsp;2336 &nbsp; 1976244 &nbsp; 8192980 &nbsp; &nbsp; &nbsp; &nbsp; 0
&nbsp; &nbsp; &nbsp;0.00 &nbsp; &nbsp; &nbsp; &nbsp; 0<br>
06:10:00 PM &nbsp; 1831708 &nbsp; 4100308 &nbsp; &nbsp; 69.12 &nbsp; &nbsp;
&nbsp;1192 &nbsp; 2040788 &nbsp; 8192980 &nbsp; &nbsp; &nbsp; &nbsp; 0
&nbsp; &nbsp; &nbsp;0.00 &nbsp; &nbsp; &nbsp; &nbsp; 0<br>
06:20:01 PM &nbsp; 1832808 &nbsp; 4099208 &nbsp; &nbsp; 69.10 &nbsp; &nbsp;
&nbsp;1372 &nbsp; 2040912 &nbsp; 8192980 &nbsp; &nbsp; &nbsp; &nbsp; 0
&nbsp; &nbsp; &nbsp;0.00 &nbsp; &nbsp; &nbsp; &nbsp; 0<br>
06:30:03 PM &nbsp; 1844548 &nbsp; 4087468 &nbsp; &nbsp; 68.91 &nbsp; &nbsp;
&nbsp;1284 &nbsp; 2040988 &nbsp; 8192980 &nbsp; &nbsp; &nbsp; &nbsp; 0
&nbsp; &nbsp; &nbsp;0.00 &nbsp; &nbsp; &nbsp; &nbsp; 0<br>
06:40:01 PM &nbsp; 1895092 &nbsp; 4036924 &nbsp; &nbsp; 68.05 &nbsp; &nbsp;
&nbsp;1304 &nbsp; 2041120 &nbsp; 8192980 &nbsp; &nbsp; &nbsp; &nbsp; 0
&nbsp; &nbsp; &nbsp;0.00 &nbsp; &nbsp; &nbsp; &nbsp; 0 <br>
06:50:00 PM &nbsp; 1909852 &nbsp; 4022164 &nbsp; &nbsp; 67.80 &nbsp; &nbsp;
&nbsp;1300 &nbsp; 2041248 &nbsp; 8192980 &nbsp; &nbsp; &nbsp; &nbsp; 0
&nbsp; &nbsp; &nbsp;0.00 &nbsp; &nbsp; &nbsp; &nbsp; 0<b><br>
07:00:01 PM &nbsp; 1906980 &nbsp; 4025036</b> &nbsp; &nbsp; 67.85 &nbsp;
&nbsp; &nbsp;1104 &nbsp; 2041300 &nbsp; 8192980 &nbsp; &nbsp; &nbsp; &nbsp;
0 &nbsp; &nbsp; &nbsp;0.00 &nbsp; &nbsp; &nbsp; &nbsp; 0<b><br>
07:10:01 PM &nbsp; 4363412 &nbsp; 1568604</b> &nbsp; &nbsp; 26.44 &nbsp;
&nbsp; 13816 &nbsp; &nbsp;726432 &nbsp; 8192980 &nbsp; &nbsp; &nbsp; &nbsp;
0 &nbsp; &nbsp; &nbsp;0.00 &nbsp; &nbsp; &nbsp; &nbsp; 0</font><font size="3">
<br>
<br>
-Gene</font></span></div><font color="blue" size="3"><u><br>
</u></font><a href="mailto:gene@(protected)" target="_blank" onclick="return top
.js.OpenExtLink(window,event,this)"><font color="blue" size="3"><u>gene@(protected)
.org</u></font></a><font size="2"><tt>--<span class="q"><br>
Taroon-list mailing list<br>
<a href="mailto:Taroon-list@(protected)" target="_blank" onclick="return top.js
.OpenExtLink(window,event,this)">Taroon-list@(protected)</a><br>
<a href="https://www.redhat.com/mailman/listinfo/taroon-list" target="_blank"
onclick="return top.js.OpenExtLink(window,event,this)">https://www.redhat.com
/mailman/listinfo/taroon-list</a></span></tt></font>
<br><br>--<br>Taroon-list mailing list<br><a onclick="return top.js.OpenExtLink
(window,event,this)" href="mailto:Taroon-list@(protected)">Taroon-list@(protected)
</a><br><a onclick="return top.js.OpenExtLink(window,event,this)" href="https:/
/www.redhat.com/mailman/listinfo/taroon-list" target="_blank">
https://www.redhat.com/mailman/listinfo/taroon-list</a><br></blockquote></div>
<br>

--
Taroon-list mailing list
Taroon-list@(protected)
https://www.redhat.com/mailman/listinfo/taroon-list