Grokbase
Topics Posts Groups | in
x
[ help ]

Hervé Piedvache (bill.fo...@gmail.com)

Profile | Posts (2)

User Information

Display Name:Hervé Piedvache
Partial Email Address:bill.fo...@gmail.com
Posts:
2 total
1 in PostgreSQL - Admin
1 in PostgreSQL - Performance

5 Most Recent

1) Hervé Piedvache Re: [GENERAL] Kernel kills postgres process - help need
| +1 vote
Le mercredi 09 janvier 2008, Jeff Davis a écrit : How can I process to find this ? It's a...
PostgreSQL - General
[ Profile | Reply to group ] [ Flat  Thread  Threaded ]
Le mercredi 09 janvier 2008, Jeff Davis a écrit :
> On Wed, 2008-01-09 at 22:57 +0100, Hervé Piedvache wrote:
> > Hi,
> >
> > I have a big trouble with a PostgreSQL server ... regulary since I have
> > added 8 Gb of memory, on a server having already 8Gb of memory, I have
> > troubles. Nothing else have changed ... I'm on a Dell server, and all the
> > memory diagnostics from Dell seems to be good ...
> > When I have a lot of connexions (persistante connexions from 6 web
> > apache/php serveurs using PDO, about 110 process on each web servers) on
> > the server, or long request, it's difficult for me to know when it's
> > appening, the kernel seems to kill my postgresql process then the server
> > become completly instable, and most of the time need a reboot ...
> >
> > I'm on Linux kernel 2.6.15 with a version 8.1.10 of PostgreSQL.
> > My database is a size of 56G
> > RAM = 16 Gb
>
> [snip]
>
> > Jan 9 20:30:47 db2 kernel: oom-killer: gfp_mask=0x84d0, order=0
>
> It looks like the Out Of Memory Killer was invoked, and you need to find
> out why it was invoked.
>
> I posted to LKML here:
>
> http://kerneltrap.org/mailarchive/linux-kernel/2007/2/12/54202
>
> because linux has a behavior -- which in my opinion is a bug -- that
> causes the OOM killer to almost always kill PostgreSQL first, regardless
> of whether it was truly the offending process or not.
>
> So, find out which process truly caused the memory pressure that lead to
> the OOM being invoked, and fix that problem.

How can I process to find this ? It's a production server for a web service,
and I have no idea how to find wich process was the cause of this ... !?

> You may also consider some other linux configuration options that make
> invocation of OOM killer less likely.

On this server there is only Postgresql, slony, and sshd running the rest is
only Linux basic process (cron, atd, getty etc.)

regards,
--
Hervé Piedvache

---------------------------(end of broadcast)---------------------------
TIP 3: Have you checked our extensive FAQ?

http://www.postgresql.org/docs/faq
2) Hervé Piedvache Re: [GENERAL] Kernel kills postgres process - help need
| +1 vote
Tom, Le mercredi 09 janvier 2008, Tom Lane a écrit : My sysctl.conf file looks like this :...
PostgreSQL - General
[ Profile | Reply to group ] [ Flat  Thread  Threaded ]
Tom,

Le mercredi 09 janvier 2008, Tom Lane a écrit :
> =?utf-8?q?Herv=C3=A9_Piedvache?= <bill.footcow@gmail.com> writes:
> > When I have a lot of connexions (persistante connexions from 6 web
> > apache/php serveurs using PDO, about 110 process on each web servers) on
> > the server, or long request, it's difficult for me to know when it's
> > appening, the kernel seems to kill my postgresql process then the server
> > become completly instable, and most of the time need a reboot ...
>
> Turn off memory overcommit.

My sysctl.conf file looks like this :
kernel.shmmax= 941604096
kernel.sem = 250 32000 100 400
fs.file-max=655360
vm.overcommit_memory=2
vm.overcommit_ratio=30

> > max_connections = 2048
>
> Have you considered using a connection pooler in front of a smaller
> number of backends?

Which system do you recommand for this ?

> If you really need that many backends, it'd likely be a good idea to
> reduce max_files_per_process to perhaps 100 or so. If you manage
> to run the kernel out of filetable slots, all sorts of userland stuff
> is going to get very unhappy.

I'll try this ...

regards,
--
Hervé

---------------------------(end of broadcast)---------------------------
TIP 3: Have you checked our extensive FAQ?

http://www.postgresql.org/docs/faq
3) Hervé Piedvache Re: [GENERAL] Is there something like MySQL enterprise monitor for Postgres?
| +1 vote
Log Analyzer : pgFouine http://pgfoundry.org/projects/pgfouine/ Regards, Le samedi 29 décembre...
PostgreSQL - General
[ Profile | Reply to group ] [ Flat  Thread  Threaded ]
Log Analyzer : pgFouine
http://pgfoundry.org/projects/pgfouine/

Regards,

Le samedi 29 décembre 2007, Ivan Sergio Borgonovo a écrit :

> On Sat, 29 Dec 2007 10:16:50 +0100
>
> Andreas Kretschmer <akretschmer@spamfence.net> wrote:
> > Ivan Sergio Borgonovo <mail@webthatworks.it> schrieb:
> > > or/and is there something to spot what are the most critical sql
> > > queries/function behind an application?
> >
> > You can set "log_min_duration_statement" in your postgresql.conf to
> > log all querys with a duration highter than that value.
>
> That is interesting but it may be misleading (something that is below
> the threshold but get used thousands time won't be spotted).
>
> What about a log analyser?
> What about a configuration wizard that eat your logs and suggest
> improvement to the config?



--
Hervé Piedvache

---------------------------(end of broadcast)---------------------------
TIP 3: Have you checked our extensive FAQ?

http://www.postgresql.org/docs/faq
4) Hervé Piedvache Vacuum full since 15 hours
| +1 vote
Hi, I have a small question ... right now on a 8.1.10 version of PostgreSQL I'm doing a vacuum full...
PostgreSQL - Performance
[ Profile | Reply to group ] [ Flat  Thread  Threaded ]
Hi,

I have a small question ... right now on a 8.1.10 version of PostgreSQL I'm
doing a  vacuum full verbose anaylze a table with 60 304 340 rows in 1155791 
pages and there were 16 835 144 unused item pointers inside and 5 index.

After the first treatment of the index (appeared in the verbose) ... the
vacuum is still working now since 15 hours ... There is none other activity
on this server ... it's a replication server ... so the vacuum is locking
most of the replication queries ...
What can I do to get this doing quicker ...?
It's a 8Gb server ... with a RAID 10 ... my maintenance_work_mem = 25600.

Any idea ?
I'm sure that if I delete all the index an rebuild them by hand it'll be
really quicker ! (done on another replication server ... took 20 min)

regards,
--
Hervé Piedvache
5) Hervé Piedvache Re: [PERFORM] select on 1milion register = 6s
| +1 vote
Do you have analyzed your table before doing this ? Le samedi 28 juillet 2007, Bruno Rodrigues...
PostgreSQL - Performance
[ Profile | Reply to group ] [ Flat  Thread  Threaded ]
Do you have analyzed your table before doing this ?

Le samedi 28 juillet 2007, Bruno Rodrigues Siqueira a écrit :

> Friends,
>
>
>
>
>
>
>
> Who can help me? My SELECT in a base with 1 milion register,
> using  expression index = 6seconds.
>
>
>
>
>
> Please, I don't  know how to makes it better.
>
>
>
>
>
> Thanks



--
Hervé Piedvache

---------------------------(end of broadcast)---------------------------
TIP 9: In versions below 8.0, the planner will ignore your desire to
       choose an index scan if your joining column's datatypes do not
match

spacer
Profile | Posts (2)
Home > People > Hervé Piedvache