users@glassfish.java.net

Re: Debugging Glassfish CPU usage

From: Jagadish Prasath Ramu <Jagadish.Ramu_at_Sun.COM>
Date: Wed, 25 Mar 2009 10:22:52 +0530

Hi JeanFrancois :

Except the follwing thread dump
jstack_dump_2009-03-24_09:26:34.txt

all others are not related to connection pool /db.

As there are three other stack traces which are indicating that the
database operations are fine during the "appserver unresponsive"
moments, the issue is not really due to database calls.

Can you take a look at the three stack traces below ?

http://forums.java.net/jive/servlet/JiveServlet/download/56-59323-338857-8163/jstack_dump_2009-03-22_20-25-12.txt.tar.gz
grep -ri "httpWorkerThread-80" jstack_dump_2009-03-22_20:25:12.txt | wc
-l
250

grep -ri "AbstractResourcePool" jstack_dump_2009-03-22_20:25:12.txt | wc
-l
0

grep -ri "org.apache.log4j.Category.forcedLog"
jstack_dump_2009-03-22_20:25:12.txt | wc -l
67

grep -ri "BLOCKED" jstack_dump_2009-03-22_20:25:12.txt | wc -l
68



http://forums.java.net/jive/servlet/JiveServlet/download/56-59323-338654-8151/jstack_dump_2009-03-23_22:10:22.txt

grep -ri "httpWorkerThread-80" jstack_dump_2009-03-23_22:10:22.txt | wc
-l
250

grep -ri "com.mysql.jdbc.MysqlIO.readFully"
jstack_dump_2009-03-23_22:10:22.txt | wc -l
24

grep -ri "AbstractResourcePool.getResource"
jstack_dump_2009-03-23_22:10:22.txt | wc -l
5



http://forums.java.net/jive/servlet/JiveServlet/download/56-59323-338842-8160/jstack_dump_2009-03-24_18:49:21.txt
grep -ri "httpWorkerThread-80" jstack_dump_2009-03-24_18:49:21.txt | wc
-l
50

grep -ri "AbstractResourcePool" jstack_dump_2009-03-24_18:49:21.txt | wc
-l
0

grep -ri "com.mysql.jdbc.ConnectionImpl"
jstack_dump_2009-03-24_18:49:21.txt | wc -l
5


Thanks,
-Jagadish










On Tue, 2009-03-24 at 15:27 +0100, Jeanfrancois Arcand wrote:
>
> Jagadish Prasath Ramu wrote:
> >
> > On Tue, 2009-03-24 at 15:11 +0100, Jeanfrancois Arcand wrote:
> >> Salut,
> >>
> >> Jagadish Prasath Ramu wrote:
> >>>
> >>> On Tue, 2009-03-24 at 11:46 +0100, Jeanfrancois Arcand wrote:
> >>>> Salut,
> >>>>
> >>>> glassfish_at_javadesktop.org wrote:
> >>>> Jagadish, do you know if this could be the issue or not? But for sure
> >>>> all Grizzly WorkerThread may gets locked by such call.
> >>> jstack_dump_2009-03-23_22:10:22.txt
> >>> I see 250 "httpWorkerThread-80*" threads of which 34 are used for
> >>> database.
> >> Hum, for that one:
> >>
> >> http://forums.java.net/jive/servlet/JiveServlet/download/56-59323-338654-8150/jstack_dump_2009-03-24_09:26:34.txt
> >>
> >> All Grizzly WorkerThread are locked.
> > When resizer (cleaner) is doing cleanup of the pool, all the connections
> > will be validated. This will make all the requesting threads to wait
> > till resizer completes its job. This is a temporary wait stage.
> >
> > jstack_dump_2009-03-23_22:10:22.txt
>
>
> Also 1 hour pass between the two jstack so I would think the slow down
> happened during that time. How long does it take for the finalizer to
> execute? That window might be the issue. It is really hard to say with
> those 2 jstack as the time frame in between is really long.
>
> A+
>
> - Jeanfrancois
>
>
> > For the above stack, only 34 out of 250 httpWorkerThreads are used by
> > database calls. So, what could be the issue ?
> >
> > Thanks,
> > -Jagadish
> >>> Lets wait for "rwillie" to provide more details, output based on the
> >>> proposed settings and see.
> >> Thanks!
> >>
> >> -- Jeanfrancois
> >>
> >>
> >>> Thanks,
> >>> -Jagadish
> >>>
> >>>
> >>>> A+
> >>>>
> >>>> -- Jeanfrancois
> >>>>
> >>>>
> >>>>> Thanks!
> >>>>> [Message sent by forum member 'rwillie6' (rwillie6)]
> >>>>>
> >>>>> http://forums.java.net/jive/thread.jspa?messageID=338656
> >>>>>
> >>>>> ---------------------------------------------------------------------
> >>>>> To unsubscribe, e-mail: users-unsubscribe_at_glassfish.dev.java.net
> >>>>> For additional commands, e-mail: users-help_at_glassfish.dev.java.net
> >>>>>
> >>>
> >>> ---------------------------------------------------------------------
> >>> To unsubscribe, e-mail: users-unsubscribe_at_glassfish.dev.java.net
> >>> For additional commands, e-mail: users-help_at_glassfish.dev.java.net
> >>>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: users-unsubscribe_at_glassfish.dev.java.net
> >> For additional commands, e-mail: users-help_at_glassfish.dev.java.net
> >>
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe_at_glassfish.dev.java.net
> For additional commands, e-mail: users-help_at_glassfish.dev.java.net
>