users@glassfish.java.net

Re: glassfish pauses for certain periods

From: <glassfish_at_javadesktop.org>
Date: Thu, 01 Apr 2010 02:11:45 PDT

As a said in previous post, problem disappeared for a while, but now arise again, when we run a stress tests on our server. This time we run it inside local network so they doing requests to server much more frequently. Unfortunately, we got the same problem again - GF unexpectedly pausing for a while. This happens every time we run the tests.

Our server run on 8888 http port
We monitored network status by "netstat -a | grep 8888" during the tests. We saw nothing suspicious until server hangs - then we got a lot of CLOSE_WAITs
Here is the full stack:


tcp6 0 0 [::]:8888 [::]:* LISTEN
tcp6 0 0 localhost:8888 localhost:27742 TIME_WAIT
tcp6 0 0 appserver.flexsoft.:8888 nt1-n005.flex:1828 ESTABLISHED
tcp6 1 0 appserver.flexsoft.:8888 nt1-n005.flex:1765 CLOSE_WAIT
tcp6 0 0 appserver.flexsoft.:8888 nt1-n005.flex:1816 TIME_WAIT
tcp6 1 0 appserver.flexsoft.:8888 nt1-n005.flex:1709 CLOSE_WAIT
tcp6 1 0 appserver.flexsoft.:8888 nt1-n005.flex:1795 CLOSE_WAIT
tcp6 0 0 localhost:8888 localhost:27733 TIME_WAIT
tcp6 0 0 localhost:8888 localhost:27725 TIME_WAIT
tcp6 0 0 localhost:8888 localhost:27741 TIME_WAIT
tcp6 1 0 appserver.flexsoft.:8888 nt1-n005.flex:1819 CLOSE_WAIT
tcp6 1 0 appserver.flexsoft.:8888 nt1-n005.flex:1826 CLOSE_WAIT
tcp6 0 0 localhost:8888 localhost:27739 TIME_WAIT
tcp6 0 0 localhost:8888 localhost:27722 TIME_WAIT
tcp6 1 0 appserver.flexsoft.:8888 nt1-n005.flex:1707 CLOSE_WAIT
tcp6 0 0 localhost:8888 localhost:27746 TIME_WAIT
tcp6 0 0 localhost:8888 localhost:27734 TIME_WAIT
tcp6 0 0 localhost:8888 localhost:27736 TIME_WAIT
tcp6 0 0 localhost:8888 localhost:27727 TIME_WAIT
tcp6 0 0 appserver.flexsoft.:8888 nt1-n005.flex:1827 ESTABLISHED
tcp6 0 0 localhost:8888 localhost:27719 TIME_WAIT
tcp6 0 0 appserver.flexsoft.:8888 nt1-n005.flex:1830 ESTABLISHED
tcp6 0 0 localhost:8888 localhost:27737 TIME_WAIT
tcp6 0 0 localhost:8888 localhost:27723 TIME_WAIT
tcp6 1 0 appserver.flexsoft.:8888 nt1-n005.flex:1797 CLOSE_WAIT
tcp6 0 0 appserver.flexsoft.:8888 nt1-n005.flex:1831 ESTABLISHED
tcp6 0 0 localhost:8888 localhost:27740 TIME_WAIT
tcp6 0 0 localhost:8888 localhost:27745 TIME_WAIT
tcp6 0 0 localhost:8888 localhost:27735 TIME_WAIT
tcp6 1 0 appserver.flexsoft.:8888 nt1-n005.flex:1821 CLOSE_WAIT
tcp6 0 0 localhost:8888 localhost:27743 TIME_WAIT
tcp6 0 0 localhost:8888 localhost:27744 TIME_WAIT
tcp6 1 0 appserver.flexsoft.:8888 nt1-n005.flex:1801 CLOSE_WAIT
tcp6 0 0 localhost:8888 localhost:27726 TIME_WAIT
tcp6 0 0 localhost:8888 localhost:27738 TIME_WAIT
tcp6 0 0 localhost:8888 localhost:27724 TIME_WAIT
tcp6 1 0 appserver.flexsoft.:8888 nt1-n005.flex:1824 CLOSE_WAIT
tcp6 1 0 appserver.flexsoft.:8888 nt1-n005.flex:1804 CLOSE_WAIT
tcp6 1 0 appserver.flexsoft.:8888 nt1-n005.flex:1822 CLOSE_WAIT
[Message sent by forum member 'alex_pinjin']

http://forums.java.net/jive/thread.jspa?messageID=394866