users@glassfish.java.net

Re: GrizzlyServiceListener IllegalStateException

From: Paul Harrup <paul.harrup_at_bto.org>
Date: Wed, 06 Jun 2012 14:54:08 +0100

The problem went away after restarting Glassfish and no changes were
made to the workers configuration. Our workers.properties:

workers.tomcat_home=/usr/local/glassfish/latest
workers.java_home=/usr/java/latest
ps=/
worker.list=worker1
worker.worker1.type=ajp13
worker.worker1.host=localhost
worker.worker1.port=8009
worker.worker1.socket_keepalive=1
worker.worker1.socket_timeout=900
worker.worker1.connection_pool_timeout=300
worker.worker1.retries=2

Paul

On 06/06/2012 12:39, Oleksiy Stashok wrote:
> Hi Paul,
>
> may be you disabled ping in Apache ajp workers config?
>
> Thanks.
>
> WBR,
> Alexey.
>
> On 06/06/2012 01:05 PM, Paul Harrup wrote:
>> Hi Alexey
>>
>> We will apply the patch, though this issue hasn't occurred again
>> since last time.
>>
>> Thanks
>> Paul
>>
>> On 02/06/2012 09:43, Oleksiy Stashok wrote:
>>> Hi Paul,
>>>
>>> I updated the patch to fix the cping/cpong issue you found.
>>> http://java.net/jira/browse/GLASSFISH-18446
>>>
>>> Pls. let us know if it helped.
>>>
>>> Thanks.
>>>
>>> WBR,
>>> Alexey.
>>>
>>> On 06/01/2012 10:56 AM, Paul Harrup wrote:
>>>> The stream of IllegalStateException errors were preceeded by these
>>>> two stack errors:
>>>>
>>>> [#|2012-05-31T11:54:21.538+0100|SEVERE|glassfish3.1.2|com.sun.grizzly.config.GrizzlyServiceListener|_ThreadID=31;_ThreadName=Thread-2;|GRIZZLY0051:
>>>> ProcessorTask exception.
>>>> java.lang.NullPointerException
>>>> at
>>>> com.sun.grizzly.http.ajp.AjpHttpResponse.writeCPongReply(AjpHttpResponse.java:62)
>>>> at
>>>> com.sun.grizzly.http.ajp.AjpProcessorTask.processCPing(AjpProcessorTask.java:353)
>>>> at
>>>> com.sun.grizzly.http.ajp.AjpProcessorTask.invokeAdapter(AjpProcessorTask.java:146)
>>>> at
>>>> com.sun.grizzly.http.ProcessorTask.doProcess(ProcessorTask.java:746)
>>>> at
>>>> com.sun.grizzly.http.ProcessorTask.process(ProcessorTask.java:1045)
>>>> at
>>>> com.sun.grizzly.http.DefaultProtocolFilter.execute(DefaultProtocolFilter.java:228)
>>>> at
>>>> com.sun.grizzly.DefaultProtocolChain.executeProtocolFilter(DefaultProtocolChain.java:137)
>>>> at
>>>> com.sun.grizzly.DefaultProtocolChain.execute(DefaultProtocolChain.java:104)
>>>> at
>>>> com.sun.grizzly.DefaultProtocolChain.execute(DefaultProtocolChain.java:90)
>>>> at
>>>> com.sun.grizzly.http.HttpProtocolChain.execute(HttpProtocolChain.java:79)
>>>> at
>>>> com.sun.grizzly.ProtocolChainContextTask.doCall(ProtocolChainContextTask.java:54)
>>>> at
>>>> com.sun.grizzly.SelectionKeyContextTask.call(SelectionKeyContextTask.java:59)
>>>> at com.sun.grizzly.ContextTask.run(ContextTask.java:71)
>>>> at
>>>> com.sun.grizzly.util.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:532)
>>>> at
>>>> com.sun.grizzly.util.AbstractThreadPool$Worker.run(AbstractThreadPool.java:513)
>>>> at java.lang.Thread.run(Thread.java:662)
>>>> |#]
>>>>
>>>> [#|2012-05-31T11:54:26.629+0100|SEVERE|glassfish3.1.2|com.sun.grizzly.config.GrizzlyServiceListener|_ThreadID=41;_ThreadName=Thread-2;|GRIZZLY0041:
>>>> Unblocking keep-alive exception.
>>>> java.lang.ArrayIndexOutOfBoundsException: 61
>>>> at
>>>> com.sun.grizzly.http.ajp.AjpMessageUtils.decodeForwardRequest(AjpMessageUtils.java:73)
>>>> at
>>>> com.sun.grizzly.http.ajp.AjpInputBuffer.parseAjpHttpHeaders(AjpInputBuffer.java:141)
>>>> at
>>>> com.sun.grizzly.http.ajp.AjpInputBuffer.parseHeaders(AjpInputBuffer.java:114)
>>>> at
>>>> com.sun.grizzly.http.ProcessorTask.parseRequest(ProcessorTask.java:902)
>>>>
>>>> at
>>>> com.sun.grizzly.http.ajp.AjpProcessorTask.parseRequest(AjpProcessorTask.java:109)
>>>> at
>>>> com.sun.grizzly.http.ProcessorTask.doProcess(ProcessorTask.java:706)
>>>> at
>>>> com.sun.grizzly.http.ProcessorTask.process(ProcessorTask.java:1045)
>>>> at
>>>> com.sun.grizzly.http.DefaultProtocolFilter.execute(DefaultProtocolFilter.java:228)
>>>> at
>>>> com.sun.grizzly.DefaultProtocolChain.executeProtocolFilter(DefaultProtocolChain.java:137)
>>>> at
>>>> com.sun.grizzly.DefaultProtocolChain.execute(DefaultProtocolChain.java:104)
>>>> at
>>>> com.sun.grizzly.DefaultProtocolChain.execute(DefaultProtocolChain.java:90)
>>>> at
>>>> com.sun.grizzly.http.HttpProtocolChain.execute(HttpProtocolChain.java:79)
>>>> at
>>>> com.sun.grizzly.ProtocolChainContextTask.doCall(ProtocolChainContextTask.java:54)
>>>> at
>>>> com.sun.grizzly.SelectionKeyContextTask.call(SelectionKeyContextTask.java:59)
>>>> at com.sun.grizzly.ContextTask.run(ContextTask.java:71)
>>>> at
>>>> com.sun.grizzly.util.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:532)
>>>> at
>>>> com.sun.grizzly.util.AbstractThreadPool$Worker.run(AbstractThreadPool.java:513)
>>>> at java.lang.Thread.run(Thread.java:662)
>>>> |#]
>>>>
>>>>
>>>> On 01/06/2012 09:32, Paul Harrup wrote:
>>>>> We Upgraded from 3.1 to 3.1.2 recently, we applying the patched
>>>>> jars for GLASSFISH-18446
>>>>> http://java.net/jira/browse/GLASSFISH-18446 to resolve issues with
>>>>> mod_jk, but now after a week we have started getting the following
>>>>> errors:
>>>>>
>>>>> [#|2012-06-01T08:47:31.478+0100|SEVERE|glassfish3.1.2|com.sun.grizzly.config.GrizzlyServiceListener|_ThreadID=22;_ThreadName=Thread-2;|GRIZZLY0051:
>>>>> ProcessorTask exception.
>>>>> java.lang.IllegalStateException: Invalid packet magic number: 6074
>>>>> pos=5lastValid=5222 end=5
>>>>> at
>>>>> com.sun.grizzly.http.ajp.AjpInputBuffer.readAjpMessageHeader(AjpInputBuffer.java:85)
>>>>> at
>>>>> com.sun.grizzly.http.ajp.AjpProcessorTask.parseRequest(AjpProcessorTask.java:107)
>>>>> at
>>>>> com.sun.grizzly.http.ProcessorTask.doProcess(ProcessorTask.java:706)
>>>>> at
>>>>> com.sun.grizzly.http.ProcessorTask.process(ProcessorTask.java:1045)
>>>>> at
>>>>> com.sun.grizzly.http.DefaultProtocolFilter.execute(DefaultProtocolFilter.java:228)
>>>>> at
>>>>> com.sun.grizzly.DefaultProtocolChain.executeProtocolFilter(DefaultProtocolChain.java:137)
>>>>> at
>>>>> com.sun.grizzly.DefaultProtocolChain.execute(DefaultProtocolChain.java:104)
>>>>> at
>>>>> com.sun.grizzly.DefaultProtocolChain.execute(DefaultProtocolChain.java:90)
>>>>> at
>>>>> com.sun.grizzly.http.HttpProtocolChain.execute(HttpProtocolChain.java:79)
>>>>> at
>>>>> com.sun.grizzly.ProtocolChainContextTask.doCall(ProtocolChainContextTask.java:54)
>>>>> at
>>>>> com.sun.grizzly.SelectionKeyContextTask.call(SelectionKeyContextTask.java:59)
>>>>> at com.sun.grizzly.ContextTask.run(ContextTask.java:71)
>>>>> at
>>>>> com.sun.grizzly.util.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:532)
>>>>> at
>>>>> com.sun.grizzly.util.AbstractThreadPool$Worker.run(AbstractThreadPool.java:513)
>>>>> at java.lang.Thread.run(Thread.java:662)
>>>>> |#]
>>>>>
>>>>> We got the same error in a constant stream until the Glassfish was
>>>>> restarted.
>>>>>
>>>>> We are running Glassfish on Java 6u32 64-bit fronted by Apache
>>>>> 2.2.3 and mod_jk 1.2.36. Has anyone else experienced these error?
>>>>>
>>>>> Thanks
>>>>> Paul
>>>>>
>>>>>
>>>
>