The logs below are from the Shoal GMS subsystem of the appserver and
indicate a communication problem of the clustered instances and DAS. The
in doubt /failure suspected signals are generated when instances
(including DAS) do not send out heartbeats and after sufficient number
of missed heartbeats and a loss of a p2p connection between the
processes, the instance(s) in question are maked as failed.
Could you double check that the DAS process and instance process have
actually failed using jps on the machine where both DAS and instance reside?
Also check if you have sufficient heap set up to handle the load (albeit
moderate load) and have sufficient available system RAM.
The defaults heap in the domain configuration may not be sufficient for
load testing.
It would help to know what specific build you are on along with other
details such as JDK version, system information, OS platform, whether on
virtual machines, etc.
hth
Shreedhar
glassfish_at_javadesktop.org wrote:
> Sorry the log did not make it in my previous post...
>
> #|2009-05-22T13:40:59.644+0200|INFO|sun-appserver2.1|ShoalLogger|_ThreadID=13;_ThreadName=ViewWindowThread;|GMS View Change Received for group mycluster : Members in view for (before change analysis) are :
> 1: MemberId: server, MemberType: SPECTATOR, Address: urn:jxta:uuid-59616261646162614A787461503250332DE658F932AB436995B78E0CB3E080DA03 [b](N.B.:it is the DAS)[/b]
> 2: MemberId: instance1, MemberType: CORE, Address: urn:jxta:uuid-59616261646162614A787461503250337987FC1134E54090AB24B0C9E01AD7DF03
> 3: MemberId: instance2, MemberType: CORE, Address: urn:jxta:uuid-59616261646162614A78746150325033C441652F131349569476E023E060DFA903
> ...
> |#
> #|2009-05-22T13:40:59.645+0200|INFO|sun-appserver2.1|ShoalLogger|_ThreadID=13;_ThreadName=ViewWindowThread;IN_DOUBT_EVENT;|Analyzing new membership snapshot received as part of event : IN_DOUBT_EVENT|#
> #|2009-05-22T13:40:59.645+0200|INFO|sun-appserver2.1|ShoalLogger|_ThreadID=13;_ThreadName=ViewWindowThread;server;|gms.failureSuspectedEventReceived|#
> #|2009-05-22T13:40:59.649+0200|INFO|sun-appserver2.1|ShoalLogger|_ThreadID=34;_ThreadName=com.sun.enterprise.ee.cms.impl.common.Router Thread;server;|Sending FailureSuspectedSignals to registered Actions. Member:server...|#
> #|2009-05-22T13:41:01.728+0200|INFO|sun-appserver2.1|ShoalLogger|_ThreadID=13;_ThreadName=ViewWindowThread;|GMS View Change Received for group mycluster : Members in view for (before change analysis) are :
> [b](N.B.: notice the DAS has vanished)
> [/b]1: MemberId: instance1, MemberType: CORE, Address: urn:jxta:uuid-59616261646162614A787461503250337987FC1134E54090AB24B0C9E01AD7DF03
> 2: MemberId: instance2, MemberType: CORE, Address: urn:jxta:uuid-59616261646162614A78746150325033C441652F131349569476E023E060DFA903
> |#
> ...
>
> A few seconds later:
>
> #|2009-05-22T13:41:07.853+0200|INFO|sun-appserver2.1|ShoalLogger|_ThreadID=13;_ThreadName=ViewWindowThread;IN_DOUBT_EVENT;|Analyzing new membership snapshot received as part of event : IN_DOUBT_EVENT|#
> #|2009-05-22T13:41:07.853+0200|INFO|sun-appserver2.1|ShoalLogger|_ThreadID=13;_ThreadName=ViewWindowThread;instance1;|gms.failureSuspectedEventReceived|#
> #|2009-05-22T13:41:07.854+0200|INFO|sun-appserver2.1|ShoalLogger|_ThreadID=34;_ThreadName=com.sun.enterprise.ee.cms.impl.common.Router Thread;instance1;|Sending FailureSuspectedSignals to registered Actions. Member:instance1...|#
> #|2009-05-22T13:41:09.870+0200|INFO|sun-appserver2.1|ShoalLogger|_ThreadID=13;_ThreadName=ViewWindowThread;|GMS View Change Received for group m2m-cluster : Members in view for (before change analysis) are :
> [b]N.B.: Now the INSTANCE has vanished[/b]
> 1: MemberId: instance2, MemberType: CORE, Address: urn:jxta:uuid-59616261646162614A78746150325033C441652F131349569476E023E060DFA903
> |#
> [Message sent by forum member 'jduprez' (jduprez)]
>
> http://forums.java.net/jive/thread.jspa?messageID=347663
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe_at_glassfish.dev.java.net
> For additional commands, e-mail: users-help_at_glassfish.dev.java.net
>
>