Dec 15, 2010 1:22:24 AM com.sun.enterprise.admin.launcher.GFLauncherLogger info INFO: JVM invocation command line: /export/software/jdk/jdk1.6.0_16_64bit/bin/java -cp /export/hatester/asgmsplot/glassfish3/glassfish/modules/glassfish.jar -XX:+UnlockDiagnosticVMOptions -XX:MaxPermSize=192m -XX:NewRatio=2 -Xmx512m -client -javaagent:/export/hatester/asgmsplot/glassfish3/glassfish/lib/monitor/btrace-agent.jar=unsafe=true,noServer=true -Dosgi.shell.telnet.maxconn=1 -Djdbc.drivers=org.apache.derby.jdbc.ClientDriver -Dfelix.fileinstall.dir=/export/hatester/asgmsplot/glassfish3/glassfish/modules/autostart/ -Djavax.net.ssl.keyStore=/export/hatester/asgmsplot/glassfish3/glassfish/domains/domain1/config/keystore.jks -Dosgi.shell.telnet.port=6666 -Djava.security.policy=/export/hatester/asgmsplot/glassfish3/glassfish/domains/domain1/config/server.policy -Dfelix.fileinstall.log.level=2 -Dfelix.fileinstall.poll=5000 -Dcom.sun.aas.instanceRoot=/export/hatester/asgmsplot/glassfish3/glassfish/domains/domain1 -Dosgi.shell.telnet.ip=127.0.0.1 -Dcom.sun.enterprise.config.config_environment_factory_class=com.sun.enterprise.config.serverbeans.AppserverConfigEnvironmentFactory -Djava.endorsed.dirs=/export/hatester/asgmsplot/glassfish3/glassfish/modules/endorsed:/export/hatester/asgmsplot/glassfish3/glassfish/lib/endorsed -Dcom.sun.aas.installRoot=/export/hatester/asgmsplot/glassfish3/glassfish -Dfelix.fileinstall.bundles.startTransient=true -Djava.ext.dirs=/export/software/jdk/jdk1.6.0_16_64bit/lib/ext:/export/software/jdk/jdk1.6.0_16_64bit/jre/lib/ext:/export/hatester/asgmsplot/glassfish3/glassfish/domains/domain1/lib/ext -Dfelix.fileinstall.bundles.new.start=true -Djavax.net.ssl.trustStore=/export/hatester/asgmsplot/glassfish3/glassfish/domains/domain1/config/cacerts.jks -Dcom.sun.enterprise.security.httpsOutboundKeyAlias=s1as -Djava.security.auth.login.config=/export/hatester/asgmsplot/glassfish3/glassfish/domains/domain1/config/login.conf -DANTLR_USE_DIRECT_CLASS_LOADING=true -Dgosh.args=--noshutdown -c noop=true -Djava.library.path=/export/hatester/asgmsplot/glassfish3/glassfish/lib:/export/software/jdk/jdk1.6.0_16_64bit/jre/lib/amd64/server:/export/software/jdk/jdk1.6.0_16_64bit/jre/lib/amd64:/export/software/jdk/jdk1.6.0_16_64bit/lib/amd64:/usr/java/packages/lib/amd64:/lib:/usr/lib com.sun.enterprise.glassfish.bootstrap.ASMain -domainname domain1 -asadmin-args --host,,,localhost,,,--port,,,4848,,,--secure=false,,,--terse=false,,,--echo=false,,,--interactive=false,,,start-domain,,,--verbose=false,,,--debug=false,,,--domaindir,,,/export/hatester/asgmsplot/glassfish3/glassfish/domains,,,domain1 -instancename server -verbose false -debug false -asadmin-classpath /export/hatester/asgmsplot/glassfish3/glassfish/modules/admin-cli.jar -asadmin-classname com.sun.enterprise.admin.cli.AsadminMain -upgrade false -type DAS -domaindir /export/hatester/asgmsplot/glassfish3/glassfish/domains/domain1 -read-stdin true Dec 15, 2010 1:22:24 AM com.sun.enterprise.admin.launcher.GFLauncherLogger info INFO: Successfully launched in 16 msec. [#|2010-12-15T01:22:28.942-0800|INFO|glassfish3.1|null|_ThreadID=16;_ThreadName=Thread-1;|Running GlassFish Version: GlassFish Server Open Source Edition 3.1-SNAPSHOT (build jf39279-private)|#] [#|2010-12-15T01:22:28.947-0800|INFO|glassfish3.1|javax.enterprise.system.core.com.sun.enterprise.server.logging|_ThreadID=16;_ThreadName=Thread-1;|This message was emitted before the logging service started:Total time to parse domain.xml: 123 milliseconds|#] [#|2010-12-15T01:22:29.254-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1095: member: server is joining group: clusterz1 ...|#] [#|2010-12-15T01:22:29.309-0800|CONFIG|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|instantiated following NetworkManager implementation:com.sun.enterprise.mgmt.transport.grizzly.GrizzlyNetworkManager|#] [#|2010-12-15T01:22:29.311-0800|CONFIG|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS MAX_MESSAGE_LENGTH=4196352|#] [#|2010-12-15T01:22:29.312-0800|CONFIG|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;| GrizzlyNetworkManager Configuration BIND_INTERFACE_ADDRESS:null NetworkInterfaceName:null TCPSTARTPORT..TCPENDPORT:9090..9200 MULTICAST_ADDRESS:MULTICAST_PORT:228.9.32.97:5229 MULTICAST_PACKET_SIZE:65536 MULTICAST_TIME_TO_LIVE: default FAILURE_DETECT_TCP_RETRANSMIT_TIMEOUT(ms):10000 ThreadPool CORE_POOLSIZE:20 MAX_POOLSIZE:50 POOL_QUEUE_SIZE:4096 KEEP_ALIVE_TIME(ms):60000 HIGH_WATER_MARK:1024 NUMBER_TO_RECLAIM:10 MAX_PARALLEL:15 START_TIMEOUT(ms):15000 WRITE_TIMEOUT(ms):10000 MAX_WRITE_SELECTOR_POOL_SIZE:30 VIRTUAL_MULTICAST_URI_LIST:null |#] [#|2010-12-15T01:22:29.357-0800|INFO|glassfish3.1|grizzly|_ThreadID=16;_ThreadName=Thread-1;|GRIZZLY0001: Starting Grizzly Framework 1.9.26 - 12/15/10 1:22 AM|#] [#|2010-12-15T01:22:29.387-0800|CONFIG|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|Grizzly controller listening on /0:0:0:0:0:0:0:0:9150. Controller started in 39 ms|#] [#|2010-12-15T01:22:29.393-0800|CONFIG|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|Set via default minimum: MulticastSocket.getTimeToLive()=4|#] [#|2010-12-15T01:22:29.394-0800|CONFIG|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|MulticastSocket configuration: local socket address: 0.0.0.0/0.0.0.0:5229 network interface: name:bond0 (bond0) index: 7 addresses: /fe80:0:0:0:21e:68ff:fe65:a6c7%7; /10.133.184.226; multicast address:/228.9.32.97 timeToLive=4|#] [#|2010-12-15T01:22:29.428-0800|CONFIG|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|HealthMonitor: heartBeatTimeout(ms)=2000 maxMissedBeats=3 failureDetectionTCPTimeout(ms)=10000 failureDetectionTCPPort=9000|#] [#|2010-12-15T01:22:29.430-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|starting cluster clusterz1 for member:server|#] [#|2010-12-15T01:22:29.431-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1061: MasterNode message listener is registered for member: server group: clusterz1|#] [#|2010-12-15T01:22:29.441-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for MASTER_CHANGE_EVENT(before change analysis) are : 1: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9150:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:22:29.442-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: server of group: clusterz1|#] [#|2010-12-15T01:22:29.439-0800|INFO|glassfish3.1|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=16;_ThreadName=Thread-1;|GMSAD1005: Member server joined group clusterz1|#] [#|2010-12-15T01:22:29.444-0800|INFO|glassfish3.1|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=16;_ThreadName=Thread-1;|GMSAD1004: Started GMS for instance server in group clusterz1|#] [#|2010-12-15T01:22:29.447-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1093: adding GroupLeadershipNotification signal leadermember: server of group: clusterz1|#] [#|2010-12-15T01:22:29.463-0800|CONFIG|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|MySystemAdvertisement(summary): GMSMember name: server group: clusterz1 memberType: SPECTATOR startTime: Dec 15, 2010 1:22:29 AM PST ID:10.133.184.226:9150:228.9.32.97:5229:clusterz1:server TCP uri(s):[tcp://[fe80:0:0:0:21e:68ff:fe65:a6c7%7]:4000, tcp://10.133.184.226:4000]|#] [#|2010-12-15T01:22:29.464-0800|CONFIG|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|MySystemAdvertisement(dump)=PEERID[10.133.184.226:9150:228.9.32.97:5229:clusterz1:server] CUSTOMTAGS[GROUP_NAME:clusterz1, MEMBER_TYPE:SPECTATOR, START_TIME[1:22:29 AM PST on Dec 15, 2010]], ENDPONTADDRESSES[[tcp://[fe80:0:0:0:21e:68ff:fe65:a6c7%7]:4000, tcp://10.133.184.226:4000]], NAME:server, OSNAME:Linux, OSVERSION:2.6.18-164.0.0.0.1.el5, OSARCH:amd64, HWARCH:amd64, HWVENDOR:Sun Microsystems Inc.|#] [#|2010-12-15T01:22:29.705-0800|INFO|glassfish3.1|null|_ThreadID=16;_ThreadName=Thread-1;|Grizzly Framework 1.9.26 started in: 70ms - bound to [0.0.0.0:8080]|#] [#|2010-12-15T01:22:29.731-0800|INFO|glassfish3.1|null|_ThreadID=16;_ThreadName=Thread-1;|Grizzly Framework 1.9.26 started in: 39ms - bound to [0.0.0.0:8181]|#] [#|2010-12-15T01:22:29.741-0800|INFO|glassfish3.1|null|_ThreadID=16;_ThreadName=Thread-1;|Grizzly Framework 1.9.26 started in: 37ms - bound to [0.0.0.0:4848]|#] [#|2010-12-15T01:22:29.750-0800|INFO|glassfish3.1|null|_ThreadID=16;_ThreadName=Thread-1;|Grizzly Framework 1.9.26 started in: 7ms - bound to [0.0.0.0:3700]|#] [#|2010-12-15T01:22:29.764-0800|INFO|glassfish3.1|null|_ThreadID=16;_ThreadName=Thread-1;|Grizzly Framework 1.9.26 started in: 6ms - bound to [0.0.0.0:7676]|#] [#|2010-12-15T01:22:29.845-0800|INFO|glassfish3.1|org.glassfish.ha.store.spi.BackingStoreFactoryRegistry|_ThreadID=16;_ThreadName=Thread-1;|Registered org.glassfish.ha.store.adapter.cache.ShoalBackingStoreProxy for persistence-type = replicated in BackingStoreFactoryRegistry|#] [#|2010-12-15T01:22:29.913-0800|INFO|glassfish3.1|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=16;_ThreadName=Thread-1;|GlassFish Server Open Source Edition 3.1-SNAPSHOT (jf39279-private) startup time : Felix (3,918ms), startup services(1,543ms), total(5,461ms)|#] [#|2010-12-15T01:22:29.914-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1099: GMS:Reporting Joined and Ready state to group: clusterz1|#] [#|2010-12-15T01:22:30.093-0800|INFO|glassfish3.1|javax.enterprise.system.std.com.sun.enterprise.server.logging|_ThreadID=16;_ThreadName=Thread-1;|____________________________ Welcome to Apache Felix Gogo |#] [#|2010-12-15T01:22:34.453-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1058: Assuming Master Node designation member: server for group: clusterz1|#] [#|2010-12-15T01:22:34.453-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for MASTER_CHANGE_EVENT(before change analysis) are : 1: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9150:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:22:34.456-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: server of group: clusterz1|#] [#|2010-12-15T01:22:34.456-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1093: adding GroupLeadershipNotification signal leadermember: server of group: clusterz1|#] [#|2010-12-15T01:22:34.458-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1057: Announcing Master Node designation for member: server of group: clusterz1. Local view contains 1 entries|#] [#|2010-12-15T01:22:34.489-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for JOINED_AND_READY_EVENT(before change analysis) are : 1: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9150:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:22:34.490-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: server of group: clusterz1|#] [#|2010-12-15T01:22:34.811-0800|INFO|glassfish3.1|javax.enterprise.resource.jta.com.sun.enterprise.transaction|_ThreadID=16;_ThreadName=Thread-1;|DTX5019: Transaction Manager is ready. Using [com.sun.enterprise.transaction.jts.JavaEETransactionManagerJTSDelegate] as the delegate|#] [#|2010-12-15T01:22:35.600-0800|INFO|glassfish3.1|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=16;_ThreadName=Thread-1;|[Thread[GlassFish Kernel Main Thread,5,main]] started|#] [#|2010-12-15T01:22:35.629-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.org.glassfish.server|_ThreadID=16;_ThreadName=Thread-1;|Binding RMI port to *:8686|#] [#|2010-12-15T01:22:36.789-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.org.glassfish.server|_ThreadID=16;_ThreadName=Thread-1;|JMXStartupService: Started JMXConnector, JMXService URL = service:jmx:rmi://gf-ha-dev-1.us.oracle.com:8686/jndi/rmi://gf-ha-dev-1.us.oracle.com:8686/jmxrmi|#] [#|2010-12-15T01:22:37.750-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1098: GMS:Announcing GroupStartup[INITIATED] for group: clusterz1 members: n1c1m1,n1c1m2,n1c1m3,n1c1m4,n1c1m5,n1c1m6,n1c1m7,n1c1m8,n1c1m9,|#] [#|2010-12-15T01:22:37.751-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1062: GroupStart for group: clusterz1 State: INITIATED Starting Members: n1c1m1,n1c1m2,n1c1m3,n1c1m4,n1c1m5,n1c1m6,n1c1m7,n1c1m8,n1c1m9,|#] [#|2010-12-15T01:22:37.752-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|Starting cluster clusterz1|#] [#|2010-12-15T01:22:37.775-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|Executing start-instance on 9 instances using a thread pool of size 9: gf-ha-dev-4:n1c1m3 gf-ha-dev-5:n1c1m4 gf-ha-dev-2:n1c1m1 gf-ha-dev-3:n1c1m2 gf-ha-dev-11:n1c1m9 gf-ha-dev-8:n1c1m7 gf-ha-dev-9:n1c1m8 gf-ha-dev-6:n1c1m5 gf-ha-dev-7:n1c1m6|#] [#|2010-12-15T01:22:37.778-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|start-instance n1c1m3|#] [#|2010-12-15T01:22:37.780-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|start-instance n1c1m4|#] [#|2010-12-15T01:22:37.782-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|start-instance n1c1m1|#] [#|2010-12-15T01:22:37.784-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|start-instance n1c1m2|#] [#|2010-12-15T01:22:37.788-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|start-instance n1c1m9|#] [#|2010-12-15T01:22:37.816-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|start-instance n1c1m7|#] [#|2010-12-15T01:22:37.821-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|start-instance n1c1m8|#] [#|2010-12-15T01:22:37.836-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|start-instance n1c1m5|#] [#|2010-12-15T01:22:37.838-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|start-instance n1c1m6|#] [#|2010-12-15T01:22:49.251-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for ADD_EVENT(before change analysis) are : 1: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 2: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9150:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:22:49.252-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: ADD_EVENT for member: n1c1m2 of group: clusterz1|#] [#|2010-12-15T01:22:49.764-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|CLI801 Instance is already synchronized Waiting for n1c1m2 to start ........ Successfully started the instance: n1c1m2 instance Location: /export/hatester/asgmsplot/glassfish3/glassfish/nodes/gf-ha-dev-3/n1c1m2 Log File: /export/hatester/asgmsplot/glassfish3/glassfish/nodes/gf-ha-dev-3/n1c1m2/logs/server.log Admin Port: 24848 Command start-local-instance executed successfully.|#] [#|2010-12-15T01:22:49.902-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|CLI801 Instance is already synchronized Waiting for n1c1m5 to start ........ Successfully started the instance: n1c1m5 instance Location: /export/hatester/asgmsplot/glassfish3/glassfish/nodes/gf-ha-dev-6/n1c1m5 Log File: /export/hatester/asgmsplot/glassfish3/glassfish/nodes/gf-ha-dev-6/n1c1m5/logs/server.log Admin Port: 24848 Command start-local-instance executed successfully.|#] [#|2010-12-15T01:22:49.932-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|CLI801 Instance is already synchronized Waiting for n1c1m7 to start ........ Successfully started the instance: n1c1m7 instance Location: /export/hatester/asgmsplot/glassfish3/glassfish/nodes/gf-ha-dev-8/n1c1m7 Log File: /export/hatester/asgmsplot/glassfish3/glassfish/nodes/gf-ha-dev-8/n1c1m7/logs/server.log Admin Port: 24848 Command start-local-instance executed successfully.|#] [#|2010-12-15T01:22:50.075-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|CLI801 Instance is already synchronized Waiting for n1c1m1 to start ......... Successfully started the instance: n1c1m1 instance Location: /export/hatester/asgmsplot/glassfish3/glassfish/nodes/gf-ha-dev-2/n1c1m1 Log File: /export/hatester/asgmsplot/glassfish3/glassfish/nodes/gf-ha-dev-2/n1c1m1/logs/server.log Admin Port: 24848 Command start-local-instance executed successfully.|#] [#|2010-12-15T01:22:50.170-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|CLI801 Instance is already synchronized Waiting for n1c1m8 to start ......... Successfully started the instance: n1c1m8 instance Location: /export/hatester/asgmsplot/glassfish3/glassfish/nodes/gf-ha-dev-9/n1c1m8 Log File: /export/hatester/asgmsplot/glassfish3/glassfish/nodes/gf-ha-dev-9/n1c1m8/logs/server.log Admin Port: 24848 Command start-local-instance executed successfully.|#] [#|2010-12-15T01:22:50.191-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|CLI801 Instance is already synchronized Waiting for n1c1m6 to start ......... Successfully started the instance: n1c1m6 instance Location: /export/hatester/asgmsplot/glassfish3/glassfish/nodes/gf-ha-dev-7/n1c1m6 Log File: /export/hatester/asgmsplot/glassfish3/glassfish/nodes/gf-ha-dev-7/n1c1m6/logs/server.log Admin Port: 24848 Command start-local-instance executed successfully.|#] [#|2010-12-15T01:22:50.259-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|CLI801 Instance is already synchronized Waiting for n1c1m3 to start ......... Successfully started the instance: n1c1m3 instance Location: /export/hatester/asgmsplot/glassfish3/glassfish/nodes/gf-ha-dev-4/n1c1m3 Log File: /export/hatester/asgmsplot/glassfish3/glassfish/nodes/gf-ha-dev-4/n1c1m3/logs/server.log Admin Port: 24848 Command start-local-instance executed successfully.|#] [#|2010-12-15T01:22:50.352-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|CLI801 Instance is already synchronized Waiting for n1c1m4 to start ......... Successfully started the instance: n1c1m4 instance Location: /export/hatester/asgmsplot/glassfish3/glassfish/nodes/gf-ha-dev-5/n1c1m4 Log File: /export/hatester/asgmsplot/glassfish3/glassfish/nodes/gf-ha-dev-5/n1c1m4/logs/server.log Admin Port: 24848 Command start-local-instance executed successfully.|#] [#|2010-12-15T01:22:50.665-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|CLI801 Instance is already synchronized Waiting for n1c1m9 to start ......... Successfully started the instance: n1c1m9 instance Location: /export/hatester/asgmsplot/glassfish3/glassfish/nodes/gf-ha-dev-11/n1c1m9 Log File: /export/hatester/asgmsplot/glassfish3/glassfish/nodes/gf-ha-dev-11/n1c1m9/logs/server.log Admin Port: 24848 Command start-local-instance executed successfully.|#] [#|2010-12-15T01:22:50.680-0800|INFO|glassfish3.1|javax.org.glassfish.gms.org.glassfish.gms.admin|_ThreadID=16;_ThreadName=Thread-1;n1c1m1;n1c1m2;n1c1m3;n1c1m4;n1c1m5;n1c1m6;n1c1m7;n1c1m8;n1c1m9;|GMSAD3001: GMSAnnounceAfterStartClusterCommand: exitCode:SUCCESS members null clusterMembers:[n1c1m1, n1c1m2, n1c1m3, n1c1m4, n1c1m5, n1c1m6, n1c1m7, n1c1m8, n1c1m9]|#] [#|2010-12-15T01:22:50.686-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1098: GMS:Announcing GroupStartup[COMPLETED_SUCCESS] for group: clusterz1 members: n1c1m1,n1c1m2,n1c1m3,n1c1m4,n1c1m5,n1c1m6,n1c1m7,n1c1m8,n1c1m9,|#] [#|2010-12-15T01:22:50.687-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1062: GroupStart for group: clusterz1 State: COMPLETED_SUCCESS Started Members: n1c1m1,n1c1m2,n1c1m3,n1c1m4,n1c1m5,n1c1m6,n1c1m7,n1c1m8,n1c1m9,|#] [#|2010-12-15T01:22:52.276-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1024: Adding Join member: n1c1m2 group: clusterz1 StartupState: GROUP_STARTUP |#] [#|2010-12-15T01:22:52.279-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for JOINED_AND_READY_EVENT(before change analysis) are : 1: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 2: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9150:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:22:52.279-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: n1c1m2 of group: clusterz1|#] [#|2010-12-15T01:22:52.280-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1025: Adding Joined And Ready member: n1c1m2 group: clusterz1 StartupState: GROUP_STARTUP |#] [#|2010-12-15T01:22:52.283-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for ADD_EVENT(before change analysis) are : 1: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 2: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 3: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9150:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:22:52.283-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: ADD_EVENT for member: n1c1m7 of group: clusterz1|#] [#|2010-12-15T01:22:55.289-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1024: Adding Join member: n1c1m7 group: clusterz1 StartupState: GROUP_STARTUP |#] [#|2010-12-15T01:22:55.290-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for ADD_EVENT(before change analysis) are : 1: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 2: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 3: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 4: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9150:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:22:55.290-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: ADD_EVENT for member: n1c1m5 of group: clusterz1|#] [#|2010-12-15T01:22:58.297-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1024: Adding Join member: n1c1m5 group: clusterz1 StartupState: GROUP_STARTUP |#] [#|2010-12-15T01:22:58.298-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for JOINED_AND_READY_EVENT(before change analysis) are : 1: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 2: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 3: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 4: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9150:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:22:58.298-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: n1c1m7 of group: clusterz1|#] [#|2010-12-15T01:22:58.298-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1025: Adding Joined And Ready member: n1c1m7 group: clusterz1 StartupState: GROUP_STARTUP |#] [#|2010-12-15T01:22:58.299-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for JOINED_AND_READY_EVENT(before change analysis) are : 1: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 2: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 3: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 4: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9150:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:22:58.299-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: n1c1m5 of group: clusterz1|#] [#|2010-12-15T01:22:58.300-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1025: Adding Joined And Ready member: n1c1m5 group: clusterz1 StartupState: GROUP_STARTUP |#] [#|2010-12-15T01:22:58.300-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for ADD_EVENT(before change analysis) are : 1: MemberId: n1c1m1, MemberType: CORE, Address: 10.133.184.227:9157:228.9.32.97:5229:clusterz1:n1c1m1 2: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 3: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 4: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 5: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9150:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:22:58.301-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: ADD_EVENT for member: n1c1m1 of group: clusterz1|#] [#|2010-12-15T01:23:01.307-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1024: Adding Join member: n1c1m1 group: clusterz1 StartupState: GROUP_STARTUP |#] [#|2010-12-15T01:23:01.309-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for ADD_EVENT(before change analysis) are : 1: MemberId: n1c1m1, MemberType: CORE, Address: 10.133.184.227:9157:228.9.32.97:5229:clusterz1:n1c1m1 2: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 3: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 4: MemberId: n1c1m6, MemberType: CORE, Address: 10.133.184.232:9170:228.9.32.97:5229:clusterz1:n1c1m6 5: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 6: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9150:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:23:01.309-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: ADD_EVENT for member: n1c1m6 of group: clusterz1|#] [#|2010-12-15T01:23:04.315-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1024: Adding Join member: n1c1m6 group: clusterz1 StartupState: GROUP_STARTUP |#] [#|2010-12-15T01:23:04.317-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for ADD_EVENT(before change analysis) are : 1: MemberId: n1c1m1, MemberType: CORE, Address: 10.133.184.227:9157:228.9.32.97:5229:clusterz1:n1c1m1 2: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 3: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 4: MemberId: n1c1m6, MemberType: CORE, Address: 10.133.184.232:9170:228.9.32.97:5229:clusterz1:n1c1m6 5: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 6: MemberId: n1c1m8, MemberType: CORE, Address: 10.133.184.234:9159:228.9.32.97:5229:clusterz1:n1c1m8 7: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9150:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:23:04.317-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: ADD_EVENT for member: n1c1m8 of group: clusterz1|#] [#|2010-12-15T01:23:07.323-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1024: Adding Join member: n1c1m8 group: clusterz1 StartupState: GROUP_STARTUP |#] [#|2010-12-15T01:23:07.325-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for JOINED_AND_READY_EVENT(before change analysis) are : 1: MemberId: n1c1m1, MemberType: CORE, Address: 10.133.184.227:9157:228.9.32.97:5229:clusterz1:n1c1m1 2: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 3: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 4: MemberId: n1c1m6, MemberType: CORE, Address: 10.133.184.232:9170:228.9.32.97:5229:clusterz1:n1c1m6 5: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 6: MemberId: n1c1m8, MemberType: CORE, Address: 10.133.184.234:9159:228.9.32.97:5229:clusterz1:n1c1m8 7: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9150:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:23:07.325-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: n1c1m6 of group: clusterz1|#] [#|2010-12-15T01:23:07.325-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1025: Adding Joined And Ready member: n1c1m6 group: clusterz1 StartupState: GROUP_STARTUP |#] [#|2010-12-15T01:23:07.326-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for JOINED_AND_READY_EVENT(before change analysis) are : 1: MemberId: n1c1m1, MemberType: CORE, Address: 10.133.184.227:9157:228.9.32.97:5229:clusterz1:n1c1m1 2: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 3: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 4: MemberId: n1c1m6, MemberType: CORE, Address: 10.133.184.232:9170:228.9.32.97:5229:clusterz1:n1c1m6 5: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 6: MemberId: n1c1m8, MemberType: CORE, Address: 10.133.184.234:9159:228.9.32.97:5229:clusterz1:n1c1m8 7: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9150:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:23:07.326-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: n1c1m1 of group: clusterz1|#] [#|2010-12-15T01:23:07.326-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1025: Adding Joined And Ready member: n1c1m1 group: clusterz1 StartupState: GROUP_STARTUP |#] [#|2010-12-15T01:23:07.327-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for ADD_EVENT(before change analysis) are : 1: MemberId: n1c1m1, MemberType: CORE, Address: 10.133.184.227:9157:228.9.32.97:5229:clusterz1:n1c1m1 2: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 3: MemberId: n1c1m3, MemberType: CORE, Address: 10.133.184.229:9159:228.9.32.97:5229:clusterz1:n1c1m3 4: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 5: MemberId: n1c1m6, MemberType: CORE, Address: 10.133.184.232:9170:228.9.32.97:5229:clusterz1:n1c1m6 6: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 7: MemberId: n1c1m8, MemberType: CORE, Address: 10.133.184.234:9159:228.9.32.97:5229:clusterz1:n1c1m8 8: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9150:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:23:07.327-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: ADD_EVENT for member: n1c1m3 of group: clusterz1|#] [#|2010-12-15T01:23:10.334-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1024: Adding Join member: n1c1m3 group: clusterz1 StartupState: GROUP_STARTUP |#] [#|2010-12-15T01:23:10.335-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for ADD_EVENT(before change analysis) are : 1: MemberId: n1c1m1, MemberType: CORE, Address: 10.133.184.227:9157:228.9.32.97:5229:clusterz1:n1c1m1 2: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 3: MemberId: n1c1m3, MemberType: CORE, Address: 10.133.184.229:9159:228.9.32.97:5229:clusterz1:n1c1m3 4: MemberId: n1c1m4, MemberType: CORE, Address: 10.133.184.230:9199:228.9.32.97:5229:clusterz1:n1c1m4 5: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 6: MemberId: n1c1m6, MemberType: CORE, Address: 10.133.184.232:9170:228.9.32.97:5229:clusterz1:n1c1m6 7: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 8: MemberId: n1c1m8, MemberType: CORE, Address: 10.133.184.234:9159:228.9.32.97:5229:clusterz1:n1c1m8 9: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9150:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:23:10.335-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: ADD_EVENT for member: n1c1m4 of group: clusterz1|#] [#|2010-12-15T01:23:13.343-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1024: Adding Join member: n1c1m4 group: clusterz1 StartupState: GROUP_STARTUP |#] [#|2010-12-15T01:23:13.344-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for JOINED_AND_READY_EVENT(before change analysis) are : 1: MemberId: n1c1m1, MemberType: CORE, Address: 10.133.184.227:9157:228.9.32.97:5229:clusterz1:n1c1m1 2: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 3: MemberId: n1c1m3, MemberType: CORE, Address: 10.133.184.229:9159:228.9.32.97:5229:clusterz1:n1c1m3 4: MemberId: n1c1m4, MemberType: CORE, Address: 10.133.184.230:9199:228.9.32.97:5229:clusterz1:n1c1m4 5: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 6: MemberId: n1c1m6, MemberType: CORE, Address: 10.133.184.232:9170:228.9.32.97:5229:clusterz1:n1c1m6 7: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 8: MemberId: n1c1m8, MemberType: CORE, Address: 10.133.184.234:9159:228.9.32.97:5229:clusterz1:n1c1m8 9: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9150:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:23:13.345-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: n1c1m8 of group: clusterz1|#] [#|2010-12-15T01:23:13.345-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1025: Adding Joined And Ready member: n1c1m8 group: clusterz1 StartupState: GROUP_STARTUP |#] [#|2010-12-15T01:23:13.345-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for JOINED_AND_READY_EVENT(before change analysis) are : 1: MemberId: n1c1m1, MemberType: CORE, Address: 10.133.184.227:9157:228.9.32.97:5229:clusterz1:n1c1m1 2: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 3: MemberId: n1c1m3, MemberType: CORE, Address: 10.133.184.229:9159:228.9.32.97:5229:clusterz1:n1c1m3 4: MemberId: n1c1m4, MemberType: CORE, Address: 10.133.184.230:9199:228.9.32.97:5229:clusterz1:n1c1m4 5: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 6: MemberId: n1c1m6, MemberType: CORE, Address: 10.133.184.232:9170:228.9.32.97:5229:clusterz1:n1c1m6 7: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 8: MemberId: n1c1m8, MemberType: CORE, Address: 10.133.184.234:9159:228.9.32.97:5229:clusterz1:n1c1m8 9: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9150:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:23:13.346-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: n1c1m3 of group: clusterz1|#] [#|2010-12-15T01:23:13.346-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1025: Adding Joined And Ready member: n1c1m3 group: clusterz1 StartupState: GROUP_STARTUP |#] [#|2010-12-15T01:23:13.347-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for JOINED_AND_READY_EVENT(before change analysis) are : 1: MemberId: n1c1m1, MemberType: CORE, Address: 10.133.184.227:9157:228.9.32.97:5229:clusterz1:n1c1m1 2: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 3: MemberId: n1c1m3, MemberType: CORE, Address: 10.133.184.229:9159:228.9.32.97:5229:clusterz1:n1c1m3 4: MemberId: n1c1m4, MemberType: CORE, Address: 10.133.184.230:9199:228.9.32.97:5229:clusterz1:n1c1m4 5: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 6: MemberId: n1c1m6, MemberType: CORE, Address: 10.133.184.232:9170:228.9.32.97:5229:clusterz1:n1c1m6 7: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 8: MemberId: n1c1m8, MemberType: CORE, Address: 10.133.184.234:9159:228.9.32.97:5229:clusterz1:n1c1m8 9: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9150:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:23:13.347-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: n1c1m4 of group: clusterz1|#] [#|2010-12-15T01:23:13.348-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1025: Adding Joined And Ready member: n1c1m4 group: clusterz1 StartupState: GROUP_STARTUP |#] [#|2010-12-15T01:23:13.349-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for ADD_EVENT(before change analysis) are : 1: MemberId: n1c1m1, MemberType: CORE, Address: 10.133.184.227:9157:228.9.32.97:5229:clusterz1:n1c1m1 2: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 3: MemberId: n1c1m3, MemberType: CORE, Address: 10.133.184.229:9159:228.9.32.97:5229:clusterz1:n1c1m3 4: MemberId: n1c1m4, MemberType: CORE, Address: 10.133.184.230:9199:228.9.32.97:5229:clusterz1:n1c1m4 5: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 6: MemberId: n1c1m6, MemberType: CORE, Address: 10.133.184.232:9170:228.9.32.97:5229:clusterz1:n1c1m6 7: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 8: MemberId: n1c1m8, MemberType: CORE, Address: 10.133.184.234:9159:228.9.32.97:5229:clusterz1:n1c1m8 9: MemberId: n1c1m9, MemberType: CORE, Address: 10.133.184.236:9164:228.9.32.97:5229:clusterz1:n1c1m9 10: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9150:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:23:13.349-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: ADD_EVENT for member: n1c1m9 of group: clusterz1|#] [#|2010-12-15T01:23:16.355-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1024: Adding Join member: n1c1m9 group: clusterz1 StartupState: GROUP_STARTUP |#] [#|2010-12-15T01:23:16.357-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for JOINED_AND_READY_EVENT(before change analysis) are : 1: MemberId: n1c1m1, MemberType: CORE, Address: 10.133.184.227:9157:228.9.32.97:5229:clusterz1:n1c1m1 2: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 3: MemberId: n1c1m3, MemberType: CORE, Address: 10.133.184.229:9159:228.9.32.97:5229:clusterz1:n1c1m3 4: MemberId: n1c1m4, MemberType: CORE, Address: 10.133.184.230:9199:228.9.32.97:5229:clusterz1:n1c1m4 5: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 6: MemberId: n1c1m6, MemberType: CORE, Address: 10.133.184.232:9170:228.9.32.97:5229:clusterz1:n1c1m6 7: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 8: MemberId: n1c1m8, MemberType: CORE, Address: 10.133.184.234:9159:228.9.32.97:5229:clusterz1:n1c1m8 9: MemberId: n1c1m9, MemberType: CORE, Address: 10.133.184.236:9164:228.9.32.97:5229:clusterz1:n1c1m9 10: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9150:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:23:16.357-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: n1c1m9 of group: clusterz1|#] [#|2010-12-15T01:23:16.357-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1025: Adding Joined And Ready member: n1c1m9 group: clusterz1 StartupState: GROUP_STARTUP |#] [#|2010-12-15T01:23:37.087-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|get-health called for cluster "clusterz1"|#] Dec 15, 2010 1:23:59 AM com.sun.enterprise.admin.launcher.GFLauncherLogger info INFO: JVM invocation command line: /export/software/jdk/jdk1.6.0_16_64bit/bin/java -cp /export/hatester/asgmsplot/glassfish3/glassfish/modules/glassfish.jar -XX:+UnlockDiagnosticVMOptions -XX:MaxPermSize=192m -XX:NewRatio=2 -Xmx512m -client -javaagent:/export/hatester/asgmsplot/glassfish3/glassfish/lib/monitor/btrace-agent.jar=unsafe=true,noServer=true -Dosgi.shell.telnet.maxconn=1 -Djdbc.drivers=org.apache.derby.jdbc.ClientDriver -Dfelix.fileinstall.dir=/export/hatester/asgmsplot/glassfish3/glassfish/modules/autostart/ -Djavax.net.ssl.keyStore=/export/hatester/asgmsplot/glassfish3/glassfish/domains/domain1/config/keystore.jks -Dosgi.shell.telnet.port=6666 -Djava.security.policy=/export/hatester/asgmsplot/glassfish3/glassfish/domains/domain1/config/server.policy -Dfelix.fileinstall.log.level=2 -Dfelix.fileinstall.poll=5000 -Dcom.sun.aas.instanceRoot=/export/hatester/asgmsplot/glassfish3/glassfish/domains/domain1 -Dosgi.shell.telnet.ip=127.0.0.1 -Dcom.sun.enterprise.config.config_environment_factory_class=com.sun.enterprise.config.serverbeans.AppserverConfigEnvironmentFactory -Djava.endorsed.dirs=/export/hatester/asgmsplot/glassfish3/glassfish/modules/endorsed:/export/hatester/asgmsplot/glassfish3/glassfish/lib/endorsed -Dcom.sun.aas.installRoot=/export/hatester/asgmsplot/glassfish3/glassfish -Dfelix.fileinstall.bundles.startTransient=true -Djava.ext.dirs=/export/software/jdk/jdk1.6.0_16_64bit/lib/ext:/export/software/jdk/jdk1.6.0_16_64bit/jre/lib/ext:/export/hatester/asgmsplot/glassfish3/glassfish/domains/domain1/lib/ext -Dfelix.fileinstall.bundles.new.start=true -Djavax.net.ssl.trustStore=/export/hatester/asgmsplot/glassfish3/glassfish/domains/domain1/config/cacerts.jks -Dcom.sun.enterprise.security.httpsOutboundKeyAlias=s1as -Djava.security.auth.login.config=/export/hatester/asgmsplot/glassfish3/glassfish/domains/domain1/config/login.conf -DANTLR_USE_DIRECT_CLASS_LOADING=true -Dgosh.args=--noshutdown -c noop=true -Djava.library.path=/export/hatester/asgmsplot/glassfish3/glassfish/lib:/export/software/jdk/jdk1.6.0_16_64bit/jre/lib/amd64/server:/export/software/jdk/jdk1.6.0_16_64bit/jre/lib/amd64:/export/software/jdk/jdk1.6.0_16_64bit/lib/amd64:/usr/java/packages/lib/amd64:/lib:/usr/lib com.sun.enterprise.glassfish.bootstrap.ASMain -domainname domain1 -asadmin-args --host,,,localhost,,,--port,,,4848,,,--secure=false,,,--terse=false,,,--echo=false,,,--interactive=false,,,start-domain,,,--verbose=false,,,--debug=false,,,--domaindir,,,/export/hatester/asgmsplot/glassfish3/glassfish/domains,,,domain1 -instancename server -verbose false -debug false -asadmin-classpath /export/hatester/asgmsplot/glassfish3/glassfish/modules/admin-cli.jar -asadmin-classname com.sun.enterprise.admin.cli.AsadminMain -upgrade false -type DAS -domaindir /export/hatester/asgmsplot/glassfish3/glassfish/domains/domain1 -read-stdin true Dec 15, 2010 1:23:59 AM com.sun.enterprise.admin.launcher.GFLauncherLogger info INFO: Successfully launched in 16 msec. [#|2010-12-15T01:24:04.624-0800|INFO|glassfish3.1|null|_ThreadID=16;_ThreadName=Thread-1;|Running GlassFish Version: GlassFish Server Open Source Edition 3.1-SNAPSHOT (build jf39279-private)|#] [#|2010-12-15T01:24:04.628-0800|INFO|glassfish3.1|javax.enterprise.system.core.com.sun.enterprise.server.logging|_ThreadID=16;_ThreadName=Thread-1;|This message was emitted before the logging service started:Total time to parse domain.xml: 117 milliseconds|#] [#|2010-12-15T01:24:04.906-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1095: member: server is joining group: clusterz1 ...|#] [#|2010-12-15T01:24:04.997-0800|CONFIG|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|instantiated following NetworkManager implementation:com.sun.enterprise.mgmt.transport.grizzly.GrizzlyNetworkManager|#] [#|2010-12-15T01:24:05.000-0800|CONFIG|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS MAX_MESSAGE_LENGTH=4196352|#] [#|2010-12-15T01:24:05.001-0800|CONFIG|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;| GrizzlyNetworkManager Configuration BIND_INTERFACE_ADDRESS:null NetworkInterfaceName:null TCPSTARTPORT..TCPENDPORT:9090..9200 MULTICAST_ADDRESS:MULTICAST_PORT:228.9.32.97:5229 MULTICAST_PACKET_SIZE:65536 MULTICAST_TIME_TO_LIVE: default FAILURE_DETECT_TCP_RETRANSMIT_TIMEOUT(ms):10000 ThreadPool CORE_POOLSIZE:20 MAX_POOLSIZE:50 POOL_QUEUE_SIZE:4096 KEEP_ALIVE_TIME(ms):60000 HIGH_WATER_MARK:1024 NUMBER_TO_RECLAIM:10 MAX_PARALLEL:15 START_TIMEOUT(ms):15000 WRITE_TIMEOUT(ms):10000 MAX_WRITE_SELECTOR_POOL_SIZE:30 VIRTUAL_MULTICAST_URI_LIST:null |#] [#|2010-12-15T01:24:05.041-0800|INFO|glassfish3.1|grizzly|_ThreadID=16;_ThreadName=Thread-1;|GRIZZLY0001: Starting Grizzly Framework 1.9.26 - 12/15/10 1:24 AM|#] [#|2010-12-15T01:24:05.066-0800|CONFIG|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|Grizzly controller listening on /0:0:0:0:0:0:0:0:9116. Controller started in 35 ms|#] [#|2010-12-15T01:24:05.073-0800|CONFIG|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|Set via default minimum: MulticastSocket.getTimeToLive()=4|#] [#|2010-12-15T01:24:05.074-0800|CONFIG|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|MulticastSocket configuration: local socket address: 0.0.0.0/0.0.0.0:5229 network interface: name:bond0 (bond0) index: 7 addresses: /fe80:0:0:0:21e:68ff:fe65:a6c7%7; /10.133.184.226; multicast address:/228.9.32.97 timeToLive=4|#] [#|2010-12-15T01:24:05.104-0800|CONFIG|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|HealthMonitor: heartBeatTimeout(ms)=2000 maxMissedBeats=3 failureDetectionTCPTimeout(ms)=10000 failureDetectionTCPPort=9000|#] [#|2010-12-15T01:24:05.106-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|starting cluster clusterz1 for member:server|#] [#|2010-12-15T01:24:05.106-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1061: MasterNode message listener is registered for member: server group: clusterz1|#] [#|2010-12-15T01:24:05.111-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for MASTER_CHANGE_EVENT(before change analysis) are : 1: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9116:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:24:05.112-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: server of group: clusterz1|#] [#|2010-12-15T01:24:05.114-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1093: adding GroupLeadershipNotification signal leadermember: server of group: clusterz1|#] [#|2010-12-15T01:24:05.118-0800|INFO|glassfish3.1|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=16;_ThreadName=Thread-1;|GMSAD1005: Member server joined group clusterz1|#] [#|2010-12-15T01:24:05.121-0800|INFO|glassfish3.1|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=16;_ThreadName=Thread-1;|GMSAD1004: Started GMS for instance server in group clusterz1|#] [#|2010-12-15T01:24:05.137-0800|CONFIG|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|MySystemAdvertisement(summary): GMSMember name: server group: clusterz1 memberType: SPECTATOR startTime: Dec 15, 2010 1:24:04 AM PST ID:10.133.184.226:9116:228.9.32.97:5229:clusterz1:server TCP uri(s):[tcp://[fe80:0:0:0:21e:68ff:fe65:a6c7%7]:4000, tcp://10.133.184.226:4000]|#] [#|2010-12-15T01:24:05.138-0800|CONFIG|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|MySystemAdvertisement(dump)=PEERID[10.133.184.226:9116:228.9.32.97:5229:clusterz1:server] CUSTOMTAGS[GROUP_NAME:clusterz1, MEMBER_TYPE:SPECTATOR, START_TIME[1:24:04 AM PST on Dec 15, 2010]], ENDPONTADDRESSES[[tcp://[fe80:0:0:0:21e:68ff:fe65:a6c7%7]:4000, tcp://10.133.184.226:4000]], NAME:server, OSNAME:Linux, OSVERSION:2.6.18-164.0.0.0.1.el5, OSARCH:amd64, HWARCH:amd64, HWVENDOR:Sun Microsystems Inc.|#] [#|2010-12-15T01:24:05.147-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for MASTER_CHANGE_EVENT(before change analysis) are : 1: MemberId: n1c1m1, MemberType: CORE, Address: 10.133.184.227:9157:228.9.32.97:5229:clusterz1:n1c1m1 2: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 3: MemberId: n1c1m3, MemberType: CORE, Address: 10.133.184.229:9159:228.9.32.97:5229:clusterz1:n1c1m3 4: MemberId: n1c1m4, MemberType: CORE, Address: 10.133.184.230:9199:228.9.32.97:5229:clusterz1:n1c1m4 5: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 6: MemberId: n1c1m6, MemberType: CORE, Address: 10.133.184.232:9170:228.9.32.97:5229:clusterz1:n1c1m6 7: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 8: MemberId: n1c1m8, MemberType: CORE, Address: 10.133.184.234:9159:228.9.32.97:5229:clusterz1:n1c1m8 9: MemberId: n1c1m9, MemberType: CORE, Address: 10.133.184.236:9164:228.9.32.97:5229:clusterz1:n1c1m9 10: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9116:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:24:05.148-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: n1c1m1 of group: clusterz1|#] [#|2010-12-15T01:24:05.149-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1093: adding GroupLeadershipNotification signal leadermember: n1c1m1 of group: clusterz1|#] [#|2010-12-15T01:24:05.150-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1024: Adding Join member: n1c1m1 group: clusterz1 StartupState: INSTANCE_STARTUP |#] [#|2010-12-15T01:24:05.151-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1024: Adding Join member: n1c1m2 group: clusterz1 StartupState: INSTANCE_STARTUP |#] [#|2010-12-15T01:24:05.151-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1024: Adding Join member: n1c1m3 group: clusterz1 StartupState: INSTANCE_STARTUP |#] [#|2010-12-15T01:24:05.152-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1024: Adding Join member: n1c1m4 group: clusterz1 StartupState: INSTANCE_STARTUP |#] [#|2010-12-15T01:24:05.152-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1024: Adding Join member: n1c1m5 group: clusterz1 StartupState: INSTANCE_STARTUP |#] [#|2010-12-15T01:24:05.152-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1024: Adding Join member: n1c1m6 group: clusterz1 StartupState: INSTANCE_STARTUP |#] [#|2010-12-15T01:24:05.153-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1024: Adding Join member: n1c1m7 group: clusterz1 StartupState: INSTANCE_STARTUP |#] [#|2010-12-15T01:24:05.153-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1024: Adding Join member: n1c1m8 group: clusterz1 StartupState: INSTANCE_STARTUP |#] [#|2010-12-15T01:24:05.153-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1024: Adding Join member: n1c1m9 group: clusterz1 StartupState: INSTANCE_STARTUP |#] [#|2010-12-15T01:24:05.154-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for ADD_EVENT(before change analysis) are : 1: MemberId: n1c1m1, MemberType: CORE, Address: 10.133.184.227:9157:228.9.32.97:5229:clusterz1:n1c1m1 2: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 3: MemberId: n1c1m3, MemberType: CORE, Address: 10.133.184.229:9159:228.9.32.97:5229:clusterz1:n1c1m3 4: MemberId: n1c1m4, MemberType: CORE, Address: 10.133.184.230:9199:228.9.32.97:5229:clusterz1:n1c1m4 5: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 6: MemberId: n1c1m6, MemberType: CORE, Address: 10.133.184.232:9170:228.9.32.97:5229:clusterz1:n1c1m6 7: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 8: MemberId: n1c1m8, MemberType: CORE, Address: 10.133.184.234:9159:228.9.32.97:5229:clusterz1:n1c1m8 9: MemberId: n1c1m9, MemberType: CORE, Address: 10.133.184.236:9164:228.9.32.97:5229:clusterz1:n1c1m9 10: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9116:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:24:05.154-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: ADD_EVENT for member: server of group: clusterz1|#] [#|2010-12-15T01:24:05.395-0800|INFO|glassfish3.1|null|_ThreadID=16;_ThreadName=Thread-1;|Grizzly Framework 1.9.26 started in: 83ms - bound to [0.0.0.0:8080]|#] [#|2010-12-15T01:24:05.402-0800|INFO|glassfish3.1|null|_ThreadID=16;_ThreadName=Thread-1;|Grizzly Framework 1.9.26 started in: 21ms - bound to [0.0.0.0:4848]|#] [#|2010-12-15T01:24:05.409-0800|INFO|glassfish3.1|null|_ThreadID=16;_ThreadName=Thread-1;|Grizzly Framework 1.9.26 started in: 39ms - bound to [0.0.0.0:8181]|#] [#|2010-12-15T01:24:05.419-0800|INFO|glassfish3.1|null|_ThreadID=16;_ThreadName=Thread-1;|Grizzly Framework 1.9.26 started in: 12ms - bound to [0.0.0.0:3700]|#] [#|2010-12-15T01:24:05.427-0800|INFO|glassfish3.1|null|_ThreadID=16;_ThreadName=Thread-1;|Grizzly Framework 1.9.26 started in: 6ms - bound to [0.0.0.0:7676]|#] [#|2010-12-15T01:24:05.527-0800|INFO|glassfish3.1|org.glassfish.ha.store.spi.BackingStoreFactoryRegistry|_ThreadID=16;_ThreadName=Thread-1;|Registered org.glassfish.ha.store.adapter.cache.ShoalBackingStoreProxy for persistence-type = replicated in BackingStoreFactoryRegistry|#] [#|2010-12-15T01:24:05.599-0800|INFO|glassfish3.1|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=16;_ThreadName=Thread-1;|GlassFish Server Open Source Edition 3.1-SNAPSHOT (jf39279-private) startup time : Felix (4,622ms), startup services(1,389ms), total(6,011ms)|#] [#|2010-12-15T01:24:05.601-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1099: GMS:Reporting Joined and Ready state to group: clusterz1|#] [#|2010-12-15T01:24:05.641-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for JOINED_AND_READY_EVENT(before change analysis) are : 1: MemberId: n1c1m1, MemberType: CORE, Address: 10.133.184.227:9157:228.9.32.97:5229:clusterz1:n1c1m1 2: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 3: MemberId: n1c1m3, MemberType: CORE, Address: 10.133.184.229:9159:228.9.32.97:5229:clusterz1:n1c1m3 4: MemberId: n1c1m4, MemberType: CORE, Address: 10.133.184.230:9199:228.9.32.97:5229:clusterz1:n1c1m4 5: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 6: MemberId: n1c1m6, MemberType: CORE, Address: 10.133.184.232:9170:228.9.32.97:5229:clusterz1:n1c1m6 7: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 8: MemberId: n1c1m8, MemberType: CORE, Address: 10.133.184.234:9159:228.9.32.97:5229:clusterz1:n1c1m8 9: MemberId: n1c1m9, MemberType: CORE, Address: 10.133.184.236:9164:228.9.32.97:5229:clusterz1:n1c1m9 10: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9116:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:24:05.641-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: JOINED_AND_READY_EVENT for member: server of group: clusterz1|#] [#|2010-12-15T01:24:05.807-0800|INFO|glassfish3.1|javax.enterprise.system.std.com.sun.enterprise.server.logging|_ThreadID=16;_ThreadName=Thread-1;|____________________________ Welcome to Apache Felix Gogo |#] [#|2010-12-15T01:24:06.255-0800|INFO|glassfish3.1|javax.enterprise.resource.jta.com.sun.enterprise.transaction|_ThreadID=16;_ThreadName=Thread-1;|DTX5019: Transaction Manager is ready. Using [com.sun.enterprise.transaction.jts.JavaEETransactionManagerJTSDelegate] as the delegate|#] [#|2010-12-15T01:24:07.093-0800|INFO|glassfish3.1|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=16;_ThreadName=Thread-1;|[Thread[GlassFish Kernel Main Thread,5,main]] started|#] [#|2010-12-15T01:24:07.091-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.org.glassfish.server|_ThreadID=16;_ThreadName=Thread-1;|Binding RMI port to *:8686|#] [#|2010-12-15T01:24:07.396-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.org.glassfish.server|_ThreadID=16;_ThreadName=Thread-1;|JMXStartupService: Started JMXConnector, JMXService URL = service:jmx:rmi://gf-ha-dev-1.us.oracle.com:8686/jndi/rmi://gf-ha-dev-1.us.oracle.com:8686/jmxrmi|#] [#|2010-12-15T01:24:47.646-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|get-health called for cluster "clusterz1"|#] [#|2010-12-15T01:24:48.378-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1097: GMS:Announcing GroupShutdown to group: clusterz1 with State = INITIATED|#] [#|2010-12-15T01:24:48.381-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1083: Assuming group leadership to shutdown group: clusterz1|#] [#|2010-12-15T01:24:48.381-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for MASTER_CHANGE_EVENT(before change analysis) are : 1: MemberId: n1c1m1, MemberType: CORE, Address: 10.133.184.227:9157:228.9.32.97:5229:clusterz1:n1c1m1 2: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 3: MemberId: n1c1m3, MemberType: CORE, Address: 10.133.184.229:9159:228.9.32.97:5229:clusterz1:n1c1m3 4: MemberId: n1c1m4, MemberType: CORE, Address: 10.133.184.230:9199:228.9.32.97:5229:clusterz1:n1c1m4 5: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 6: MemberId: n1c1m6, MemberType: CORE, Address: 10.133.184.232:9170:228.9.32.97:5229:clusterz1:n1c1m6 7: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 8: MemberId: n1c1m8, MemberType: CORE, Address: 10.133.184.234:9159:228.9.32.97:5229:clusterz1:n1c1m8 9: MemberId: n1c1m9, MemberType: CORE, Address: 10.133.184.236:9164:228.9.32.97:5229:clusterz1:n1c1m9 10: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9116:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:24:48.382-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: MASTER_CHANGE_EVENT for member: server of group: clusterz1|#] [#|2010-12-15T01:24:48.382-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1093: adding GroupLeadershipNotification signal leadermember: server of group: clusterz1|#] [#|2010-12-15T01:24:48.384-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1057: Announcing Master Node designation for member: server of group: clusterz1. Local view contains 10 entries|#] [#|2010-12-15T01:24:49.217-0800|INFO|glassfish3.1|ShoalLogger.mcast|_ThreadID=16;_ThreadName=Thread-1;|GMS1112: unable to find message to resend broadcast event with masterViewId: 21 to member: n1c1m1 of group: clusterz1|#] [#|2010-12-15T01:24:49.218-0800|INFO|glassfish3.1|ShoalLogger.mcast|_ThreadID=16;_ThreadName=Thread-1;|GMS1112: unable to find message to resend broadcast event with masterViewId: 22 to member: n1c1m1 of group: clusterz1|#] [#|2010-12-15T01:24:49.218-0800|INFO|glassfish3.1|ShoalLogger.mcast|_ThreadID=16;_ThreadName=Thread-1;|GMS1112: unable to find message to resend broadcast event with masterViewId: 23 to member: n1c1m1 of group: clusterz1|#] [#|2010-12-15T01:24:49.219-0800|INFO|glassfish3.1|ShoalLogger.mcast|_ThreadID=16;_ThreadName=Thread-1;|GMS1112: unable to find message to resend broadcast event with masterViewId: 24 to member: n1c1m1 of group: clusterz1|#] [#|2010-12-15T01:24:49.231-0800|INFO|glassfish3.1|ShoalLogger.mcast|_ThreadID=16;_ThreadName=Thread-1;|GMS1111: resend broadcast event with masterViewId: 25 to member: n1c1m1 of group: clusterz1 resends=1 broadcast seq id:25 viewChangeEvent:MASTER_CHANGE_EVENT member:server peerId:10.133.184.226:9116:228.9.32.97:5229:clusterz1:server|#] [#|2010-12-15T01:24:50.394-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|Stopping cluster clusterz1|#] [#|2010-12-15T01:24:50.426-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|Executing stop-instance on 9 instances using a thread pool of size 9: gf-ha-dev-4:n1c1m3 gf-ha-dev-5:n1c1m4 gf-ha-dev-2:n1c1m1 gf-ha-dev-3:n1c1m2 gf-ha-dev-11:n1c1m9 gf-ha-dev-8:n1c1m7 gf-ha-dev-9:n1c1m8 gf-ha-dev-6:n1c1m5 gf-ha-dev-7:n1c1m6|#] [#|2010-12-15T01:24:50.430-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|stop-instance n1c1m3|#] [#|2010-12-15T01:24:50.433-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|stop-instance n1c1m4|#] [#|2010-12-15T01:24:50.436-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|stop-instance n1c1m1|#] [#|2010-12-15T01:24:50.438-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|stop-instance n1c1m2|#] [#|2010-12-15T01:24:50.440-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|stop-instance n1c1m9|#] [#|2010-12-15T01:24:50.444-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|stop-instance n1c1m7|#] [#|2010-12-15T01:24:50.447-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|stop-instance n1c1m8|#] [#|2010-12-15T01:24:50.452-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|stop-instance n1c1m5|#] [#|2010-12-15T01:24:50.456-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|stop-instance n1c1m6|#] [#|2010-12-15T01:24:50.622-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|Instance n1c1m1 shutdown initiated|#] [#|2010-12-15T01:24:50.625-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|Instance n1c1m6 shutdown initiated|#] [#|2010-12-15T01:24:50.627-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|Instance n1c1m2 shutdown initiated|#] [#|2010-12-15T01:24:50.629-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|Instance n1c1m4 shutdown initiated|#] [#|2010-12-15T01:24:50.653-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|Instance n1c1m3 shutdown initiated|#] [#|2010-12-15T01:24:50.657-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|Instance n1c1m8 shutdown initiated|#] [#|2010-12-15T01:24:50.660-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|Instance n1c1m7 shutdown initiated|#] [#|2010-12-15T01:24:50.668-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|Instance n1c1m5 shutdown initiated|#] [#|2010-12-15T01:24:50.672-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|Instance n1c1m9 shutdown initiated|#] [#|2010-12-15T01:24:50.975-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for CLUSTER_STOP_EVENT(before change analysis) are : 1: MemberId: n1c1m1, MemberType: CORE, Address: 10.133.184.227:9157:228.9.32.97:5229:clusterz1:n1c1m1 2: MemberId: n1c1m2, MemberType: CORE, Address: 10.133.184.228:9120:228.9.32.97:5229:clusterz1:n1c1m2 3: MemberId: n1c1m3, MemberType: CORE, Address: 10.133.184.229:9159:228.9.32.97:5229:clusterz1:n1c1m3 4: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 5: MemberId: n1c1m6, MemberType: CORE, Address: 10.133.184.232:9170:228.9.32.97:5229:clusterz1:n1c1m6 6: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 7: MemberId: n1c1m8, MemberType: CORE, Address: 10.133.184.234:9159:228.9.32.97:5229:clusterz1:n1c1m8 8: MemberId: n1c1m9, MemberType: CORE, Address: 10.133.184.236:9164:228.9.32.97:5229:clusterz1:n1c1m9 9: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9116:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:24:50.976-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: CLUSTER_STOP_EVENT for member: n1c1m4 of group: clusterz1|#] [#|2010-12-15T01:24:50.976-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1017: Received PlannedShutdownEvent Announcement from member: n1c1m4 with shutdown type: GROUP_SHUTDOWN of group: clusterz1|#] [#|2010-12-15T01:24:50.990-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for CLUSTER_STOP_EVENT(before change analysis) are : 1: MemberId: n1c1m1, MemberType: CORE, Address: 10.133.184.227:9157:228.9.32.97:5229:clusterz1:n1c1m1 2: MemberId: n1c1m3, MemberType: CORE, Address: 10.133.184.229:9159:228.9.32.97:5229:clusterz1:n1c1m3 3: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 4: MemberId: n1c1m6, MemberType: CORE, Address: 10.133.184.232:9170:228.9.32.97:5229:clusterz1:n1c1m6 5: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 6: MemberId: n1c1m8, MemberType: CORE, Address: 10.133.184.234:9159:228.9.32.97:5229:clusterz1:n1c1m8 7: MemberId: n1c1m9, MemberType: CORE, Address: 10.133.184.236:9164:228.9.32.97:5229:clusterz1:n1c1m9 8: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9116:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:24:50.991-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: CLUSTER_STOP_EVENT for member: n1c1m2 of group: clusterz1|#] [#|2010-12-15T01:24:50.991-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1017: Received PlannedShutdownEvent Announcement from member: n1c1m2 with shutdown type: GROUP_SHUTDOWN of group: clusterz1|#] [#|2010-12-15T01:24:50.991-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1008: Sending PlannedShutdownSignals to registered Actions for shutdownType GROUP_SHUTDOWN member: n1c1m4 ...|#] [#|2010-12-15T01:24:50.995-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1008: Sending PlannedShutdownSignals to registered Actions for shutdownType GROUP_SHUTDOWN member: n1c1m2 ...|#] [#|2010-12-15T01:24:50.992-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for CLUSTER_STOP_EVENT(before change analysis) are : 1: MemberId: n1c1m3, MemberType: CORE, Address: 10.133.184.229:9159:228.9.32.97:5229:clusterz1:n1c1m3 2: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 3: MemberId: n1c1m6, MemberType: CORE, Address: 10.133.184.232:9170:228.9.32.97:5229:clusterz1:n1c1m6 4: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 5: MemberId: n1c1m8, MemberType: CORE, Address: 10.133.184.234:9159:228.9.32.97:5229:clusterz1:n1c1m8 6: MemberId: n1c1m9, MemberType: CORE, Address: 10.133.184.236:9164:228.9.32.97:5229:clusterz1:n1c1m9 7: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9116:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:24:50.995-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: CLUSTER_STOP_EVENT for member: n1c1m1 of group: clusterz1|#] [#|2010-12-15T01:24:50.996-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1017: Received PlannedShutdownEvent Announcement from member: n1c1m1 with shutdown type: GROUP_SHUTDOWN of group: clusterz1|#] [#|2010-12-15T01:24:50.997-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for CLUSTER_STOP_EVENT(before change analysis) are : 1: MemberId: n1c1m3, MemberType: CORE, Address: 10.133.184.229:9159:228.9.32.97:5229:clusterz1:n1c1m3 2: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 3: MemberId: n1c1m6, MemberType: CORE, Address: 10.133.184.232:9170:228.9.32.97:5229:clusterz1:n1c1m6 4: MemberId: n1c1m7, MemberType: CORE, Address: 10.133.184.233:9150:228.9.32.97:5229:clusterz1:n1c1m7 5: MemberId: n1c1m9, MemberType: CORE, Address: 10.133.184.236:9164:228.9.32.97:5229:clusterz1:n1c1m9 6: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9116:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:24:50.997-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: CLUSTER_STOP_EVENT for member: n1c1m8 of group: clusterz1|#] [#|2010-12-15T01:24:50.997-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1017: Received PlannedShutdownEvent Announcement from member: n1c1m8 with shutdown type: GROUP_SHUTDOWN of group: clusterz1|#] [#|2010-12-15T01:24:50.998-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1008: Sending PlannedShutdownSignals to registered Actions for shutdownType GROUP_SHUTDOWN member: n1c1m1 ...|#] [#|2010-12-15T01:24:50.998-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1008: Sending PlannedShutdownSignals to registered Actions for shutdownType GROUP_SHUTDOWN member: n1c1m8 ...|#] [#|2010-12-15T01:24:51.007-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for CLUSTER_STOP_EVENT(before change analysis) are : 1: MemberId: n1c1m3, MemberType: CORE, Address: 10.133.184.229:9159:228.9.32.97:5229:clusterz1:n1c1m3 2: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 3: MemberId: n1c1m6, MemberType: CORE, Address: 10.133.184.232:9170:228.9.32.97:5229:clusterz1:n1c1m6 4: MemberId: n1c1m9, MemberType: CORE, Address: 10.133.184.236:9164:228.9.32.97:5229:clusterz1:n1c1m9 5: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9116:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:24:51.008-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: CLUSTER_STOP_EVENT for member: n1c1m7 of group: clusterz1|#] [#|2010-12-15T01:24:51.008-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1017: Received PlannedShutdownEvent Announcement from member: n1c1m7 with shutdown type: GROUP_SHUTDOWN of group: clusterz1|#] [#|2010-12-15T01:24:51.008-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1008: Sending PlannedShutdownSignals to registered Actions for shutdownType GROUP_SHUTDOWN member: n1c1m7 ...|#] [#|2010-12-15T01:24:51.009-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for CLUSTER_STOP_EVENT(before change analysis) are : 1: MemberId: n1c1m3, MemberType: CORE, Address: 10.133.184.229:9159:228.9.32.97:5229:clusterz1:n1c1m3 2: MemberId: n1c1m5, MemberType: CORE, Address: 10.133.184.231:9163:228.9.32.97:5229:clusterz1:n1c1m5 3: MemberId: n1c1m9, MemberType: CORE, Address: 10.133.184.236:9164:228.9.32.97:5229:clusterz1:n1c1m9 4: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9116:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:24:51.010-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: CLUSTER_STOP_EVENT for member: n1c1m6 of group: clusterz1|#] [#|2010-12-15T01:24:51.010-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1017: Received PlannedShutdownEvent Announcement from member: n1c1m6 with shutdown type: GROUP_SHUTDOWN of group: clusterz1|#] [#|2010-12-15T01:24:51.010-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1008: Sending PlannedShutdownSignals to registered Actions for shutdownType GROUP_SHUTDOWN member: n1c1m6 ...|#] [#|2010-12-15T01:24:51.022-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for CLUSTER_STOP_EVENT(before change analysis) are : 1: MemberId: n1c1m3, MemberType: CORE, Address: 10.133.184.229:9159:228.9.32.97:5229:clusterz1:n1c1m3 2: MemberId: n1c1m9, MemberType: CORE, Address: 10.133.184.236:9164:228.9.32.97:5229:clusterz1:n1c1m9 3: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9116:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:24:51.023-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: CLUSTER_STOP_EVENT for member: n1c1m5 of group: clusterz1|#] [#|2010-12-15T01:24:51.023-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1017: Received PlannedShutdownEvent Announcement from member: n1c1m5 with shutdown type: GROUP_SHUTDOWN of group: clusterz1|#] [#|2010-12-15T01:24:51.024-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1008: Sending PlannedShutdownSignals to registered Actions for shutdownType GROUP_SHUTDOWN member: n1c1m5 ...|#] [#|2010-12-15T01:24:51.028-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for CLUSTER_STOP_EVENT(before change analysis) are : 1: MemberId: n1c1m9, MemberType: CORE, Address: 10.133.184.236:9164:228.9.32.97:5229:clusterz1:n1c1m9 2: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9116:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:24:51.029-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: CLUSTER_STOP_EVENT for member: n1c1m3 of group: clusterz1|#] [#|2010-12-15T01:24:51.029-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1017: Received PlannedShutdownEvent Announcement from member: n1c1m3 with shutdown type: GROUP_SHUTDOWN of group: clusterz1|#] [#|2010-12-15T01:24:51.030-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1008: Sending PlannedShutdownSignals to registered Actions for shutdownType GROUP_SHUTDOWN member: n1c1m3 ...|#] [#|2010-12-15T01:24:51.035-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1092: GMS View Change Received for group: clusterz1 : Members in view for CLUSTER_STOP_EVENT(before change analysis) are : 1: MemberId: server, MemberType: SPECTATOR, Address: 10.133.184.226:9116:228.9.32.97:5229:clusterz1:server |#] [#|2010-12-15T01:24:51.035-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1016: Analyzing new membership snapshot received as part of event: CLUSTER_STOP_EVENT for member: n1c1m9 of group: clusterz1|#] [#|2010-12-15T01:24:51.036-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1017: Received PlannedShutdownEvent Announcement from member: n1c1m9 with shutdown type: GROUP_SHUTDOWN of group: clusterz1|#] [#|2010-12-15T01:24:51.036-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1008: Sending PlannedShutdownSignals to registered Actions for shutdownType GROUP_SHUTDOWN member: n1c1m9 ...|#] [#|2010-12-15T01:24:54.109-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1097: GMS:Announcing GroupShutdown to group: clusterz1 with State = COMPLETED|#] [#|2010-12-15T01:25:15.397-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin.cluster|_ThreadID=16;_ThreadName=Thread-1;|get-health called for cluster "clusterz1"|#] [#|2010-12-15T01:25:16.745-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.com.sun.enterprise.v3.admin|_ThreadID=16;_ThreadName=Thread-1;|Server shutdown initiated|#] [#|2010-12-15T01:25:16.767-0800|INFO|glassfish3.1|javax.org.glassfish.gms.org.glassfish.gms|_ThreadID=16;_ThreadName=Thread-1;|GMSAD1008: GMSAdapter for member: server group: clusterz1 received GlassfishEventType: prepare_shutdown|#] [#|2010-12-15T01:25:16.768-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1096: member: server is leaving group: clusterz1|#] [#|2010-12-15T01:25:16.769-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1010: Leaving GMS group: clusterz1 with shutdown type set to InstanceShutdown|#] [#|2010-12-15T01:25:16.772-0800|CONFIG|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1065: Completed processing outstanding master node messages for member: server group: clusterz1 outstandingMessages to process: 0|#] [#|2010-12-15T01:25:16.806-0800|INFO|glassfish3.1|ShoalLogger.monitor|_ThreadID=16;_ThreadName=Thread-1;|BlockingIOMulicastSender monitoring stats: received: 279 core poolsize:10 largest pool size:10 task count:279 max queue size:0 rejected execution:0|#] [#|2010-12-15T01:25:16.806-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1110: Thread IP Multicast Listener for /228.9.32.97:5229 has completed.|#] [#|2010-12-15T01:25:16.975-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1088: MessageWindow thread for group: clusterz1 terminated due to shutdown notification|#] [#|2010-12-15T01:25:16.975-0800|INFO|glassfish3.1|ShoalLogger.monitor|_ThreadID=16;_ThreadName=Thread-1;|GMS1115: router signal queue high water mark: 0 signal queue capacity: 600|#] [#|2010-12-15T01:25:16.976-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1107: SignalHandler task named GMS SignalHandler for Group-clusterz1 thread exiting|#] [#|2010-12-15T01:25:16.976-0800|INFO|glassfish3.1|ShoalLogger|_ThreadID=16;_ThreadName=Thread-1;|GMS1091: View Window event processing thread for group: clusterz1 terminated normally|#] [#|2010-12-15T01:25:18.431-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.org.glassfish.server|_ThreadID=16;_ThreadName=Thread-1;|JMXStartupService: Stopped JMXConnectorServer: null|#] [#|2010-12-15T01:25:18.433-0800|INFO|glassfish3.1|javax.enterprise.system.tools.admin.org.glassfish.server|_ThreadID=16;_ThreadName=Thread-1;|JMXStartupService and JMXConnectors have been shut down.|#] [#|2010-12-15T01:25:18.433-0800|INFO|glassfish3.1|javax.enterprise.system.core.com.sun.enterprise.v3.server|_ThreadID=16;_ThreadName=Thread-1;|Shutdown procedure finished|#] [#|2010-12-15T01:25:18.437-0800|INFO|glassfish3.1|javax.enterprise.system.tools.monitor.org.glassfish.admin.monitor|_ThreadID=16;_ThreadName=Thread-1;| In the ctor : instance name server|#] [#|2010-12-15T01:25:18.438-0800|INFO|glassfish3.1|javax.enterprise.system.tools.monitor.org.glassfish.admin.monitor|_ThreadID=16;_ThreadName=Thread-1;| In the ctor : MONITORING SERVER amx:pp=/mon,type=server-mon,name=server|#]