Monitoring
Tests
Tested on May 8, 2012 by sherry.hill@oracle.com
On glassfish 4.0 build build35b
Verified the fix for
http://java.net/jira/browse/GLASSFISH-18450
1) monitoring client on jed-asqe-24.us.oracle.com
2) st-cluster for local test
st-domain on
jed-asqe-24.us.oracle.com
st-domain doesn't have password
[testng] /space/gf-ha/glassfish3/bin/asadmin --user
admin create-domain --adminport 4848 --nopassword st-domain
.....
[testng] Using default port 8686 for
JMX_ADMIN.
st-cluster of 10 instances on 3 machines, jed-asqe-24, 25, 26.
instance101 on jed-asqe-24
[testng] /space/gf-ha/glassfish3/bin/asadmin --user
admin create-instance --cluster st-cluster --node agent1
instance101
.....
[testng] JMX_SYSTEM_CONNECTOR_PORT=28686
[testng] JMS_PROVIDER_PORT=27676
[root@jed-asqe-24 dist]# asadmin list-instances -l
Name
Host
Port Pid Cluster
State
instance101 jed-asqe-24.us.oracle.com 24848
28496 st-cluster running
instance102 jed-asqe-25.us.oracle.com 24848
9984 st-cluster running
instance103 jed-asqe-26.us.oracle.com 24848
21316 st-cluster running
instance104 jed-asqe-24.us.oracle.com 24849
28488 st-cluster running
instance105 jed-asqe-25.us.oracle.com 24849
9989 st-cluster running
instance106 jed-asqe-26.us.oracle.com 24849
21329 st-cluster running
instance107 jed-asqe-25.us.oracle.com 24850
9994 st-cluster running
instance108 jed-asqe-26.us.oracle.com 24850
21334 st-cluster running
instance109 jed-asqe-25.us.oracle.com 24851
9976 st-cluster running
instance110 jed-asqe-26.us.oracle.com 24851
21339 st-cluster running
Command list-instances executed successfully.
[root@jed-asqe-24 dist]#
3) sqe-cluster for remote tests
sqe-domain on
bigapp-oblade-10.us.oracle.com
http://bigapp-oblade-10.us.oracle.com:1080/job/sherry-core/4/console
sqe-domain has password and enable-secure-admin
[exec] asadmin --user admin --passwordfile
/root/.hudson/jobs/sherry-core/workspace/appserver-sqe/build-config/adminpasswordfile.txt
create-domain [options] ...
...
( or from cli.log
05/07/2012 17:50:26 EXIT: 0 asadmin create-domain --adminport 4848
--user admin
--savemasterpassword=true --passwordfile
...../adminpasswordfile.txt sqe-domain )
....
[exec] Using default port 8686 for
JMX_ADMIN.
sqe-cluster of 3 instances on bigapp-oblade-10.us.oracle.com
clustered_instance_1 on
bigapp-oblade-10.us.oracle.com
.....
[exec] asadmin --host localhost --port 4848 --user admin
--passwordfile
/root/.hudson/jobs/sherry-core/workspace/appserver-sqe/build-config/adminpasswordfile.txt
--interactive=false --echo=true --terse=false create-local-instance
--cluster sqe-cluster --systemproperties
HTTP_LISTENER_PORT=38080:HTTP_SSL_LISTENER_PORT=38181:IIOP_SSL_LISTENER_PORT=33800:IIOP_LISTENER_PORT=33700:JMX_SYSTEM_CONNECTOR_PORT=37676:IIOP_SSL_MUTUALAUTH_PORT=33801:JMS_PROVIDER_PORT=38686:ASADMIN_LISTENER_PORT=34848
--checkports=true --savemasterpassword=false --usemasterpassword=false
clustered_instance_1
[exec] Rendezvoused with DAS on localhost:4848.
[exec] Port Assignments for server instance
clustered_instance_1:
[exec] JMX_SYSTEM_CONNECTOR_PORT=37676
list-instances-common:
[exec] asadmin --host localhost --port 4848
--user admin --passwordfile
/root/.hudson/jobs/sherry-core/workspace/appserver-sqe/build-config/adminpasswordfile.txt
--interactive=false --echo=true --terse=false list-instances
--long=true --timeoutmsec 60000 --standaloneonly=false --nostatus=false
[exec]
Name
Host Port
Pid Cluster
State
[exec] clustered_instance_1
localhost 34848 25049 sqe-cluster
running
[exec] clustered_instance_2
localhost 44848 25026 sqe-cluster
running
[exec] clustered_instance_3
localhost 54848 25040 sqe-cluster
running
[exec] Command list-instances executed
successfully.
4) Montoring graphs
On jed-asqe-24.us.oracle.com and in
/root/.hudson/jobs/sherry-stress/workspace/gf-ha-qe/dft/dependencies/dft/utils/plotter/dist
dir,
start plotter for monitoring graph.
4.1 Monitoring graph for local das
http://java.net/jira/secure/attachment/50000/local_das_b35b.jpg
[root@jed-asqe-24 dist]# java -jar plotter.jar
plotter_local_das.properties
{serverInstances.user=admin,
serverInstances.password=, serverInstances=das:localhost:8686}
[JMXHostPort : [das, host=localhost, port=8686]]
[]
May 08, 2012 1:41:48 PM com.sun.asqe.plotter.mbean.MBeanClient connect
INFO: Trying to connect to JMX server :
service:jmx:rmi:///jndi/rmi://localhost:8686/jmxrmi with JMX env :
{jmx.remote.credentials=[Ljava.lang.String;@7aa34f04}
May 08, 2012 1:41:48 PM
com.sun.asqe.plotter.mbean.ServerInstanceMBeanClient connect
INFO: Successfully initialized memory, os and runtime MBean for
localhost
4.2 Monitoring graph for local instance
http://java.net/jira/secure/attachment/50001/local_inst_b35b.jpg
[root@jed-asqe-24 dist]# java -jar plotter.jar
plotter_local_inst.properties
{serverInstances.user=admin,
serverInstances.password=, serverInstances=instance101:localhost:28686}
[JMXHostPort : [instance101, host=localhost, port=28686]]
[]
May 08, 2012 1:54:51 PM com.sun.asqe.plotter.mbean.MBeanClient connect
INFO: Trying to connect to JMX server :
service:jmx:rmi:///jndi/rmi://localhost:28686/jmxrmi with JMX env :
{jmx.remote.credentials=[Ljava.lang.String;@7aa34f04}
May 08, 2012 1:54:54 PM
com.sun.asqe.plotter.mbean.ServerInstanceMBeanClient connect
INFO: Successfully initialized memory, os and runtime MBean for
localhost
4.3 Monitoring graph for remote das
http://java.net/jira/secure/attachment/50002/remote_das_b35b.jpg
[root@jed-asqe-24 dist]# java -jar plotter.jar
plotter_remote_das.properties
{serverInstances.user=admin,
serverInstances.password=adminadmin,
serverInstances=das:bigapp-oblade-10.us.oracle.com:8686}
[JMXHostPort : [das, host=bigapp-oblade-10.us.oracle.com, port=8686]]
[]
May 08, 2012 2:02:03 PM com.sun.asqe.plotter.mbean.MBeanClient connect
INFO: Trying to connect to JMX server :
service:jmx:rmi:///jndi/rmi://bigapp-oblade-10.us.oracle.com:8686/jmxrmi
with JMX env : {jmx.remote.credentials=[Ljava.lang.String;@7aa34f04}
May 08, 2012 2:02:05 PM
com.sun.asqe.plotter.mbean.ServerInstanceMBeanClient connect
INFO: Successfully initialized memory, os and runtime MBean for
bigapp-oblade-10.us.oracle.com
4.4 Monitoring graph for remote instance
http://java.net/jira/secure/attachment/50003/remote_inst_b35b.jpg
[root@jed-asqe-24 dist]# java -jar plotter.jar
plotter_remote_inst.properties
{serverInstances.user=admin,
serverInstances.password=adminadmin,
serverInstances=clustered_instance_1:bigapp-oblade-10.us.oracle.com:37676}
[JMXHostPort : [clustered_instance_1,
host=bigapp-oblade-10.us.oracle.com, port=37676]]
[]
May 08, 2012 2:34:58 PM com.sun.asqe.plotter.mbean.MBeanClient connect
INFO: Trying to connect to JMX server :
service:jmx:rmi:///jndi/rmi://bigapp-oblade-10.us.oracle.com:37676/jmxrmi
with JMX env : {jmx.remote.credentials=[Ljava.lang.String;@7aa34f04}
May 08, 2012 2:35:00 PM
com.sun.asqe.plotter.mbean.ServerInstanceMBeanClient connect
INFO: Successfully initialized memory, os and runtime MBean for
bigapp-oblade-10.us.oracle.com